-- Logs begin at Tue 2022-10-04 10:15:34 UTC, end at Tue 2022-10-04 12:47:10 UTC. -- Oct 04 10:48:33.692303 n-d-791135-8 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 10:48:33.700771 n-d-791135-8 devstack@n-api.service[106367]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 10:48:33 2022] *** Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: nodename: n-d-791135-8 Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: machine: x86_64 Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: clock source: unix Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: pcre jit disabled Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: detected number of CPU cores: 4 Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: current working directory: / Oct 04 10:48:33.702822 n-d-791135-8 devstack@n-api.service[106367]: detected binary path: /usr/bin/uwsgi-core Oct 04 10:48:33.703403 n-d-791135-8 devstack@n-api.service[106367]: your processes number limit is 47680 Oct 04 10:48:33.703403 n-d-791135-8 devstack@n-api.service[106367]: your memory page size is 4096 bytes Oct 04 10:48:33.703403 n-d-791135-8 devstack@n-api.service[106367]: detected max file descriptor number: 2048 Oct 04 10:48:33.703403 n-d-791135-8 devstack@n-api.service[106367]: lock engine: pthread robust mutexes Oct 04 10:48:33.703403 n-d-791135-8 devstack@n-api.service[106367]: thunder lock: enabled Oct 04 10:48:33.703403 n-d-791135-8 devstack@n-api.service[106367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 10:48:33.703403 n-d-791135-8 devstack@n-api.service[106367]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 10:48:33.741771 n-d-791135-8 devstack@n-api.service[106367]: Python main interpreter initialized at 0x55ff111989c0 Oct 04 10:48:33.741771 n-d-791135-8 devstack@n-api.service[106367]: python threads support enabled Oct 04 10:48:33.741771 n-d-791135-8 devstack@n-api.service[106367]: your server socket listen backlog is limited to 100 connections Oct 04 10:48:33.741771 n-d-791135-8 devstack@n-api.service[106367]: your mercy for graceful operations on workers is 90 seconds Oct 04 10:48:33.742104 n-d-791135-8 devstack@n-api.service[106367]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 10:48:33.742180 n-d-791135-8 devstack@n-api.service[106367]: *** Operational MODE: preforking *** Oct 04 10:48:33.742423 n-d-791135-8 devstack@n-api.service[106367]: *** uWSGI is running in multiple interpreter mode *** Oct 04 10:48:33.742423 n-d-791135-8 devstack@n-api.service[106367]: spawned uWSGI master process (pid: 106367) Oct 04 10:48:33.742599 n-d-791135-8 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 10:48:33.743115 n-d-791135-8 devstack@n-api.service[106367]: spawned uWSGI worker 1 (pid: 106368, cores: 1) Oct 04 10:48:33.743446 n-d-791135-8 devstack@n-api.service[106367]: spawned uWSGI worker 2 (pid: 106369, cores: 1) Oct 04 10:48:33.743602 n-d-791135-8 devstack@n-api.service[106367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 10:48:34.398694 n-d-791135-8 devstack@n-api.service[106369]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 10:48:34.401935 n-d-791135-8 devstack@n-api.service[106368]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 10:48:35.479933 n-d-791135-8 devstack@n-api.service[106369]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:48:35.479933 n-d-791135-8 devstack@n-api.service[106369]: from cryptography.utils import int_from_bytes Oct 04 10:48:35.480566 n-d-791135-8 devstack@n-api.service[106369]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:48:35.480566 n-d-791135-8 devstack@n-api.service[106369]: from cryptography.utils import int_from_bytes Oct 04 10:48:35.484058 n-d-791135-8 devstack@n-api.service[106368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:48:35.484058 n-d-791135-8 devstack@n-api.service[106368]: from cryptography.utils import int_from_bytes Oct 04 10:48:35.484523 n-d-791135-8 devstack@n-api.service[106368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:48:35.484523 n-d-791135-8 devstack@n-api.service[106368]: from cryptography.utils import int_from_bytes Oct 04 10:48:37.968987 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:48:37.969672 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:48:37.969820 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:48:37.970122 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:48:37.970783 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:48:37.971155 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:48:37.971249 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:48:37.971345 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.971485 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:48:37.971585 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.971848 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:48:37.971945 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.972105 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:48:37.972216 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.972492 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.972598 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.972803 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.972942 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.973114 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.973217 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.973449 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.973558 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.973770 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.973884 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.974047 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.974153 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.974335 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.974438 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.974681 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-791135-8 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.974788 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.974975 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.975081 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.975231 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.975342 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.975544 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.975648 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.975865 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.975960 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-791135-8 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.976166 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.976261 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.976469 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.976569 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.976772 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.976860 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.977098 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.977249 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.977457 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.977752 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.979344 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.979464 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.979585 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.979585 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.979794 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.979938 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980055 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980140 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980276 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980380 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980460 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980597 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980683 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980770 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980856 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.980996 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.981082 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.981214 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.981300 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.981430 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-791135-8 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.981634 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.981741 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.981959 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.982056 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.982271 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.982361 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.982680 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-791135-8 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.982769 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.982996 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.983098 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.983297 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.983467 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.983610 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.983706 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.983941 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.984038 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.984246 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.984335 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.984570 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.984665 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.984885 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.984980 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.985205 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.985293 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.985546 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.985648 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.985879 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.985989 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.986186 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.986290 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.986492 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.986582 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.986807 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.986895 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.987105 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.987202 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.987404 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.987534 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.987651 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.987747 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.987953 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.988054 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.988269 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.988364 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.988586 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.988681 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.988838 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.988937 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.989139 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.989230 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.989407 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.989502 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.989726 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.989826 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.990044 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.990141 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.990334 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.990442 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.990585 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.990682 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.990904 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.990999 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.991222 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.991324 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.991526 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.991614 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.991829 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.991928 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.992131 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.992236 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.992434 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.992523 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.992739 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.992825 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.993050 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.993164 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.993371 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.993472 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.993680 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.993773 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.993996 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.994089 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.994325 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.994432 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.994620 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.994719 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.994924 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.995028 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.995240 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.995345 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.995561 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.995655 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.996121 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.996224 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.996426 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.996518 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.996739 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.996841 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.997042 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.997141 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.997345 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.997473 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.997675 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.997789 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.997994 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.998090 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.998297 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.998403 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.998603 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.998705 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.998847 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.998935 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.999141 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.999234 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.999443 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.999546 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.999758 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:37.999859 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.000062 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.000156 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.000360 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.000453 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.000661 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.000769 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.000978 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.001074 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.001251 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.001382 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.001605 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.001698 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.001910 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.002014 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.002208 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.002300 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.002510 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.002609 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.002812 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.002927 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.003129 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.003268 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.003412 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.003501 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.003711 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.003799 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.004011 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.004112 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.004311 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.004407 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.004617 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.004716 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.004918 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.005005 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.005217 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.005311 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.005544 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.005644 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.005848 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.005944 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.006154 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.006249 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.006454 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.006551 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.006754 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.006850 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.007058 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.007153 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.007357 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.007444 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.007658 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.007746 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.007960 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.008049 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.008261 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.008358 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.008565 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.008653 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.008871 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.008958 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.009166 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.009332 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.009495 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.009596 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.009799 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.009887 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.010099 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.010198 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.010402 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.010489 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.010701 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.010803 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.011003 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.011104 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.011319 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.011456 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.011603 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.011697 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.011900 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.011994 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.012200 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.012287 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.012492 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.012587 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.012793 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.012881 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.013095 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.013189 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.013417 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.013509 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.013718 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.013815 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.014018 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.014104 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.014333 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.014421 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.014639 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.014732 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.014945 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.015034 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.015248 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.015350 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.015566 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:48:38.015655 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.015901 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.015989 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.016234 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.016340 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.016549 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.016646 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.016859 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.016956 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.017705 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.017824 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.018033 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.018125 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.018344 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.018438 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.018652 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.018741 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.018958 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.019056 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.019274 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.019363 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.019585 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.019673 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.019897 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.020010 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.020206 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.020302 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.020518 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.020615 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.020835 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.020930 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.021144 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.021234 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.021482 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.021586 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.021800 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.021894 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.022116 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.022205 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.022426 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.022514 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.022745 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.022833 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.023074 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.023162 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.023383 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.023471 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.023692 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.023791 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.024004 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.024092 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.024311 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.024404 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.024617 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.024713 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.024922 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.025020 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.025259 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.025370 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.025595 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.025691 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.025901 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.026001 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.026207 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.026296 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.026514 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.026601 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.026831 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.026929 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.027142 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.027231 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.027449 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.027536 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.027756 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.027863 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.028064 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.028153 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.028372 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.028466 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.028683 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.028781 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.028993 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.029094 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.029308 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.029419 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.029641 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.029730 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.029946 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.030034 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.030261 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.030350 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.030568 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.030658 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.030875 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.030963 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.031180 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.031267 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.031482 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.031570 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.031785 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.031882 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.032085 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.032250 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.032389 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.032477 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.032706 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.033327 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.033576 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.033678 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.033884 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.033972 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.034190 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.034277 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.034492 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.034590 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.034807 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.034895 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.035116 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.035249 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.035421 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.035519 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.035731 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.035829 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.036033 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.036123 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.036340 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.036437 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.036645 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.036733 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.036946 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.037034 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.037247 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.037335 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.037582 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.037673 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.037886 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.037980 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.038188 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.038281 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.038494 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.038581 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.038797 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.038893 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.039098 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.039186 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.039406 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.039493 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.039715 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.039816 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.040019 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.040107 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.040324 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.040419 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.040631 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.040726 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.040940 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.041028 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.041244 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.041329 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.041574 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.041675 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.041896 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.041986 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.042204 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.042292 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.042510 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.042610 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.042836 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.042923 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.043151 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.043240 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.043452 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.043577 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.043759 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.043848 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.044062 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.044151 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.044364 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.044453 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.044665 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.044753 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.044973 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.045066 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.045270 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.045414 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.045598 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.045685 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.045898 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.045984 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.046200 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.046290 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.046499 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.046586 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.046803 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.046900 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.047107 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.047194 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.047408 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.047513 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.047705 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.047801 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.048007 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.048095 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.048328 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.048432 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.048639 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.048736 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.048943 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.049031 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.049246 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.049333 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.049617 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.049717 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.049923 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.050011 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.050236 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.050324 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.050550 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.050639 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.050858 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.050946 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.051165 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.051253 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.051472 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.051561 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.051779 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.051867 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.052088 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.052174 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.052393 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.052481 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.052701 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.052796 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.053005 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.053091 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.053324 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.053481 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.053653 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.053783 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.053969 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.054057 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.054271 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.054360 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.054583 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.054671 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.054891 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.054992 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.055211 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.055300 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.055519 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.055607 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.055834 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.055936 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.056140 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.056226 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.056454 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.056542 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.056762 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.056858 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.057070 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.057157 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.057397 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.057491 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.057709 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.057810 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.058023 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.058111 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.058329 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.058419 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.058638 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.058740 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.058940 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.059028 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.059255 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.059342 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.059559 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.059656 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.059874 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.059962 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.060174 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.060271 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.060483 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.060573 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.060789 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.060876 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.061109 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.061206 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.061435 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.061538 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.061744 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.061839 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.062064 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.062156 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.062373 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.062462 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.062679 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.062768 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.062989 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.063084 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.063289 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.063377 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.063592 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.063687 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.063899 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.064033 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.064234 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.064329 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.064537 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.064624 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.064842 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.064942 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.065146 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.065234 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.065485 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.065590 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.065792 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.065889 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.066094 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.066183 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.066394 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.066483 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.066701 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.066798 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.067007 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.067094 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.067312 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.067399 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.067617 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.067706 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.067927 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.068015 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.068225 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.068312 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.068527 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.068617 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.068845 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.068932 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.069150 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.069240 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.069473 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.069577 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.069778 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.069931 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.070077 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.070178 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.070394 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.070488 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.070699 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.070787 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.070996 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.071091 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.071296 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.071382 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.071614 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.071700 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.071920 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.072055 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.072221 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.072316 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.072525 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.072612 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.072832 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.072935 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.073141 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.073235 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.073477 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.073604 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.073785 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.073870 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.074093 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.074194 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.074397 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.074486 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.074703 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.074793 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.075009 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.075097 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.075316 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.075404 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.075624 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.075713 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.075931 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.076018 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.076234 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.076321 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.076536 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.076625 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.076840 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.076927 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.077147 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.077243 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.077484 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.077733 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.077821 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.078067 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.078164 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.078380 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.078469 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.078695 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.078940 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.079030 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.079281 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.079379 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.080121 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.080224 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.080446 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.080535 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.080785 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.080873 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.081088 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.081194 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.081418 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.081512 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.081724 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.081812 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.082025 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.082166 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.082332 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.082428 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.082635 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.082723 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.082937 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.083034 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.083240 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.083335 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.083544 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.083638 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.083846 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.083948 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.084145 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.084236 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.084447 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.084536 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.084750 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.084840 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.085051 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.085138 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.085365 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.085453 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.085678 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.085770 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.085981 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.086069 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.086298 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.086387 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.086600 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.086689 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.086901 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.086999 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.087202 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.087290 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.087502 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.087598 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.087814 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.087910 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.088119 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.088221 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.088425 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.088514 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.088729 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.088816 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.089072 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.089170 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.089394 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.089497 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.089701 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.089798 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.090023 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.090122 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.090325 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.090415 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.090626 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.090714 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.090926 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.091023 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.091231 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.091322 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.091534 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.091622 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.091833 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.091934 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.092133 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.092258 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.092434 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.092522 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.092739 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.092835 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.093039 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.093126 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.093336 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.093500 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.093664 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.093754 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.093962 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.094050 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.094270 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.094381 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.094576 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.094679 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.094878 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.094966 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.095191 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.095820 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.096060 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.096157 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.096371 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.096461 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.096677 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.096779 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.096980 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.097069 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.097279 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.097431 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.097613 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.097712 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.097912 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.098006 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.098215 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.098303 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.098515 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.098611 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.098818 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.098905 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.099118 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.099205 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.099416 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.099505 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.099714 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.099809 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.100027 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.100114 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.100328 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.100417 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.100626 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.100761 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.100930 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.101018 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.101228 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.101319 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.101553 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.101644 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.101860 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.101956 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.102171 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.102259 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.102476 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.102569 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.102775 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.102873 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.103081 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.103169 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.103381 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.103469 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.103684 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.103782 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.103984 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.104071 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.104304 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.104437 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.104590 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.104694 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.104889 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.104986 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.105187 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.105275 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.105520 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.105623 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.105823 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.105910 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.106128 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.106218 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.106432 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.106521 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.106734 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.106822 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.107033 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.107120 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.107334 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.107431 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.107647 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.107734 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.107954 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.108049 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.108262 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.108351 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.108565 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.108663 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.108889 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.108976 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.109198 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.109287 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.109526 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.109617 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.109835 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.109934 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.110144 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.110232 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.110445 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.110534 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.110755 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.110879 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.111088 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.111176 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.111398 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.111484 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.111696 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.111791 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.111996 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.112085 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.112305 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.112391 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.112610 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.112719 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.112910 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.112998 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.113214 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.113302 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.113557 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.113659 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.113868 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.113965 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.114166 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.114253 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.114454 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.114546 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.114762 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.114853 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.115065 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.115161 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.115372 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.115462 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.115676 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.115763 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.115978 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.116071 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.116283 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.116378 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.116584 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.116672 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.116890 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.116977 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.117192 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.117281 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.117517 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.117607 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.117823 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.117925 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.118127 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.118215 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.118428 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.118516 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.118729 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.118824 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.119036 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.119122 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.119335 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.119423 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.119634 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.119729 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.119933 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.120026 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.120238 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.120326 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.120538 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.120634 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.121101 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.121196 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.121428 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.121524 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.121741 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.121832 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.122045 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.122133 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.122397 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.122484 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.122705 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.122800 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.123015 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.123103 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.123324 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.123416 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.123624 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.123715 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.123938 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.124026 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.124253 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.124342 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.124567 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.124664 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.124870 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.124958 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.125198 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.125298 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.125522 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.125611 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.125828 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.125916 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.126152 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.126252 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.126470 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.126561 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.126773 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.126871 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.127074 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.127176 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.127391 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.127482 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.127690 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.127779 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.127991 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.128091 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.128298 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.128386 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.128619 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.128708 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.128923 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.129020 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.129242 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.129402 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.129690 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.129779 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.129997 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.130085 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.130301 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.130387 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.130622 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.130730 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.130943 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.131033 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.131244 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.131334 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.131553 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.131641 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.131857 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.131954 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.132174 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.132263 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.132490 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.132578 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.132796 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.132888 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.133104 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.133194 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.133425 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.133520 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.133746 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.133849 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.134057 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.134145 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.134363 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.134460 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.134664 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.134772 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.134985 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.135075 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.135304 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.135392 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.135617 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.135714 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.135938 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.136035 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.136275 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.136370 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.136576 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.136675 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.136876 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.136969 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.137182 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.137271 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.137517 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.137608 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.137818 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.137918 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.138135 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.138230 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.138438 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.138535 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.138744 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.138832 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.139044 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.139133 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.139348 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.139437 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.139649 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.139737 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.139949 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.140038 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.140260 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.140349 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.140556 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.140643 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.140859 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.140969 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.141164 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.141259 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.141502 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.141595 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.141804 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.141902 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.142623 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.142721 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.142943 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.143031 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.143248 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.143346 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.143549 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.143638 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.143847 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.143935 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.144146 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.144243 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.144458 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.144545 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.144762 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.144851 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.145067 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.145164 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.145390 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.145493 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.145722 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.145818 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.146028 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.146115 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.146348 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.146437 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.146673 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.146760 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.146987 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.147077 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.147291 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.147386 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.147602 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.147698 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.147919 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.148009 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.148218 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.148306 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.148515 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.148613 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.148819 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.148907 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.149119 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.149277 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.149441 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.149546 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.149743 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.149839 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.150049 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.150136 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.150347 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.150446 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.150648 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.150738 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.150948 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.151036 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.151257 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.151361 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.151554 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.151641 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.151857 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.151945 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.152160 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.152248 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.152459 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.152556 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.152758 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.152850 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.153057 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.153147 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.153382 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.153472 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.153693 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.153781 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.154000 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.154092 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.154302 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.154391 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.154618 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.154714 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.154933 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.155035 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.155243 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.155331 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.155550 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.155655 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.155858 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.155946 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.156169 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.156257 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.156482 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.156579 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.156791 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.156878 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.157098 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.157199 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.157430 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.157539 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.157784 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.158380 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.158596 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.158684 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.158903 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.159113 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.159203 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.159444 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.159534 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.159758 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.159860 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.160071 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.160335 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.160433 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.160672 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.160760 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.160984 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.161096 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.161293 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.161436 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.161633 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.161885 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.162068 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.162199 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.162287 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.162516 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.162606 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.162840 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.162956 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.163151 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.163262 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.163463 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.163555 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.163790 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.163880 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.164105 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.164194 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.164417 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.164506 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.164730 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.164820 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.165039 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.165132 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.165369 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.165474 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.165705 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.165836 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.166119 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.166223 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.166307 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.166397 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.166620 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.166717 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.166932 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.167022 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.167240 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.167338 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.167546 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.167635 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.167857 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.167944 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.168164 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.168262 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.168471 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.168559 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.168776 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.168872 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.169087 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.169178 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.169414 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.169520 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.169726 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.169824 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.170043 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.170132 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.170359 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.170455 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.170675 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.170773 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.170990 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.171079 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.171304 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.171392 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.171616 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.171824 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.171935 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.172139 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.172253 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.172469 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.172769 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.172860 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.173087 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.173205 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.173455 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.173552 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.173775 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.173869 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.174096 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.174201 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.174399 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.174487 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.174703 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.174794 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.175013 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.175101 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.175317 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.175404 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.175617 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.175705 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.175924 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.176019 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.176231 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.176327 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.176532 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.176620 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.176849 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.176943 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.177156 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.177253 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.177482 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.177714 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.177817 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.178058 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.178147 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.178371 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.178616 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.178706 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.178961 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.179049 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.179278 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.179368 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.179592 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.179678 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.179913 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.179999 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.180216 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.180361 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.180520 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.180610 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.180835 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.180925 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.181141 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.181230 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.181471 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.181574 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.181776 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.181864 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.182084 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.182174 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.182387 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.182483 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.182686 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.182782 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.182992 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.183080 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.183295 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.183396 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.183593 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.183691 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.183900 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.183990 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.184199 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.184296 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.184501 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.184599 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.184808 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.184896 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.185110 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.185196 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.185434 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.185543 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.185738 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.185831 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.186039 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.186127 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.186344 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.186435 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.186648 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.186743 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.186951 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.187039 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.187251 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.187348 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.187554 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.187642 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.187864 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.187953 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.188169 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.188272 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.188477 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.188565 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.188797 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.188885 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.189647 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.189742 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.189954 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.190043 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.190269 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.190358 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.190574 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.190663 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.190886 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.190976 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.191191 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.191287 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.191500 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.191589 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.191819 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.191915 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.192134 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.192236 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.192449 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.192659 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.192798 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.192993 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.193117 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.193314 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.193669 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.193768 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.193997 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.194103 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.194303 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.194394 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.194609 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.194711 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.194911 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.195006 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.195234 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.195328 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.195538 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.195629 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.195844 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.195934 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.196152 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.196254 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.196458 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.196548 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.196764 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.196852 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.197070 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.197168 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.197389 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.197493 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.197703 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.197816 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.198011 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.198113 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.198312 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.198405 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.198617 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.198791 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.198926 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.199019 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.199225 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.199313 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.199530 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.199629 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.199837 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.199925 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.200147 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.200237 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.200456 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.200547 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.200766 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.200854 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.201078 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.201174 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.201410 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.201505 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.201720 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.201808 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.202025 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.202113 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.202330 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.202421 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.202635 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.202731 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.202946 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.203044 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.203270 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.203362 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.203580 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.203673 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.203881 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.203979 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.204212 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.204530 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.205195 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.205412 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.205555 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.205794 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.206074 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.206163 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.206395 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.206484 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.206720 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.206811 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.207040 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.207135 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.207351 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.207439 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.207667 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.207763 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.207975 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.208076 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.208285 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.208381 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.208608 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.208699 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.208920 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.209011 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.209238 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.209335 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.209570 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.209663 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.209873 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.209962 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.210175 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.210273 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.210483 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.210573 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.210800 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.210896 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.211102 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.211203 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.211402 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.211490 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.211706 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.211794 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.212013 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.212110 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.212312 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.212407 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.212613 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.212701 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.212911 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.212999 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.213211 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.213300 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.213540 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.213640 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.213842 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.213931 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.214144 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.214279 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.214441 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.214529 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.214740 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.214829 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.215038 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.215126 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.215336 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.215425 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.215636 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.215727 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.215934 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.216031 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.216233 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.216330 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.216529 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.216617 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.216829 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.216925 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.217131 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.217227 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.217452 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.217545 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.217758 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.217847 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.218060 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.218169 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.218389 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.218479 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.218695 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.218782 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.219055 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.219162 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.219318 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.219408 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.219625 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.219719 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.219937 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.220025 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.220265 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.220373 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.220583 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.220685 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.220907 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.221005 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.221211 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.221300 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.221542 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.221631 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.221853 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.221951 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.222160 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.222249 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.222466 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.222554 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.222771 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.222867 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.223079 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.223167 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.223387 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.223485 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.223689 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.223777 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.224011 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.224107 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.224321 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.224418 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.224627 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.224715 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.224937 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.225031 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.225244 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.225343 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.225586 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.225675 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.225890 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.225981 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.226197 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.226287 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.226500 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.226596 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.226808 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.226898 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.227116 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.227205 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.227426 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.227516 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.227729 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.227824 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.228036 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.228133 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.228345 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.228434 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.228651 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.228748 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.228959 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.229049 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.229275 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.229383 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.229605 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.229703 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.229926 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.230016 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.230248 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.230336 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.230557 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.230657 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.230879 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.230967 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.231202 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.231289 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.231530 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.231626 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.231840 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.231929 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.232148 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.232237 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.232450 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.232540 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.232689 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:48:38.232778 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.233088 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.233426 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:48:38.233674 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:48:38.386119 n-d-791135-8 devstack@n-api.service[106368]: INFO dbcounter [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Registered counter for database nova_api Oct 04 10:48:38.389285 n-d-791135-8 devstack@n-api.service[106369]: INFO dbcounter [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Registered counter for database nova_api Oct 04 10:48:38.406476 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_db.sqlalchemy.engines [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:48:38.409438 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_db.sqlalchemy.engines [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:48:38.413345 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writer thread running {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:48:38.415930 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writer thread running {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:48:38.471493 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.context [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) {{(pid=106368) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 10:48:38.472515 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.context [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) {{(pid=106369) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 10:48:38.475349 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:38.475828 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:38.476331 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_concurrency.lockutils [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:38.476795 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_concurrency.lockutils [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:38.477428 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:38.478166 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:38.478390 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_concurrency.lockutils [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:38.478616 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:38.479107 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_concurrency.lockutils [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:48:38.479546 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_concurrency.lockutils [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:48:38.480619 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:38.481522 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_concurrency.lockutils [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:48:38.482629 n-d-791135-8 devstack@n-api.service[106368]: INFO dbcounter [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Registered counter for database nova_cell0 Oct 04 10:48:38.483488 n-d-791135-8 devstack@n-api.service[106369]: INFO dbcounter [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Registered counter for database nova_cell0 Oct 04 10:48:38.486851 n-d-791135-8 devstack@n-api.service[106368]: INFO dbcounter [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Registered counter for database nova_cell1 Oct 04 10:48:38.487431 n-d-791135-8 devstack@n-api.service[106369]: INFO dbcounter [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Registered counter for database nova_cell1 Oct 04 10:48:38.494131 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_db.sqlalchemy.engines [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:48:38.495479 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_db.sqlalchemy.engines [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:48:38.497578 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_db.sqlalchemy.engines [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:48:38.501138 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_db.sqlalchemy.engines [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:48:38.501252 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writer thread running {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:48:38.504154 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writer thread running {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:48:38.642408 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writer thread running {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:48:38.642610 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writer thread running {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:48:38.651150 n-d-791135-8 devstack@n-api.service[106369]: INFO dbcounter [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Registered counter for database nova_cell0 Oct 04 10:48:38.651526 n-d-791135-8 devstack@n-api.service[106368]: INFO dbcounter [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Registered counter for database nova_cell0 Oct 04 10:48:38.660061 n-d-791135-8 devstack@n-api.service[106369]: DEBUG oslo_db.sqlalchemy.engines [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:48:38.663651 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_db.sqlalchemy.engines [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:48:38.664784 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writer thread running {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:48:38.668502 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writer thread running {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:48:39.003382 n-d-791135-8 devstack@n-api.service[106369]: WARNING keystonemiddleware.auth_token [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:48:39.005583 n-d-791135-8 devstack@n-api.service[106368]: WARNING keystonemiddleware.auth_token [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:48:39.010678 n-d-791135-8 devstack@n-api.service[106369]: WARNING keystonemiddleware.auth_token [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:48:39.012828 n-d-791135-8 devstack@n-api.service[106368]: WARNING keystonemiddleware.auth_token [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:48:39.351911 n-d-791135-8 devstack@n-api.service[106369]: WARNING keystonemiddleware.auth_token [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:48:39.354248 n-d-791135-8 devstack@n-api.service[106368]: WARNING keystonemiddleware.auth_token [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:48:39.357800 n-d-791135-8 devstack@n-api.service[106369]: WARNING keystonemiddleware.auth_token [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:48:39.360183 n-d-791135-8 devstack@n-api.service[106368]: WARNING keystonemiddleware.auth_token [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:48:39.363890 n-d-791135-8 devstack@n-api.service[106369]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff111989c0 pid: 106369 (default app) Oct 04 10:48:39.365488 n-d-791135-8 devstack@n-api.service[106368]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff111989c0 pid: 106368 (default app) Oct 04 10:48:39.365968 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:48:39.367127 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-6408d0e3-9114-4afa-92d0-c226cda979b8 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Oct 04 10:48:39.367537 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Tue Oct 4 10:48:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:49:58.876224 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:58.878856 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003574 Oct 04 10:49:58.880597 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:49:58 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:49:58.892625 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writing DB stats nova_api:SELECT=3 {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:49:58.893450 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writing DB stats nova_cell0:SELECT=3 {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:49:58.894280 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writing DB stats nova_cell1:SELECT=3 {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:49:58.896506 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:49:59.759586 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-75d82c07-05c2-42b0-90d5-295f4d103659 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:49:59.791937 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-75d82c07-05c2-42b0-90d5-295f4d103659 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905026 Oct 04 10:49:59.792727 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 10:49:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:02.389845 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:02.391447 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-39bc742e-2159-46a9-a217-aff8a4d0af59 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 04 10:50:02.393659 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:02 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:02.883490 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-b3a0956b-dfdd-4ee7-b85e-8004a310ccb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "vcpus": 1, "disk": 1}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:02.930989 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-b3a0956b-dfdd-4ee7-b85e-8004a310ccb1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533099 Oct 04 10:50:02.932053 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:50:02.946547 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writing DB stats nova_api:SELECT=3 {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:02.948567 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writing DB stats nova_cell1:SELECT=3 {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:02.949369 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writing DB stats nova_cell0:SELECT=3 {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:02.950751 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:03.159164 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-14dfc359-c4ba-4518-8108-65e33ac1f23d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:03.230295 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-14dfc359-c4ba-4518-8108-65e33ac1f23d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289196 Oct 04 10:50:03.230885 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Oct 4 10:50:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:50:05.951119 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-b3a0956b-dfdd-4ee7-b85e-8004a310ccb1 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:05.952061 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-b3a0956b-dfdd-4ee7-b85e-8004a310ccb1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 04 10:50:05.952651 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:06.824077 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-73c6df65-dcf0-449c-90bc-654bddf7e036 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:06.870161 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-73c6df65-dcf0-449c-90bc-654bddf7e036 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.902178 Oct 04 10:50:06.871937 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:50:06.886436 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-f637a01f-da64-49e8-83e5-9bfb56794b2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:06.945934 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-f637a01f-da64-49e8-83e5-9bfb56794b2e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061356 Oct 04 10:50:06.945934 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Oct 4 10:50:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:50:09.882074 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-73c6df65-dcf0-449c-90bc-654bddf7e036 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:09.883307 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-73c6df65-dcf0-449c-90bc-654bddf7e036 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001955 Oct 04 10:50:09.883805 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:10.320452 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-523f7c03-561a-47c9-929d-22525c81eb0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:10.341555 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-523f7c03-561a-47c9-929d-22525c81eb0e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450928 Oct 04 10:50:10.349250 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:50:10.354674 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-d16cc003-fbe0-4532-bcbf-ff93e178e0e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:10.384520 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-d16cc003-fbe0-4532-bcbf-ff93e178e0e1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033730 Oct 04 10:50:10.385190 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Oct 4 10:50:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:12.997767 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-523f7c03-561a-47c9-929d-22525c81eb0e admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:12.998867 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-523f7c03-561a-47c9-929d-22525c81eb0e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Oct 04 10:50:12.999279 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:13.476268 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-dc3cc6b7-3050-4a03-ae77-4e6eca40c5ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:13.498545 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-dc3cc6b7-3050-4a03-ae77-4e6eca40c5ae admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492010 Oct 04 10:50:13.499296 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:50:13.513748 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-5d6ab370-822b-4bd8-be3e-48cc677ab5bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:13.565649 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-5d6ab370-822b-4bd8-be3e-48cc677ab5bb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055885 Oct 04 10:50:13.567344 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Oct 4 10:50:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:16.207722 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-dc3cc6b7-3050-4a03-ae77-4e6eca40c5ae admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:16.209513 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-dc3cc6b7-3050-4a03-ae77-4e6eca40c5ae admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Oct 04 10:50:16.210162 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:16.661278 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-2a293caa-2a88-4151-b737-35802dcef4c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "vcpus": 4}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:16.685069 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-2a293caa-2a88-4151-b737-35802dcef4c6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468447 Oct 04 10:50:16.686081 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:50:16.697848 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-809f62d8-9fda-4cb1-aa0a-51f04a94aa51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:16.726757 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-809f62d8-9fda-4cb1-aa0a-51f04a94aa51 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032416 Oct 04 10:50:16.742398 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Oct 4 10:50:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:19.387098 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-2a293caa-2a88-4151-b737-35802dcef4c6 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:19.388144 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-2a293caa-2a88-4151-b737-35802dcef4c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 04 10:50:19.388570 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:19.824308 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-42b20de6-7b6a-4960-b5dd-e43249290dc1 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:19.849800 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-42b20de6-7b6a-4960-b5dd-e43249290dc1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454998 Oct 04 10:50:19.850419 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 10:50:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:50:22.450299 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-2a293caa-2a88-4151-b737-35802dcef4c6 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:22.451311 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-2a293caa-2a88-4151-b737-35802dcef4c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 04 10:50:22.451715 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:22.890901 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-3eb1f273-50cb-460f-85b8-352fa4c0e9e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:22.912462 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-3eb1f273-50cb-460f-85b8-352fa4c0e9e7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.454791 Oct 04 10:50:22.913014 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:50:22.925432 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-c141157b-0edf-49bf-8ded-f9354ee7499a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:22.951330 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-c141157b-0edf-49bf-8ded-f9354ee7499a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029723 Oct 04 10:50:22.952223 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Oct 4 10:50:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:25.566040 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-3eb1f273-50cb-460f-85b8-352fa4c0e9e7 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:25.567599 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-3eb1f273-50cb-460f-85b8-352fa4c0e9e7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Oct 04 10:50:25.568000 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:25.954468 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-2ebf9276-297b-4f93-a95c-be87167428d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "id": "2"}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:25.973808 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-2ebf9276-297b-4f93-a95c-be87167428d2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.399592 Oct 04 10:50:25.974376 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:50:25.986214 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-625d35f4-e05b-4ae2-abe0-02dcde7f52a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:26.010150 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-625d35f4-e05b-4ae2-abe0-02dcde7f52a3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026956 Oct 04 10:50:26.010740 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Oct 4 10:50:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:28.598767 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-2ebf9276-297b-4f93-a95c-be87167428d2 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:28.599852 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-2ebf9276-297b-4f93-a95c-be87167428d2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Oct 04 10:50:28.600292 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:28.988198 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-bc814199-85ba-4040-ab73-6dfad02d7163 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium"}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:29.010745 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-bc814199-85ba-4040-ab73-6dfad02d7163 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.403488 Oct 04 10:50:29.011222 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:50:29.024186 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-f74f8d5a-1975-48b1-b096-9b4c3682d16b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:29.029533 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:29.055343 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-f74f8d5a-1975-48b1-b096-9b4c3682d16b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035043 Oct 04 10:50:29.055951 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Oct 4 10:50:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:31.719133 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-bc814199-85ba-4040-ab73-6dfad02d7163 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:31.720145 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-bc814199-85ba-4040-ab73-6dfad02d7163 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 04 10:50:31.720557 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:32.160810 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-3a7f8798-ef6d-4fb8-8d69-2a5a86088975 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "vcpus": 4, "disk": 80, "rxtx_factor": 1.0}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:32.180291 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-3a7f8798-ef6d-4fb8-8d69-2a5a86088975 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453812 Oct 04 10:50:32.181426 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:50:32.193595 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-082a7764-d471-45fa-b7bb-42ac7e74a3fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:32.218472 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-082a7764-d471-45fa-b7bb-42ac7e74a3fa admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028511 Oct 04 10:50:32.219832 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Oct 4 10:50:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:50:34.810546 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-3a7f8798-ef6d-4fb8-8d69-2a5a86088975 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:34.811613 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-3a7f8798-ef6d-4fb8-8d69-2a5a86088975 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 04 10:50:34.812181 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:35.315951 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-d2895aa7-b78e-4d00-ba43-19935e81d29d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "id": "5"}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:35.323658 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:35.340238 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-d2895aa7-b78e-4d00-ba43-19935e81d29d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.521354 Oct 04 10:50:35.340807 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Oct 4 10:50:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:50:35.353439 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-867d8f6d-f439-4f21-a0da-264e2bcf05af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:50:35.379176 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-867d8f6d-f439-4f21-a0da-264e2bcf05af admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029308 Oct 04 10:50:35.380219 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Oct 4 10:50:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:50:56.803751 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-d2895aa7-b78e-4d00-ba43-19935e81d29d admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:56.804798 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-d2895aa7-b78e-4d00-ba43-19935e81d29d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 04 10:50:56.805206 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:50:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:56.816118 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:50:57.184080 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-873fedc6-bb55-447c-9779-2204ee2c6377 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:57.201843 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-873fedc6-bb55-447c-9779-2204ee2c6377 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.390753 Oct 04 10:50:57.202375 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 10:50:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:50:58.502728 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-d2895aa7-b78e-4d00-ba43-19935e81d29d admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:58.503732 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-d2895aa7-b78e-4d00-ba43-19935e81d29d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 04 10:50:58.504159 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:50:59.038787 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-b0ca52cf-24ff-4b14-ac57-eff81d9b7c6c admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:59.044034 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.wsgi [None req-b0ca52cf-24ff-4b14-ac57-eff81d9b7c6c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-b0ca52cf-24ff-4b14-ac57-eff81d9b7c6c admin admin] Request method failure captured: Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: Accept: application/json Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: Accept-Encoding: gzip, deflate Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: Connection: keep-alive Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: Content-Length: 0 Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: Host: 10.222.0.23 Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: Openstack-Api-Version: compute 2.92 Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: Openstack-System-Scope: None Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: User-Agent: python-novaclient Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Auth-Token: gAAAAABjPBASLmeJwDXocqj1u3s6a9RcNSZYuKDz9qQIZ_wua1w_ZQuVtLbQf1ktsGT0PFCI1V_EKpz8cWqYxKhBG6oxqY5ZUKlggIioOszCvn2pBIpSlxhjSOJoVzW-xjEndBPlVHFJRqyswdI9o85tW11pGBUpaAZd_6LT-hsDS7ZKAvib8fk Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Domain-Id: None Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Domain-Name: None Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Identity-Status: Confirmed Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Is-Admin-Project: True Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Domain-Id: default Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Domain-Name: Default Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Name: admin Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Role: reader,member,admin Oct 04 10:50:59.047269 n-d-791135-8 devstack@n-api.service[106369]: X-Roles: reader,member,admin Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29fd01daf86e42bea87048c02cd4d84c"}]}] Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant: admin Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant-Name: admin Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-User: admin Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-User-Domain-Id: default Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-User-Domain-Name: Default Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-User-Id: fd521efce18742dd9ea13e0a66fcf253 Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: X-User-Name: admin Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: method: > Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: exception: Flavor 42 could not be found. Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: action_args: {'id': '42'} Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:50:59.048872 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:50:59.049916 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.051215 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-b0ca52cf-24ff-4b14-ac57-eff81d9b7c6c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:50:59.052307 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-b0ca52cf-24ff-4b14-ac57-eff81d9b7c6c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388642 Oct 04 10:50:59.052307 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Oct 4 10:50:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:50:59.058320 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-7462684d-c98a-4771-a75e-a2084ad2ff35 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:59.083588 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-7462684d-c98a-4771-a75e-a2084ad2ff35 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028737 Oct 04 10:50:59.084150 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Oct 4 10:50:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:50:59.102212 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-c1190912-5c04-4980-95e5-4b53cc281574 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:59.123957 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-c1190912-5c04-4980-95e5-4b53cc281574 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026373 Oct 04 10:50:59.124490 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Oct 4 10:50:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:50:59.133874 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-26008c5d-1fc9-4584-a688-2c6dd84cc950 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:50:59.139518 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.wsgi [None req-26008c5d-1fc9-4584-a688-2c6dd84cc950 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-26008c5d-1fc9-4584-a688-2c6dd84cc950 admin admin] Request method failure captured: Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: Accept: application/json Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: Accept-Encoding: gzip, deflate Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: Connection: keep-alive Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: Content-Length: 0 Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: Host: 10.222.0.23 Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: Openstack-Api-Version: compute 2.92 Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: Openstack-System-Scope: None Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: User-Agent: python-novaclient Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Auth-Token: gAAAAABjPBASLmeJwDXocqj1u3s6a9RcNSZYuKDz9qQIZ_wua1w_ZQuVtLbQf1ktsGT0PFCI1V_EKpz8cWqYxKhBG6oxqY5ZUKlggIioOszCvn2pBIpSlxhjSOJoVzW-xjEndBPlVHFJRqyswdI9o85tW11pGBUpaAZd_6LT-hsDS7ZKAvib8fk Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Domain-Id: None Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Domain-Name: None Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Identity-Status: Confirmed Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Is-Admin-Project: True Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Domain-Id: default Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Domain-Name: Default Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Name: admin Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Role: reader,member,admin Oct 04 10:50:59.142750 n-d-791135-8 devstack@n-api.service[106368]: X-Roles: reader,member,admin Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29fd01daf86e42bea87048c02cd4d84c"}]}] Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant: admin Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant-Name: admin Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-User: admin Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-User-Domain-Id: default Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-User-Domain-Name: Default Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-User-Id: fd521efce18742dd9ea13e0a66fcf253 Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: X-User-Name: admin Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: method: > Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: exception: Flavor 42 could not be found. Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: action_args: {'id': '42'} Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:50:59.144168 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:50:59.144997 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:50:59.146188 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-26008c5d-1fc9-4584-a688-2c6dd84cc950 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:50:59.147399 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-26008c5d-1fc9-4584-a688-2c6dd84cc950 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013967 Oct 04 10:50:59.147399 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Oct 4 10:50:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:51:00.355863 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-c1190912-5c04-4980-95e5-4b53cc281574 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:00.356870 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-c1190912-5c04-4980-95e5-4b53cc281574 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 04 10:51:00.357267 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:51:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:00.869674 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-af28b4ba-bc57-47ff-9072-7677d9f4fdcc admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:00.875433 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.wsgi [None req-af28b4ba-bc57-47ff-9072-7677d9f4fdcc admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-af28b4ba-bc57-47ff-9072-7677d9f4fdcc admin admin] Request method failure captured: Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: Accept: application/json Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: Accept-Encoding: gzip, deflate Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: Connection: keep-alive Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: Content-Length: 0 Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: Host: 10.222.0.23 Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: Openstack-Api-Version: compute 2.92 Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: Openstack-System-Scope: None Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: User-Agent: python-novaclient Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Auth-Token: gAAAAABjPBAUoqMnS-FzxZK_v_m9QrzL0FPK16Q6Uknq1UoLrMJTNJC9o1vGgkAhvhhk0wDjzBbEJ5QhAXTxDTejgXBVn5de_rl5sqf81iNXrK028jfshOZmXxXyLLuRKq_tKh7TAjSyloewzBqA8P49rZolvNKaC3Z1c4YFbgjxF2j0q5SJ5os Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Domain-Id: None Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Domain-Name: None Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Identity-Status: Confirmed Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Is-Admin-Project: True Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Domain-Id: default Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Domain-Name: Default Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Name: admin Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Role: reader,member,admin Oct 04 10:51:00.876975 n-d-791135-8 devstack@n-api.service[106368]: X-Roles: reader,member,admin Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29fd01daf86e42bea87048c02cd4d84c"}]}] Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant: admin Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant-Name: admin Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-User: admin Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-User-Domain-Id: default Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-User-Domain-Name: Default Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-User-Id: fd521efce18742dd9ea13e0a66fcf253 Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: X-User-Name: admin Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: method: > Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: exception: Flavor 84 could not be found. Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: action_args: {'id': '84'} Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:51:00.878310 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:51:00.879154 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.880503 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-af28b4ba-bc57-47ff-9072-7677d9f4fdcc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:51:00.881735 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-af28b4ba-bc57-47ff-9072-7677d9f4fdcc admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386713 Oct 04 10:51:00.881735 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Oct 4 10:51:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:51:00.888136 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-4880898c-df73-44c5-ac21-d2338222ca26 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:00.903370 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-4880898c-df73-44c5-ac21-d2338222ca26 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018815 Oct 04 10:51:00.903900 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Oct 4 10:51:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:51:00.912977 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-bf439083-170b-475a-a7fa-8462b2531bcf admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:00.928540 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-bf439083-170b-475a-a7fa-8462b2531bcf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019074 Oct 04 10:51:00.929061 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Oct 4 10:51:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:51:00.938581 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-156ea7de-1bc7-4e52-bfca-9bf115d9b2ce admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:00.943409 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.wsgi [None req-156ea7de-1bc7-4e52-bfca-9bf115d9b2ce admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-156ea7de-1bc7-4e52-bfca-9bf115d9b2ce admin admin] Request method failure captured: Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: Accept: application/json Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: Accept-Encoding: gzip, deflate Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: Connection: keep-alive Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: Content-Length: 0 Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: Host: 10.222.0.23 Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: Openstack-Api-Version: compute 2.92 Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: Openstack-System-Scope: None Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: User-Agent: python-novaclient Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Auth-Token: gAAAAABjPBAUoqMnS-FzxZK_v_m9QrzL0FPK16Q6Uknq1UoLrMJTNJC9o1vGgkAhvhhk0wDjzBbEJ5QhAXTxDTejgXBVn5de_rl5sqf81iNXrK028jfshOZmXxXyLLuRKq_tKh7TAjSyloewzBqA8P49rZolvNKaC3Z1c4YFbgjxF2j0q5SJ5os Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Domain-Id: None Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Domain-Name: None Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Identity-Status: Confirmed Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Is-Admin-Project: True Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Domain-Id: default Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Domain-Name: Default Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Name: admin Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Role: reader,member,admin Oct 04 10:51:00.944897 n-d-791135-8 devstack@n-api.service[106369]: X-Roles: reader,member,admin Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29fd01daf86e42bea87048c02cd4d84c"}]}] Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant: admin Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant-Name: admin Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-User: admin Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-User-Domain-Id: default Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-User-Domain-Name: Default Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-User-Id: fd521efce18742dd9ea13e0a66fcf253 Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: X-User-Name: admin Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: method: > Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: exception: Flavor 84 could not be found. Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: action_args: {'id': '84'} Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:51:00.946476 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:51:00.947398 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:00.948579 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-156ea7de-1bc7-4e52-bfca-9bf115d9b2ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:51:00.949607 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-156ea7de-1bc7-4e52-bfca-9bf115d9b2ce admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011659 Oct 04 10:51:00.949607 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Oct 4 10:51:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:51:02.147015 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-bf439083-170b-475a-a7fa-8462b2531bcf admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:02.148043 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-bf439083-170b-475a-a7fa-8462b2531bcf admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 04 10:51:02.148436 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:02.670201 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-bbe2e8cd-c36c-40f2-8dc5-5dc7b7f89b95 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:02.675990 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.wsgi [None req-bbe2e8cd-c36c-40f2-8dc5-5dc7b7f89b95 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-bbe2e8cd-c36c-40f2-8dc5-5dc7b7f89b95 admin admin] Request method failure captured: Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: Accept: application/json Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: Accept-Encoding: gzip, deflate Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: Connection: keep-alive Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: Content-Length: 0 Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: Host: 10.222.0.23 Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: Openstack-Api-Version: compute 2.92 Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: Openstack-System-Scope: None Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: User-Agent: python-novaclient Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Auth-Token: gAAAAABjPBAWQADUcCkse-qbz8ZqzBX213XaIVJh2nGmeZ3X9fIytmX1ogYaBkN0RiSD9KfNdQTVCVudWD_WSwko28q2w7xrdcptH1fqMlKYvs4nPVHQ-fJAqaeGIM6ek-umC6EgWN-SUYSL2mAzqZ7InY-x5yRN0qS8zwfocgctr4xWndYOzU4 Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Domain-Id: None Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Domain-Name: None Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Identity-Status: Confirmed Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Is-Admin-Project: True Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Domain-Id: default Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Domain-Name: Default Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Project-Name: admin Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Role: reader,member,admin Oct 04 10:51:02.677549 n-d-791135-8 devstack@n-api.service[106369]: X-Roles: reader,member,admin Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29fd01daf86e42bea87048c02cd4d84c"}]}] Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant: admin Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-Tenant-Name: admin Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-User: admin Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-User-Domain-Id: default Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-User-Domain-Name: Default Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-User-Id: fd521efce18742dd9ea13e0a66fcf253 Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: X-User-Name: admin Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: method: > Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: exception: Flavor 451 could not be found. Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: action_args: {'id': '451'} Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:51:02.679041 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:51:02.680042 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.681407 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-bbe2e8cd-c36c-40f2-8dc5-5dc7b7f89b95 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:51:02.682771 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-bbe2e8cd-c36c-40f2-8dc5-5dc7b7f89b95 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394672 Oct 04 10:51:02.682771 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Oct 4 10:51:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 10:51:02.688617 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-9ba45e99-a90c-4aa6-8b7c-ee28c36d091a admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:02.703770 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-9ba45e99-a90c-4aa6-8b7c-ee28c36d091a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018710 Oct 04 10:51:02.704452 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Oct 4 10:51:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:51:02.713880 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:02.729909 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019673 Oct 04 10:51:02.730464 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Oct 4 10:51:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:51:02.740661 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-7cedf824-21e9-494d-bbf4-a239ae77bc3a admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:02.745583 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.wsgi [None req-7cedf824-21e9-494d-bbf4-a239ae77bc3a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-7cedf824-21e9-494d-bbf4-a239ae77bc3a admin admin] Request method failure captured: Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: Accept: application/json Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: Accept-Encoding: gzip, deflate Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: Connection: keep-alive Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: Content-Length: 0 Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: Host: 10.222.0.23 Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: Openstack-Api-Version: compute 2.92 Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: Openstack-System-Scope: None Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: User-Agent: python-novaclient Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Auth-Token: gAAAAABjPBAWQADUcCkse-qbz8ZqzBX213XaIVJh2nGmeZ3X9fIytmX1ogYaBkN0RiSD9KfNdQTVCVudWD_WSwko28q2w7xrdcptH1fqMlKYvs4nPVHQ-fJAqaeGIM6ek-umC6EgWN-SUYSL2mAzqZ7InY-x5yRN0qS8zwfocgctr4xWndYOzU4 Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Domain-Id: None Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Domain-Name: None Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Identity-Status: Confirmed Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Is-Admin-Project: True Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Domain-Id: default Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Domain-Name: Default Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Project-Name: admin Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Role: reader,member,admin Oct 04 10:51:02.747329 n-d-791135-8 devstack@n-api.service[106368]: X-Roles: reader,member,admin Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29fd01daf86e42bea87048c02cd4d84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29fd01daf86e42bea87048c02cd4d84c"}]}] Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant: admin Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant-Id: 29fd01daf86e42bea87048c02cd4d84c Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-Tenant-Name: admin Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-User: admin Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-User-Domain-Id: default Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-User-Domain-Name: Default Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-User-Id: fd521efce18742dd9ea13e0a66fcf253 Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: X-User-Name: admin Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: method: > Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: exception: Flavor 451 could not be found. Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: action_args: {'id': '451'} Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:51:02.749551 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:51:02.750465 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: ERROR nova.api.openstack.wsgi Oct 04 10:51:02.751760 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-7cedf824-21e9-494d-bbf4-a239ae77bc3a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:51:02.752972 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-7cedf824-21e9-494d-bbf4-a239ae77bc3a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012297 Oct 04 10:51:02.752972 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Oct 4 10:51:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:51:03.946892 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:03.947907 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 04 10:51:03.948300 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:51:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:04.455456 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-002519dd-2960-4c06-8a98-cef3e741373e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:51:04.474886 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-002519dd-2960-4c06-8a98-cef3e741373e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.392294 Oct 04 10:51:04.475424 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Oct 4 10:51:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:51:05.689724 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:05.690736 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 04 10:51:05.691137 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:06.205626 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-98a54aa7-aca9-496b-9854-0cdfa72b47c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:51:06.224574 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-98a54aa7-aca9-496b-9854-0cdfa72b47c0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.395133 Oct 04 10:51:06.225132 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Oct 4 10:51:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:51:07.418288 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:07.419289 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 04 10:51:07.419706 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:51:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:07.925993 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-a1f42920-584f-48b8-88d6-895a13a7320e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:51:07.944383 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-a1f42920-584f-48b8-88d6-895a13a7320e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.389788 Oct 04 10:51:07.944929 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Oct 4 10:51:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:51:09.150042 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:09.151042 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 04 10:51:09.151439 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:51:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:09.675039 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-1d22c095-02cc-4993-bd73-423bf546c46b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:51:09.694007 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-1d22c095-02cc-4993-bd73-423bf546c46b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405228 Oct 04 10:51:09.694594 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Oct 4 10:51:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:51:10.894273 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:10.895280 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 04 10:51:10.895677 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:51:11.409752 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-29215bad-6bf1-4190-a2b6-cb86e11dd667 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:51:11.429609 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-29215bad-6bf1-4190-a2b6-cb86e11dd667 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397483 Oct 04 10:51:11.430146 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Tue Oct 4 10:51:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:52:07.251610 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:07.252627 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-7ea10851-0c9d-4148-b5ee-f73d451e085d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 04 10:52:07.253027 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 931 bytes} [Tue Oct 4 10:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:52:07.263556 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:52:07.762609 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-d4290b36-c71b-48d9-9b9e-b220521aa750 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:07.783714 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-d4290b36-c71b-48d9-9b9e-b220521aa750 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.524639 Oct 04 10:52:07.784260 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 10:52:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:52:07.804671 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writing DB stats nova_api:SELECT=14 {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:52:07.808456 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-3fd25cb2-8e81-4f09-8183-520167d55d42 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:07.815568 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-3fd25cb2-8e81-4f09-8183-520167d55d42 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012326 Oct 04 10:52:07.816074 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1283 bytes} [Tue Oct 4 10:52:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:07.827859 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-68a82351-14f0-4f0d-81eb-3db6b1b09f34 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:07.835122 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-68a82351-14f0-4f0d-81eb-3db6b1b09f34 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011326 Oct 04 10:52:07.835638 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1286 bytes} [Tue Oct 4 10:52:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:52:07.847051 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-8f04f0b4-2612-40e9-96e0-fc06d9d85e41 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:07.853985 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-8f04f0b4-2612-40e9-96e0-fc06d9d85e41 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010349 Oct 04 10:52:07.854486 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1286 bytes} [Tue Oct 4 10:52:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:52:07.865159 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-28f22a05-3f18-45b7-b314-79d8a33b3154 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:52:07.872137 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-28f22a05-3f18-45b7-b314-79d8a33b3154 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010325 Oct 04 10:52:07.872910 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1283 bytes} [Tue Oct 4 10:52:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:57:36.356590 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-8f04f0b4-2612-40e9-96e0-fc06d9d85e41 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:57:36.357621 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-8f04f0b4-2612-40e9-96e0-fc06d9d85e41 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 04 10:57:36.358013 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:57:36.495863 n-d-791135-8 devstack@n-api.service[106368]: DEBUG dbcounter [-] [106368] Writing DB stats nova_api:SELECT=6 {{(pid=106368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:57:36.635318 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-cb243bce-862c-4409-9946-6d75e33caa62 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:57:36.640018 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-cb243bce-862c-4409-9946-6d75e33caa62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:57:36.640495 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-cb243bce-862c-4409-9946-6d75e33caa62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:57:36.640923 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-cb243bce-862c-4409-9946-6d75e33caa62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:57:36.641670 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-cb243bce-862c-4409-9946-6d75e33caa62 admin admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:57:36.642123 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-cb243bce-862c-4409-9946-6d75e33caa62 admin admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:57:36.642539 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-cb243bce-862c-4409-9946-6d75e33caa62 admin admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:57:36.681252 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-cb243bce-862c-4409-9946-6d75e33caa62 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.186520 Oct 04 10:57:36.681836 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Oct 4 10:57:36 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:57:37.757167 n-d-791135-8 devstack@n-api.service[106369]: DEBUG nova.api.openstack.wsgi [None req-8f04f0b4-2612-40e9-96e0-fc06d9d85e41 admin admin] Calling method '>' {{(pid=106369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:57:37.758205 n-d-791135-8 devstack@n-api.service[106369]: INFO nova.api.openstack.requestlog [None req-8f04f0b4-2612-40e9-96e0-fc06d9d85e41 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 04 10:57:37.758610 n-d-791135-8 devstack@n-api.service[106369]: [pid: 106369|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Oct 4 10:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:57:37.947772 n-d-791135-8 devstack@n-api.service[106368]: DEBUG nova.api.openstack.wsgi [None req-6e87e239-ecc8-4bff-83d8-03a4444c6a61 admin admin] Calling method '>' {{(pid=106368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:57:37.951270 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-6e87e239-ecc8-4bff-83d8-03a4444c6a61 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:57:37.951769 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-6e87e239-ecc8-4bff-83d8-03a4444c6a61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:57:37.952192 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-6e87e239-ecc8-4bff-83d8-03a4444c6a61 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:57:37.952961 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-6e87e239-ecc8-4bff-83d8-03a4444c6a61 admin admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:57:37.953451 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-6e87e239-ecc8-4bff-83d8-03a4444c6a61 admin admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:57:37.953866 n-d-791135-8 devstack@n-api.service[106368]: DEBUG oslo_concurrency.lockutils [None req-6e87e239-ecc8-4bff-83d8-03a4444c6a61 admin admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:57:37.976900 n-d-791135-8 devstack@n-api.service[106368]: INFO nova.api.openstack.requestlog [None req-6e87e239-ecc8-4bff-83d8-03a4444c6a61 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080358 Oct 04 10:57:37.977461 n-d-791135-8 devstack@n-api.service[106368]: [pid: 106368|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Oct 4 10:57:37 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:58:22.285532 n-d-791135-8 devstack@n-api.service[106367]: Tue Oct 4 10:58:22 2022 - graceful shutdown triggered... Oct 04 10:58:22.286057 n-d-791135-8 devstack@n-api.service[106368]: Gracefully killing worker 1 (pid: 106368)... Oct 04 10:58:22.285641 n-d-791135-8 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 10:58:22.286953 n-d-791135-8 devstack@n-api.service[106369]: Gracefully killing worker 2 (pid: 106369)... Oct 04 10:58:22.413938 n-d-791135-8 devstack@n-api.service[106369]: DEBUG dbcounter [-] [106369] Writing DB stats nova_api:SELECT=4 {{(pid=106369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:58:23.286645 n-d-791135-8 devstack@n-api.service[106367]: worker 1 buried after 1 seconds Oct 04 10:58:23.287070 n-d-791135-8 devstack@n-api.service[106367]: worker 2 buried after 1 seconds Oct 04 10:58:23.287070 n-d-791135-8 devstack@n-api.service[106367]: goodbye to uWSGI. Oct 04 10:58:23.288240 n-d-791135-8 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 10:58:23.288848 n-d-791135-8 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 10:58:23.291597 n-d-791135-8 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 10:58:23.307268 n-d-791135-8 devstack@n-api.service[122395]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 10:58:23 2022] *** Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: nodename: n-d-791135-8 Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: machine: x86_64 Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: clock source: unix Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: pcre jit disabled Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: detected number of CPU cores: 4 Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: current working directory: / Oct 04 10:58:23.324872 n-d-791135-8 devstack@n-api.service[122395]: detected binary path: /usr/bin/uwsgi-core Oct 04 10:58:23.325679 n-d-791135-8 devstack@n-api.service[122395]: your processes number limit is 47680 Oct 04 10:58:23.325679 n-d-791135-8 devstack@n-api.service[122395]: your memory page size is 4096 bytes Oct 04 10:58:23.325679 n-d-791135-8 devstack@n-api.service[122395]: detected max file descriptor number: 2048 Oct 04 10:58:23.325679 n-d-791135-8 devstack@n-api.service[122395]: lock engine: pthread robust mutexes Oct 04 10:58:23.325679 n-d-791135-8 devstack@n-api.service[122395]: thunder lock: enabled Oct 04 10:58:23.325679 n-d-791135-8 devstack@n-api.service[122395]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 10:58:23.325679 n-d-791135-8 devstack@n-api.service[122395]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 10:58:23.366509 n-d-791135-8 devstack@n-api.service[122395]: Python main interpreter initialized at 0x55c599b699c0 Oct 04 10:58:23.366509 n-d-791135-8 devstack@n-api.service[122395]: python threads support enabled Oct 04 10:58:23.366509 n-d-791135-8 devstack@n-api.service[122395]: your server socket listen backlog is limited to 100 connections Oct 04 10:58:23.366509 n-d-791135-8 devstack@n-api.service[122395]: your mercy for graceful operations on workers is 90 seconds Oct 04 10:58:23.366960 n-d-791135-8 devstack@n-api.service[122395]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 10:58:23.366960 n-d-791135-8 devstack@n-api.service[122395]: *** Operational MODE: preforking *** Oct 04 10:58:23.367207 n-d-791135-8 devstack@n-api.service[122395]: *** uWSGI is running in multiple interpreter mode *** Oct 04 10:58:23.367207 n-d-791135-8 devstack@n-api.service[122395]: spawned uWSGI master process (pid: 122395) Oct 04 10:58:23.367415 n-d-791135-8 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 10:58:23.368107 n-d-791135-8 devstack@n-api.service[122395]: spawned uWSGI worker 1 (pid: 122408, cores: 1) Oct 04 10:58:23.371241 n-d-791135-8 devstack@n-api.service[122395]: spawned uWSGI worker 2 (pid: 122409, cores: 1) Oct 04 10:58:23.371241 n-d-791135-8 devstack@n-api.service[122395]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 10:58:24.022354 n-d-791135-8 devstack@n-api.service[122408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 10:58:24.025373 n-d-791135-8 devstack@n-api.service[122409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 10:58:25.178930 n-d-791135-8 devstack@n-api.service[122408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:58:25.178930 n-d-791135-8 devstack@n-api.service[122408]: from cryptography.utils import int_from_bytes Oct 04 10:58:25.179519 n-d-791135-8 devstack@n-api.service[122409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:58:25.179519 n-d-791135-8 devstack@n-api.service[122409]: from cryptography.utils import int_from_bytes Oct 04 10:58:25.179910 n-d-791135-8 devstack@n-api.service[122408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:58:25.179910 n-d-791135-8 devstack@n-api.service[122408]: from cryptography.utils import int_from_bytes Oct 04 10:58:25.180062 n-d-791135-8 devstack@n-api.service[122409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 10:58:25.180062 n-d-791135-8 devstack@n-api.service[122409]: from cryptography.utils import int_from_bytes Oct 04 10:58:27.551423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:58:27.552367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:58:27.553148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:58:27.553771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:58:27.554238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:58:27.554840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.555386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.555939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.556472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.557074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.557648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.558188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.558735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.558924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 10:58:27.559405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 10:58:27.559729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 10:58:27.560097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 10:58:27.560352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 10:58:27.560570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.560748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.561060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.561658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.561749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.562033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.562346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.562604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.562705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.562972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.563081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.563301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.563530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-791135-8 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.563637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.563864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.563970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.564211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.564369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-791135-8 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.565070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.565230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.565529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.565698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.565848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.566023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.566198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.566358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.566450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.566687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.566796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.567073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.567229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.568503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.568774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.568994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.569257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.569532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.569532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.569968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.570218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.570427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.570750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.570750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.571192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.571412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.571631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.571838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.572059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.572283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.572504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.572723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.572940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.573172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-791135-8 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.573393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.573606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.573606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.573970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-791135-8 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.574153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.574311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.574456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.574456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.574778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.574937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.575100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.575297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.575455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.575607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.575757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.575915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.576058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.576208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.576362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.576506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.576692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.577470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.577575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.577655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.577655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.577802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.577883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.577965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.578950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.579950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.580022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.580160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.580848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.581480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.581480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.581778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.581949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.582144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.582297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.582453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.582763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.582931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.583089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.583243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.583401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.583551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.583701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.583861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.584037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.584189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.584376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.584537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.584689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.584849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.584994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.585135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.585284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.585458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.585615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.585898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.586049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.586211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.586355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.586530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.586691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.586849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.586994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.587143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.587435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.587751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.587906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.588086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.588245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.588397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.588549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.588699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.588867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.589110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.589271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.589498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.589658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.589812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.589971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.590117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.590348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.590507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.590669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.590823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.590982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.591138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.591290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.591433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.591583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.591738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.591893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.592037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.592190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.592342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.592342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.592645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.592822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.592822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.593189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.593341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.593533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.593690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.593841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.593991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.594134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.594286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.594437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.594591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.594759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.594912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.595055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.595204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.595356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.595509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.595652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.595825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.595825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.596106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.596249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.596399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.596549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.596709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.596866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.597017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.597169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.597321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.597505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.597748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.597909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.598054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.598196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.598346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.598498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.598713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.598873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.599023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.599251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.599410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.599605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.599764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.599917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.600068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.600223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.600383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.600608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.600769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.600924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.601082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.601244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.601244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.601625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.601778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.601922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.602064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.602216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.602368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.602522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.602667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.602810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.602977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.602977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.603342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.603496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.603639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.603791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.603948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.604101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.604243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.604385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.604527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.604669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.604826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.604981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.605131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.605274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.605448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.605596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.605749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.605894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.606050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.606195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.606195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.606472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.606616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.606769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.606920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.607063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.607213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.607366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.607518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.607668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.607903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.608066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.608211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.608370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.608514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.608665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.608819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.608963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.609114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.609290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.609675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.609826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.609979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.610123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.610282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.610427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 10:58:27.610597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.610597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.610956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.611127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.611285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.611460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.611611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.611763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.611917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.612075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.612220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.612373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.612532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.612677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.612819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.612970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.613114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.613368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.613526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.613670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.613824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.613975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.614120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.614278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.614423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.614593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.614746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.614897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.615061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.615227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.615381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.615557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.615709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.615901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.616073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.616226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.616460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.616614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.616789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.616940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.617098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.617260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.617450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.617613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.617758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.617926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.618163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.618314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.618458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.618600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.618742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.618896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.619040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.619191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.619344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.619488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.619649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.619912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.620058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.620200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.620351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.620515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.620661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.620839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.621054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.621203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.621396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.621561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.621715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.621715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.622010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.622155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.622298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.622441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.622595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.622747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.622891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.623034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.623244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.623483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.623649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.623802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.623946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.624088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.624239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.624390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.624548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.624693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.624835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.624976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.625119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.625261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.625784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.625940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.626107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.626251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.626393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.626537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.626727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.626881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.627547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.627693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.627871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.628034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.628274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.628444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.628597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.628742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.628885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.629041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.629185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.629328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.629512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.629658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.629913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.630081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.630234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.630398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.631155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.631387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.631540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.631692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.631850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.632015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.632160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.632303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.632461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.632616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.632772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.632925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.632925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.633207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.633405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.633654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.633806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.633806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.634090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.634243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.634395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.634540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.634691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.634855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.634855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.635137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.635280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.635422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.635580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.635725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.635868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.636019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.636171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.636315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.636473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.636626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.636788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.636788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.637067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.637219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.637396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.637570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.637715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.637858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.638001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.638158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.638401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.638560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.638712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.638874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.639018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.639172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.639317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.639467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.639611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.639763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.640030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.640198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.640351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.640505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.640649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.640802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.640953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.641111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.641264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.641520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.641674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.641824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.641986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.642150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.642294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.642446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.642640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.643301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.643479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.643658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.643658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.643820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.643908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.644139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.644309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.644462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.644621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.644772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.644905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.645090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.645265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.645505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.645671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.645834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.645938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.646063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.646229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.646389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.646654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.646773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.646992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.647108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.647309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.647410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.647626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.647718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.647945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.648049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.648264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.648355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.648587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.648695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.648902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.649011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.649227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.649320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.649580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.649683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.649906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.650153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.650258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.650344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.650521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.650617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.650855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.650952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.651193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.651285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.651510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.651631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.651828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.651944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.652147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.652403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.652504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.652589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.652758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.652907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.653072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.653245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.653415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.653705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.653825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.654021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.654135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.654340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.654441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.654653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.654762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.654966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.655116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.655258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.655405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.655561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.655708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.655878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.656018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.656172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.656318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.656535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.656682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.656772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.656954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.657093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.657279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.657446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.657624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.657775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.657946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.658105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.658293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.658472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.658630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.658783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.658932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.659109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.659253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.659422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.659584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.659731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.659902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.660047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.660238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.660401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.660552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.660700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.660871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.661013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.661172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.661313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.661600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.661749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.661935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.662103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.662275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.662422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.662563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.662723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.662874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.663024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.663168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.663308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.663451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.663696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.663852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.664011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.664169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.664396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.664551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.664700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.664840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.664990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.665132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.665272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.665430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.665605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.665716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.665919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.666021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.666233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.666328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.666545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.666673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.666852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.667168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.667485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.668076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.668415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.668739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.669060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.669444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.669598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.669769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.669969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.670166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.670413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.670554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.670727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.670876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.671040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.671349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.671499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.671660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.672013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.672157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.672286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.672470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.672611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.672858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.673090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.673231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.673489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.674325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.674474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.674639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.674783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.674996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.675137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.675307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.675607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.675760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.675919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.676089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.676221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.676527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.676657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.676916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.677065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.677281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.677589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.677725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.677909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.678138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.678318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.678707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.678861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.679030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.679180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.679312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.679569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.679711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.679851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.680091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.680283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.680449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.680698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.680832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.681070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.681275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.681521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.681696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.681827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.682036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.682229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.682376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.682612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.682742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.682971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.683196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.683291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.683511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.683653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.683851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.683959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.684227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.684341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.684507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.684722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.684838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.685182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.685289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.685539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.685677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.685872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.686049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.686177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.686545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.686664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.686822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.686925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.687143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.687259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.687527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.687765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.687872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.688082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.688190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.688392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.688518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.688749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.688858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.689157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.689299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.689741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.689860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.690086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.690190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.690403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.690512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.690721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.690819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.691026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.691122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.691355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.691465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.691672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.691849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.691987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.692081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.692288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.692399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.692601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.692703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.692906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.693013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.693218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.693396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.693567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.693707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.693888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.694058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.694200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.694333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.694509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.694646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.694818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.694964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.695128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.695272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.695437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.695572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.695745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.695882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.696054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.696196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.696336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.696475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.696682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.696823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.696965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.697106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.697227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.697501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.697638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.697784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.697925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.698094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.698237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.698369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.698499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.698645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.698779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.698966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.699103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.699344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.699481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.699662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.699805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.699977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.700154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.700313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.700463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.700610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.700786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.700950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.701091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.701268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.701445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.701620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.701764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.701939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.702083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.702254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.702400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.702559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.702701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.702877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.703010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.703196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.703342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.703505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.703647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.703812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.703973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.704133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.704276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.704447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.704586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.704765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.704900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.705619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.705775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.705941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.706082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.706274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.706421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.706571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.706701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.706916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.707058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.707199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.707329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.707470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.707609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.707756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.707944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.708079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.708209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.708353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.708492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.708666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.708800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.708984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.709128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.709305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.709452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.709663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.709812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.709976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.710131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.710292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.710455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.710594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.710727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.710900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.711049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.711209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.711351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.711527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.711663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.711833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.711975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.712142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.712274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.712448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.712588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.712765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.712900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.713072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.713215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.713407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.713677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.713898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.714034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.714161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.714291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.714462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.714603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.714749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.714904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.715046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.715212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.715357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.715523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.715673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.715835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.715979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.716144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.716276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.716451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.716585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.716779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.716930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.717125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.717268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.717441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.717576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.717714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.717842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.718013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.718158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.718364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.718542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.718676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.718807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.719025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.719167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.719336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.719472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.719647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.719784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.719972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.720120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.720281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.720423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.720601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.720777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.720971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.721120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.721285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.721517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.721669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.721801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.721938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.722106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.722243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.722425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.722559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.722743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.722886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.723071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.723207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.723399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.723532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.723728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.723876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.724021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.724161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.724346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.724479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.724660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.724810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.724989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.725124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.725316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.725486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.725657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.725810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.725974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.726124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.726284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.726426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.726602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.726745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.726905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.727049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.727268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.727412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.727558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.727699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.727837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.727958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.728142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.728285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.728456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.728594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.728777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.728921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.729096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.729238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.729431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.729566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.729766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.729902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.730085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.730229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.730398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.730534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.730715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.730856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.731026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.731169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.731341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.731483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.731653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.731787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.731968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.732112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.732282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.732416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.732591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.732728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.732901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.733036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.733227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.733389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.733562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.733714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.733889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.734033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.734205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.734340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.734530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.734712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.734848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.734986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.735149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.735284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.735477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.735691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.735827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.735957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.736096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.736237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.736904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.737055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.737217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.737460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.737597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.737729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.737950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.738077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.738187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.738286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.738518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.738612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.738851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.738954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.739164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.739259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.739494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.739635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.739828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.739962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.740152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.740295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.740467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.740610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.740823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.740953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.741245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.741419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.741590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.741737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.741922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.742106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.742250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.742425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.742560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.742742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.742877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.743017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.743175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.743331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.743473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.743641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.743811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.743954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.744131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.744276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.744451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.744590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.744777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.744946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.745087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.745227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.745419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.745555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.745752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.745889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.746069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.746211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.746381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.746524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.746691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.746833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.747039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.747174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.747349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.747497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.747694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.747828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.747983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.748157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.748309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.748453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.748629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.748763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.748948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.749095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.749266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.749431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.749613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.749756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.749931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.750112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.750247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.750635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.750810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.750946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.751122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.751258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.751437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.751572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.751751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.751894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.752113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.752795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.752972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.753175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.753310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.753536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.753689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.753855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.753989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.754173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.754308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.754490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.754640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.754802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.754934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.755115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.755250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.755429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.755577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.755746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.755889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.756062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.756197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.756378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.756522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.756709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.756853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.757022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.757164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.757368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.757507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.757733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.757890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.758021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.758151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.758342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.758484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.758662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.758839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.758990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.759208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.759352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.759483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.759623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.759752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.759928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.760079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.760271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.760417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.760549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.760680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.760861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.761013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.761172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.761385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.761522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.761664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.761810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.761953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.762093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.762232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.762390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.762522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.762696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.762841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.763007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.763147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.763303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.763445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.763634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.763756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.763954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.764083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.764766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.764893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.765008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.765118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.765237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.765372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.765372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.765605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.765725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.765837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.769386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.769386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.769699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.769812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.769812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.769986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.770902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.771987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.772995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.773081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.773172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.773264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.773437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.773536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.773635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.773869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.773985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.774188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.774295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.774523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.774627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.774855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.774950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.775165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.775257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.775482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.775588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.775806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.775920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.776128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.776234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.776437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.776550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.776748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.776870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.777064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.777179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.777393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.777513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.777710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.777832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.778024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.778129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.778336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.778450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.778680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.778790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.778980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.779122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.779297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.779404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.806657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.806813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.806899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.806969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.807981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.808254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.808388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.808503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.808662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.808662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.809274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.809480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.809576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.809686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.810956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.811127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.811291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.811418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.811789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.812972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.813031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.813099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.813180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.813258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.813483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.813629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.813846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.813934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.814102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.814176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.814176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.814306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.814393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.814393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.814393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.815970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.816027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.816761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.816849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.816933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.817940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.818962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.819960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.820981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.821931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.822891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.823303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.823303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.823434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.823503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.823585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.823655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.823723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.823974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.824942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.825936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.826993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.827846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.829112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.829798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.831861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.831968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.832059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.832221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.832412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.832561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.832888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.832974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.833237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.833315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.833614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.833692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.833948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.834046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.834277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.834376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.834620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.834698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.834981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.835073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.835262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.835339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.835583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.835668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.835905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.835983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.836226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.836304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.836554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.836639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.836874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.836989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.837196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.837274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.837564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.837675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.837946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.838069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.838296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.838416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.838648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.838767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.838987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.839106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.839326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.839458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.839749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.839834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.839906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.840059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.840215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.840380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.840536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.840732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.840855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.841067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.841157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.841806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.843847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.843947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.844777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.844857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.844930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:58:27.845104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.845902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.846233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.846545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.846877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.847204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.847602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.847907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.848208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.848541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.848894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.849195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.852693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.853023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.853376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.853704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.854024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.854373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.856871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.857228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.857590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.858066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.858545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.859023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.859483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.859975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.860448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.860919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.861942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.862424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.862888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.863386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.863866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.864370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.864841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.865336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.865848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.866315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.866858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.867328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 10:58:27.867705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 10:58:27.910132 n-d-791135-8 devstack@n-api.service[122409]: INFO dbcounter [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Registered counter for database nova_api Oct 04 10:58:27.932345 n-d-791135-8 devstack@n-api.service[122408]: INFO dbcounter [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Registered counter for database nova_api Oct 04 10:58:27.932680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:58:27.939662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writer thread running {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:58:27.952378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_db.sqlalchemy.engines [None req-e49e0809-7151-4652-a241-bd11da741bea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:58:27.959503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writer thread running {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:58:27.996080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.context [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) {{(pid=122409) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 10:58:28.000077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:58:28.000837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:58:28.003012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:58:28.003740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:58:28.004183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:58:28.006213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:58:28.008259 n-d-791135-8 devstack@n-api.service[122409]: INFO dbcounter [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Registered counter for database nova_cell0 Oct 04 10:58:28.012232 n-d-791135-8 devstack@n-api.service[122409]: INFO dbcounter [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Registered counter for database nova_cell1 Oct 04 10:58:28.016946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.context [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) {{(pid=122408) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 10:58:28.019995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:58:28.021305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:58:28.021887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:58:28.022397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:58:28.024040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:58:28.024814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:58:28.025265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:58:28.027357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:58:28.028221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writer thread running {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:58:28.029483 n-d-791135-8 devstack@n-api.service[122408]: INFO dbcounter [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Registered counter for database nova_cell0 Oct 04 10:58:28.029581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writer thread running {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:58:28.033534 n-d-791135-8 devstack@n-api.service[122408]: INFO dbcounter [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Registered counter for database nova_cell1 Oct 04 10:58:28.041755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_db.sqlalchemy.engines [None req-e49e0809-7151-4652-a241-bd11da741bea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:58:28.042378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_db.sqlalchemy.engines [None req-e49e0809-7151-4652-a241-bd11da741bea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:58:28.047931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writer thread running {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:58:28.053150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writer thread running {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:58:28.176589 n-d-791135-8 devstack@n-api.service[122409]: INFO dbcounter [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Registered counter for database nova_cell0 Oct 04 10:58:28.183945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:58:28.188835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writer thread running {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:58:28.199091 n-d-791135-8 devstack@n-api.service[122408]: INFO dbcounter [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Registered counter for database nova_cell0 Oct 04 10:58:28.206305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_db.sqlalchemy.engines [None req-e49e0809-7151-4652-a241-bd11da741bea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 10:58:28.210802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writer thread running {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 10:58:28.510745 n-d-791135-8 devstack@n-api.service[122409]: WARNING keystonemiddleware.auth_token [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:58:28.518247 n-d-791135-8 devstack@n-api.service[122409]: WARNING keystonemiddleware.auth_token [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:58:28.535671 n-d-791135-8 devstack@n-api.service[122408]: WARNING keystonemiddleware.auth_token [None req-e49e0809-7151-4652-a241-bd11da741bea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:58:28.542998 n-d-791135-8 devstack@n-api.service[122408]: WARNING keystonemiddleware.auth_token [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:58:28.862373 n-d-791135-8 devstack@n-api.service[122409]: WARNING keystonemiddleware.auth_token [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:58:28.869081 n-d-791135-8 devstack@n-api.service[122409]: WARNING keystonemiddleware.auth_token [None req-d0ebb692-dad0-4b06-8f5c-da85d62dba7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:58:28.874427 n-d-791135-8 devstack@n-api.service[122409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c599b699c0 pid: 122409 (default app) Oct 04 10:58:28.893908 n-d-791135-8 devstack@n-api.service[122408]: WARNING keystonemiddleware.auth_token [None req-e49e0809-7151-4652-a241-bd11da741bea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 10:58:28.900024 n-d-791135-8 devstack@n-api.service[122408]: WARNING keystonemiddleware.auth_token [None req-e49e0809-7151-4652-a241-bd11da741bea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 10:58:28.905402 n-d-791135-8 devstack@n-api.service[122408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c599b699c0 pid: 122408 (default app) Oct 04 10:59:08.148912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:08.150094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:08.150880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:08.151692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:09.673732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '.version_select at 0x7f71d600a4c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:09.681502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) {{(pid=122409) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 10:59:09.682444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:09.683131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:09.683510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:09.719515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:09.720751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:09.721484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:09.735867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:09.736444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:09.736933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:09.744502 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4cddbf64-ec13-4c91-8516-e3f72d745bde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.606812 Oct 04 10:59:09.759437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Oct 4 10:59:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:09.993085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7658d5b5-44bd-43df-9c0c-3f79ab4b4074 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-760547421", "name": "tempest-test_aggregate-872075849"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:10.030359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-7658d5b5-44bd-43df-9c0c-3f79ab4b4074 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid 987faf1b-1fb9-42ce-af09-cf954aecf113 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:10.038458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:10.039215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:10.040040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:10.040912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:10.133976 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7658d5b5-44bd-43df-9c0c-3f79ab4b4074 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.372534 Oct 04 10:59:10.134885 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1165 bytes} [Tue Oct 4 10:59:09 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:10.147614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2d2f23d-4427-4a0e-8712-64ad4f615ed0 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:10.168143 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2d2f23d-4427-4a0e-8712-64ad4f615ed0 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.025401 Oct 04 10:59:10.169102 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 10:59:10 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:10.182709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c7215b6-6098-4e07-bf7b-63849c2ee545 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:10.208837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7215b6-6098-4e07-bf7b-63849c2ee545 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:10.209907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7215b6-6098-4e07-bf7b-63849c2ee545 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:10.210952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7215b6-6098-4e07-bf7b-63849c2ee545 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:10.800519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Calling method '.version_select at 0x7f71d600ab80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:10.817150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:10.819546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:10.824189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:10.854146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:10.854628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:10.855059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:10.884990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:10.887552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:10.893544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:10.907220 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc2df475-e11a-4ed2-be6a-17ecd721ea1b tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.595898 Oct 04 10:59:10.910658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3/4] 10.222.0.23 () {60 vars in 1208 bytes} [Tue Oct 4 10:59:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:59:11.346351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11fbeecc-d74c-46f8-8877-35d99199e385 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-516076868", "id": 392933472, "os-flavor-access:is_public": "True"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:11.461821 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11fbeecc-d74c-46f8-8877-35d99199e385 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.549669 Oct 04 10:59:11.462559 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4/5] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:10 2022] POST /compute/v2.1/flavors => generated 426 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:11.553466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1b257ad-0a24-45cf-9cdd-285ff39c7bcf tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1043780893", "id": 1285007515, "os-flavor-access:is_public": "False"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:11.566840 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c7215b6-6098-4e07-bf7b-63849c2ee545 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 1.389081 Oct 04 10:59:11.567635 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2/6] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:11.587707 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1b257ad-0a24-45cf-9cdd-285ff39c7bcf tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.123951 Oct 04 10:59:11.588582 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5/7] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:11 2022] POST /compute/v2.1/flavors => generated 431 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:11.686009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5523d07-344c-4291-b263-3d499dd43bb3 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:11.687715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5523d07-344c-4291-b263-3d499dd43bb3 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:11.688790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5523d07-344c-4291-b263-3d499dd43bb3 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:11.689290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5523d07-344c-4291-b263-3d499dd43bb3 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:11.690027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5523d07-344c-4291-b263-3d499dd43bb3 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:11.690472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5523d07-344c-4291-b263-3d499dd43bb3 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:11.690887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5523d07-344c-4291-b263-3d499dd43bb3 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:11.729409 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5523d07-344c-4291-b263-3d499dd43bb3 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.139755 Oct 04 10:59:11.732533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-32650459", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:11.738077 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 6/8] 10.222.0.23 () {58 vars in 1164 bytes} [Tue Oct 4 10:59:11 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:11.745423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3402ff0e-e396-43f5-92d2-f7381b742510 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:11.788510 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3402ff0e-e396-43f5-92d2-f7381b742510 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/392933472" status: 202 len: 0 microversion: 2.1 time: 0.046659 Oct 04 10:59:11.789524 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 7/9] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 10:59:11 2022] DELETE /compute/v2.1/flavors/392933472 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:11.853429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-38055ec4-f7c3-4713-a8ad-f3da15afc905 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:11.857098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38055ec4-f7c3-4713-a8ad-f3da15afc905 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:11.857724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38055ec4-f7c3-4713-a8ad-f3da15afc905 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:11.858153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38055ec4-f7c3-4713-a8ad-f3da15afc905 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:11.858866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38055ec4-f7c3-4713-a8ad-f3da15afc905 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:11.859309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38055ec4-f7c3-4713-a8ad-f3da15afc905 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:11.859727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38055ec4-f7c3-4713-a8ad-f3da15afc905 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:11.885656 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-38055ec4-f7c3-4713-a8ad-f3da15afc905 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.094763 Oct 04 10:59:11.886291 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 8/10] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 10:59:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:11.891150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64707abf-6e3b-4608-9453-e3b0d6965602 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bf59fe7a7d374a0f877f1830addaffe1"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:12.020698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64707abf-6e3b-4608-9453-e3b0d6965602 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1285007515/action" status: 200 len: 97 microversion: 2.1 time: 0.133151 Oct 04 10:59:12.021499 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 9/11] 10.222.0.23 () {60 vars in 1200 bytes} [Tue Oct 4 10:59:11 2022] POST /compute/v2.1/flavors/1285007515/action => generated 97 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:12.027243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:59:12.084640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1509272582", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "availability_zone": "tempest-test_az-760547421"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:12.105774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:12.106526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:12.107146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:12.108108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:12.108738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:12.109226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:12.321378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:59:12.623880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:59:12.624413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:59:12.624831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:59:12.625241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:59:12.626221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:59:12.650977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:12.651458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:12.651889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:12.652598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:12.664067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:12.664950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:12.719249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Getting quotas for project a702891ff9284b77b7d431d2ce819cc2. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:59:12.726610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Getting quotas for user dd2260573f8342a2ae252c245603c85f and project a702891ff9284b77b7d431d2ce819cc2. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:59:12.739769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:59:12.742906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:59:12.767670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:59:12.768171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:59:12.768623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:59:12.769119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:59:12.769609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:59:12.803810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:12.804268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:12.804703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:12.805451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:12.805905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:12.806325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:12.841598 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3c8b4bc8-99c9-44dd-ac5f-909a95a9d32d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.272522 Oct 04 10:59:12.844700 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 3/12] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:59:12.852675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2afdd6d5-2a2c-4d56-870a-9904166d1b00 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:12.858301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2afdd6d5-2a2c-4d56-870a-9904166d1b00 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:12.858784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2afdd6d5-2a2c-4d56-870a-9904166d1b00 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:12.859219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2afdd6d5-2a2c-4d56-870a-9904166d1b00 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:12.860476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2afdd6d5-2a2c-4d56-870a-9904166d1b00 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:12.860932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2afdd6d5-2a2c-4d56-870a-9904166d1b00 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:12.866584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2afdd6d5-2a2c-4d56-870a-9904166d1b00 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:12.869188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Getting quotas for project 5ad230590d2b4600b928951aa8c253ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:59:12.891227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Getting quotas for user e2d2501472714b07a145134548b9d347 and project 5ad230590d2b4600b928951aa8c253ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:59:12.917717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:59:12.920704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:59:12.928961 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2afdd6d5-2a2c-4d56-870a-9904166d1b00 tempest-AZAdminV2TestJSON-2089397580 tempest-AZAdminV2TestJSON-2089397580-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.083002 Oct 04 10:59:12.947765 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 4/13] 10.222.0.23 () {58 vars in 1185 bytes} [Tue Oct 4 10:59:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:12.953158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-553bc959-acbc-4091-9648-59083dffd3be tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.015846 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-553bc959-acbc-4091-9648-59083dffd3be tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065932 Oct 04 10:59:13.026382 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 5/14] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:13.092561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3235f44d-ccc5-4ebb-a902-f46f7dfc4b25 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066420 Oct 04 10:59:13.095171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 10/15] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:59:13.109616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0763b0a-0fb5-4d74-ad4d-baabc48267e7 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.112364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0763b0a-0fb5-4d74-ad4d-baabc48267e7 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:13.318867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0763b0a-0fb5-4d74-ad4d-baabc48267e7 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:13.325261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3a45134-cc15-4edb-ba07-84841d37bbc1 tempest-FlavorsAccessTestJSON-909792063 tempest-FlavorsAccessTestJSON-909792063-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.361883 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0763b0a-0fb5-4d74-ad4d-baabc48267e7 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1218 microversion: 2.1 time: 0.264415 Oct 04 10:59:13.364003 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 11/16] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:13 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:13.378275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-566e7d0a-0bd5-4c4d-9932-9d2b364822f3 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-816401040", "id": 1594343399, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:13.390201 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3a45134-cc15-4edb-ba07-84841d37bbc1 tempest-FlavorsAccessTestJSON-909792063 tempest-FlavorsAccessTestJSON-909792063-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.362359 Oct 04 10:59:13.391313 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 6/17] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:13 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:13.396488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-571843b6-ecf3-47dd-ae81-a53e9f7c6555 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.397675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-571843b6-ecf3-47dd-ae81-a53e9f7c6555 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:13.441466 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-566e7d0a-0bd5-4c4d-9932-9d2b364822f3 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.076326 Oct 04 10:59:13.451288 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 12/18] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:13 2022] POST /compute/v2.1/flavors => generated 416 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:13.458580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6077c8b-2929-4b49-83fa-4e7f734f6ad5 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bf59fe7a7d374a0f877f1830addaffe1"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:13.530200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-571843b6-ecf3-47dd-ae81-a53e9f7c6555 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:13.553847 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-571843b6-ecf3-47dd-ae81-a53e9f7c6555 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1242 microversion: 2.1 time: 0.160722 Oct 04 10:59:13.577797 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 7/19] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:13 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1242 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:13.587553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e02e294-65bd-448b-958f-04a130af23c5 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.612538 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e02e294-65bd-448b-958f-04a130af23c5 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.032702 Oct 04 10:59:13.626287 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 8/20] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:13 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:13.634644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70383922-b700-416c-ab12-081d31c5c59b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.675826 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70383922-b700-416c-ab12-081d31c5c59b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1594343399" status: 202 len: 0 microversion: 2.1 time: 0.045133 Oct 04 10:59:13.677674 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 9/21] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:13 2022] DELETE /compute/v2.1/flavors/1594343399 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:59:13.684207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e89b899-6dfc-4d87-b14f-36d1a6d31303 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.721204 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e89b899-6dfc-4d87-b14f-36d1a6d31303 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040538 Oct 04 10:59:13.721910 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 10/22] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:13.747148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-701dbcdd-7878-4526-bca8-af3afe64cb59 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1351518599", "id": 1585982006, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:13.795375 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-701dbcdd-7878-4526-bca8-af3afe64cb59 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.051825 Oct 04 10:59:13.800330 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 11/23] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:13 2022] POST /compute/v2.1/flavors => generated 429 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:13.814537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cb40bb5-a310-4bfc-a546-e80ceb52983b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.844838 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cb40bb5-a310-4bfc-a546-e80ceb52983b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1585982006" status: 202 len: 0 microversion: 2.1 time: 0.034765 Oct 04 10:59:13.847002 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:13 2022] DELETE /compute/v2.1/flavors/1585982006 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:13.867513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9df99192-70ff-4c27-9643-5237ffa2305c tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.894423 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6077c8b-2929-4b49-83fa-4e7f734f6ad5 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1285007515/action" status: 200 len: 21 microversion: 2.1 time: 0.441728 Oct 04 10:59:13.896606 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 13/25] 10.222.0.23 () {60 vars in 1200 bytes} [Tue Oct 4 10:59:13 2022] POST /compute/v2.1/flavors/1285007515/action => generated 21 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:13.908531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fea5ad6b-49e8-47fe-bbbd-b7eb5b2ea909 tempest-FlavorsAccessTestJSON-909792063 tempest-FlavorsAccessTestJSON-909792063-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:13.923522 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9df99192-70ff-4c27-9643-5237ffa2305c tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073005 Oct 04 10:59:13.925293 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:13.947544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48c9955c-0326-490c-b4d0-a22a3ded7683 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-405128668", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:13.966480 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fea5ad6b-49e8-47fe-bbbd-b7eb5b2ea909 tempest-FlavorsAccessTestJSON-909792063 tempest-FlavorsAccessTestJSON-909792063-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061977 Oct 04 10:59:13.967575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:13.986764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71e816ed-8dc1-4b89-9a31-05ebf5759fe6 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.004652 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48c9955c-0326-490c-b4d0-a22a3ded7683 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.057657 Oct 04 10:59:14.005297 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 14/28] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:13 2022] POST /compute/v2.1/flavors => generated 506 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:14.019747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b849ed68-5f8c-477b-b360-d5d54e838986 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.050801 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71e816ed-8dc1-4b89-9a31-05ebf5759fe6 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1285007515" status: 202 len: 0 microversion: 2.1 time: 0.069159 Oct 04 10:59:14.053404 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:13 2022] DELETE /compute/v2.1/flavors/1285007515 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:14.059555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d3a47e78-e4e1-49c9-a443-1a32dd49a536 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.086563 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b849ed68-5f8c-477b-b360-d5d54e838986 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/da84d4d8-125d-431e-857b-96dec159dfb7" status: 202 len: 0 microversion: 2.1 time: 0.070953 Oct 04 10:59:14.087194 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 15/30] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 10:59:14 2022] DELETE /compute/v2.1/flavors/da84d4d8-125d-431e-857b-96dec159dfb7 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:14.098527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b23b6ee-f606-4c6e-9cc4-cc3ace95df3f tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.177186 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b23b6ee-f606-4c6e-9cc4-cc3ace95df3f tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082372 Oct 04 10:59:14.178201 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 16/31] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:14.184560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d3a47e78-e4e1-49c9-a443-1a32dd49a536 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.122712 Oct 04 10:59:14.185657 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:14.210177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4b91e78-9c75-44bd-80c8-1207ddde2af1 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-170003639", "id": "70b64433-e9eb-48bd-84ef-a9254534976f", "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:14.213713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ccf2982-6bbc-4946-b6cf-ddda22456800 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1589296484", "id": 1894886275, "os-flavor-access:is_public": "False"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:14.241767 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4b91e78-9c75-44bd-80c8-1207ddde2af1 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.038259 Oct 04 10:59:14.245599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ccf2982-6bbc-4946-b6cf-ddda22456800 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.036164 Oct 04 10:59:14.247595 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 17/33] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:14 2022] POST /compute/v2.1/flavors => generated 431 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:14.254479 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 17/34] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:14 2022] POST /compute/v2.1/flavors => generated 506 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:14.264426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f1eb627-38b3-4c10-9ed2-4946facee20d tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.268677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae0cdf81-7982-495d-91fa-d8769b264459 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.292435 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae0cdf81-7982-495d-91fa-d8769b264459 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/70b64433-e9eb-48bd-84ef-a9254534976f" status: 202 len: 0 microversion: 2.1 time: 0.029107 Oct 04 10:59:14.293413 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 18/35] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 10:59:14 2022] DELETE /compute/v2.1/flavors/70b64433-e9eb-48bd-84ef-a9254534976f => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:14.307489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac045769-f1d8-4fc6-8a32-6336e528da0b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.320613 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f1eb627-38b3-4c10-9ed2-4946facee20d tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1894886275/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.064162 Oct 04 10:59:14.321514 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 18/36] 10.222.0.23 () {58 vars in 1209 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/flavors/1894886275/os-flavor-access => generated 21 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:14.331692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0423d0f5-8d0f-44f7-9944-a1977c54cb51 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.357679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:14.378130 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0423d0f5-8d0f-44f7-9944-a1977c54cb51 tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1894886275" status: 202 len: 0 microversion: 2.1 time: 0.050406 Oct 04 10:59:14.378723 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 19/37] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:14 2022] DELETE /compute/v2.1/flavors/1894886275 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:14.386434 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac045769-f1d8-4fc6-8a32-6336e528da0b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087550 Oct 04 10:59:14.388170 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 19/38] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:14.400821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ca2ccf3-1524-4cf7-b099-93605b1f845e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.402439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ca2ccf3-1524-4cf7-b099-93605b1f845e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:14.410339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca41ea56-7129-4b9f-b9e3-703853abea5e tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.428429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9,nova_api:DELETE=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:14.447529 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca41ea56-7129-4b9f-b9e3-703853abea5e tempest-FlavorsAccessTestJSON-148548631 tempest-FlavorsAccessTestJSON-148548631-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060359 Oct 04 10:59:14.458419 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 20/39] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:14.484270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bfca385e-22da-4d89-8f2c-2368c76b3a42 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1098476895", "id": 578614120, "os-flavor-access:is_public": "True"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:14.526390 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bfca385e-22da-4d89-8f2c-2368c76b3a42 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.063725 Oct 04 10:59:14.530045 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:14 2022] POST /compute/v2.1/flavors => generated 411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:14.548374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0caf4dea-7149-4e28-8e90-b9b4387f5545 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.573093 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0caf4dea-7149-4e28-8e90-b9b4387f5545 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/578614120" status: 200 len: 411 microversion: 2.1 time: 0.033099 Oct 04 10:59:14.574575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 22/41] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/flavors/578614120 => generated 411 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:14.577957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ca2ccf3-1524-4cf7-b099-93605b1f845e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:14.589382 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ca2ccf3-1524-4cf7-b099-93605b1f845e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1218 microversion: 2.1 time: 0.199098 Oct 04 10:59:14.593417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1cae1393-d046-4275-98d5-151954bab39b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.594433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1cae1393-d046-4275-98d5-151954bab39b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:14.596536 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 20/42] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:14.769281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1cae1393-d046-4275-98d5-151954bab39b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:14.801738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1cae1393-d046-4275-98d5-151954bab39b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1242 microversion: 2.1 time: 0.201711 Oct 04 10:59:14.802778 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 23/43] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1242 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:14.899688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dde99906-74bb-4658-8abe-cc002e978661 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:14.968300 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dde99906-74bb-4658-8abe-cc002e978661 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.370518 Oct 04 10:59:14.971894 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 21/44] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:14 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:14.989832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d90b16b-8ab6-413e-aa6a-bf5f4c4cddbc tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.032836 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d90b16b-8ab6-413e-aa6a-bf5f4c4cddbc tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/578614120" status: 202 len: 0 microversion: 2.1 time: 0.045337 Oct 04 10:59:15.033491 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 24/45] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 10:59:14 2022] DELETE /compute/v2.1/flavors/578614120 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:15.041387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d225edf-eab0-46a8-b5b2-e9465914c7ca tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.097740 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d225edf-eab0-46a8-b5b2-e9465914c7ca tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059778 Oct 04 10:59:15.099313 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 22/46] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:15.123436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ae683d7-7e18-4abb-b7b0-fb743bc2d310 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-461976083", "id": 1786479805, "os-flavor-access:is_public": "False"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:15.180261 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ae683d7-7e18-4abb-b7b0-fb743bc2d310 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.053070 Oct 04 10:59:15.181507 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 25/47] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:15 2022] POST /compute/v2.1/flavors => generated 429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:15.195764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42997380-18a6-446e-8dc0-bb3f8e12f1f7 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "1786479805"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:15.230754 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-42997380-18a6-446e-8dc0-bb3f8e12f1f7 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] HTTP exception thrown: Flavor 1786479805 could not be found. Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42997380-18a6-446e-8dc0-bb3f8e12f1f7 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] Request method failure captured: Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 107 Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH7ktnZoUvYD76v-spVQujrrGRw1vp0wmFaiXCmYF_B-SuvnCbsh_4TEsgUqU6iedV0_0JtnxWy-xJMnl0WEU_hw8mWVGkGwyKoL3qFRz96Aw8fQf0MFInAjxp4M0fROKvWK8trdPEK4w4NwVvfK_SJ18eIUsk1ed5zWxNhp-E8894 Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: c87d73233a924e7b9fd63f620d0f7d02 Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsAdminTestJSON-944381406 Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 10:59:15.259361 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c87d73233a924e7b9fd63f620d0f7d02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c87d73233a924e7b9fd63f620d0f7d02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c87d73233a924e7b9fd63f620d0f7d02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c87d73233a924e7b9fd63f620d0f7d02"}]}] Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsAdminTestJSON-944381406 Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: c87d73233a924e7b9fd63f620d0f7d02 Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-944381406 Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FlavorsAdminTestJSON-944381406-project Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 2b040a24ba914b7dba3382d44e56b126 Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsAdminTestJSON-944381406-project Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: {"server": {"name": "test", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "1786479805"}} Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:15.260477 n-d-791135-8 devstack@n-api.service[122408]: exception: Flavor 1786479805 could not be found. Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '1786479805'}}} Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1786479805 could not be found. Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:15.261242 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1786479805 could not be found. Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:15.262284 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:15.263324 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:15.263324 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:15.263324 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:15.263324 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1786479805 could not be found. Oct 04 10:59:15.263324 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:15.263324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-42997380-18a6-446e-8dc0-bb3f8e12f1f7 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] Returning 400 to user: Flavor 1786479805 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:15.263324 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-42997380-18a6-446e-8dc0-bb3f8e12f1f7 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.073162 Oct 04 10:59:15.272182 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 23/48] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:15 2022] POST /compute/v2.1/servers => generated 81 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:59:15.274176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f75fb2c7-27dc-4400-b5e2-53ee3083c667 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.314493 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f75fb2c7-27dc-4400-b5e2-53ee3083c667 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1786479805" status: 202 len: 0 microversion: 2.1 time: 0.044924 Oct 04 10:59:15.315551 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 26/49] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:15 2022] DELETE /compute/v2.1/flavors/1786479805 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:59:15.325743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae4b3af6-746c-4430-b056-69719d059b4b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.365309 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae4b3af6-746c-4430-b056-69719d059b4b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043445 Oct 04 10:59:15.366841 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 24/50] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:15.393314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ccd4242-5119-47b4-a0bd-a7ca060835ef tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-936590635", "id": 1011926405, "os-flavor-access:is_public": "False"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:15.423286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ccd4242-5119-47b4-a0bd-a7ca060835ef tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036219 Oct 04 10:59:15.426358 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 27/51] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:15 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:15.444390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7334c47-a4b8-464d-b949-95b90f2370d1 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1848100108", "id": 421470598, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:15.479328 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a7334c47-a4b8-464d-b949-95b90f2370d1 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044898 Oct 04 10:59:15.485518 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 25/52] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:15 2022] POST /compute/v2.1/flavors => generated 411 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:15.491633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9be14d12-c6b9-450c-9154-6ce5d1604f29 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.510988 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9be14d12-c6b9-450c-9154-6ce5d1604f29 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.022881 Oct 04 10:59:15.520537 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 28/53] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:15.525816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-626edb9d-e411-4ba4-b797-3655586eec54 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.550591 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-626edb9d-e411-4ba4-b797-3655586eec54 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.028437 Oct 04 10:59:15.559660 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 26/54] 10.222.0.23 () {58 vars in 1177 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:15.566313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef9e3fb3-262d-46d8-8d1e-6cfdfdd3650f tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.577262 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ef9e3fb3-262d-46d8-8d1e-6cfdfdd3650f tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.015543 Oct 04 10:59:15.586615 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 29/55] 10.222.0.23 () {58 vars in 1171 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:15.597216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a04d4af-2eb7-44e1-bdbc-9ca977f6b9f5 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.613678 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a04d4af-2eb7-44e1-bdbc-9ca977f6b9f5 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.025804 Oct 04 10:59:15.614834 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 27/56] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:15.627951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.629206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:15.631581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b7a27ac2-d995-4806-824e-aa301dd0cfea tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.638174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:15.639139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:15.641987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:15.643540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:15.644235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:15.644961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:15.658452 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b7a27ac2-d995-4806-824e-aa301dd0cfea tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.030538 Oct 04 10:59:15.673912 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 28/57] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:15.681626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5d83cbbe-6b3e-4520-9fab-c2c5733aa94c tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.708970 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5d83cbbe-6b3e-4520-9fab-c2c5733aa94c tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.028900 Oct 04 10:59:15.709829 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 29/58] 10.222.0.23 () {58 vars in 1175 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:15.738268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e70c3728-ff10-403a-9c8b-e922270b1657 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.769303 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e70c3728-ff10-403a-9c8b-e922270b1657 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.042038 Oct 04 10:59:15.777402 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1173 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:15.790876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e44a9694-365f-4ae9-bca8-58824accd452 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.821012 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e44a9694-365f-4ae9-bca8-58824accd452 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.036046 Oct 04 10:59:15.821980 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:15.828314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:15.828991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:15.835957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:15.836622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:15.837050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:15.837796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:15.838249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:15.838820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:15.990563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:16.004870 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d4001451-5563-462e-9bf9-a809ba62e722 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1291 microversion: 2.1 time: 0.383216 Oct 04 10:59:16.005691 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 30/61] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1291 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:16.014971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f623690-8d8e-4376-ae86-8bd717c7dca2 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.052661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f623690-8d8e-4376-ae86-8bd717c7dca2 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/421470598" status: 202 len: 0 microversion: 2.1 time: 0.045846 Oct 04 10:59:16.057215 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 31/62] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 10:59:16 2022] DELETE /compute/v2.1/flavors/421470598 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:16.062757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f55e82af-7426-46a5-b337-067fcfdfeb1a tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.099988 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f55e82af-7426-46a5-b337-067fcfdfeb1a tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041300 Oct 04 10:59:16.109548 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:16.128026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a7c8757-7a92-4540-a980-850722399b78 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.167445 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a7c8757-7a92-4540-a980-850722399b78 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1011926405" status: 202 len: 0 microversion: 2.1 time: 0.043617 Oct 04 10:59:16.168444 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 33/64] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:16 2022] DELETE /compute/v2.1/flavors/1011926405 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:59:16.184365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b655543-8f7d-47e4-9cc3-db898a8545e6 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.192331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:16.212902 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b655543-8f7d-47e4-9cc3-db898a8545e6 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038427 Oct 04 10:59:16.220474 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:16.241548 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-723dd4eb-0621-4d72-989e-a1e22d6afadb tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1234 microversion: 2.1 time: 0.417160 Oct 04 10:59:16.246452 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 32/66] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:15 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1234 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:16.251036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb6a675b-6f0c-4f1e-ab36-f836f9baa6a4 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1711927878", "id": 1466235247, "os-flavor-access:is_public": "False"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:16.306571 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb6a675b-6f0c-4f1e-ab36-f836f9baa6a4 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.061950 Oct 04 10:59:16.311279 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 35/67] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:16 2022] POST /compute/v2.1/flavors => generated 415 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:16.319964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbdcdfaa-d5e6-483c-a2d9-368825602e4f tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.359653 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cbdcdfaa-d5e6-483c-a2d9-368825602e4f tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043597 Oct 04 10:59:16.373783 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 33/68] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:16.379424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a622f53-02e4-4bbc-add0-c353aeabadde tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.417322 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a622f53-02e4-4bbc-add0-c353aeabadde tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034700 Oct 04 10:59:16.428119 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:16.444672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d28fea52-e4a1-4bf1-a80a-a95de3ceb2f8 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.475298 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d28fea52-e4a1-4bf1-a80a-a95de3ceb2f8 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1466235247" status: 202 len: 0 microversion: 2.1 time: 0.034885 Oct 04 10:59:16.479052 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 34/70] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:16 2022] DELETE /compute/v2.1/flavors/1466235247 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:16.484734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dafaca09-2087-4bdc-b8c4-44a82c914c2b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.527831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dafaca09-2087-4bdc-b8c4-44a82c914c2b tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047451 Oct 04 10:59:16.536173 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 37/71] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:16.559561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-adec70b7-67d3-47d1-bb1f-c7087d047dc2 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-186740922", "id": 396405328, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:16.587441 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-adec70b7-67d3-47d1-bb1f-c7087d047dc2 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.031581 Oct 04 10:59:16.588148 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 35/72] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:16 2022] POST /compute/v2.1/flavors => generated 410 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:16.600762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f8825da-0aaf-4102-9022-7ba33657e114 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.624233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f8825da-0aaf-4102-9022-7ba33657e114 tempest-FlavorsAdminTestJSON-944381406 tempest-FlavorsAdminTestJSON-944381406-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.027125 Oct 04 10:59:16.645243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccff2f37-c26e-4771-a308-b516b8a8fe21 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.652198 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 38/73] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:16 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:16.687725 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccff2f37-c26e-4771-a308-b516b8a8fe21 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/396405328" status: 202 len: 0 microversion: 2.1 time: 0.046533 Oct 04 10:59:16.688814 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 36/74] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 10:59:16 2022] DELETE /compute/v2.1/flavors/396405328 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:16.698087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8c50aa7-4e6e-4370-899c-b8f7690887e4 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:16.770587 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8c50aa7-4e6e-4370-899c-b8f7690887e4 tempest-FlavorsAdminTestJSON-2051300357 tempest-FlavorsAdminTestJSON-2051300357-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076113 Oct 04 10:59:16.775051 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 39/75] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:17.028055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:17.028667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:17.039316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:17.039831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:17.044786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:17.045639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:17.046128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:17.046559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:17.228918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:17.248990 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa2ae184-e106-4c31-8cf4-28e2e0e9f07b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1297 microversion: 2.1 time: 0.221818 Oct 04 10:59:17.252297 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 37/76] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:17 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1297 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:17.274232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:17.274844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:17.292503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:17.293527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:17.294203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:17.295150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:17.295989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:17.296627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:17.419297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:17.438873 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e71292b-8791-453f-ad43-0e695cc90dd1 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1296 microversion: 2.1 time: 0.170996 Oct 04 10:59:17.440634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 40/77] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:17 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1296 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:18.282086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:18.283510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:18.300411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:18.308278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:18.311323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:18.312691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:18.319304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:18.323128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:18.464070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:18.464801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:18.478378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:18.480676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:18.482876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:18.486714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:18.487278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:18.490026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:19.012671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:19.038112 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14114b26-7aaa-4b9a-8be2-f6dccf4ca801 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1296 microversion: 2.1 time: 0.574511 Oct 04 10:59:19.042319 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 41/78] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:18 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1296 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:19.388380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:19.408173 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8823f285-c4ec-49d9-8b3a-11a30462f87b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 1.130702 Oct 04 10:59:19.409929 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 38/79] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:18 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:20.074203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:20.078328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:20.105751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:20.105751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:20.105751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:20.105751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:20.106188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:20.106188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:20.436480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:20.437175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:20.444682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:20.445170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:20.445624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:20.454422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:20.459765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:20.462218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:21.061123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:21.072390 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7135096a-1cc2-415d-bb14-a434042ddda4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.639651 Oct 04 10:59:21.073002 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 39/80] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:20 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:21.180520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:21.205300 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f84762b6-d133-447e-bbeb-3986dcb07cc9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 1.141431 Oct 04 10:59:21.209527 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 42/81] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:20 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:22.097898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:22.099161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:22.119656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:22.120438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:22.123106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:22.132781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:22.135352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:22.135834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:22.237232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:22.238490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:22.248356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:22.252297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:22.253122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:22.255887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:22.256636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:22.257546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:22.838483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:22.889644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:22.941334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:22.968564 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-769e3bef-ef91-4a07-8731-4df66d7654ff tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.873829 Oct 04 10:59:22.973106 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 40/82] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:22 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:23.703197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fefea48-aa73-4e98-926f-0a9ded9f6520 tempest-AZAdminNegativeTestJSON-1360738026 tempest-AZAdminNegativeTestJSON-1360738026-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:23.704955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0fefea48-aa73-4e98-926f-0a9ded9f6520 tempest-AZAdminNegativeTestJSON-1360738026 tempest-AZAdminNegativeTestJSON-1360738026-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '0a0606457e0442788ced1141e81ab8c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b2d21db48a4bdc961a0fd8762ebd88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fefea48-aa73-4e98-926f-0a9ded9f6520 tempest-AZAdminNegativeTestJSON-1360738026 tempest-AZAdminNegativeTestJSON-1360738026-project] Request method failure captured: Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIIyozsOiZbTmQBOMhuXfw0ho83JTeKucpbRfJ3TcSC_HokB4SsSZSUHX8Jp0BkYOhx7OOpU57564kgDoosCm4tnRQeVfE0-0uPPi-urp9_SYqpz3DHR0mJ993LRjoELAieP3njvqyjwG5ii__ozf8GyzSHzVpl9kSpCggRBrvtdQs Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: d0b2d21db48a4bdc961a0fd8762ebd88 Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1360738026 Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 10:59:23.714973 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d0b2d21db48a4bdc961a0fd8762ebd88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d0b2d21db48a4bdc961a0fd8762ebd88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d0b2d21db48a4bdc961a0fd8762ebd88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d0b2d21db48a4bdc961a0fd8762ebd88"}]}] Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AZAdminNegativeTestJSON-1360738026 Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: d0b2d21db48a4bdc961a0fd8762ebd88 Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1360738026 Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AZAdminNegativeTestJSON-1360738026-project Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 0a0606457e0442788ced1141e81ab8c3 Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AZAdminNegativeTestJSON-1360738026-project Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 10:59:23.716390 n-d-791135-8 devstack@n-api.service[122408]: action_args: {} Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:23.717150 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 10:59:23.718352 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:23.720807 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fefea48-aa73-4e98-926f-0a9ded9f6520 tempest-AZAdminNegativeTestJSON-1360738026 tempest-AZAdminNegativeTestJSON-1360738026-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:23.722095 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0fefea48-aa73-4e98-926f-0a9ded9f6520 tempest-AZAdminNegativeTestJSON-1360738026 tempest-AZAdminNegativeTestJSON-1360738026-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.747147 Oct 04 10:59:23.723087 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 41/83] 10.222.0.23 () {58 vars in 1185 bytes} [Tue Oct 4 10:59:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 749 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:23.890026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:23.895055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-052dc381-f22a-4aec-bd22-39ac3ac4401e tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Calling method '.version_select at 0x7f71d5310a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:23.907778 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b7ef97b-c76b-4e34-8002-4635a69914d3 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 1.676599 Oct 04 10:59:23.909277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-052dc381-f22a-4aec-bd22-39ac3ac4401e tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:23.912634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-052dc381-f22a-4aec-bd22-39ac3ac4401e tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:23.913267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-052dc381-f22a-4aec-bd22-39ac3ac4401e tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:23.914982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-052dc381-f22a-4aec-bd22-39ac3ac4401e tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:23.916313 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 43/84] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:22 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:23.931460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-052dc381-f22a-4aec-bd22-39ac3ac4401e tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:23.935974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-052dc381-f22a-4aec-bd22-39ac3ac4401e tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.099556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5f55c01e-0466-4a90-ba2c-8ef2eeffdb9e req-431f941a-944b-477f-a347-28b9fe8fd32d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58172c5-7f3b-4513-a108-c2e39beaaad3", "tag": "35edc9b1-f0f2-4c9f-8698-b45bfcccb2fa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:24.115237 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-052dc381-f22a-4aec-bd22-39ac3ac4401e tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.389354 Oct 04 10:59:24.131081 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1128 bytes} [Tue Oct 4 10:59:23 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:24.162384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:24.168763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:24.170182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5f55c01e-0466-4a90-ba2c-8ef2eeffdb9e req-431f941a-944b-477f-a347-28b9fe8fd32d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.174652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5f55c01e-0466-4a90-ba2c-8ef2eeffdb9e req-431f941a-944b-477f-a347-28b9fe8fd32d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.184423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5f55c01e-0466-4a90-ba2c-8ef2eeffdb9e req-431f941a-944b-477f-a347-28b9fe8fd32d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.213032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.215145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.216003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.219794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.223115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.225927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.279680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5f55c01e-0466-4a90-ba2c-8ef2eeffdb9e req-431f941a-944b-477f-a347-28b9fe8fd32d service nova] Creating event network-changed:35edc9b1-f0f2-4c9f-8698-b45bfcccb2fa for instance c58172c5-7f3b-4513-a108-c2e39beaaad3 on n-h1-791135-8 Oct 04 10:59:24.280219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5f55c01e-0466-4a90-ba2c-8ef2eeffdb9e req-431f941a-944b-477f-a347-28b9fe8fd32d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 10:59:24.285297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5f55c01e-0466-4a90-ba2c-8ef2eeffdb9e req-431f941a-944b-477f-a347-28b9fe8fd32d service nova] Acquired lock "compute-rpcapi-router" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 10:59:24.289549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.290971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.296045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.298124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.298759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.300463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.346193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.rpcapi [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 10:59:24.348494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] Releasing lock "compute-rpcapi-router" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 10:59:24.379877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-05406b47-cf84-418a-ade3-4736f3559e0d None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.461202 Oct 04 10:59:24.381016 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 44/86] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:24.393277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd2aa05a-c74a-4e4d-b466-429ed79ebfac tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Calling method '.version_select at 0x7f71d54348b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:24.401180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd2aa05a-c74a-4e4d-b466-429ed79ebfac tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.405412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd2aa05a-c74a-4e4d-b466-429ed79ebfac tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.406093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd2aa05a-c74a-4e4d-b466-429ed79ebfac tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.410428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd2aa05a-c74a-4e4d-b466-429ed79ebfac tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.411232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd2aa05a-c74a-4e4d-b466-429ed79ebfac tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.411847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd2aa05a-c74a-4e4d-b466-429ed79ebfac tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.491173 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd2aa05a-c74a-4e4d-b466-429ed79ebfac tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.108715 Oct 04 10:59:24.496390 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 45/87] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Oct 4 10:59:24 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:24.514494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27288157-2fac-4cd8-ad7f-7b6f3059efc4 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Calling method '.version_select at 0x7f71d5559a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:24.519131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27288157-2fac-4cd8-ad7f-7b6f3059efc4 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.519617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27288157-2fac-4cd8-ad7f-7b6f3059efc4 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.525029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27288157-2fac-4cd8-ad7f-7b6f3059efc4 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.526180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27288157-2fac-4cd8-ad7f-7b6f3059efc4 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.526825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27288157-2fac-4cd8-ad7f-7b6f3059efc4 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.530769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27288157-2fac-4cd8-ad7f-7b6f3059efc4 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.583025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:24.595928 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-27288157-2fac-4cd8-ad7f-7b6f3059efc4 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.090420 Oct 04 10:59:24.602586 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 46/88] 10.222.0.23 () {58 vars in 1145 bytes} [Tue Oct 4 10:59:24 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:24.713042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:24.729467 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-105bd7c8-5aed-479e-b6ce-38af718f918f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.592837 Oct 04 10:59:24.731283 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 43/89] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:24 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:24.936893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:24.937668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:24.940219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:24.966360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.967719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.968336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:24.969963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:24.972432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:24.972888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:25.758212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:25.759399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:25.783478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:25.783967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:25.784398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:25.785101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:25.790788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:25.791552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:26.344544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:26.355539 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1096259f-975f-4de0-9c61-9f80d637f442 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 1.422299 Oct 04 10:59:26.374195 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 47/90] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:24 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:26.536655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:26.552133 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-247c20e4-db22-4f67-bd56-f1e3bb40ed8d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.798122 Oct 04 10:59:26.552903 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 44/91] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:25 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:26.905643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-eb1b1463-512a-48d9-8ce7-f514831befd1 req-4f70f652-5f37-493c-b918-5572f26853d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587b5421-7b9c-497c-a477-5d6147ee51ab", "tag": "32fc41b9-715a-4573-8d39-63880356a855"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:26.936801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eb1b1463-512a-48d9-8ce7-f514831befd1 req-4f70f652-5f37-493c-b918-5572f26853d7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:26.942659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eb1b1463-512a-48d9-8ce7-f514831befd1 req-4f70f652-5f37-493c-b918-5572f26853d7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:26.945941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eb1b1463-512a-48d9-8ce7-f514831befd1 req-4f70f652-5f37-493c-b918-5572f26853d7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:26.995222 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-eb1b1463-512a-48d9-8ce7-f514831befd1 req-4f70f652-5f37-493c-b918-5572f26853d7 service nova] Creating event network-changed:32fc41b9-715a-4573-8d39-63880356a855 for instance 587b5421-7b9c-497c-a477-5d6147ee51ab on n-h1-791135-8 Oct 04 10:59:27.014869 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-eb1b1463-512a-48d9-8ce7-f514831befd1 req-4f70f652-5f37-493c-b918-5572f26853d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.635041 Oct 04 10:59:27.016425 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 48/92] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:27.388301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:27.389327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:27.399028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:27.399885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:27.400469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:27.402153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:27.402948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:27.403544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:27.589081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:27.590046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:27.620475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:27.621078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:27.622883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:27.625333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:27.629004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:27.631463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:28.233632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:28.245963 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cbd7b74-78f9-4ffb-9da3-cbac660d91c4 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.863578 Oct 04 10:59:28.266858 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 45/93] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:27 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:28.276578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:28.291653 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb6ae821-03ae-498b-8787-c8c1f379df89 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.707466 Oct 04 10:59:28.309797 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 49/94] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:27 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:29.276798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:29.278376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:29.288382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:29.290594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:29.291222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:29.292155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:29.292641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:29.293064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:29.321005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:29.322599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:29.336453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:29.340923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:29.341620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:29.344038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:29.347373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:29.348083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:29.555530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:29.568604 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-829188cd-c660-4fde-a59c-a54e0742e7c5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.300060 Oct 04 10:59:29.569183 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 46/95] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:29 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:29.663862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:29.674017 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78306076-ece7-46f2-9683-cbdf239e98bb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.358701 Oct 04 10:59:29.677169 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 50/96] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:29 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:29.915985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d66b4127-dd5a-441d-90a7-db7740944da1 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1510391601", "id": 1768535031, "os-flavor-access:is_public": "False"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:29.946343 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d66b4127-dd5a-441d-90a7-db7740944da1 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.368120 Oct 04 10:59:29.947473 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 47/97] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:29 2022] POST /compute/v2.1/flavors => generated 439 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:29.960974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a05fd558-98ad-4743-a53e-45ca0c5bb97f tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:30.397461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:30.419072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a05fd558-98ad-4743-a53e-45ca0c5bb97f tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1768535031/action" status: 200 len: 97 microversion: 2.1 time: 0.462468 Oct 04 10:59:30.421272 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 51/98] 10.222.0.23 () {60 vars in 1200 bytes} [Tue Oct 4 10:59:29 2022] POST /compute/v2.1/flavors/1768535031/action => generated 97 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 10:59:30.433671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5310deb-56ca-43ce-a576-f5d0af393db5 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:30.592275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:30.592721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:30.602067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:30.602644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:30.603168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:30.603955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:30.604461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:30.604951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:30.855693 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a5310deb-56ca-43ce-a576-f5d0af393db5 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] HTTP exception thrown: Flavor access already exists for flavor 28 and project 4e403ec03c5c47c4adaa6a5a78ec7de2 combination. Oct 04 10:59:30.873334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:30.882305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7236db04-b4e1-4ee1-9158-7283ef246039 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.294173 Oct 04 10:59:30.887099 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:30 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:30.895433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:30.896043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:30.903898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:30.904516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:30.904955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:30.905816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:30.907002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:30.907190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5310deb-56ca-43ce-a576-f5d0af393db5 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Request method failure captured: Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/flavors/1768535031/action HTTP/1.1 Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 67 Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIQNPCPzdVbc_EyGzsCtquDElQJwC1ZWw7_kEfAF6WHFG35u0lvdijVIAZisG_wNkldmFIIyx11LtT1U9QthqWSTIL-Ugo52hKOS-9YQDGrew1UWtHIJirByd2l36_x8QbXD7R0xLEFP_BDARDIaMGLdP8aRkEnHO1dzLNdxNdPpD4 Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 83eeaa7ffac74d54809baed2fadc7f8c Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:30.962690 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83eeaa7ffac74d54809baed2fadc7f8c"}]}] Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 83eeaa7ffac74d54809baed2fadc7f8c Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 953262a1026946b0a2c3ead66cbb6117 Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: {"addTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} Oct 04 10:59:30.964041 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: exception: Flavor access already exists for flavor 28 and project 4e403ec03c5c47c4adaa6a5a78ec7de2 combination. Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '1768535031', 'body': {'addTenantAccess': {'tenant': '4e403ec03c5c47c4adaa6a5a78ec7de2'}}} Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result.read() Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:59:30.964865 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '28-4e403ec03c5c47c4adaa6a5a78ec7de2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 10:59:30.965890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 10:59:30.966908 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:59:30.967859 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result.read() Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '28-4e403ec03c5c47c4adaa6a5a78ec7de2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 10, 59, 30, 846270), 'updated_at': None, 'flavor_id': 28, 'project_id': '4e403ec03c5c47c4adaa6a5a78ec7de2'}] Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:30.968929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 28 and project 4e403ec03c5c47c4adaa6a5a78ec7de2 combination. Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:30.973512 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 28 and project 4e403ec03c5c47c4adaa6a5a78ec7de2 combination. Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:30.976398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:30.979488 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 28 and project 4e403ec03c5c47c4adaa6a5a78ec7de2 combination. Oct 04 10:59:30.979488 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:30.980373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5310deb-56ca-43ce-a576-f5d0af393db5 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Returning 409 to user: Flavor access already exists for flavor 28 and project 4e403ec03c5c47c4adaa6a5a78ec7de2 combination. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:30.981817 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5310deb-56ca-43ce-a576-f5d0af393db5 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1768535031/action" status: 409 len: 152 microversion: 2.1 time: 0.553156 Oct 04 10:59:30.983038 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 48/100] 10.222.0.23 () {60 vars in 1200 bytes} [Tue Oct 4 10:59:30 2022] POST /compute/v2.1/flavors/1768535031/action => generated 152 bytes in 555 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:59:31.121651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:31.131207 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-44eeb258-9a31-4a2f-a0f5-d9806e5b26e9 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.243062 Oct 04 10:59:31.132076 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 53/101] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:30 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:31.137441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-500d37f8-79bf-4465-aa1a-add67e4269e8 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:31.185912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce4ea6d1-f596-4e8b-8122-83089b544f03 tempest-FlavorMetadataValidation-2050029138 tempest-FlavorMetadataValidation-2050029138-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1712459022", "id": 2070053755, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:31.211259 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce4ea6d1-f596-4e8b-8122-83089b544f03 tempest-FlavorMetadataValidation-2050029138 tempest-FlavorMetadataValidation-2050029138-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.226872 Oct 04 10:59:31.213114 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 49/102] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 10:59:30 2022] POST /compute/v2.1/flavors => generated 471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:31.228606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a484cf7-35a5-4215-bd76-3269e025bda8 tempest-FlavorMetadataValidation-2050029138 tempest-FlavorMetadataValidation-2050029138-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:31.242741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-500d37f8-79bf-4465-aa1a-add67e4269e8 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1768535031/action" status: 200 len: 21 microversion: 2.1 time: 0.109067 Oct 04 10:59:31.243345 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 54/103] 10.222.0.23 () {60 vars in 1200 bytes} [Tue Oct 4 10:59:31 2022] POST /compute/v2.1/flavors/1768535031/action => generated 21 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:31.252964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4928e0b3-b5ac-4e4c-8f64-2fea66d1db2b tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.274802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4928e0b3-b5ac-4e4c-8f64-2fea66d1db2b tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1768535031" status: 202 len: 0 microversion: 2.1 time: 0.025489 Oct 04 10:59:31.275386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 55/104] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:31 2022] DELETE /compute/v2.1/flavors/1768535031 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:59:31.283709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d930a192-e6e4-4c75-a949-7d02ba6168d5 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.305345 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d930a192-e6e4-4c75-a949-7d02ba6168d5 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.025618 Oct 04 10:59:31.305957 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 56/105] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:31 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:31.328585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33820ad7-35b3-4029-b7f5-e1bde3472905 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1173292692", "id": 2062774750, "os-flavor-access:is_public": "True"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:31.364034 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-33820ad7-35b3-4029-b7f5-e1bde3472905 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.039091 Oct 04 10:59:31.366469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 57/106] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:31 2022] POST /compute/v2.1/flavors => generated 438 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:31.384644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4142f7f9-8aef-49ce-be9a-0c9aff73fb0e tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.398974 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4142f7f9-8aef-49ce-be9a-0c9aff73fb0e tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4142f7f9-8aef-49ce-be9a-0c9aff73fb0e tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Request method failure captured: Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/flavors/2062774750/os-flavor-access HTTP/1.1 Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIQNPCPzdVbc_EyGzsCtquDElQJwC1ZWw7_kEfAF6WHFG35u0lvdijVIAZisG_wNkldmFIIyx11LtT1U9QthqWSTIL-Ugo52hKOS-9YQDGrew1UWtHIJirByd2l36_x8QbXD7R0xLEFP_BDARDIaMGLdP8aRkEnHO1dzLNdxNdPpD4 Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 83eeaa7ffac74d54809baed2fadc7f8c Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:31.401748 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83eeaa7ffac74d54809baed2fadc7f8c"}]}] Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 83eeaa7ffac74d54809baed2fadc7f8c Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 953262a1026946b0a2c3ead66cbb6117 Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: exception: Access list not available for public flavors. Oct 04 10:59:31.402909 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'flavor_id': '2062774750'} Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 10:59:31.403552 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:31.407255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4142f7f9-8aef-49ce-be9a-0c9aff73fb0e tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:31.408716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4142f7f9-8aef-49ce-be9a-0c9aff73fb0e tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/2062774750/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.031415 Oct 04 10:59:31.413643 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 58/107] 10.222.0.23 () {58 vars in 1209 bytes} [Tue Oct 4 10:59:31 2022] GET /compute/v2.1/flavors/2062774750/os-flavor-access => generated 91 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:59:31.423246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ad65ffb-12e5-477a-baf5-3fd79a43da11 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.445382 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a484cf7-35a5-4215-bd76-3269e025bda8 tempest-FlavorMetadataValidation-2050029138 tempest-FlavorMetadataValidation-2050029138-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/2070053755/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.221056 Oct 04 10:59:31.446568 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 50/108] 10.222.0.23 () {62 vars in 1265 bytes} [Tue Oct 4 10:59:31 2022] POST /compute/v2.1/flavors/2070053755/os-extra_specs => generated 62 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:31.455794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ad65ffb-12e5-477a-baf5-3fd79a43da11 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2062774750" status: 202 len: 0 microversion: 2.1 time: 0.038891 Oct 04 10:59:31.457112 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 59/109] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:31 2022] DELETE /compute/v2.1/flavors/2062774750 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:31.458443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-243f1d0d-7f5a-49e9-8723-6922e55c6afd tempest-FlavorMetadataValidation-2050029138 tempest-FlavorMetadataValidation-2050029138-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.465158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-956ee8bb-ce56-49b0-b875-4156e59694c9 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.493487 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-956ee8bb-ce56-49b0-b875-4156e59694c9 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.032081 Oct 04 10:59:31.494464 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 60/110] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:31 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:31.499777 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-243f1d0d-7f5a-49e9-8723-6922e55c6afd tempest-FlavorMetadataValidation-2050029138 tempest-FlavorMetadataValidation-2050029138-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2070053755" status: 202 len: 0 microversion: 2.86 time: 0.045246 Oct 04 10:59:31.500420 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 51/111] 10.222.0.23 () {60 vars in 1202 bytes} [Tue Oct 4 10:59:31 2022] DELETE /compute/v2.1/flavors/2070053755 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:59:31.511975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d874f71-a3e7-4832-92fc-27dbaa746a92 tempest-FlavorMetadataValidation-2050029138 tempest-FlavorMetadataValidation-2050029138-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.523513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a3b6f1a-024a-440e-8752-92fc71b09b4c tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2006454387", "id": 1333098162, "os-flavor-access:is_public": "False"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:31.536285 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d874f71-a3e7-4832-92fc-27dbaa746a92 tempest-FlavorMetadataValidation-2050029138 tempest-FlavorMetadataValidation-2050029138-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.030632 Oct 04 10:59:31.537418 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 61/112] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 10:59:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:31.574641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8,nova_api:DELETE=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:31.600937 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a3b6f1a-024a-440e-8752-92fc71b09b4c tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.083449 Oct 04 10:59:31.610646 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 52/113] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:31 2022] POST /compute/v2.1/flavors => generated 439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:31.786536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-520f4647-d312-4b9c-907d-347ecd6dd505 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:31.794222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-520f4647-d312-4b9c-907d-347ecd6dd505 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '30e1342efb454c5ca19fbff0394bec14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e403ec03c5c47c4adaa6a5a78ec7de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-520f4647-d312-4b9c-907d-347ecd6dd505 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] Request method failure captured: Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/flavors/1333098162/action HTTP/1.1 Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 67 Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIOhdX8B70aaQsijobHq7QVih4iezxrNu_pT55LWauuydxqtMvO5RhvhGspcSjmbzGO3S8y3oIAwTN5-xwLbE7hKYsBPZnJzvVDWGCxeQL1_xsVBc2ebREGill8MXvR8z9Yn1G_JXsK3V06QM8IeetYO0w1g3Q3q0xDh8hAOQ6KITg Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 4e403ec03c5c47c4adaa6a5a78ec7de2 Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-995175302 Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:31.797679 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4e403ec03c5c47c4adaa6a5a78ec7de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e403ec03c5c47c4adaa6a5a78ec7de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e403ec03c5c47c4adaa6a5a78ec7de2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4e403ec03c5c47c4adaa6a5a78ec7de2"}]}] Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-995175302 Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 4e403ec03c5c47c4adaa6a5a78ec7de2 Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-995175302 Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FlavorsAccessNegativeTestJSON-995175302-project Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 30e1342efb454c5ca19fbff0394bec14 Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-995175302-project Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: {"addTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} Oct 04 10:59:31.798786 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1333098162', 'body': {'addTenantAccess': {'tenant': '4e403ec03c5c47c4adaa6a5a78ec7de2'}}} Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:31.799430 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 10:59:31.800375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:31.812096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-520f4647-d312-4b9c-907d-347ecd6dd505 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:31.814554 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-520f4647-d312-4b9c-907d-347ecd6dd505 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] 10.222.0.23 "POST /compute/v2.1/flavors/1333098162/action" status: 403 len: 130 microversion: 2.1 time: 0.203877 Oct 04 10:59:31.816360 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 62/114] 10.222.0.23 () {60 vars in 1200 bytes} [Tue Oct 4 10:59:31 2022] POST /compute/v2.1/flavors/1333098162/action => generated 130 bytes in 206 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:31.824344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95ef9369-55ba-44ae-8a46-7af47c7b45ee tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.846819 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95ef9369-55ba-44ae-8a46-7af47c7b45ee tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1333098162" status: 202 len: 0 microversion: 2.1 time: 0.025851 Oct 04 10:59:31.852125 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 53/115] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:31 2022] DELETE /compute/v2.1/flavors/1333098162 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:31.857501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd068c18-1230-4080-80ac-9546fc0a9c75 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.883318 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd068c18-1230-4080-80ac-9546fc0a9c75 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030042 Oct 04 10:59:31.883905 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 63/116] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:31.904614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-baa1e07f-8270-4fc3-a66c-7bc6adfa3ae4 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-93225772", "id": 155395088, "os-flavor-access:is_public": "False"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:31.908491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:31.909505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:31.915637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:31.916180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:31.916712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:31.917603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:31.918078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:31.918546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:31.936700 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-baa1e07f-8270-4fc3-a66c-7bc6adfa3ae4 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.036173 Oct 04 10:59:31.946174 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 54/117] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:31 2022] POST /compute/v2.1/flavors => generated 434 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:31.954693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1fd01977-d354-4ee1-a029-8d337a1712a7 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:32.069082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:32.079537 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77c933cb-f0c5-44b1-8c78-84b475c16e0a tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.175341 Oct 04 10:59:32.085891 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 64/118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:31 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:32.179465 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1fd01977-d354-4ee1-a029-8d337a1712a7 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/155395088/action" status: 200 len: 96 microversion: 2.1 time: 0.231894 Oct 04 10:59:32.180598 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 55/119] 10.222.0.23 () {60 vars in 1197 bytes} [Tue Oct 4 10:59:31 2022] POST /compute/v2.1/flavors/155395088/action => generated 96 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:32.185756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:32.186657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:32.194788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:32.195626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:32.196128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:32.197497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:32.198222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:32.198898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:32.221770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28879ed7-6732-48fd-b4eb-7c05d6a202c5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:32.230496 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28879ed7-6732-48fd-b4eb-7c05d6a202c5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.148376 Oct 04 10:59:32.231081 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 65/120] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 10:59:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:32.245252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f9b4111-eca1-492f-b261-2201da5a02d3 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f9b4111-eca1-492f-b261-2201da5a02d3 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '30e1342efb454c5ca19fbff0394bec14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e403ec03c5c47c4adaa6a5a78ec7de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f9b4111-eca1-492f-b261-2201da5a02d3 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] Request method failure captured: Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/flavors/155395088/action HTTP/1.1 Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 70 Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIOhdX8B70aaQsijobHq7QVih4iezxrNu_pT55LWauuydxqtMvO5RhvhGspcSjmbzGO3S8y3oIAwTN5-xwLbE7hKYsBPZnJzvVDWGCxeQL1_xsVBc2ebREGill8MXvR8z9Yn1G_JXsK3V06QM8IeetYO0w1g3Q3q0xDh8hAOQ6KITg Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 4e403ec03c5c47c4adaa6a5a78ec7de2 Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-995175302 Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:32.251938 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4e403ec03c5c47c4adaa6a5a78ec7de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e403ec03c5c47c4adaa6a5a78ec7de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4e403ec03c5c47c4adaa6a5a78ec7de2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4e403ec03c5c47c4adaa6a5a78ec7de2"}]}] Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-995175302 Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 4e403ec03c5c47c4adaa6a5a78ec7de2 Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-995175302 Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FlavorsAccessNegativeTestJSON-995175302-project Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 30e1342efb454c5ca19fbff0394bec14 Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-995175302-project Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: {"removeTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} Oct 04 10:59:32.256876 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '155395088', 'body': {'removeTenantAccess': {'tenant': '4e403ec03c5c47c4adaa6a5a78ec7de2'}}} Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can( Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:32.257845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 10:59:32.259079 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:32.260398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f9b4111-eca1-492f-b261-2201da5a02d3 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:32.260398 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f9b4111-eca1-492f-b261-2201da5a02d3 tempest-FlavorsAccessNegativeTestJSON-995175302 tempest-FlavorsAccessNegativeTestJSON-995175302-project] 10.222.0.23 "POST /compute/v2.1/flavors/155395088/action" status: 403 len: 133 microversion: 2.1 time: 0.011333 Oct 04 10:59:32.260398 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 66/121] 10.222.0.23 () {60 vars in 1197 bytes} [Tue Oct 4 10:59:32 2022] POST /compute/v2.1/flavors/155395088/action => generated 133 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:32.330246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f791a1e9-ef5f-4dda-ad02-3fc3338fe3cf tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1170012077", "id": 1704215892, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:32.352934 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f791a1e9-ef5f-4dda-ad02-3fc3338fe3cf tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.098799 Oct 04 10:59:32.357128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:32.361403 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 67/122] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:32 2022] POST /compute/v2.1/flavors => generated 425 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:32.366041 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-324123ca-1a13-4917-8e98-d59050e4d4e5 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.184070 Oct 04 10:59:32.366361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0a932ab-492b-4b3d-8853-5c5f96ab2eb1 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4e403ec03c5c47c4adaa6a5a78ec7de2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:32.367090 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 56/123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:32 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:32.371750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e25aaba8-3efe-4b91-81af-50ae9f423f16 tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:32.382049 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e25aaba8-3efe-4b91-81af-50ae9f423f16 tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013692 Oct 04 10:59:32.383225 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 57/124] 10.222.0.23 () {58 vars in 1182 bytes} [Tue Oct 4 10:59:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:32.395052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ad4ad04-4497-48e3-9a9a-599ce24a8193 tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1734237958", "id": 464592950, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:32.417054 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ad4ad04-4497-48e3-9a9a-599ce24a8193 tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.027133 Oct 04 10:59:32.417912 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 58/125] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:32 2022] POST /compute/v2.1/flavors => generated 422 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:32.440696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-222d88f4-9e11-4743-8913-dcac3f290fab tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:32.448262 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0a932ab-492b-4b3d-8853-5c5f96ab2eb1 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/155395088/action" status: 200 len: 21 microversion: 2.1 time: 0.085584 Oct 04 10:59:32.448985 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 68/126] 10.222.0.23 () {60 vars in 1197 bytes} [Tue Oct 4 10:59:32 2022] POST /compute/v2.1/flavors/155395088/action => generated 21 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:32.458067 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-222d88f4-9e11-4743-8913-dcac3f290fab tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031369 Oct 04 10:59:32.458821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73ad50c7-54e8-4cf9-824a-6d2dba2ca470 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:32.459160 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 59/127] 10.222.0.23 () {58 vars in 1182 bytes} [Tue Oct 4 10:59:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:32.473274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-659bcce8-4846-4036-be9f-be44ba22e6a5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Action: 'create', calling method: .version_select at 0x7f71d50a8820>, body: {"keypair": {"name": "tempest-keypair-2090858167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdp/C0rmBdWWel8jUMrENklUFvod9DcYxwKxqSOMm8bGiLSb0B7F6NQyI2vxScuwsi+OkP3e0G/SZii0ICqMI90QdwJvW6h8oZ3aY5cVcxcHPZe6qE6g8StiZ4nE3XHzQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:32.491224 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73ad50c7-54e8-4cf9-824a-6d2dba2ca470 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/155395088" status: 202 len: 0 microversion: 2.1 time: 0.036262 Oct 04 10:59:32.492036 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 69/128] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 10:59:32 2022] DELETE /compute/v2.1/flavors/155395088 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 10:59:32.502029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-468e9add-cd7a-4de4-9e90-d60ba1dcb625 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:32.504238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-659bcce8-4846-4036-be9f-be44ba22e6a5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Getting quotas for project 02a6b3dcd80b41c090b9567856b9d7c7. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:59:32.508818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-659bcce8-4846-4036-be9f-be44ba22e6a5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Getting quotas for user 6c2f73db46ee4f88a988540177a931e3 and project 02a6b3dcd80b41c090b9567856b9d7c7. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:59:32.531529 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-468e9add-cd7a-4de4-9e90-d60ba1dcb625 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.034071 Oct 04 10:59:32.532227 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 70/129] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:32 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:32.536859 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-659bcce8-4846-4036-be9f-be44ba22e6a5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069077 Oct 04 10:59:32.537730 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 60/130] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 10:59:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:32.560247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db18a7a5-4194-4eaf-af42-115bde951786 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1939834931", "id": 236654491, "os-flavor-access:is_public": "False"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:32.586859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db18a7a5-4194-4eaf-af42-115bde951786 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.032219 Oct 04 10:59:32.587874 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 71/131] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:32.601523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-031f9eed-97ff-4d5a-bb7b-22e71dcd70a6 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2d7539240fa64d6c933bc37db331e9a9"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:32.989962 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-031f9eed-97ff-4d5a-bb7b-22e71dcd70a6 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] HTTP exception thrown: Flavor access not found for 35 / 2d7539240fa64d6c933bc37db331e9a9 combination. Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-031f9eed-97ff-4d5a-bb7b-22e71dcd70a6 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Request method failure captured: Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/flavors/236654491/action HTTP/1.1 Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 70 Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIQNPCPzdVbc_EyGzsCtquDElQJwC1ZWw7_kEfAF6WHFG35u0lvdijVIAZisG_wNkldmFIIyx11LtT1U9QthqWSTIL-Ugo52hKOS-9YQDGrew1UWtHIJirByd2l36_x8QbXD7R0xLEFP_BDARDIaMGLdP8aRkEnHO1dzLNdxNdPpD4 Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 83eeaa7ffac74d54809baed2fadc7f8c Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:32.992235 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83eeaa7ffac74d54809baed2fadc7f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83eeaa7ffac74d54809baed2fadc7f8c"}]}] Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 83eeaa7ffac74d54809baed2fadc7f8c Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-144805233 Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 953262a1026946b0a2c3ead66cbb6117 Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: {"removeTenantAccess": {"tenant": "2d7539240fa64d6c933bc37db331e9a9"}} Oct 04 10:59:32.994140 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: exception: Flavor access not found for 35 / 2d7539240fa64d6c933bc37db331e9a9 combination. Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '236654491', 'body': {'removeTenantAccess': {'tenant': '2d7539240fa64d6c933bc37db331e9a9'}}} Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 10:59:32.994844 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / 2d7539240fa64d6c933bc37db331e9a9 combination. Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / 2d7539240fa64d6c933bc37db331e9a9 combination. Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:32.996362 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / 2d7539240fa64d6c933bc37db331e9a9 combination. Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-031f9eed-97ff-4d5a-bb7b-22e71dcd70a6 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Returning 404 to user: Flavor access not found for 35 / 2d7539240fa64d6c933bc37db331e9a9 combination. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-031f9eed-97ff-4d5a-bb7b-22e71dcd70a6 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/236654491/action" status: 404 len: 124 microversion: 2.1 time: 0.396232 Oct 04 10:59:32.997961 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 61/132] 10.222.0.23 () {60 vars in 1197 bytes} [Tue Oct 4 10:59:32 2022] POST /compute/v2.1/flavors/236654491/action => generated 124 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:33.003124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f9011cd-63fb-4514-9170-e23387c13552 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:33.021328 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f9011cd-63fb-4514-9170-e23387c13552 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/236654491" status: 202 len: 0 microversion: 2.1 time: 0.022008 Oct 04 10:59:33.022584 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 72/133] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 10:59:32 2022] DELETE /compute/v2.1/flavors/236654491 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:33.030463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1bf7be4d-ebef-45d6-b3c4-a0bcfb20bd39 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:33.058243 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1bf7be4d-ebef-45d6-b3c4-a0bcfb20bd39 tempest-FlavorsAccessNegativeTestJSON-144805233 tempest-FlavorsAccessNegativeTestJSON-144805233-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.031533 Oct 04 10:59:33.073378 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 62/134] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:33 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:33.105056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:33.106060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:33.114151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:33.116601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:33.117211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:33.118124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:33.118572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:33.120595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:33.152518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:33.303268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:33.313208 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff50ec96-d149-4ffd-a658-a8f017f401e8 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.211685 Oct 04 10:59:33.321395 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 73/135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:33 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:33.395113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:33.395725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:33.403925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:33.404445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:33.404951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:33.405693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:33.406146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:33.407138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:33.625213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:33.633960 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-adfc381e-a137-45b5-bae3-88a27799969d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.242868 Oct 04 10:59:33.635914 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 63/136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:33 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:34.338415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:34.339037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:34.349748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:34.350550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:34.351237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:34.352174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:34.352868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:34.353462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:34.522600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:34.534742 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d64c114d-d494-43c6-a619-3934d2508ca5 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.200394 Oct 04 10:59:34.538309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 74/137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:34 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:34.659858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:34.661249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:34.663624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:34.683108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:34.683874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:34.684447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:34.686130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:34.686707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:34.687037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:34.847951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1694128148", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "464592950", "adminPass": "***", "networks": [{"uuid": "24228c7f-bc6a-4652-9fd1-cb20e7632e8b"}], "security_groups": [{"name": "tempest-securitygroup--983720186"}], "key_name": "tempest-keypair-2090858167", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:34.867245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:35.035793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:35.043727 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd735c56-c3b9-4693-9e01-1423b2e8d3bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.389556 Oct 04 10:59:35.060806 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 64/138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:34 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:35.105736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] validate_networks() for [('24228c7f-bc6a-4652-9fd1-cb20e7632e8b', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:59:35.433083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-372c4428-1ca1-4496-a80c-ce588a277bbd tempest-FlavorsV255TestJSON-1474514283 tempest-FlavorsV255TestJSON-1474514283-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1846553149", "id": 152413463, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:35.455720 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-372c4428-1ca1-4496-a80c-ce588a277bbd tempest-FlavorsV255TestJSON-1474514283 tempest-FlavorsV255TestJSON-1474514283-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.165226 Oct 04 10:59:35.457751 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 65/139] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 10:59:35 2022] POST /compute/v2.1/flavors => generated 446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 10:59:35.594110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6a3410b-690a-46e6-bd33-02108f5eb00f tempest-FlavorsV255TestJSON-1447018961 tempest-FlavorsV255TestJSON-1447018961-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:35.605578 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6a3410b-690a-46e6-bd33-02108f5eb00f tempest-FlavorsV255TestJSON-1447018961 tempest-FlavorsV255TestJSON-1447018961-project] 10.222.0.23 "GET /compute/v2.1/flavors/152413463" status: 200 len: 446 microversion: 2.55 time: 0.138594 Oct 04 10:59:35.606162 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 66/140] 10.222.0.23 () {60 vars in 1196 bytes} [Tue Oct 4 10:59:35 2022] GET /compute/v2.1/flavors/152413463 => generated 446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:35.612375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:35.613173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:35.621431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:35.622407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:35.622938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:35.623737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:35.626904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:35.627369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:35.844755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:35.853900 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6277d87c-6fec-4123-b00d-c8a9c392c469 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.246531 Oct 04 10:59:35.855162 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 67/141] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:35 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:35.871066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b948461-8d62-4aa8-857a-3c5f501650a1 tempest-FlavorsV255TestJSON-1474514283 tempest-FlavorsV255TestJSON-1474514283-project-admin] Action: 'update', calling method: .version_select at 0x7f71d63c5b80>, body: {"flavor": {"description": "new"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:35.943675 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b948461-8d62-4aa8-857a-3c5f501650a1 tempest-FlavorsV255TestJSON-1474514283 tempest-FlavorsV255TestJSON-1474514283-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/152413463" status: 200 len: 447 microversion: 2.55 time: 0.084934 Oct 04 10:59:35.945719 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 68/142] 10.222.0.23 () {62 vars in 1216 bytes} [Tue Oct 4 10:59:35 2022] PUT /compute/v2.1/flavors/152413463 => generated 447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:35.962912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff6f7fe3-ba3f-446a-ab2b-591317dc7c94 tempest-FlavorsV255TestJSON-1447018961 tempest-FlavorsV255TestJSON-1447018961-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:36.001620 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff6f7fe3-ba3f-446a-ab2b-591317dc7c94 tempest-FlavorsV255TestJSON-1447018961 tempest-FlavorsV255TestJSON-1447018961-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.047530 Oct 04 10:59:36.006445 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 69/143] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 10:59:35 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:59:36.025646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-69c73ea6-43d7-46d4-b626-5e4172f1a32f tempest-FlavorsV255TestJSON-1447018961 tempest-FlavorsV255TestJSON-1447018961-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:36.062828 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-69c73ea6-43d7-46d4-b626-5e4172f1a32f tempest-FlavorsV255TestJSON-1447018961 tempest-FlavorsV255TestJSON-1447018961-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.040843 Oct 04 10:59:36.066906 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 70/144] 10.222.0.23 () {60 vars in 1166 bytes} [Tue Oct 4 10:59:36 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:36.072221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:36.073077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:36.080382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:36.081003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:36.081799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:36.082811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:36.083423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:36.083851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:36.366341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:36.377878 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8293c681-e738-462f-8a4b-6b26ce813014 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.308718 Oct 04 10:59:36.379020 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 71/145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:36 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:36.397935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9066945c-8897-46ef-8612-7bc4f62f2c00 tempest-FlavorsV255TestJSON-1474514283 tempest-FlavorsV255TestJSON-1474514283-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:36.412383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:59:36.412894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:59:36.413269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:59:36.413701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:59:36.414109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:59:36.425392 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9066945c-8897-46ef-8612-7bc4f62f2c00 tempest-FlavorsV255TestJSON-1474514283 tempest-FlavorsV255TestJSON-1474514283-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/152413463" status: 202 len: 0 microversion: 2.55 time: 0.045071 Oct 04 10:59:36.426156 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 72/146] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Oct 4 10:59:36 2022] DELETE /compute/v2.1/flavors/152413463 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:59:36.430445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:36.431232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:36.432138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:36.433029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:36.433606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:36.434238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:36.435675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37775fad-aeac-4785-93c8-146385eeb063 tempest-FlavorsV255TestJSON-1474514283 tempest-FlavorsV255TestJSON-1474514283-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:36.456562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Getting quotas for project 02a6b3dcd80b41c090b9567856b9d7c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:59:36.461188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Getting quotas for user 6c2f73db46ee4f88a988540177a931e3 and project 02a6b3dcd80b41c090b9567856b9d7c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:59:36.461963 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37775fad-aeac-4785-93c8-146385eeb063 tempest-FlavorsV255TestJSON-1474514283 tempest-FlavorsV255TestJSON-1474514283-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6154 microversion: 2.55 time: 0.029847 Oct 04 10:59:36.463378 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 73/147] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 10:59:36 2022] GET /compute/v2.1/flavors/detail => generated 6154 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 10:59:36.493957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:59:36.499404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:59:36.568071 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d14b5ac2-ddba-408c-a055-697f5c16c6b7 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.725248 Oct 04 10:59:36.569139 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 75/148] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:59:36.584862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-17993aa6-8db5-4172-af42-ae3bbc6d100d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:36.585835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-17993aa6-8db5-4172-af42-ae3bbc6d100d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:36.676274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-17993aa6-8db5-4172-af42-ae3bbc6d100d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:36.685935 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-17993aa6-8db5-4172-af42-ae3bbc6d100d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1263 microversion: 2.1 time: 0.107650 Oct 04 10:59:36.685935 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 74/149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:36 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1263 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:36.888724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:36.889379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:36.897974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:36.898837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:36.899480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:36.900569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:36.901667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:36.902353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:37.137482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:37.150942 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc01748b-5ef7-4172-aeb5-78fac0fc8ab9 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.273346 Oct 04 10:59:37.152475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 76/150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:36 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:37.404507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:37.405113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:37.431479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:37.433157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:37.434243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:37.440272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:37.441882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:37.442533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:37.634351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:37.640307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:37.643376 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ae7e285-c953-4686-bbbd-00f031c112ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.244243 Oct 04 10:59:37.649395 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 75/151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:37 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:37.710481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:37.711664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:37.713853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=79,nova_api:DELETE=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:37.719838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:37.720582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:37.721520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:37.723167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:37.723698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:37.724777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:37.804122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:37.813010 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-74667463-ebb7-4d46-950e-ac0805524bca tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1315 microversion: 2.1 time: 0.109262 Oct 04 10:59:37.817755 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 77/152] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:37 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1315 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:38.180515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:38.181330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:38.188590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:38.189975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:38.191654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:38.194329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:38.195023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:38.195639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:38.502736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:38.514410 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57c2ddd6-ff9a-4a8d-9006-74f1344f68c0 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.337605 Oct 04 10:59:38.515001 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 76/153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:38 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:38.672003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:38.672937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:38.680560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:38.681301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:38.681951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:38.682867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:38.684285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:38.685179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:38.810949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b64072b6-7faa-4b99-b213-c48c7c47ec55 req-80197d3d-a54c-4eef-8922-5930ee7d370f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587b5421-7b9c-497c-a477-5d6147ee51ab", "name": "network-vif-plugged", "status": "completed", "tag": "32fc41b9-715a-4573-8d39-63880356a855"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:38.820884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b64072b6-7faa-4b99-b213-c48c7c47ec55 req-80197d3d-a54c-4eef-8922-5930ee7d370f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:38.821540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b64072b6-7faa-4b99-b213-c48c7c47ec55 req-80197d3d-a54c-4eef-8922-5930ee7d370f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:38.821831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b64072b6-7faa-4b99-b213-c48c7c47ec55 req-80197d3d-a54c-4eef-8922-5930ee7d370f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:38.835632 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b64072b6-7faa-4b99-b213-c48c7c47ec55 req-80197d3d-a54c-4eef-8922-5930ee7d370f service nova] Creating event network-vif-plugged:32fc41b9-715a-4573-8d39-63880356a855 for instance 587b5421-7b9c-497c-a477-5d6147ee51ab on n-h1-791135-8 Oct 04 10:59:38.841083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b64072b6-7faa-4b99-b213-c48c7c47ec55 req-80197d3d-a54c-4eef-8922-5930ee7d370f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255879 Oct 04 10:59:38.841721 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 78/154] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:38.924168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46874f75-388a-4fd1-aa52-7c07ec108185 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1598859796", "ram": 512, "vcpus": 1, "disk": 10, "id": 1516302273, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:38.940517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:38.960463 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06056ffc-e32b-4f6c-97c9-d40b167759bf tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.291698 Oct 04 10:59:38.971220 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46874f75-388a-4fd1-aa52-7c07ec108185 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.126989 Oct 04 10:59:38.973276 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 79/155] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:38 2022] POST /compute/v2.1/flavors => generated 416 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:38.978309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:38.979239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:38.980255 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 77/156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:38 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:38.986893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:38.988022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:38.992387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:38.993286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:38.993787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:38.994227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:39.087794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:39.096361 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53eef284-9c8c-4386-b411-0167eb4e4e21 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1321 microversion: 2.1 time: 0.121766 Oct 04 10:59:39.097560 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 80/157] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:38 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1321 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:39.257096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abc4ef38-84d0-4c59-94c3-5f1f189c086a tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:39.267030 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-abc4ef38-84d0-4c59-94c3-5f1f189c086a tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] HTTP exception thrown: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abc4ef38-84d0-4c59-94c3-5f1f189c086a tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Request method failure captured: Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/flavors/1516302273/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIZP7JU2DMjBqjFUAkbujBABygUhq8XNS_CRAhxhwb5kPU6YTGjW4qYvaVw_HZfmuT4DJ-i2EsSqAQbKa5i4RvxdTJc7W5VyoUg8fOZrRU-bCJI-s6RHsHnp4Gp8t0qZH6YjV_tVvZWfQtsdOTp7KNkExF5CiUrFOgQPJuVPbWcBCY Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 91ff610294a4413fafd2cc00086a0594 Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 10:59:39.268642 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ff610294a4413fafd2cc00086a0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ff610294a4413fafd2cc00086a0594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ff610294a4413fafd2cc00086a0594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ff610294a4413fafd2cc00086a0594"}]}] Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 91ff610294a4413fafd2cc00086a0594 Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: a05aaa83b34047468e705e7c13a06625 Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:39.269890 n-d-791135-8 devstack@n-api.service[122408]: exception: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'flavor_id': '1516302273', 'id': 'hw:cpu_thread_policy'} Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.270483 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.271636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.271636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.271636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.271636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:39.271636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:39.271636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. Oct 04 10:59:39.271636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.273203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abc4ef38-84d0-4c59-94c3-5f1f189c086a tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Returning 404 to user: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:39.274169 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-abc4ef38-84d0-4c59-94c3-5f1f189c086a tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] 10.222.0.23 "GET /compute/v2.1/flavors/1516302273/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.291535 Oct 04 10:59:39.274630 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 78/158] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 10:59:38 2022] GET /compute/v2.1/flavors/1516302273/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:39.283960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed08667f-51b8-44c9-bb7a-0c7e63b171e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:39.287570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed08667f-51b8-44c9-bb7a-0c7e63b171e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a05aaa83b34047468e705e7c13a06625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ff610294a4413fafd2cc00086a0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed08667f-51b8-44c9-bb7a-0c7e63b171e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Request method failure captured: Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/flavors/1516302273/os-extra_specs HTTP/1.1 Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 66 Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIZP7JU2DMjBqjFUAkbujBABygUhq8XNS_CRAhxhwb5kPU6YTGjW4qYvaVw_HZfmuT4DJ-i2EsSqAQbKa5i4RvxdTJc7W5VyoUg8fOZrRU-bCJI-s6RHsHnp4Gp8t0qZH6YjV_tVvZWfQtsdOTp7KNkExF5CiUrFOgQPJuVPbWcBCY Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 91ff610294a4413fafd2cc00086a0594 Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:39.289679 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ff610294a4413fafd2cc00086a0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ff610294a4413fafd2cc00086a0594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ff610294a4413fafd2cc00086a0594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ff610294a4413fafd2cc00086a0594"}]}] Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 91ff610294a4413fafd2cc00086a0594 Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: a05aaa83b34047468e705e7c13a06625 Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 10:59:39.290794 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'flavor_id': '1516302273', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:39.291461 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 10:59:39.292511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.298236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed08667f-51b8-44c9-bb7a-0c7e63b171e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:39.298236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ed08667f-51b8-44c9-bb7a-0c7e63b171e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] 10.222.0.23 "POST /compute/v2.1/flavors/1516302273/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.011679 Oct 04 10:59:39.298236 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 81/159] 10.222.0.23 () {60 vars in 1224 bytes} [Tue Oct 4 10:59:39 2022] POST /compute/v2.1/flavors/1516302273/os-extra_specs => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:39.305953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2dcb7af7-a61e-4f0d-b56a-2b9514498f27 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:39.325409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=7,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:39.340655 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2dcb7af7-a61e-4f0d-b56a-2b9514498f27 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1516302273/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042480 Oct 04 10:59:39.341264 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 79/160] 10.222.0.23 () {60 vars in 1224 bytes} [Tue Oct 4 10:59:39 2022] POST /compute/v2.1/flavors/1516302273/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:39.355005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ace37f0b-9ab7-4b29-98f5-c6c7be48ecd2 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:39.360447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ace37f0b-9ab7-4b29-98f5-c6c7be48ecd2 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a05aaa83b34047468e705e7c13a06625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ff610294a4413fafd2cc00086a0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ace37f0b-9ab7-4b29-98f5-c6c7be48ecd2 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Request method failure captured: Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIZP7JU2DMjBqjFUAkbujBABygUhq8XNS_CRAhxhwb5kPU6YTGjW4qYvaVw_HZfmuT4DJ-i2EsSqAQbKa5i4RvxdTJc7W5VyoUg8fOZrRU-bCJI-s6RHsHnp4Gp8t0qZH6YjV_tVvZWfQtsdOTp7KNkExF5CiUrFOgQPJuVPbWcBCY Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 91ff610294a4413fafd2cc00086a0594 Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:39.363298 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ff610294a4413fafd2cc00086a0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ff610294a4413fafd2cc00086a0594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ff610294a4413fafd2cc00086a0594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ff610294a4413fafd2cc00086a0594"}]}] Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 91ff610294a4413fafd2cc00086a0594 Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: a05aaa83b34047468e705e7c13a06625 Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:39.364520 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'flavor_id': '1516302273', 'id': 'hw:numa_nodes'} Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:39.365099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.366323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ace37f0b-9ab7-4b29-98f5-c6c7be48ecd2 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:39.367290 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ace37f0b-9ab7-4b29-98f5-c6c7be48ecd2 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018350 Oct 04 10:59:39.373663 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 82/161] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 10:59:39 2022] DELETE /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:39.383892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca860d38-051b-49f9-8cc2-899b2b568233 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:39.415035 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca860d38-051b-49f9-8cc2-899b2b568233 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1516302273/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040308 Oct 04 10:59:39.415540 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 80/162] 10.222.0.23 () {60 vars in 1224 bytes} [Tue Oct 4 10:59:39 2022] POST /compute/v2.1/flavors/1516302273/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 10:59:39.428744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba06884a-de92-49be-b3a7-0ac7a4b2401c tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:39.432417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ba06884a-de92-49be-b3a7-0ac7a4b2401c tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a05aaa83b34047468e705e7c13a06625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ff610294a4413fafd2cc00086a0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba06884a-de92-49be-b3a7-0ac7a4b2401c tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Request method failure captured: Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 22 Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIZP7JU2DMjBqjFUAkbujBABygUhq8XNS_CRAhxhwb5kPU6YTGjW4qYvaVw_HZfmuT4DJ-i2EsSqAQbKa5i4RvxdTJc7W5VyoUg8fOZrRU-bCJI-s6RHsHnp4Gp8t0qZH6YjV_tVvZWfQtsdOTp7KNkExF5CiUrFOgQPJuVPbWcBCY Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 91ff610294a4413fafd2cc00086a0594 Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:39.434051 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ff610294a4413fafd2cc00086a0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ff610294a4413fafd2cc00086a0594"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ff610294a4413fafd2cc00086a0594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ff610294a4413fafd2cc00086a0594"}]}] Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 91ff610294a4413fafd2cc00086a0594 Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: a05aaa83b34047468e705e7c13a06625 Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: {"hw:numa_nodes": "1"} Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:39.435399 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'flavor_id': '1516302273', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:39.436072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 10:59:39.438093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.439303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba06884a-de92-49be-b3a7-0ac7a4b2401c tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:39.439303 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba06884a-de92-49be-b3a7-0ac7a4b2401c tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450 tempest-FlavorsExtraSpecsNegativeTestJSON-1853268450-project] 10.222.0.23 "PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012348 Oct 04 10:59:39.439303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 83/163] 10.222.0.23 () {60 vars in 1265 bytes} [Tue Oct 4 10:59:39 2022] PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:59:39.445703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82329d11-f3fc-4d5c-ac4c-dca86605959a tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:39.453648 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-82329d11-f3fc-4d5c-ac4c-dca86605959a tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] HTTP exception thrown: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82329d11-f3fc-4d5c-ac4c-dca86605959a tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Request method failure captured: Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/flavors/1516302273/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIacGc6m3BHSQtq-UWJt6kOTTmZyl8dnUpK7EkoCDPgV3DOu8oRCkZH8kDP_LX4nlxnCxCyPIy00wfilJHeWs0jmnlrZKd_-z7DSU9fn5Cvosx0byd-eU9qygkeLh_vfd2OGco2HrZbi4mPNHOT4WqQElwwplJckkDbKtMHXNQTHAQ Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 20fbbd1eeba34b96907cd65172e2a2f7 Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:39.455006 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20fbbd1eeba34b96907cd65172e2a2f7"}]}] Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 20fbbd1eeba34b96907cd65172e2a2f7 Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 5f7261516c15473584d2337d31bd9e7c Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:39.456181 n-d-791135-8 devstack@n-api.service[122408]: exception: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'flavor_id': '1516302273', 'id': 'hw:cpu_thread_policy'} Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.456778 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82329d11-f3fc-4d5c-ac4c-dca86605959a tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Returning 404 to user: Flavor 1516302273 has no extra specs with key hw:cpu_thread_policy. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82329d11-f3fc-4d5c-ac4c-dca86605959a tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1516302273/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.014376 Oct 04 10:59:39.457941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 81/164] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 10:59:39 2022] DELETE /compute/v2.1/flavors/1516302273/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:59:39.466307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c424fb6-b028-41fb-83e3-40d335373751 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:39.469948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4c424fb6-b028-41fb-83e3-40d335373751 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c424fb6-b028-41fb-83e3-40d335373751 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Request method failure captured: Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 27 Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIacGc6m3BHSQtq-UWJt6kOTTmZyl8dnUpK7EkoCDPgV3DOu8oRCkZH8kDP_LX4nlxnCxCyPIy00wfilJHeWs0jmnlrZKd_-z7DSU9fn5Cvosx0byd-eU9qygkeLh_vfd2OGco2HrZbi4mPNHOT4WqQElwwplJckkDbKtMHXNQTHAQ Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 20fbbd1eeba34b96907cd65172e2a2f7 Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:39.471729 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20fbbd1eeba34b96907cd65172e2a2f7"}]}] Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 20fbbd1eeba34b96907cd65172e2a2f7 Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5f7261516c15473584d2337d31bd9e7c Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: {"hw:cpu_policy": "shared"} Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:39.473013 n-d-791135-8 devstack@n-api.service[122409]: exception: Request body and URI mismatch Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'flavor_id': '1516302273', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.473788 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.475092 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:39.475092 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:39.475092 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 10:59:39.475092 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.475092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c424fb6-b028-41fb-83e3-40d335373751 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:39.475509 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c424fb6-b028-41fb-83e3-40d335373751 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.012975 Oct 04 10:59:39.483898 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 84/165] 10.222.0.23 () {60 vars in 1265 bytes} [Tue Oct 4 10:59:39 2022] PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 10:59:39.489556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7284503b-e20b-4f34-984e-9156cdf195a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7284503b-e20b-4f34-984e-9156cdf195a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Request method failure captured: Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: request: PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 49 Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIacGc6m3BHSQtq-UWJt6kOTTmZyl8dnUpK7EkoCDPgV3DOu8oRCkZH8kDP_LX4nlxnCxCyPIy00wfilJHeWs0jmnlrZKd_-z7DSU9fn5Cvosx0byd-eU9qygkeLh_vfd2OGco2HrZbi4mPNHOT4WqQElwwplJckkDbKtMHXNQTHAQ Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 20fbbd1eeba34b96907cd65172e2a2f7 Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:39.502585 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20fbbd1eeba34b96907cd65172e2a2f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20fbbd1eeba34b96907cd65172e2a2f7"}]}] Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 20fbbd1eeba34b96907cd65172e2a2f7 Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 5f7261516c15473584d2337d31bd9e7c Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 10:59:39.504384 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'flavor_id': '1516302273', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance: Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 10:59:39.505101 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.506358 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7284503b-e20b-4f34-984e-9156cdf195a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7284503b-e20b-4f34-984e-9156cdf195a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.019606 Oct 04 10:59:39.507882 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 82/166] 10.222.0.23 () {60 vars in 1265 bytes} [Tue Oct 4 10:59:39 2022] PUT /compute/v2.1/flavors/1516302273/os-extra_specs/hw:numa_nodes => generated 117 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:59:39.513883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57df93e0-cdd5-4f0a-a290-b67685367f2a tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:39.531229 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57df93e0-cdd5-4f0a-a290-b67685367f2a tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1516302273" status: 202 len: 0 microversion: 2.1 time: 0.021415 Oct 04 10:59:39.532452 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 85/167] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 10:59:39 2022] DELETE /compute/v2.1/flavors/1516302273 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 10:59:39.537149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:39.537822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:39.544604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6dd5e27f-1acf-46da-bc43-e2000fb8821e tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:39.547564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:39.548064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:39.554085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:39.554894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:39.555375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:39.557889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:39.570462 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6dd5e27f-1acf-46da-bc43-e2000fb8821e tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106 tempest-FlavorsExtraSpecsNegativeTestJSON-1511301106-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.033595 Oct 04 10:59:39.581726 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 86/168] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 10:59:39 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:39.715944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:39.732095 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0419d40b-33ae-45fe-bf95-2da7e670533e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.197301 Oct 04 10:59:39.734276 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 83/169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:39 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:39.987565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:39.989050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:39.994996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:39.995480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:39.995918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:39.996778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:39.997231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:39.998246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:40.121943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:40.122773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:40.130650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:40.132028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:40.132463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:40.133463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:40.133871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:40.134467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:40.180730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:40.190444 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-54ff2c90-4007-4759-baf0-4ccd063eff51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.207272 Oct 04 10:59:40.191021 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 87/170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:39 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:40.227857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:40.244517 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba16e1db-7333-46a1-8033-017d6f15af8a tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1321 microversion: 2.1 time: 0.127034 Oct 04 10:59:40.245706 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 84/171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:40 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1321 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:40.758155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:40.759557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:40.765952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:40.766685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:40.767320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:40.768219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:40.768872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:40.769526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:40.845887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31255863-1d62-4c64-8f16-f17fac5148d3 tempest-FlavorsV261TestJSON-1732144160 tempest-FlavorsV261TestJSON-1732144160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2079007804", "id": 596472521, "os-flavor-access:is_public": "True"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:40.885298 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31255863-1d62-4c64-8f16-f17fac5148d3 tempest-FlavorsV261TestJSON-1732144160 tempest-FlavorsV261TestJSON-1732144160-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.361936 Oct 04 10:59:40.886297 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 88/172] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 10:59:40 2022] POST /compute/v2.1/flavors => generated 465 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:40.894756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-fee16ae7-8445-4ab7-ad1f-8647e8376b22 req-bbc32424-c710-48ef-b594-90596a84971e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58172c5-7f3b-4513-a108-c2e39beaaad3", "name": "network-vif-plugged", "status": "completed", "tag": "35edc9b1-f0f2-4c9f-8698-b45bfcccb2fa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:40.907417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fee16ae7-8445-4ab7-ad1f-8647e8376b22 req-bbc32424-c710-48ef-b594-90596a84971e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:40.908311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fee16ae7-8445-4ab7-ad1f-8647e8376b22 req-bbc32424-c710-48ef-b594-90596a84971e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:40.908953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fee16ae7-8445-4ab7-ad1f-8647e8376b22 req-bbc32424-c710-48ef-b594-90596a84971e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:40.922937 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-fee16ae7-8445-4ab7-ad1f-8647e8376b22 req-bbc32424-c710-48ef-b594-90596a84971e service nova] Creating event network-vif-plugged:35edc9b1-f0f2-4c9f-8698-b45bfcccb2fa for instance c58172c5-7f3b-4513-a108-c2e39beaaad3 on n-h1-791135-8 Oct 04 10:59:40.929522 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-fee16ae7-8445-4ab7-ad1f-8647e8376b22 req-bbc32424-c710-48ef-b594-90596a84971e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041813 Oct 04 10:59:40.930454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 89/173] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:40.982979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:41.006055 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19d7a713-8ff6-4426-9863-bb70a450bc0e tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.249198 Oct 04 10:59:41.006673 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 85/174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:40 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:41.181248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5bffc608-c064-47c8-8830-843ef9da4b15 tempest-FlavorsV261TestJSON-339938907 tempest-FlavorsV261TestJSON-339938907-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:41.191508 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5bffc608-c064-47c8-8830-843ef9da4b15 tempest-FlavorsV261TestJSON-339938907 tempest-FlavorsV261TestJSON-339938907-project] 10.222.0.23 "GET /compute/v2.1/flavors/596472521" status: 200 len: 465 microversion: 2.61 time: 0.259649 Oct 04 10:59:41.192064 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 90/175] 10.222.0.23 () {60 vars in 1196 bytes} [Tue Oct 4 10:59:40 2022] GET /compute/v2.1/flavors/596472521 => generated 465 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:41.207179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-724605dd-9e4b-4ca5-946a-95c55faeff6e tempest-FlavorsV261TestJSON-1732144160 tempest-FlavorsV261TestJSON-1732144160-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:41.224951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:41.225876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:41.234798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:41.235306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:41.235742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:41.236456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:41.237019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:41.237470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:41.253459 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-724605dd-9e4b-4ca5-946a-95c55faeff6e tempest-FlavorsV261TestJSON-1732144160 tempest-FlavorsV261TestJSON-1732144160-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/596472521" status: 200 len: 466 microversion: 2.61 time: 0.051069 Oct 04 10:59:41.255180 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 86/176] 10.222.0.23 () {62 vars in 1216 bytes} [Tue Oct 4 10:59:41 2022] PUT /compute/v2.1/flavors/596472521 => generated 466 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:41.288857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:41.289546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:41.302561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:41.303518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:41.304308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:41.305262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:41.305932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:41.306522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:41.410236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:41.419562 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5449b2ec-551e-4b2e-b216-65dd78dc6c0c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1321 microversion: 2.1 time: 0.144947 Oct 04 10:59:41.420147 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 87/177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:41 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:41.430015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c0e7327-8682-4726-8373-ddacd51483b2 tempest-FlavorsV261TestJSON-339938907 tempest-FlavorsV261TestJSON-339938907-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:41.480859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:41.488300 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c0e7327-8682-4726-8373-ddacd51483b2 tempest-FlavorsV261TestJSON-339938907 tempest-FlavorsV261TestJSON-339938907-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 7154 microversion: 2.61 time: 0.065837 Oct 04 10:59:41.497934 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93adc89e-fc33-4e20-aeb6-23824c770327 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1339 microversion: 2.1 time: 0.275281 Oct 04 10:59:41.498331 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 88/178] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 10:59:41 2022] GET /compute/v2.1/flavors/detail => generated 7154 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:41.498802 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 91/179] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:41 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1339 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:41.520555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfcbfb71-929b-4e15-9f67-c8c1cc29c040 tempest-FlavorsV261TestJSON-339938907 tempest-FlavorsV261TestJSON-339938907-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:41.543852 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfcbfb71-929b-4e15-9f67-c8c1cc29c040 tempest-FlavorsV261TestJSON-339938907 tempest-FlavorsV261TestJSON-339938907-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.61 time: 0.027359 Oct 04 10:59:41.557450 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 89/180] 10.222.0.23 () {60 vars in 1166 bytes} [Tue Oct 4 10:59:41 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:41.567021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68c447f3-a1bc-4af0-9048-3f9fc1d77b87 tempest-FlavorsV261TestJSON-1732144160 tempest-FlavorsV261TestJSON-1732144160-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:41.588923 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68c447f3-a1bc-4af0-9048-3f9fc1d77b87 tempest-FlavorsV261TestJSON-1732144160 tempest-FlavorsV261TestJSON-1732144160-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/596472521" status: 202 len: 0 microversion: 2.61 time: 0.028254 Oct 04 10:59:41.593332 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 92/181] 10.222.0.23 () {60 vars in 1199 bytes} [Tue Oct 4 10:59:41 2022] DELETE /compute/v2.1/flavors/596472521 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:59:41.598614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-973429e4-2bc9-4599-b2bc-92c6c07d95f6 tempest-FlavorsV261TestJSON-1732144160 tempest-FlavorsV261TestJSON-1732144160-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:41.622265 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-973429e4-2bc9-4599-b2bc-92c6c07d95f6 tempest-FlavorsV261TestJSON-1732144160 tempest-FlavorsV261TestJSON-1732144160-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6698 microversion: 2.61 time: 0.026988 Oct 04 10:59:41.623518 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 90/182] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 10:59:41 2022] GET /compute/v2.1/flavors/detail => generated 6698 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:42.034588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:42.035284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:42.048769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:42.049265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:42.050498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:42.050498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:42.050881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:42.051456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:42.291363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:42.307459 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31219276-ff81-4fed-a395-ef2372056c20 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1338 microversion: 2.1 time: 0.278284 Oct 04 10:59:42.317988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 93/183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:42 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1338 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:42.444827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:42.446097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:42.455529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:42.456299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:42.456947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:42.457955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:42.458648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:42.459290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:42.525389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:42.526484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:42.537377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:42.549167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:42.551082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:42.552252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:42.552730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:42.553162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:42.559270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:42.573184 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed464ba6-9ef2-48e5-af45-06663d3a88e2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1321 microversion: 2.1 time: 0.132440 Oct 04 10:59:42.573802 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 91/184] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:42 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1321 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:42.717044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:42.725668 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31133b12-e181-40e4-9fa3-961ab255890d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1489 microversion: 2.1 time: 0.204628 Oct 04 10:59:42.736485 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 94/185] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:42 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1489 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:43.103281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:43.103773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:43.110576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.111324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.112093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.113975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.114442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.114936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.184349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:59:43.292518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 10:59:43.293339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7b8ad52-e619-41a6-b217-335658d847fe tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 10:59:43.294784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.295592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.296025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.296951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.297488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.297907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.307302 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.compute.rpcapi [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 10:59:43.308179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] Releasing lock "compute-rpcapi-router" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 10:59:43.331724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:43.333179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:43.341955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.342725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.343325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.345015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.345668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.346133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.348654 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1de95086-d38e-41ff-bdde-411964eca22b None None] 10.222.0.23 "DELETE /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 204 len: 0 microversion: 2.1 time: 0.601436 Oct 04 10:59:43.353444 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 92/186] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 10:59:42 2022] DELETE /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:59:43.360634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:43.361686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:43.368887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.369640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.370426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.371725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.372428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.373041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.580353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:43.583873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:43.590604 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7dfcd2c-c6c2-4877-ad3c-3cbd6b59682b tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1488 microversion: 2.1 time: 0.263855 Oct 04 10:59:43.591504 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 95/187] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:43 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1488 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:43.591881 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2810372a-2429-4f90-ad84-75c3edc5ee99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1495 microversion: 2.1 time: 0.236844 Oct 04 10:59:43.601748 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 93/188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:43 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1495 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:43.608166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:43.609160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:43.616556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.617041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.617618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.618363 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.618901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.619324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.683255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:43.692541 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4bfe2a98-42ae-4932-bee5-7c90d8a09377 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1321 microversion: 2.1 time: 0.089752 Oct 04 10:59:43.693235 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 94/189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:43 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1321 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:43.697873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:43.698563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:43.706377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.707041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.707465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.708151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:43.708594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:43.709017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:43.735984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1384510696", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:43.799217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:59:44.086547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:59:44.087458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:59:44.087840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:59:44.088237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:59:44.089061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:59:44.099593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.100083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.100500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.101302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.101792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.102192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.122297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:59:44.127405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for user b024d221d4784e2399fd7676706cbc04 and project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:59:44.139346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:59:44.142000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:59:44.149415 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-edac6d77-f795-4caf-9ce6-4d64bda62b6d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1639 microversion: 2.1 time: 0.454957 Oct 04 10:59:44.150801 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 95/190] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:43 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1639 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:44.173952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:44.174616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:44.180935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.181570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.182097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.182889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.183465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.183979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.194398 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28d7fc17-cddb-48a2-bbd7-93b540bd61c8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601389 Oct 04 10:59:44.195701 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 96/191] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:59:44.207003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1bd8090-bbd4-4aef-b672-db103b78ec98 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:44.207877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1bd8090-bbd4-4aef-b672-db103b78ec98 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:44.216433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 10:59:44.265661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f1bd8090-bbd4-4aef-b672-db103b78ec98 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:44.274553 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1bd8090-bbd4-4aef-b672-db103b78ec98 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1213 microversion: 2.1 time: 0.071800 Oct 04 10:59:44.276192 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 97/192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:44 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:44.517406 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5ccd997-8f6d-494e-b0d8-5db9e7ba7093 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 204 len: 0 microversion: 2.1 time: 0.347103 Oct 04 10:59:44.518532 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 96/193] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 10:59:44 2022] DELETE /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 10:59:44.526667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:44.527270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:44.536134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.536624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.537212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.537913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.538188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.538604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.622612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:44.623317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:44.630724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.631427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.631866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.632565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.633856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.634306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.727040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:44.740816 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff8bab62-297f-4b63-ba45-68b872be999f tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1494 microversion: 2.1 time: 0.217913 Oct 04 10:59:44.741416 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 98/194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:44 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1494 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:44.746985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:44.748162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:44.756617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.757091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.757558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.758246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.758715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.759296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.816689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:44.820688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:44.825341 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4d829ba-ed77-42a4-8282-c367d6f08f2b tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1495 microversion: 2.1 time: 0.207147 Oct 04 10:59:44.825962 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 97/195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:44 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1495 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:44.832981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:44.842647 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b7bda87-62a8-4c13-b438-29352d0bdd45 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1321 microversion: 2.1 time: 0.099762 Oct 04 10:59:44.843214 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 99/196] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:44 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1321 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:44.945298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Action: 'update', calling method: .version_select at 0x7f71d5310dc0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:44.953265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) {{(pid=122408) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 10:59:44.954164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.954625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.955047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.961765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.962228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.962651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.969711 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] HTTP exception thrown: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Request method failure captured: Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700 HTTP/1.1 Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 56 Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIgP6-dGQXDew6_MuW1H_6I1_rKCwEfcspJZreKE-lHQPN1EhsRQCqpdFi08qVDtlH_qpg1Wy89pMbs_vQNclPtcZzBw1Bq_KS56cB37ERfABJYJGZMX9V_THaigOlcM1LuLAPmdo8RIaWACjY2eStEYCOmRpZKcj3LGpM2HLJncYk Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 8909fdd829394db8a7f5490244bcc127 Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:44.973900 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8909fdd829394db8a7f5490244bcc127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8909fdd829394db8a7f5490244bcc127"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8909fdd829394db8a7f5490244bcc127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8909fdd829394db8a7f5490244bcc127"}]}] Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 8909fdd829394db8a7f5490244bcc127 Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 02db865b6e5a4cdc84e6dba2b15a41d5 Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 10:59:44.975317 n-d-791135-8 devstack@n-api.service[122408]: exception: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'a8faa8e7-cde5-49b7-818c-78ce5c095700', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:44.976091 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:44.977446 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:44.978673 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:44.978673 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:44.978673 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:44.978673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Returning 404 to user: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:44.978673 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-201349c2-dad5-444f-af56-1a9919f1f202 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700" status: 404 len: 110 microversion: 2.53 time: 0.148381 Oct 04 10:59:44.978673 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 98/197] 10.222.0.23 () {62 vars in 1309 bytes} [Tue Oct 4 10:59:44 2022] PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700 => generated 110 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:59:44.985759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Action: 'update', calling method: .version_select at 0x7f71d5434a60>, body: {"status": "disabled"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:44.989283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.989799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.990235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:44.997478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:44.997950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:44.998388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.004963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] HTTP exception thrown: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Request method failure captured: Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700 HTTP/1.1 Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 22 Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIgP6-dGQXDew6_MuW1H_6I1_rKCwEfcspJZreKE-lHQPN1EhsRQCqpdFi08qVDtlH_qpg1Wy89pMbs_vQNclPtcZzBw1Bq_KS56cB37ERfABJYJGZMX9V_THaigOlcM1LuLAPmdo8RIaWACjY2eStEYCOmRpZKcj3LGpM2HLJncYk Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 8909fdd829394db8a7f5490244bcc127 Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:45.009104 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8909fdd829394db8a7f5490244bcc127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8909fdd829394db8a7f5490244bcc127"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8909fdd829394db8a7f5490244bcc127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8909fdd829394db8a7f5490244bcc127"}]}] Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 8909fdd829394db8a7f5490244bcc127 Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 02db865b6e5a4cdc84e6dba2b15a41d5 Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: {"status": "disabled"} Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: exception: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.010594 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a8faa8e7-cde5-49b7-818c-78ce5c095700', 'body': {'status': 'disabled'}} Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.011516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:45.012832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:45.013970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.013970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.013970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Returning 404 to user: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:45.013970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d43b7866-d267-4fa9-b919-9aedb2708e72 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700" status: 404 len: 110 microversion: 2.53 time: 0.029257 Oct 04 10:59:45.013970 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 100/198] 10.222.0.23 () {62 vars in 1309 bytes} [Tue Oct 4 10:59:44 2022] PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700 => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:59:45.019997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4df3040>, body: {"status": "enabled"} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:45.023460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.023930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.024353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.029719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.030174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.030591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.035690 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] HTTP exception thrown: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Request method failure captured: Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700 HTTP/1.1 Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 21 Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIgP6-dGQXDew6_MuW1H_6I1_rKCwEfcspJZreKE-lHQPN1EhsRQCqpdFi08qVDtlH_qpg1Wy89pMbs_vQNclPtcZzBw1Bq_KS56cB37ERfABJYJGZMX9V_THaigOlcM1LuLAPmdo8RIaWACjY2eStEYCOmRpZKcj3LGpM2HLJncYk Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 8909fdd829394db8a7f5490244bcc127 Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:45.037230 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8909fdd829394db8a7f5490244bcc127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8909fdd829394db8a7f5490244bcc127"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8909fdd829394db8a7f5490244bcc127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8909fdd829394db8a7f5490244bcc127"}]}] Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 8909fdd829394db8a7f5490244bcc127 Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619 Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 02db865b6e5a4cdc84e6dba2b15a41d5 Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: {"status": "enabled"} Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: exception: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.038656 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'a8faa8e7-cde5-49b7-818c-78ce5c095700', 'body': {'status': 'enabled'}} Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.039523 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:45.040602 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:45.041656 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. Oct 04 10:59:45.041656 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.041656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Returning 404 to user: Service a8faa8e7-cde5-49b7-818c-78ce5c095700 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:45.041656 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e081ec76-951b-4e06-ad81-67b46eb1883a tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700" status: 404 len: 110 microversion: 2.53 time: 0.022367 Oct 04 10:59:45.041656 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 99/199] 10.222.0.23 () {62 vars in 1309 bytes} [Tue Oct 4 10:59:45 2022] PUT /compute/v2.1/os-services/a8faa8e7-cde5-49b7-818c-78ce5c095700 => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 10:59:45.048723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13bf3d97-cbcb-42c6-883b-04b1fa7edec7 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.052118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bf3d97-cbcb-42c6-883b-04b1fa7edec7 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.052603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bf3d97-cbcb-42c6-883b-04b1fa7edec7 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.053070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bf3d97-cbcb-42c6-883b-04b1fa7edec7 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.053823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bf3d97-cbcb-42c6-883b-04b1fa7edec7 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.054279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bf3d97-cbcb-42c6-883b-04b1fa7edec7 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.054703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bf3d97-cbcb-42c6-883b-04b1fa7edec7 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.078749 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13bf3d97-cbcb-42c6-883b-04b1fa7edec7 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1260 microversion: 2.53 time: 0.034275 Oct 04 10:59:45.079302 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 101/200] 10.222.0.23 () {60 vars in 1178 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/os-services => generated 1260 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:45.091573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4142103-fbfc-4455-ae22-0ae563697dce tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.095795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4142103-fbfc-4455-ae22-0ae563697dce tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.096269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4142103-fbfc-4455-ae22-0ae563697dce tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.096732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4142103-fbfc-4455-ae22-0ae563697dce tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.097511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4142103-fbfc-4455-ae22-0ae563697dce tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.097961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4142103-fbfc-4455-ae22-0ae563697dce tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.098379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4142103-fbfc-4455-ae22-0ae563697dce tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.122139 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4142103-fbfc-4455-ae22-0ae563697dce tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1260 microversion: 2.53 time: 0.034175 Oct 04 10:59:45.122691 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 100/201] 10.222.0.23 () {60 vars in 1211 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1260 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:45.136233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b775d9e3-17be-470c-ad9f-a0671261d900 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.139647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b775d9e3-17be-470c-ad9f-a0671261d900 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.140134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b775d9e3-17be-470c-ad9f-a0671261d900 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.141175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b775d9e3-17be-470c-ad9f-a0671261d900 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.141945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b775d9e3-17be-470c-ad9f-a0671261d900 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.142400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b775d9e3-17be-470c-ad9f-a0671261d900 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.142899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b775d9e3-17be-470c-ad9f-a0671261d900 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.166478 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b775d9e3-17be-470c-ad9f-a0671261d900 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1260 microversion: 2.53 time: 0.033769 Oct 04 10:59:45.167054 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 102/202] 10.222.0.23 () {60 vars in 1178 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/os-services => generated 1260 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:45.179223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-634b7b5d-bbe1-4083-b75c-3e4fd4c4f48f tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.182760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634b7b5d-bbe1-4083-b75c-3e4fd4c4f48f tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.183239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634b7b5d-bbe1-4083-b75c-3e4fd4c4f48f tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.183673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634b7b5d-bbe1-4083-b75c-3e4fd4c4f48f tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.184400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634b7b5d-bbe1-4083-b75c-3e4fd4c4f48f tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.184847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634b7b5d-bbe1-4083-b75c-3e4fd4c4f48f tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.185267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-634b7b5d-bbe1-4083-b75c-3e4fd4c4f48f tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.208763 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-634b7b5d-bbe1-4083-b75c-3e4fd4c4f48f tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-791135-8&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.033207 Oct 04 10:59:45.209475 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 101/203] 10.222.0.23 () {60 vars in 1235 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/os-services?host=n-d-791135-8&binary=xxx => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:45.220867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77c3c214-9cb9-48a9-ad56-d0eb0fcd7165 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.224245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c3c214-9cb9-48a9-ad56-d0eb0fcd7165 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.224720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c3c214-9cb9-48a9-ad56-d0eb0fcd7165 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.225149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c3c214-9cb9-48a9-ad56-d0eb0fcd7165 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.225919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c3c214-9cb9-48a9-ad56-d0eb0fcd7165 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.226365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c3c214-9cb9-48a9-ad56-d0eb0fcd7165 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.226778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77c3c214-9cb9-48a9-ad56-d0eb0fcd7165 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.249231 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77c3c214-9cb9-48a9-ad56-d0eb0fcd7165 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1260 microversion: 2.53 time: 0.031959 Oct 04 10:59:45.250361 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 103/204] 10.222.0.23 () {60 vars in 1178 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/os-services => generated 1260 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 10:59:45.262393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-285783ca-54c5-459b-876d-9708456df033 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.266550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285783ca-54c5-459b-876d-9708456df033 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.267030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285783ca-54c5-459b-876d-9708456df033 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.267467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285783ca-54c5-459b-876d-9708456df033 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.268192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285783ca-54c5-459b-876d-9708456df033 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.268644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285783ca-54c5-459b-876d-9708456df033 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.269062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-285783ca-54c5-459b-876d-9708456df033 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.292235 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-285783ca-54c5-459b-876d-9708456df033 tempest-ServicesAdminNegativeV253TestJSON-541175619 tempest-ServicesAdminNegativeV253TestJSON-541175619-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.033416 Oct 04 10:59:45.293142 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 102/205] 10.222.0.23 () {60 vars in 1239 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:45.300006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.300763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:45.307263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.307741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.308190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.308915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.309423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.309843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.370840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:45.379125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d2c8f752-1dad-423e-a18b-9dcf7cec66d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1217 microversion: 2.1 time: 0.083054 Oct 04 10:59:45.392828 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 104/206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:45.407776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbe7d112-d23d-4def-8d6a-e75d3b29258b tempest-ServicesAdminNegativeV253TestJSON-1756250700 tempest-ServicesAdminNegativeV253TestJSON-1756250700-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.412552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bbe7d112-d23d-4def-8d6a-e75d3b29258b tempest-ServicesAdminNegativeV253TestJSON-1756250700 tempest-ServicesAdminNegativeV253TestJSON-1756250700-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4de03143f11f4a8c9ba68e0d5822832e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa50d489a4d4138873aa16568f8295b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbe7d112-d23d-4def-8d6a-e75d3b29258b tempest-ServicesAdminNegativeV253TestJSON-1756250700 tempest-ServicesAdminNegativeV253TestJSON-1756250700-project] Request method failure captured: Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIflKUsqPqhKKzr3OQhVx3eyAIt93vVylqz5we6rVMNb56Bgak5a1F-5EWDoXLM0hRGdo5g2IdaptKPqEsH1OC7A8la7uIomC0hoqyeoUXv5Idm4I73EIdBH4StytxjSuWUIy9hgKUxzyxqa7Ef52zipABdPw9tFED3hjGscxpuz3I Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: aaa50d489a4d4138873aa16568f8295b Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1756250700 Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 10:59:45.414388 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aaa50d489a4d4138873aa16568f8295b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aaa50d489a4d4138873aa16568f8295b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aaa50d489a4d4138873aa16568f8295b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aaa50d489a4d4138873aa16568f8295b"}]}] Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1756250700 Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: aaa50d489a4d4138873aa16568f8295b Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1756250700 Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1756250700-project Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4de03143f11f4a8c9ba68e0d5822832e Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1756250700-project Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 10:59:45.415781 n-d-791135-8 devstack@n-api.service[122408]: action_args: {} Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:45.416538 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 10:59:45.417610 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:45.418636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbe7d112-d23d-4def-8d6a-e75d3b29258b tempest-ServicesAdminNegativeV253TestJSON-1756250700 tempest-ServicesAdminNegativeV253TestJSON-1756250700-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:45.418636 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bbe7d112-d23d-4def-8d6a-e75d3b29258b tempest-ServicesAdminNegativeV253TestJSON-1756250700 tempest-ServicesAdminNegativeV253TestJSON-1756250700-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.114365 Oct 04 10:59:45.418636 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 103/207] 10.222.0.23 () {60 vars in 1178 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 116 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 04 10:59:45.770348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.771965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:45.780496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.782356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.783034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.783924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.784845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.785507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.849880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:45.850794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:45.863442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.864220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.864970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:45.866503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:45.867532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:45.868141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:46.409211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:46.417147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-648865bc-b732-420b-983d-d58e1ed8a659 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1494 microversion: 2.1 time: 0.652514 Oct 04 10:59:46.417981 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 105/208] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1494 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:46.422946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:46.431390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:46.440657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:46.441158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:46.441624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:46.442333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:46.442783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:46.446062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:46.472598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:46.514717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:46.527772 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc875465-1996-4466-8551-ea992db294cd tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 200 len: 1495 microversion: 2.1 time: 0.682897 Oct 04 10:59:46.541581 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 104/209] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:45 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 1495 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:46.544364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ab113f19-4877-4d7f-ab2b-c9a638d5d49d req-fb201ccd-330e-44d3-99ec-a9e2df966658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587b5421-7b9c-497c-a477-5d6147ee51ab", "name": "network-vif-deleted", "tag": "32fc41b9-715a-4573-8d39-63880356a855"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:46.566347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab113f19-4877-4d7f-ab2b-c9a638d5d49d req-fb201ccd-330e-44d3-99ec-a9e2df966658 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:46.566975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab113f19-4877-4d7f-ab2b-c9a638d5d49d req-fb201ccd-330e-44d3-99ec-a9e2df966658 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:46.567404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ab113f19-4877-4d7f-ab2b-c9a638d5d49d req-fb201ccd-330e-44d3-99ec-a9e2df966658 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:46.600324 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ab113f19-4877-4d7f-ab2b-c9a638d5d49d req-fb201ccd-330e-44d3-99ec-a9e2df966658 service nova] Creating event network-vif-deleted:32fc41b9-715a-4573-8d39-63880356a855 for instance 587b5421-7b9c-497c-a477-5d6147ee51ab on n-h1-791135-8 Oct 04 10:59:46.607827 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ab113f19-4877-4d7f-ab2b-c9a638d5d49d req-fb201ccd-330e-44d3-99ec-a9e2df966658 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070801 Oct 04 10:59:46.608564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:46.609484 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 105/210] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:46.617426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:46.618362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:46.619791 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1a18f83-024c-415c-b332-82dc7bd533bb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1321 microversion: 2.1 time: 0.200618 Oct 04 10:59:46.620895 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 106/211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:46 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:46.626722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:46.627416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:46.628036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:46.628917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:46.629595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:46.630197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:46.680794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:46.744343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:46.754189 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-205e8607-2352-46e2-9318-e1f2b1c87416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1271 microversion: 2.1 time: 0.143282 Oct 04 10:59:46.754774 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 106/212] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:46 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:47.368991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-28d0b81c-d83a-482b-a415-b8c88f9b1f0f req-d2d65fde-aadf-4eea-9ad7-f8cf496a761c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58172c5-7f3b-4513-a108-c2e39beaaad3", "name": "network-vif-deleted", "tag": "35edc9b1-f0f2-4c9f-8698-b45bfcccb2fa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:47.389545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-28d0b81c-d83a-482b-a415-b8c88f9b1f0f req-d2d65fde-aadf-4eea-9ad7-f8cf496a761c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.390245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-28d0b81c-d83a-482b-a415-b8c88f9b1f0f req-d2d65fde-aadf-4eea-9ad7-f8cf496a761c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.390972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-28d0b81c-d83a-482b-a415-b8c88f9b1f0f req-d2d65fde-aadf-4eea-9ad7-f8cf496a761c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:47.431946 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-28d0b81c-d83a-482b-a415-b8c88f9b1f0f req-d2d65fde-aadf-4eea-9ad7-f8cf496a761c service nova] Creating event network-vif-deleted:35edc9b1-f0f2-4c9f-8698-b45bfcccb2fa for instance c58172c5-7f3b-4513-a108-c2e39beaaad3 on n-h1-791135-8 Oct 04 10:59:47.439293 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-28d0b81c-d83a-482b-a415-b8c88f9b1f0f req-d2d65fde-aadf-4eea-9ad7-f8cf496a761c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073349 Oct 04 10:59:47.440181 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 107/213] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:47.440686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:47.441315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:47.457104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.457627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.458067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:47.458774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.459227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.459647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:47.560455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:47.563375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:47.578587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.579542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.580180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:47.582783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.583438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.583964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:47.605741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d2501472714b07a145134548b9d347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad230590d2b4600b928951aa8c253ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:47.617695 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] HTTP exception thrown: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Request method failure captured: Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab HTTP/1.1 Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8gBqOGoyRrsctV1eUqhU1BlPJ3ao5RTKGHa4UJCfSS12bpWhkW3Ufa22Nv-jePgPGGO0j4SwEd_zj-xfvKcheGE77OPgff7aNzLI5SN8mBuBTwBiiFXSVQMT_rTim1rrBKEKO1Arr4HDxM0_DZQ3xIfqHpIbOWc-G6n1PINX5FeA Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:47.621280 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a702891ff9284b77b7d431d2ce819cc2"}]}] Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: dd2260573f8342a2ae252c245603c85f Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 10:59:47.622476 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '587b5421-7b9c-497c-a477-5d6147ee51ab'} Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:47.623119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 10:59:47.634267 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:47.635410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Returning 404 to user: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:47.635492 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82e1ac32-163f-467a-a565-af1ecd7a0a39 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 200 len: 1323 microversion: 2.1 time: 0.184353 Oct 04 10:59:47.635578 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3da1ff4-e3dd-4dac-b963-31a6a717a041 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 404 len: 111 microversion: 2.1 time: 0.072804 Oct 04 10:59:47.635669 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 107/214] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:47 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 1323 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:47.635753 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 108/215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:47 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:47.646576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:47.647193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:47.660564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.661053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.661528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:47.662234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.662684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.663112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:47.778398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:47.780421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:47.795366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.796310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.800322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:47.803895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:47.804952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:47.807115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:48.162142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:48.171023 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f8657c0-b012-4ac7-8017-1a652229e43c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 0.528608 Oct 04 10:59:48.186701 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 108/216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:47 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:48.195390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2108394551", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:48.236860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:48.251487 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7da8a09-2729-4f33-9e00-5910327aceeb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1313 microversion: 2.1 time: 0.477435 Oct 04 10:59:48.252521 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 109/217] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:47 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:48.272527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 10:59:48.650724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:48.652500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:48.662295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 10:59:48.663866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 10:59:48.664951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 10:59:48.665502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 10:59:48.666138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 10:59:48.674921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:48.675494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:48.676811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:48.679390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:48.680319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:48.681008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:48.681718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:48.686849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:48.687639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:48.688652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:48.689344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:48.690009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:48.709392 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] HTTP exception thrown: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Request method failure captured: Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 HTTP/1.1 Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH6BmmwyTrc7ivGBjEd_6fjZPgnd9Va9EKGIboXxEVP3GGJkPXpVqCoq_5sHuZEGWXSedOnXUu5HxSJhZHp5RxAw8dhylkyJAQU-DdF9sUyhQWQQa6ZNR-BKcrR7OCGmmleAy1ICkxGbAJHCKsuCnC7LR-KKwCtK0ZtQcv9feg2fhw Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 5ad230590d2b4600b928951aa8c253ec Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:48.715138 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5ad230590d2b4600b928951aa8c253ec"}]}] Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 5ad230590d2b4600b928951aa8c253ec Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminTestJSON-1088512117-project Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e2d2501472714b07a145134548b9d347 Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminTestJSON-1088512117-project Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:48.716601 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c58172c5-7f3b-4513-a108-c2e39beaaad3'} Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:48.717268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:48.719343 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:48.720277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Returning 404 to user: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:48.720277 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff5cdd6a-ad3a-4d09-a1c7-26e61344b4b2 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 404 len: 111 microversion: 2.1 time: 0.070735 Oct 04 10:59:48.728203 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 110/218] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:48 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:59:48.733312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d070491-11f3-404e-bbd9-eb35b80d6d4f tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:48.735973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Getting quotas for project a702891ff9284b77b7d431d2ce819cc2. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 10:59:48.747890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Getting quotas for user dd2260573f8342a2ae252c245603c85f and project a702891ff9284b77b7d431d2ce819cc2. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 10:59:48.764951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SAVEPOINT=3,nova_api:INSERT=1,nova_api:RELEASE=3,nova_api:SELECT=90,nova_api:UPDATE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:48.767168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 10:59:48.770408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 10:59:48.779628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d070491-11f3-404e-bbd9-eb35b80d6d4f tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:48.780134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d070491-11f3-404e-bbd9-eb35b80d6d4f tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:48.780589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d070491-11f3-404e-bbd9-eb35b80d6d4f tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:48.851256 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34216474-9891-4b95-9188-55daeebaee57 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662570 Oct 04 10:59:48.852442 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 109/219] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 10:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 10:59:48.857324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ee706317-ac00-43bd-bfdf-0a0d416f29f7 req-30cb7c85-9003-4bc8-b8fc-b372d2d9d0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f801b4d9-89bd-4232-9031-fbb661178744", "tag": "ad4bec16-719d-4826-bf8e-6aefb10f7672"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:48.868735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ee706317-ac00-43bd-bfdf-0a0d416f29f7 req-30cb7c85-9003-4bc8-b8fc-b372d2d9d0a9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:48.869541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ee706317-ac00-43bd-bfdf-0a0d416f29f7 req-30cb7c85-9003-4bc8-b8fc-b372d2d9d0a9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:48.870270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ee706317-ac00-43bd-bfdf-0a0d416f29f7 req-30cb7c85-9003-4bc8-b8fc-b372d2d9d0a9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:48.882147 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ee706317-ac00-43bd-bfdf-0a0d416f29f7 req-30cb7c85-9003-4bc8-b8fc-b372d2d9d0a9 service nova] Creating event network-changed:ad4bec16-719d-4826-bf8e-6aefb10f7672 for instance f801b4d9-89bd-4232-9031-fbb661178744 on n-h2-791135-8 Oct 04 10:59:48.888228 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ee706317-ac00-43bd-bfdf-0a0d416f29f7 req-30cb7c85-9003-4bc8-b8fc-b372d2d9d0a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034341 Oct 04 10:59:48.892443 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 110/220] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:48.902741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d58be42-d4c3-438f-bdb3-4b7c61d344ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:48.913699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d58be42-d4c3-438f-bdb3-4b7c61d344ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:49.022321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d58be42-d4c3-438f-bdb3-4b7c61d344ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:49.031519 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d58be42-d4c3-438f-bdb3-4b7c61d344ef tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1220 microversion: 2.1 time: 0.136511 Oct 04 10:59:49.032665 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 111/221] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:48 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:49.201152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:49.202249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:49.222562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:49.223063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:49.223499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:49.224209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:49.224664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:49.225085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:49.348836 n-d-791135-8 devstack@n-api.service[122409]: WARNING nova.scheduler.client.report [None req-7d070491-11f3-404e-bbd9-eb35b80d6d4f tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] [req-d5b70f39-8ab3-4911-9b22-83505a4ddbae] Failed to update aggregates to [] for resource provider with UUID d85a362f-acce-4a7f-b884-9b78989b5ab1. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-d5b70f39-8ab3-4911-9b22-83505a4ddbae"}]} Oct 04 10:59:49.417045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:49.433341 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e378fc96-f75d-4c74-a643-6e86dc70c2a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 0.237533 Oct 04 10:59:49.434769 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 112/222] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:49 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:49.440988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:49.441767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:49.450335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:49.450852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:49.451486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:49.452349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:49.452844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:49.453431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:49.474132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:49.499540 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d070491-11f3-404e-bbd9-eb35b80d6d4f tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.769356 Oct 04 10:59:49.501545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 111/223] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:49.507845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-fafb4071-c03e-4c46-9438-938ee7fedec1 req-2cdd418d-a8e0-453c-8d38-2f7d4d4da721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5981b8-d0e7-43d1-89ed-0b1186788807", "tag": "5f86481a-fa5c-4dba-8d67-849aa98cd0b5"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:49.518792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fafb4071-c03e-4c46-9438-938ee7fedec1 req-2cdd418d-a8e0-453c-8d38-2f7d4d4da721 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:49.519433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fafb4071-c03e-4c46-9438-938ee7fedec1 req-2cdd418d-a8e0-453c-8d38-2f7d4d4da721 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:49.520052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fafb4071-c03e-4c46-9438-938ee7fedec1 req-2cdd418d-a8e0-453c-8d38-2f7d4d4da721 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:49.533632 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-fafb4071-c03e-4c46-9438-938ee7fedec1 req-2cdd418d-a8e0-453c-8d38-2f7d4d4da721 service nova] Creating event network-changed:5f86481a-fa5c-4dba-8d67-849aa98cd0b5 for instance be5981b8-d0e7-43d1-89ed-0b1186788807 on n-h2-791135-8 Oct 04 10:59:49.538634 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-fafb4071-c03e-4c46-9438-938ee7fedec1 req-2cdd418d-a8e0-453c-8d38-2f7d4d4da721 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035144 Oct 04 10:59:49.539217 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 112/224] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:49.544082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e9e5d37-1ec8-4366-b401-1f98dd2b630a tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:49.587577 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e9e5d37-1ec8-4366-b401-1f98dd2b630a tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.046834 Oct 04 10:59:49.588152 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 113/225] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:49 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:49.601120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-527668b7-47e1-46e6-bb5a-bf1ad3666797 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1085997872"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:49.604624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-527668b7-47e1-46e6-bb5a-bf1ad3666797 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid 090e75ba-5d9a-49c3-8902-74f71a4cde66 for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:49.637947 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-527668b7-47e1-46e6-bb5a-bf1ad3666797 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041004 Oct 04 10:59:49.639482 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 114/226] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:49.654108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6bc80777-2b48-4bf4-9db0-e52fe0e8c0f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:49.671546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bc80777-2b48-4bf4-9db0-e52fe0e8c0f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:49.672303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bc80777-2b48-4bf4-9db0-e52fe0e8c0f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:49.672900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bc80777-2b48-4bf4-9db0-e52fe0e8c0f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:49.705257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:49.716442 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82af4555-c486-4c13-b13c-9ec3bc9efb00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1313 microversion: 2.1 time: 0.280307 Oct 04 10:59:49.717320 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 113/227] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:49 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:49.818453 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6bc80777-2b48-4bf4-9db0-e52fe0e8c0f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.171026 Oct 04 10:59:49.819114 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 115/228] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:49 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:49.832947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40f6f0a6-5b25-4461-a7b5-96beb4b64a5f tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:49.846254 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40f6f0a6-5b25-4461-a7b5-96beb4b64a5f tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.018898 Oct 04 10:59:49.847397 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 114/229] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 10:59:49 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:49.861683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb88ac98-416c-42e5-a226-3230a764a3f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:49.877693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb88ac98-416c-42e5-a226-3230a764a3f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:49.878354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb88ac98-416c-42e5-a226-3230a764a3f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:49.878794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb88ac98-416c-42e5-a226-3230a764a3f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.059565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:50.060219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:50.071528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.072162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.072775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.073856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.074474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.075161 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb88ac98-416c-42e5-a226-3230a764a3f7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.218419 Oct 04 10:59:50.075282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.076078 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 116/230] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:49 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:50.090205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb888459-83d6-409a-9686-7ae364d7ae11 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:50.119401 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb888459-83d6-409a-9686-7ae364d7ae11 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.035262 Oct 04 10:59:50.120262 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 117/231] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:50 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 10:59:50.131912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b29e1d4-58de-441c-9181-0c4cccde22c2 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-408696412"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:50.135494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-3b29e1d4-58de-441c-9181-0c4cccde22c2 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid 3d3853c8-4635-457b-a08c-e947bb94403d for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:50.156203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b29e1d4-58de-441c-9181-0c4cccde22c2 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.028543 Oct 04 10:59:50.156921 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 118/232] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:50.169848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98ae8890-dbca-4c39-b639-b322d9fb741e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:50.181918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ae8890-dbca-4c39-b639-b322d9fb741e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.182408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ae8890-dbca-4c39-b639-b322d9fb741e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.182851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ae8890-dbca-4c39-b639-b322d9fb741e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.244905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:50.256161 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5bb0a01-8a30-4ba0-85b8-69a2430f9f02 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1272 microversion: 2.1 time: 0.201874 Oct 04 10:59:50.257518 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 115/233] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:50 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:50.335426 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98ae8890-dbca-4c39-b639-b322d9fb741e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.169425 Oct 04 10:59:50.337391 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 119/234] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:50 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:50.348349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73d7bc27-10ef-43cc-82fd-260f66350ce7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:50.359789 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73d7bc27-10ef-43cc-82fd-260f66350ce7 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.014720 Oct 04 10:59:50.360366 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 116/235] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 10:59:50 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:50.372317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c04cab7-40af-41bb-a0c6-9e87763edae0 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:50.384468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c04cab7-40af-41bb-a0c6-9e87763edae0 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.385056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c04cab7-40af-41bb-a0c6-9e87763edae0 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.385581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c04cab7-40af-41bb-a0c6-9e87763edae0 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.455888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:50.456497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:50.462929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.463406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.463830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.464516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.464962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.465402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.512073 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c04cab7-40af-41bb-a0c6-9e87763edae0 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.143729 Oct 04 10:59:50.513506 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 120/236] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:50 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:50.524332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ea22e37-d44a-42b0-88d1-7a5e7a551512 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:50.546323 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ea22e37-d44a-42b0-88d1-7a5e7a551512 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.025658 Oct 04 10:59:50.547015 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 121/237] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:50 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:50.562966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c36a8a2-e205-4864-a575-900e052c5360 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-509517161"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:50.566292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-7c36a8a2-e205-4864-a575-900e052c5360 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid 1b67283a-e69c-488f-8fe3-2dce648abdd7 for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:50.587306 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c36a8a2-e205-4864-a575-900e052c5360 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.029240 Oct 04 10:59:50.593306 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 122/238] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:50.599465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfa59928-c090-4522-a86c-e8679c479ed2 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:50.610880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfa59928-c090-4522-a86c-e8679c479ed2 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.611369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfa59928-c090-4522-a86c-e8679c479ed2 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.611836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfa59928-c090-4522-a86c-e8679c479ed2 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.771941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:50.777436 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfa59928-c090-4522-a86c-e8679c479ed2 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.180970 Oct 04 10:59:50.778339 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 123/239] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:50 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:50.786985 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2b389b1-5e34-4463-9755-5d94df05f6ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 0.334816 Oct 04 10:59:50.787817 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 117/240] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:50 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 10:59:50.789688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:50.792005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:50.794738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f038c6e3-9f46-483a-b2e9-7ec2f6701ebf tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:50.803154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.804718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.805614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.806608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.807238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.807808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.811705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f038c6e3-9f46-483a-b2e9-7ec2f6701ebf tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:50.813701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f038c6e3-9f46-483a-b2e9-7ec2f6701ebf tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:50.814319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f038c6e3-9f46-483a-b2e9-7ec2f6701ebf tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:50.965040 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f038c6e3-9f46-483a-b2e9-7ec2f6701ebf tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.174365 Oct 04 10:59:50.966111 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 118/241] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:50 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:50.978630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-283f17e6-4264-4946-9def-2a6b972428df tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.010141 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-283f17e6-4264-4946-9def-2a6b972428df tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.034813 Oct 04 10:59:51.010767 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 119/242] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:50 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 10:59:51.021882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df57b285-84e2-4378-a080-133ff4e8fc24 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1936581246"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:51.025961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-df57b285-84e2-4378-a080-133ff4e8fc24 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid 2455a02e-0856-4d09-b1d9-d74d92417ea8 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:51.052009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:51.057977 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df57b285-84e2-4378-a080-133ff4e8fc24 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040817 Oct 04 10:59:51.059543 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 120/243] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.059815 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-03bd4565-64df-4f5b-81ff-6fd4a57eb5b7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1313 microversion: 2.1 time: 0.280004 Oct 04 10:59:51.060382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 124/244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:50 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:51.073725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc94325f-000b-4bd8-9e4e-fe1e7b127c71 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Calling method '.version_select at 0x7f71d4df5040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.077748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abbf19e8-6a0c-4bf8-9186-fed98e4a6dab tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.078050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc94325f-000b-4bd8-9e4e-fe1e7b127c71 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.082468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc94325f-000b-4bd8-9e4e-fe1e7b127c71 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.084005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc94325f-000b-4bd8-9e4e-fe1e7b127c71 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.085371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc94325f-000b-4bd8-9e4e-fe1e7b127c71 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.085371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc94325f-000b-4bd8-9e4e-fe1e7b127c71 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.086859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc94325f-000b-4bd8-9e4e-fe1e7b127c71 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.113033 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc94325f-000b-4bd8-9e4e-fe1e7b127c71 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.052413 Oct 04 10:59:51.114044 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 121/245] 10.222.0.23 () {58 vars in 1128 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.120710 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-abbf19e8-6a0c-4bf8-9186-fed98e4a6dab tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.049618 Oct 04 10:59:51.121534 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 125/246] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:51 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:51.130266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3a2a782-83eb-48b4-b601-88c2b1a12a15 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.132621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4410bde7-1792-473d-8903-73184b43f271 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Calling method '.version_select at 0x7f71d4e20160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.138949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4410bde7-1792-473d-8903-73184b43f271 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.141143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4410bde7-1792-473d-8903-73184b43f271 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.142212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4410bde7-1792-473d-8903-73184b43f271 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.143631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4410bde7-1792-473d-8903-73184b43f271 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.144929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4410bde7-1792-473d-8903-73184b43f271 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.145987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4410bde7-1792-473d-8903-73184b43f271 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.147013 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c3a2a782-83eb-48b4-b601-88c2b1a12a15 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3a2a782-83eb-48b4-b601-88c2b1a12a15 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Request method failure captured: Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8T5RGyG4FJWQP1phAa4mjviO8XzHzOwHLTub4mIFsKAFgSrRlp0IcBJWPgYYnersxLTbVZZrTJ19ksAZYfRxCpvhJHrewhWcS-yS1WWSIQODGPI6iMlGTb6OGn7EUdbgW2yl5sIjKbIrMv_rep6YqB-dNQvLfgNeEygMP_W7Mnqw Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: aad99d3b434b4a758179019120c4b7bb Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:51.163924 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aad99d3b434b4a758179019120c4b7bb"}]}] Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: aad99d3b434b4a758179019120c4b7bb Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminTestJSON-110031534-project-admin Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: c010b1da066246719f88d48ad30a1def Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminTestJSON-110031534-project-admin Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: exception: Aggregate 5 could not be found. Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5'} Oct 04 10:59:51.165343 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.166095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.167752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3a2a782-83eb-48b4-b601-88c2b1a12a15 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:51.168858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c3a2a782-83eb-48b4-b601-88c2b1a12a15 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.040380 Oct 04 10:59:51.168858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 126/247] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 10:59:51.175716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0beb244b-ed2e-4327-a539-352e9b3cb63d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.185979 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4410bde7-1792-473d-8903-73184b43f271 tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.063523 Oct 04 10:59:51.186855 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 122/248] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.198328 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0beb244b-ed2e-4327-a539-352e9b3cb63d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0beb244b-ed2e-4327-a539-352e9b3cb63d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Request method failure captured: Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8T5RGyG4FJWQP1phAa4mjviO8XzHzOwHLTub4mIFsKAFgSrRlp0IcBJWPgYYnersxLTbVZZrTJ19ksAZYfRxCpvhJHrewhWcS-yS1WWSIQODGPI6iMlGTb6OGn7EUdbgW2yl5sIjKbIrMv_rep6YqB-dNQvLfgNeEygMP_W7Mnqw Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: aad99d3b434b4a758179019120c4b7bb Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:51.200419 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aad99d3b434b4a758179019120c4b7bb"}]}] Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: aad99d3b434b4a758179019120c4b7bb Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminTestJSON-110031534-project-admin Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: c010b1da066246719f88d48ad30a1def Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminTestJSON-110031534-project-admin Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: exception: Aggregate 5 could not be found. Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5'} Oct 04 10:59:51.201854 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:51.202701 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.203793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.204891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.204891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:51.204891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:51.204891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 10:59:51.204891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.205195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6c224bf-798b-4ccb-9d07-ed24c9505afc tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Calling method '.version_select at 0x7f71d4db0f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.205276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0beb244b-ed2e-4327-a539-352e9b3cb63d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:51.205276 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0beb244b-ed2e-4327-a539-352e9b3cb63d tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.033640 Oct 04 10:59:51.206175 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 127/249] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:51 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 10:59:51.214203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6c224bf-798b-4ccb-9d07-ed24c9505afc tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.214697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6c224bf-798b-4ccb-9d07-ed24c9505afc tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.215194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6c224bf-798b-4ccb-9d07-ed24c9505afc tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.216012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02de3e5c-e880-4e31-9f59-8d3fa4552326 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1458209397", "name": "tempest-test_aggregate-1821960025"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:51.216167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6c224bf-798b-4ccb-9d07-ed24c9505afc tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.216554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6c224bf-798b-4ccb-9d07-ed24c9505afc tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.216975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6c224bf-798b-4ccb-9d07-ed24c9505afc tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.240265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-02de3e5c-e880-4e31-9f59-8d3fa4552326 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid c15e6573-a515-4719-9607-e85ec0ee7824 for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:51.252351 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6c224bf-798b-4ccb-9d07-ed24c9505afc tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.054306 Oct 04 10:59:51.258283 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 123/250] 10.222.0.23 () {58 vars in 1128 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.258864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0203c3a0-f8bd-4ddb-9beb-794c738fe100 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-85004278"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:51.264060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-0203c3a0-f8bd-4ddb-9beb-794c738fe100 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid 4dd7323c-b84a-4510-90af-eaeef3cab909 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:51.271745 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02de3e5c-e880-4e31-9f59-8d3fa4552326 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.059760 Oct 04 10:59:51.272988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 128/251] 10.222.0.23 () {60 vars in 1165 bytes} [Tue Oct 4 10:59:51 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.279246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12f63f64-e095-44e0-a51e-a4fb2175a49b tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Calling method '.version_select at 0x7f71d52d6820>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.288317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12f63f64-e095-44e0-a51e-a4fb2175a49b tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.289116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12f63f64-e095-44e0-a51e-a4fb2175a49b tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.289647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12f63f64-e095-44e0-a51e-a4fb2175a49b tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.306808 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0203c3a0-f8bd-4ddb-9beb-794c738fe100 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.052284 Oct 04 10:59:51.307537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12f63f64-e095-44e0-a51e-a4fb2175a49b tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.308154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12f63f64-e095-44e0-a51e-a4fb2175a49b tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.308906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12f63f64-e095-44e0-a51e-a4fb2175a49b tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.309500 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 124/252] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:51 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.315875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.316748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:51.325112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.325889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.326538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.327419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.328632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.329254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.348825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12f63f64-e095-44e0-a51e-a4fb2175a49b tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h1-791135-8" status: 200 len: 467 microversion: 2.1 time: 0.074648 Oct 04 10:59:51.350653 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 129/253] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-hosts/n-h1-791135-8 => generated 467 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.356042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0812d266-e4f4-4e86-a973-584f5cfeb464 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.380691 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0812d266-e4f4-4e86-a973-584f5cfeb464 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.028539 Oct 04 10:59:51.381666 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 130/254] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:51 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:51.387260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78a9122b-f375-4184-883a-6838f0af3b4e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:51.398893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78a9122b-f375-4184-883a-6838f0af3b4e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.399374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78a9122b-f375-4184-883a-6838f0af3b4e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.399777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78a9122b-f375-4184-883a-6838f0af3b4e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.409408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=12,nova_api:INSERT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:51.474154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:51.488019 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01d0d96d-c20b-459a-93d0-1215b7523d0f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1278 microversion: 2.1 time: 0.176836 Oct 04 10:59:51.489112 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 125/255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:51.498883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28990cd3-2e8b-4570-a15d-c61fc855212d tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Calling method '.version_select at 0x7f71d4df53a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.507887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28990cd3-2e8b-4570-a15d-c61fc855212d tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.508746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28990cd3-2e8b-4570-a15d-c61fc855212d tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.509447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28990cd3-2e8b-4570-a15d-c61fc855212d tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.526908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28990cd3-2e8b-4570-a15d-c61fc855212d tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.527889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28990cd3-2e8b-4570-a15d-c61fc855212d tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.528503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28990cd3-2e8b-4570-a15d-c61fc855212d tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.555601 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78a9122b-f375-4184-883a-6838f0af3b4e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 240 microversion: 2.1 time: 0.172666 Oct 04 10:59:51.556530 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 131/256] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:51 2022] POST /compute/v2.1/os-aggregates/7/action => generated 240 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.562685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ee576ec6-89fe-46c1-834a-eae1537e2fa9 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.571677 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ee576ec6-89fe-46c1-834a-eae1537e2fa9 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ee576ec6-89fe-46c1-834a-eae1537e2fa9 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Request method failure captured: Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8T5RGyG4FJWQP1phAa4mjviO8XzHzOwHLTub4mIFsKAFgSrRlp0IcBJWPgYYnersxLTbVZZrTJ19ksAZYfRxCpvhJHrewhWcS-yS1WWSIQODGPI6iMlGTb6OGn7EUdbgW2yl5sIjKbIrMv_rep6YqB-dNQvLfgNeEygMP_W7Mnqw Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: aad99d3b434b4a758179019120c4b7bb Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:51.574464 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aad99d3b434b4a758179019120c4b7bb"}]}] Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: aad99d3b434b4a758179019120c4b7bb Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminTestJSON-110031534-project-admin Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: c010b1da066246719f88d48ad30a1def Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminTestJSON-110031534-project-admin Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: exception: Aggregate 6 could not be found. Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '6'} Oct 04 10:59:51.575701 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.576417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.577441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ee576ec6-89fe-46c1-834a-eae1537e2fa9 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:51.578496 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ee576ec6-89fe-46c1-834a-eae1537e2fa9 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.018607 Oct 04 10:59:51.578496 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 132/257] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:59:51.583994 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28990cd3-2e8b-4570-a15d-c61fc855212d tempest-HostsAdminTestJSON-1698196469 tempest-HostsAdminTestJSON-1698196469-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h2-791135-8" status: 200 len: 598 microversion: 2.1 time: 0.093580 Oct 04 10:59:51.584892 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 126/258] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-hosts/n-h2-791135-8 => generated 598 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.591787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-087b6bee-715c-4adb-a1cf-98aabe6589a3 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.598643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24f94a54-ab92-481e-90ac-947467217589 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:51.616472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24f94a54-ab92-481e-90ac-947467217589 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.617755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24f94a54-ab92-481e-90ac-947467217589 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.619084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24f94a54-ab92-481e-90ac-947467217589 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.622565 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-087b6bee-715c-4adb-a1cf-98aabe6589a3 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-087b6bee-715c-4adb-a1cf-98aabe6589a3 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Request method failure captured: Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH8T5RGyG4FJWQP1phAa4mjviO8XzHzOwHLTub4mIFsKAFgSrRlp0IcBJWPgYYnersxLTbVZZrTJ19ksAZYfRxCpvhJHrewhWcS-yS1WWSIQODGPI6iMlGTb6OGn7EUdbgW2yl5sIjKbIrMv_rep6YqB-dNQvLfgNeEygMP_W7Mnqw Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: aad99d3b434b4a758179019120c4b7bb Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:51.625149 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aad99d3b434b4a758179019120c4b7bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aad99d3b434b4a758179019120c4b7bb"}]}] Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: aad99d3b434b4a758179019120c4b7bb Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-110031534 Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminTestJSON-110031534-project-admin Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: c010b1da066246719f88d48ad30a1def Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminTestJSON-110031534-project-admin Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: exception: Aggregate 6 could not be found. Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '6'} Oct 04 10:59:51.626818 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:51.627630 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.628838 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.631107 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.631107 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:51.631107 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:51.631107 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 04 10:59:51.631107 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.631107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-087b6bee-715c-4adb-a1cf-98aabe6589a3 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:51.631107 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-087b6bee-715c-4adb-a1cf-98aabe6589a3 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.042964 Oct 04 10:59:51.637615 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 127/259] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:51 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:59:51.645044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca744436-7092-43b3-8cc6-fed59c34c75e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-989913909"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:51.653634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-ca744436-7092-43b3-8cc6-fed59c34c75e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid 05355154-65c2-418c-890a-8d34f8292242 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:51.667917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-24f94a54-ab92-481e-90ac-947467217589 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-791135-8. Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24f94a54-ab92-481e-90ac-947467217589 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Request method failure captured: Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 39 Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH_o9UmiWJl1M9kkYd3paDRcMnXqsjjzVD-rBQ-MUV1DzRhpvHFP7HJ1DEhKtPxYfbxj-7BBLW4yfOjAmj9h6UZE0xnfo3bjlJoILSjo03z1_JCHMzaBSUmX8iHD0x2aNUmDCaCyoPHriOMhQvg0SoIyg34oQUEM79Ibt-LngfsxYw Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:51.681389 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9d1c4879e52477a8a105b55c979583c"}]}] Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 85172c3fedbf4afaa0e0eff313586f45 Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: {"add_host": {"host": "n-h1-791135-8"}} Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:51.682692 n-d-791135-8 devstack@n-api.service[122409]: exception: Aggregate 7 already has host n-h1-791135-8. Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-791135-8'}}} Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result.read() Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:59:51.683393 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-791135-8-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 10:59:51.684438 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 10:59:51.685625 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 10:59:51.688392 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result.read() Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-791135-8-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 10, 59, 51, 656955), 'updated_at': None, 'host': 'n-h1-791135-8', 'aggregate_id': 7}] Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.691495 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-791135-8. Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.694759 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-791135-8. Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:51.706338 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:51.709652 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-791135-8. Oct 04 10:59:51.709652 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:51.709652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24f94a54-ab92-481e-90ac-947467217589 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-791135-8. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:51.709652 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24f94a54-ab92-481e-90ac-947467217589 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.105881 Oct 04 10:59:51.709652 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 133/260] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:51 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 10:59:51.711338 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca744436-7092-43b3-8cc6-fed59c34c75e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059447 Oct 04 10:59:51.711338 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 128/261] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:51.711823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d42704c8-9d0d-4001-b5ef-727f6de0a8e2 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:51.712010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c64eb485-a1fd-4d11-92e3-dd62729dda85 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.727170 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c64eb485-a1fd-4d11-92e3-dd62729dda85 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.020287 Oct 04 10:59:51.727743 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 129/262] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:51.736406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d42704c8-9d0d-4001-b5ef-727f6de0a8e2 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.740858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f8c4f74-8cbf-4a9a-b64a-0aa1fbda6600 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:51.741323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d42704c8-9d0d-4001-b5ef-727f6de0a8e2 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.742274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d42704c8-9d0d-4001-b5ef-727f6de0a8e2 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.803973 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f8c4f74-8cbf-4a9a-b64a-0aa1fbda6600 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.064231 Oct 04 10:59:51.815135 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 130/263] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:51 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:51.844302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:51.846235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:51.861729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.863315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.863985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.864934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:51.881239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:51.882727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:51.989582 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d42704c8-9d0d-4001-b5ef-727f6de0a8e2 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 225 microversion: 2.1 time: 0.298748 Oct 04 10:59:51.990183 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 134/264] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:51 2022] POST /compute/v2.1/os-aggregates/7/action => generated 225 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:51.999225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac3f1744-06f9-4269-9b94-895d34a880e6 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:52.020764 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac3f1744-06f9-4269-9b94-895d34a880e6 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.029520 Oct 04 10:59:52.022558 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 135/265] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:52.050041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8d398fb-165a-424f-9567-efff3f802bad tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:52.118608 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8d398fb-165a-424f-9567-efff3f802bad tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.087244 Oct 04 10:59:52.119495 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 136/266] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:52 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:52.127627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7871e28c-ed7d-4d34-a19e-6a74c664751e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:52.180326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7871e28c-ed7d-4d34-a19e-6a74c664751e tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.059373 Oct 04 10:59:52.183090 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 137/267] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:52 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:52.194196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:52.195406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:52.219466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:52.221563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:52.222374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:52.223877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:52.225222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:52.226843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:52.374119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:52.383567 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5a90468-5a2f-4007-abba-804bb12c9e0d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 0.566902 Oct 04 10:59:52.384225 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 131/268] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:51 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:52.389478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68c60225-c94a-4768-9f8f-cd7bf7abfd9a tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-392690275"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:52.393850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-68c60225-c94a-4768-9f8f-cd7bf7abfd9a tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid 37db93c7-eada-43e4-a557-863e81200899 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:52.422008 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68c60225-c94a-4768-9f8f-cd7bf7abfd9a tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.035771 Oct 04 10:59:52.423145 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 132/269] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:52 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:52.433577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8a4ed4f-1b39-4d95-a64c-b396598ed7f0 tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-444520686"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:52.443740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-c8a4ed4f-1b39-4d95-a64c-b396598ed7f0 tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Generated uuid 2f9ea6ac-879a-4d80-b67c-792ac93ca128 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:52.486195 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8a4ed4f-1b39-4d95-a64c-b396598ed7f0 tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.061681 Oct 04 10:59:52.487031 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 133/270] 10.222.0.23 () {62 vars in 1205 bytes} [Tue Oct 4 10:59:52 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:52.492695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-848d5e99-d8e8-4b48-b4b5-ccf6fcd8b1e5 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1191958543", "availability_zone": "tempest-test_az-638190777"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:52.528792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-848d5e99-d8e8-4b48-b4b5-ccf6fcd8b1e5 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid 4b5a7308-fa0a-45e7-acd2-7623ef2fa6bf for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:52.551404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=11,nova_api:DELETE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:52.579908 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-848d5e99-d8e8-4b48-b4b5-ccf6fcd8b1e5 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.091517 Oct 04 10:59:52.586751 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 134/271] 10.222.0.23 () {60 vars in 1165 bytes} [Tue Oct 4 10:59:52 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:52.707168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:52.716995 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-496fbce5-c66c-453b-81ab-8e46fed7d65d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1313 microversion: 2.1 time: 0.532894 Oct 04 10:59:52.718116 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 138/272] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:52 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:52.726602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06d25ccf-4443-475e-931c-5f5690aeba7d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1055367943"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:52.847970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-293db15a-b0cf-4721-a5ca-0a0afb8c1f72 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:52.852211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-293db15a-b0cf-4721-a5ca-0a0afb8c1f72 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '338b8b5ee95f4056ae7ca82f629ed373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb40af55197e4e19910755f19ea7defc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-293db15a-b0cf-4721-a5ca-0a0afb8c1f72 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Request method failure captured: Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 39 Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH8fSvHG7hOZQ7q6uFY7msXrFcShIeAFcI1DltLtspSix4clfIByJYjasXmybzvj3iEzl4qvvog5xDoj7D2Uk_9y0nwCGQYz8C3mrhmWFjh_gz_dlLrIKEt6Wfo23YQ8JkYo95A-TPM_6szwXsXcB1zHnooW2quxTnntsoc3HCOuWI Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 10:59:52.853833 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb40af55197e4e19910755f19ea7defc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb40af55197e4e19910755f19ea7defc"}]}] Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 338b8b5ee95f4056ae7ca82f629ed373 Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: {"add_host": {"host": "n-h1-791135-8"}} Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:52.855021 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-791135-8'}}} Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:52.855741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 10:59:52.859398 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:52.861686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-293db15a-b0cf-4721-a5ca-0a0afb8c1f72 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:52.861686 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-293db15a-b0cf-4721-a5ca-0a0afb8c1f72 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.273291 Oct 04 10:59:52.861686 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 135/273] 10.222.0.23 () {60 vars in 1191 bytes} [Tue Oct 4 10:59:52 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 274 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:52.866570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:52.867190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:52.881980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:52.883051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:52.883707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:52.884624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:52.885413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:52.887967 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06d25ccf-4443-475e-931c-5f5690aeba7d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.168447 Oct 04 10:59:52.888653 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 139/274] 10.222.0.23 () {62 vars in 1213 bytes} [Tue Oct 4 10:59:52 2022] PUT /compute/v2.1/os-aggregates/10 => generated 300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:52.894680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c60a3aa0-238e-4fca-9af3-7bc5f6aebdde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1191958543_new", "availability_zone": "tempest-test_az-638190777_new"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:52.899679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:53.129332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60a3aa0-238e-4fca-9af3-7bc5f6aebdde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:53.130585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60a3aa0-238e-4fca-9af3-7bc5f6aebdde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:53.131220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60a3aa0-238e-4fca-9af3-7bc5f6aebdde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:53.182274 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c60a3aa0-238e-4fca-9af3-7bc5f6aebdde tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 335 microversion: 2.1 time: 0.292188 Oct 04 10:59:53.190357 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 140/275] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Oct 4 10:59:52 2022] PUT /compute/v2.1/os-aggregates/11 => generated 335 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:53.193787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b1d74e7-9dc2-413c-89e2-989eb0990752 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:53.237859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b1d74e7-9dc2-413c-89e2-989eb0990752 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.051201 Oct 04 10:59:53.238542 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 141/276] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:53 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:53.252381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4f441c2-67f9-4dcc-bddc-e10ab922ebca tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:53.272327 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4f441c2-67f9-4dcc-bddc-e10ab922ebca tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.025449 Oct 04 10:59:53.277188 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 142/277] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Oct 4 10:59:53 2022] GET /compute/v2.1/os-aggregates/10 => generated 300 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:53.290166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4b87afd-556e-469a-984d-d66ae16675cf tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:53.305193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4b87afd-556e-469a-984d-d66ae16675cf tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 577 microversion: 2.1 time: 0.026609 Oct 04 10:59:53.316141 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 143/278] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 10:59:53 2022] GET /compute/v2.1/os-aggregates => generated 577 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:53.329210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ddf03d2-71c6-4ead-9028-a6a61c009725 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1214658463"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:53.332566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-4ddf03d2-71c6-4ead-9028-a6a61c009725 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid a152aaad-b002-461b-af6b-e36210cb74cb for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:53.364363 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ddf03d2-71c6-4ead-9028-a6a61c009725 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056561 Oct 04 10:59:53.365982 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 144/279] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:53.387666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-baf39f45-0682-47cd-a707-f5685b651a2d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:53.405021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-baf39f45-0682-47cd-a707-f5685b651a2d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:53.405558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-baf39f45-0682-47cd-a707-f5685b651a2d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:53.406545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-baf39f45-0682-47cd-a707-f5685b651a2d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:53.558281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:53.566655 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f1aab5f-dcbd-45db-871d-a31fb04ca213 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1320 microversion: 2.1 time: 0.709934 Oct 04 10:59:53.582028 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 136/280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:52 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1320 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:53.582028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a645b0f5-1ba6-48b1-9259-d0b4de2c1a91 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:53.623238 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a645b0f5-1ba6-48b1-9259-d0b4de2c1a91 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.047772 Oct 04 10:59:53.623627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-baf39f45-0682-47cd-a707-f5685b651a2d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 315 microversion: 2.41 time: 0.251371 Oct 04 10:59:53.624580 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 137/281] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:53.632669 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 145/282] 10.222.0.23 () {62 vars in 1235 bytes} [Tue Oct 4 10:59:53 2022] POST /compute/v2.1/os-aggregates/10/action => generated 315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:53.634336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1560643881"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:53.638298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:53.638909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:53.647754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:53.648246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:53.648672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:53.649804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:53.650256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:53.650674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:53.664935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:53.669713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:53.670517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:53.689454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:53.690219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:53.690964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:53.694874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:53.710785 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1560643881 could not be found. Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Request method failure captured: Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 58 Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH_o9UmiWJl1M9kkYd3paDRcMnXqsjjzVD-rBQ-MUV1DzRhpvHFP7HJ1DEhKtPxYfbxj-7BBLW4yfOjAmj9h6UZE0xnfo3bjlJoILSjo03z1_JCHMzaBSUmX8iHD0x2aNUmDCaCyoPHriOMhQvg0SoIyg34oQUEM79Ibt-LngfsxYw Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:53.715046 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9d1c4879e52477a8a105b55c979583c"}]}] Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 85172c3fedbf4afaa0e0eff313586f45 Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: {"add_host": {"host": "tempest-nonexist_host-1560643881"}} Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:53.716465 n-d-791135-8 devstack@n-api.service[122408]: exception: Compute host tempest-nonexist_host-1560643881 could not be found. Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-1560643881'}}} Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1560643881' is not mapped to any cell Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:53.717329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 10:59:53.718587 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1560643881 could not be found. Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1560643881 could not be found. Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:53.720049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.721834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:53.721834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:53.721834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:53.721834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:53.721834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:53.721834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1560643881 could not be found. Oct 04 10:59:53.721834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:53.724094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1560643881 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:53.725264 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c3c0acd-ddd5-4248-bcf5-adaff38aa20e tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.099413 Oct 04 10:59:53.729540 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 138/283] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 10:59:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:53.737173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19517397-c36b-43ed-842b-0d8c5441ad2a tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-294665918"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:53.741824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-19517397-c36b-43ed-842b-0d8c5441ad2a tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Generated uuid 81054a29-ac07-4c59-815b-f365e1da4ba9 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:53.779719 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19517397-c36b-43ed-842b-0d8c5441ad2a tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048842 Oct 04 10:59:53.781061 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 139/284] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:53.787420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0e85848-8242-4641-8517-c65be2ebbb79 tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:53.801265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e85848-8242-4641-8517-c65be2ebbb79 tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:53.802062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e85848-8242-4641-8517-c65be2ebbb79 tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:53.802670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0e85848-8242-4641-8517-c65be2ebbb79 tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:53.976191 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0e85848-8242-4641-8517-c65be2ebbb79 tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 300 microversion: 2.41 time: 0.193756 Oct 04 10:59:53.987166 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 140/285] 10.222.0.23 () {62 vars in 1235 bytes} [Tue Oct 4 10:59:53 2022] POST /compute/v2.1/os-aggregates/10/action => generated 300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:53.992651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd655cbf-6d03-41d0-90c1-72f5c2ecbd9f tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.030338 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd655cbf-6d03-41d0-90c1-72f5c2ecbd9f tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041740 Oct 04 10:59:54.036644 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 141/286] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:53 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:54.043694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.044311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:54.053595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.054550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.055280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.056388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.057438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.058707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:54.058962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.068725 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d6b3ff2-9183-42ca-9815-cd54c34c4601 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 0.434716 Oct 04 10:59:54.069609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 146/287] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:53 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:54.074018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f3befd2-1a97-49d7-a906-f8fa68d0e022 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.085092 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6f3befd2-1a97-49d7-a906-f8fa68d0e022 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 469 microversion: 2.1 time: 0.014300 Oct 04 10:59:54.085943 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 147/288] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 10:59:54 2022] GET /compute/v2.1/os-aggregates => generated 469 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:54.090918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b344ed2-9ed2-42a2-b42c-8b2d9d481e6d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.114780 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b344ed2-9ed2-42a2-b42c-8b2d9d481e6d tempest-AggregatesAdminTestV241-946707829 tempest-AggregatesAdminTestV241-946707829-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.41 time: 0.027554 Oct 04 10:59:54.115651 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 148/289] 10.222.0.23 () {60 vars in 1196 bytes} [Tue Oct 4 10:59:54 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:54.125574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-673017e0-b11e-4859-9347-09c33be73fec tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-673017e0-b11e-4859-9347-09c33be73fec tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Request method failure captured: Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 283 Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH_o9UmiWJl1M9kkYd3paDRcMnXqsjjzVD-rBQ-MUV1DzRhpvHFP7HJ1DEhKtPxYfbxj-7BBLW4yfOjAmj9h6UZE0xnfo3bjlJoILSjo03z1_JCHMzaBSUmX8iHD0x2aNUmDCaCyoPHriOMhQvg0SoIyg34oQUEM79Ibt-LngfsxYw Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:54.134671 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9d1c4879e52477a8a105b55c979583c"}]}] Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 85172c3fedbf4afaa0e0eff313586f45 Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:54.136672 n-d-791135-8 devstack@n-api.service[122409]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 10:59:54.137432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 10:59:54.138173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 10:59:54.139389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 10:59:54.140413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 10:59:54.140413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.140413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-673017e0-b11e-4859-9347-09c33be73fec tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.140413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-673017e0-b11e-4859-9347-09c33be73fec tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.019513 Oct 04 10:59:54.140720 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 149/290] 10.222.0.23 () {60 vars in 1165 bytes} [Tue Oct 4 10:59:54 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:59:54.149765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd400201-ff7a-474e-a7af-8e3886ab76e9 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.189972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd400201-ff7a-474e-a7af-8e3886ab76e9 tempest-AggregatesAdminTestJSON-110031534 tempest-AggregatesAdminTestJSON-110031534-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.048062 Oct 04 10:59:54.191025 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 150/291] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:54 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:54.197304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b236d5be-0847-4e7c-a6c7-0969feaa7502 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b236d5be-0847-4e7c-a6c7-0969feaa7502 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Request method failure captured: Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 27 Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH_o9UmiWJl1M9kkYd3paDRcMnXqsjjzVD-rBQ-MUV1DzRhpvHFP7HJ1DEhKtPxYfbxj-7BBLW4yfOjAmj9h6UZE0xnfo3bjlJoILSjo03z1_JCHMzaBSUmX8iHD0x2aNUmDCaCyoPHriOMhQvg0SoIyg34oQUEM79Ibt-LngfsxYw Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:54.201449 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9d1c4879e52477a8a105b55c979583c"}]}] Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 85172c3fedbf4afaa0e0eff313586f45 Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: {"aggregate": {"name": ""}} Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:54.202654 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '' Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.203351 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 10:59:54.204579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.206662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b236d5be-0847-4e7c-a6c7-0969feaa7502 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.206662 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b236d5be-0847-4e7c-a6c7-0969feaa7502 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009609 Oct 04 10:59:54.206662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 151/292] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:54 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 10:59:54.216809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.217424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:54.243328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.246789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.247433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.248334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.252993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.253946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.285392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:54.287566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] HTTP exception thrown: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Request method failure captured: Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 HTTP/1.1 Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH6BmmwyTrc7ivGBjEd_6fjZPgnd9Va9EKGIboXxEVP3GGJkPXpVqCoq_5sHuZEGWXSedOnXUu5HxSJhZHp5RxAw8dhylkyJAQU-DdF9sUyhQWQQa6ZNR-BKcrR7OCGmmleAy1ICkxGbAJHCKsuCnC7LR-KKwCtK0ZtQcv9feg2fhw Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 5ad230590d2b4600b928951aa8c253ec Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:54.289658 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5ad230590d2b4600b928951aa8c253ec"}]}] Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 5ad230590d2b4600b928951aa8c253ec Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminTestJSON-1088512117-project Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e2d2501472714b07a145134548b9d347 Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminTestJSON-1088512117-project Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.291248 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c58172c5-7f3b-4513-a108-c2e39beaaad3'} Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.292060 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.293539 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.295773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Returning 404 to user: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.297943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de160f0b-fbd6-47c1-ab96-1ed983899216 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 404 len: 111 microversion: 2.1 time: 0.092936 Oct 04 10:59:54.302636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 152/293] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 10:59:54 2022] DELETE /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:54.314683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c19235f4-991b-4d92-a30b-e4c334917eb9 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-618365877"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:54.320109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c19235f4-991b-4d92-a30b-e4c334917eb9 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '338b8b5ee95f4056ae7ca82f629ed373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb40af55197e4e19910755f19ea7defc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c19235f4-991b-4d92-a30b-e4c334917eb9 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Request method failure captured: Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 59 Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8fSvHG7hOZQ7q6uFY7msXrFcShIeAFcI1DltLtspSix4clfIByJYjasXmybzvj3iEzl4qvvog5xDoj7D2Uk_9y0nwCGQYz8C3mrhmWFjh_gz_dlLrIKEt6Wfo23YQ8JkYo95A-TPM_6szwXsXcB1zHnooW2quxTnntsoc3HCOuWI Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:54.323590 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb40af55197e4e19910755f19ea7defc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb40af55197e4e19910755f19ea7defc"}]}] Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 338b8b5ee95f4056ae7ca82f629ed373 Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: {"aggregate": {"name": "tempest-test_aggregate-618365877"}} Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:54.324920 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-618365877'}}} Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:54.325654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:54.326635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 10:59:54.328243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.331194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c19235f4-991b-4d92-a30b-e4c334917eb9 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.332377 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c19235f4-991b-4d92-a30b-e4c334917eb9 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.028428 Oct 04 10:59:54.335368 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 153/294] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:54 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:54.352669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.353541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] [instance: c58172c5-7f3b-4513-a108-c2e39beaaad3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:54.367749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.368236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.368659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.370948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.376444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.377101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.403807 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:54.411951 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] HTTP exception thrown: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Request method failure captured: Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 HTTP/1.1 Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH6BmmwyTrc7ivGBjEd_6fjZPgnd9Va9EKGIboXxEVP3GGJkPXpVqCoq_5sHuZEGWXSedOnXUu5HxSJhZHp5RxAw8dhylkyJAQU-DdF9sUyhQWQQa6ZNR-BKcrR7OCGmmleAy1ICkxGbAJHCKsuCnC7LR-KKwCtK0ZtQcv9feg2fhw Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 5ad230590d2b4600b928951aa8c253ec Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:54.413733 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5ad230590d2b4600b928951aa8c253ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5ad230590d2b4600b928951aa8c253ec"}]}] Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 5ad230590d2b4600b928951aa8c253ec Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1088512117 Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminTestJSON-1088512117-project Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e2d2501472714b07a145134548b9d347 Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminTestJSON-1088512117-project Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.414947 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c58172c5-7f3b-4513-a108-c2e39beaaad3'} Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.415598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. Oct 04 10:59:54.416636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.417858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] Returning 404 to user: Instance c58172c5-7f3b-4513-a108-c2e39beaaad3 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.417858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9ac17f22-fe40-40af-be10-a422c43bb459 tempest-AggregatesAdminTestJSON-1088512117 tempest-AggregatesAdminTestJSON-1088512117-project] 10.222.0.23 "GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3" status: 404 len: 111 microversion: 2.1 time: 0.078752 Oct 04 10:59:54.417858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 154/295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:54 2022] GET /compute/v2.1/servers/c58172c5-7f3b-4513-a108-c2e39beaaad3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:54.418455 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dba73a16-c682-404b-b361-530bed1f1f18 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1313 microversion: 2.1 time: 0.374534 Oct 04 10:59:54.419222 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 142/296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:54 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:54.423846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e7cf962-708d-44e6-9554-f7ee40ac9976 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1023676144"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:54.436759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-0e7cf962-708d-44e6-9554-f7ee40ac9976 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid 20383a4b-ce9b-41cf-8bbd-118f9451faa6 for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:54.480660 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e7cf962-708d-44e6-9554-f7ee40ac9976 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062029 Oct 04 10:59:54.481399 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 155/297] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:54.493211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b693a04-8b11-4e0f-9dfb-2be25aafa683 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1023676144"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:54.496677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-5b693a04-8b11-4e0f-9dfb-2be25aafa683 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid e86f4465-4007-4b12-b97e-949f9cd885e0 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:54.520743 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-5b693a04-8b11-4e0f-9dfb-2be25aafa683 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1023676144 already exists. Oct 04 10:59:54.533876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-935eec38-6d28-48d4-9ee3-75d2cdad1861 req-c05ff696-69e9-4901-8c0c-15bab839e5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ada5a1-1d78-40e1-ac76-6d91c1826587", "tag": "9a19f612-454a-488b-bbf2-774c1c1d5b98"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b693a04-8b11-4e0f-9dfb-2be25aafa683 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Request method failure captured: Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 60 Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH_o9UmiWJl1M9kkYd3paDRcMnXqsjjzVD-rBQ-MUV1DzRhpvHFP7HJ1DEhKtPxYfbxj-7BBLW4yfOjAmj9h6UZE0xnfo3bjlJoILSjo03z1_JCHMzaBSUmX8iHD0x2aNUmDCaCyoPHriOMhQvg0SoIyg34oQUEM79Ibt-LngfsxYw Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:54.535387 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9d1c4879e52477a8a105b55c979583c"}]}] Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 85172c3fedbf4afaa0e0eff313586f45 Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: {"aggregate": {"name": "tempest-test_aggregate-1023676144"}} Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:54.536613 n-d-791135-8 devstack@n-api.service[122408]: exception: Aggregate tempest-test_aggregate-1023676144 already exists. Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1023676144'}}} Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 10:59:54.537431 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1023676144 already exists. Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:54.542124 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1023676144 already exists. Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1023676144 already exists. Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b693a04-8b11-4e0f-9dfb-2be25aafa683 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1023676144 already exists. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.544399 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b693a04-8b11-4e0f-9dfb-2be25aafa683 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.047235 Oct 04 10:59:54.545986 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 143/298] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:54 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:59:54.545986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be69169e-edc4-44f1-b436-d8435275b61a tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.560302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-935eec38-6d28-48d4-9ee3-75d2cdad1861 req-c05ff696-69e9-4901-8c0c-15bab839e5d3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.561268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-935eec38-6d28-48d4-9ee3-75d2cdad1861 req-c05ff696-69e9-4901-8c0c-15bab839e5d3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.565829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-935eec38-6d28-48d4-9ee3-75d2cdad1861 req-c05ff696-69e9-4901-8c0c-15bab839e5d3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.578797 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-935eec38-6d28-48d4-9ee3-75d2cdad1861 req-c05ff696-69e9-4901-8c0c-15bab839e5d3 service nova] Creating event network-changed:9a19f612-454a-488b-bbf2-774c1c1d5b98 for instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 on n-h1-791135-8 Oct 04 10:59:54.587269 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be69169e-edc4-44f1-b436-d8435275b61a tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.045411 Oct 04 10:59:54.587854 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 144/299] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:54 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 10:59:54.593523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.594410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:54.599059 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-935eec38-6d28-48d4-9ee3-75d2cdad1861 req-c05ff696-69e9-4901-8c0c-15bab839e5d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074468 Oct 04 10:59:54.600197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 156/300] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:54.603708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.610024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7433e30-8039-4511-b842-0c671e072dda tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2138268436"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:54.611011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.611719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.612698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:54.613445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:54.614044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:54.623061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-e7433e30-8039-4511-b842-0c671e072dda tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid 34b333a3-c0b5-4b2f-b394-938a69c465d6 for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:54.637612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=11,nova_api:UPDATE=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:54.692966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7433e30-8039-4511-b842-0c671e072dda tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091136 Oct 04 10:59:54.696600 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 157/301] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:54.709050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4108ea85-636e-45d3-a42d-7c80af2acf2c tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.712066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4108ea85-636e-45d3-a42d-7c80af2acf2c tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '338b8b5ee95f4056ae7ca82f629ed373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb40af55197e4e19910755f19ea7defc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4108ea85-636e-45d3-a42d-7c80af2acf2c tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Request method failure captured: Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8fSvHG7hOZQ7q6uFY7msXrFcShIeAFcI1DltLtspSix4clfIByJYjasXmybzvj3iEzl4qvvog5xDoj7D2Uk_9y0nwCGQYz8C3mrhmWFjh_gz_dlLrIKEt6Wfo23YQ8JkYo95A-TPM_6szwXsXcB1zHnooW2quxTnntsoc3HCOuWI Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:54.720256 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb40af55197e4e19910755f19ea7defc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb40af55197e4e19910755f19ea7defc"}]}] Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 338b8b5ee95f4056ae7ca82f629ed373 Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 10:59:54.721885 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '15'} Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:54.722600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.723680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4108ea85-636e-45d3-a42d-7c80af2acf2c tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.725055 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4108ea85-636e-45d3-a42d-7c80af2acf2c tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.017922 Oct 04 10:59:54.725776 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 158/302] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:54 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:54.744615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f91445a7-3b02-48ec-b362-91f751584d4b tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.815773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f91445a7-3b02-48ec-b362-91f751584d4b tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.088469 Oct 04 10:59:54.823740 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 159/303] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:54 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:54.842075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f2d7945-4dc2-4e63-85d4-f0cf0a628bb5 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.873106 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-2f2d7945-4dc2-4e63-85d4-f0cf0a628bb5 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f2d7945-4dc2-4e63-85d4-f0cf0a628bb5 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Request method failure captured: Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH_o9UmiWJl1M9kkYd3paDRcMnXqsjjzVD-rBQ-MUV1DzRhpvHFP7HJ1DEhKtPxYfbxj-7BBLW4yfOjAmj9h6UZE0xnfo3bjlJoILSjo03z1_JCHMzaBSUmX8iHD0x2aNUmDCaCyoPHriOMhQvg0SoIyg34oQUEM79Ibt-LngfsxYw Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:54.875049 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9d1c4879e52477a8a105b55c979583c"}]}] Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 85172c3fedbf4afaa0e0eff313586f45 Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: exception: Aggregate -1 could not be found. Oct 04 10:59:54.876480 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '-1'} Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 10:59:54.877122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.882693 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f2d7945-4dc2-4e63-85d4-f0cf0a628bb5 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f2d7945-4dc2-4e63-85d4-f0cf0a628bb5 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.051950 Oct 04 10:59:54.884097 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 160/304] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:54 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:59:54.893599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24be819e-c614-46cb-bb90-648dfe8b684c tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-983954233"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:54.899947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-24be819e-c614-46cb-bb90-648dfe8b684c tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid cb0d2fac-7552-4328-9d0b-a9452ac2da51 for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:54.959072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24be819e-c614-46cb-bb90-648dfe8b684c tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075478 Oct 04 10:59:54.959591 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 161/305] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:54.972292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d6fc118-aaa0-4d06-873d-034528750287 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:54.981041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d6fc118-aaa0-4d06-873d-034528750287 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '338b8b5ee95f4056ae7ca82f629ed373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb40af55197e4e19910755f19ea7defc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d6fc118-aaa0-4d06-873d-034528750287 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Request method failure captured: Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8fSvHG7hOZQ7q6uFY7msXrFcShIeAFcI1DltLtspSix4clfIByJYjasXmybzvj3iEzl4qvvog5xDoj7D2Uk_9y0nwCGQYz8C3mrhmWFjh_gz_dlLrIKEt6Wfo23YQ8JkYo95A-TPM_6szwXsXcB1zHnooW2quxTnntsoc3HCOuWI Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:54.983201 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb40af55197e4e19910755f19ea7defc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb40af55197e4e19910755f19ea7defc"}]}] Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 338b8b5ee95f4056ae7ca82f629ed373 Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 10:59:54.984483 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '16'} Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:54.985173 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 10:59:54.986240 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:54.989602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d6fc118-aaa0-4d06-873d-034528750287 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:54.990728 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d6fc118-aaa0-4d06-873d-034528750287 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.023419 Oct 04 10:59:54.991668 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 162/306] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:54 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 10:59:55.009037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-efc7def4-5ddc-4401-96df-7ac9a2d9a22b tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:55.044595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-efc7def4-5ddc-4401-96df-7ac9a2d9a22b tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.041160 Oct 04 10:59:55.046004 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 163/307] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:55 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:55.057115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66592b8f-a4dd-4286-b6a3-53bdc3804000 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:55.067863 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-66592b8f-a4dd-4286-b6a3-53bdc3804000 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66592b8f-a4dd-4286-b6a3-53bdc3804000 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Request method failure captured: Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH_o9UmiWJl1M9kkYd3paDRcMnXqsjjzVD-rBQ-MUV1DzRhpvHFP7HJ1DEhKtPxYfbxj-7BBLW4yfOjAmj9h6UZE0xnfo3bjlJoILSjo03z1_JCHMzaBSUmX8iHD0x2aNUmDCaCyoPHriOMhQvg0SoIyg34oQUEM79Ibt-LngfsxYw Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 10:59:55.069882 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9d1c4879e52477a8a105b55c979583c"}]}] Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 85172c3fedbf4afaa0e0eff313586f45 Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: exception: Aggregate -1 could not be found. Oct 04 10:59:55.071113 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '-1'} Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:55.071852 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 10:59:55.072908 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:55.075871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66592b8f-a4dd-4286-b6a3-53bdc3804000 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:55.077263 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-66592b8f-a4dd-4286-b6a3-53bdc3804000 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024675 Oct 04 10:59:55.084567 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 164/308] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 10:59:55 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:59:55.091698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4d3b479-3453-46f9-8880-3ccc362f54b2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:55.093243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a4d3b479-3453-46f9-8880-3ccc362f54b2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '338b8b5ee95f4056ae7ca82f629ed373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb40af55197e4e19910755f19ea7defc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4d3b479-3453-46f9-8880-3ccc362f54b2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Request method failure captured: Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8fSvHG7hOZQ7q6uFY7msXrFcShIeAFcI1DltLtspSix4clfIByJYjasXmybzvj3iEzl4qvvog5xDoj7D2Uk_9y0nwCGQYz8C3mrhmWFjh_gz_dlLrIKEt6Wfo23YQ8JkYo95A-TPM_6szwXsXcB1zHnooW2quxTnntsoc3HCOuWI Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:55.094780 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb40af55197e4e19910755f19ea7defc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb40af55197e4e19910755f19ea7defc"}]}] Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 338b8b5ee95f4056ae7ca82f629ed373 Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 10:59:55.096038 n-d-791135-8 devstack@n-api.service[122409]: action_args: {} Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:55.096753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:55.106674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4d3b479-3453-46f9-8880-3ccc362f54b2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:55.109575 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4d3b479-3453-46f9-8880-3ccc362f54b2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009712 Oct 04 10:59:55.109575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 165/309] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 10:59:55 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:55.116786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:55.124250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:55.143460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:55.144657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:55.146539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:55.147427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:55.147891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:55.148316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:55.229272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:55.231776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:55.237877 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb8fe63a-deae-481f-89a0-a4b6c4ac3c8f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1320 microversion: 2.1 time: 0.648733 Oct 04 10:59:55.249778 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 145/310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:54 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1320 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:55.261636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-937f3c55-06b8-4ab4-993d-2cf49f44bfb9 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1825766296"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:55.266367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-937f3c55-06b8-4ab4-993d-2cf49f44bfb9 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid b1233885-4418-4491-a58d-582d1ac97746 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:55.299971 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-937f3c55-06b8-4ab4-993d-2cf49f44bfb9 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049033 Oct 04 10:59:55.306385 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 146/311] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:55.327429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c763d013-72de-4142-8c9a-2954fd682082 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:55.341298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c763d013-72de-4142-8c9a-2954fd682082 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:55.342695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c763d013-72de-4142-8c9a-2954fd682082 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:55.342695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c763d013-72de-4142-8c9a-2954fd682082 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:55.546863 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c763d013-72de-4142-8c9a-2954fd682082 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.228448 Oct 04 10:59:55.547673 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 147/312] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 10:59:55 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:55.565403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:55.566338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:55.576087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:55.579560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:55.580002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:55.580734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:55.581211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:55.584530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:56.197075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:56.208581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36b2971b-8661-467f-8840-956da395bbb5 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 1.110869 Oct 04 10:59:56.209797 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 166/313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:55 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:56.215574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f559c36-86dd-4df3-9564-5d40159bd2a2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:56.220080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f559c36-86dd-4df3-9564-5d40159bd2a2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '338b8b5ee95f4056ae7ca82f629ed373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb40af55197e4e19910755f19ea7defc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f559c36-86dd-4df3-9564-5d40159bd2a2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Request method failure captured: Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 42 Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8fSvHG7hOZQ7q6uFY7msXrFcShIeAFcI1DltLtspSix4clfIByJYjasXmybzvj3iEzl4qvvog5xDoj7D2Uk_9y0nwCGQYz8C3mrhmWFjh_gz_dlLrIKEt6Wfo23YQ8JkYo95A-TPM_6szwXsXcB1zHnooW2quxTnntsoc3HCOuWI Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 10:59:56.222300 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb40af55197e4e19910755f19ea7defc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb40af55197e4e19910755f19ea7defc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb40af55197e4e19910755f19ea7defc"}]}] Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fb40af55197e4e19910755f19ea7defc Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337 Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 338b8b5ee95f4056ae7ca82f629ed373 Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1024712337-project Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: {"remove_host": {"host": "n-h1-791135-8"}} Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 10:59:56.223521 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-791135-8'}}} Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:56.224234 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 10:59:56.225308 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.227312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f559c36-86dd-4df3-9564-5d40159bd2a2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:56.228141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f559c36-86dd-4df3-9564-5d40159bd2a2 tempest-AggregatesAdminNegativeTestJSON-1024712337 tempest-AggregatesAdminNegativeTestJSON-1024712337-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.017058 Oct 04 10:59:56.228701 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 167/314] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 10:59:56 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 10:59:56.237327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eeb92a20-7730-4bc1-92f8-d15ba09dfccd tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:56.250140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eeb92a20-7730-4bc1-92f8-d15ba09dfccd tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:56.250728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eeb92a20-7730-4bc1-92f8-d15ba09dfccd tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:56.251677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eeb92a20-7730-4bc1-92f8-d15ba09dfccd tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:56.398428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eeb92a20-7730-4bc1-92f8-d15ba09dfccd tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.165025 Oct 04 10:59:56.399536 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 168/315] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 10:59:56 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:56.404780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:56.405440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:56.413112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:56.426117 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a5741b5-2a84-463b-bac9-6b4294b14aec tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1313 microversion: 2.1 time: 0.876595 Oct 04 10:59:56.429544 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 148/316] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:55 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:56.435156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e74879a4-7f09-4ce4-855b-f1d86e1bba72 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:56.439854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:56.440568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:56.441549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:56.442589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:56.443624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:56.444234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:56.474299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:56.502316 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e74879a4-7f09-4ce4-855b-f1d86e1bba72 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.067037 Oct 04 10:59:56.504142 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 149/317] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:56 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:56.514144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e123ba15-e7c8-4183-9cc8-cb4a2b1eb84d tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1856709186"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:56.518868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.aggregate [None req-e123ba15-e7c8-4183-9cc8-cb4a2b1eb84d tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Generated uuid 531a6c20-dee0-480b-8bb2-e9b32de60b40 for aggregate {{(pid=122408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 10:59:56.542147 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e123ba15-e7c8-4183-9cc8-cb4a2b1eb84d tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.030761 Oct 04 10:59:56.543023 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 150/318] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 10:59:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:56.555349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:56.567370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:56.568113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:56.568771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:56.578852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:56.579590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:56.580637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:56.591092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.compute.aggregates [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 10:59:56.594463 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Request method failure captured: Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 42 Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH_o9UmiWJl1M9kkYd3paDRcMnXqsjjzVD-rBQ-MUV1DzRhpvHFP7HJ1DEhKtPxYfbxj-7BBLW4yfOjAmj9h6UZE0xnfo3bjlJoILSjo03z1_JCHMzaBSUmX8iHD0x2aNUmDCaCyoPHriOMhQvg0SoIyg34oQUEM79Ibt-LngfsxYw Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 10:59:56.602888 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9d1c4879e52477a8a105b55c979583c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9d1c4879e52477a8a105b55c979583c"}]}] Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: d9d1c4879e52477a8a105b55c979583c Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-90170924 Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 85172c3fedbf4afaa0e0eff313586f45 Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: {"remove_host": {"host": "nonexist_host"}} Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 10:59:56.604323 n-d-791135-8 devstack@n-api.service[122408]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 10:59:56.605041 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 10:59:56.606179 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.607252 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 10:59:56.608357 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 10:59:56.608357 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 10:59:56.608357 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 10:59:56.608357 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 10:59:56.608357 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 04 10:59:56.608357 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 10:59:56.608357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 10:59:56.611128 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e131bc7-c28b-4fee-b57c-4adf1e135e53 tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.057060 Oct 04 10:59:56.611762 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 151/319] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 10:59:56 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 10:59:56.634160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac295868-259d-4c7a-8140-46630db7ba9a tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:56.688904 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac295868-259d-4c7a-8140-46630db7ba9a tempest-AggregatesAdminNegativeTestJSON-90170924 tempest-AggregatesAdminNegativeTestJSON-90170924-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.072098 Oct 04 10:59:56.695889 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 152/320] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 10:59:56 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 10:59:56.884526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:56.892972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1f2c1a59-422a-4e9b-b71f-c2bf34c9ede0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1320 microversion: 2.1 time: 0.492174 Oct 04 10:59:56.893558 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 169/321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:56 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:57.195824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e31919aa-29c7-4ae0-80aa-dba5ed56fe60 req-a897b450-f9e5-4d39-9490-90495bf6dd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f801b4d9-89bd-4232-9031-fbb661178744", "name": "network-vif-plugged", "status": "completed", "tag": "ad4bec16-719d-4826-bf8e-6aefb10f7672"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:57.225419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e31919aa-29c7-4ae0-80aa-dba5ed56fe60 req-a897b450-f9e5-4d39-9490-90495bf6dd8f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:57.227972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e31919aa-29c7-4ae0-80aa-dba5ed56fe60 req-a897b450-f9e5-4d39-9490-90495bf6dd8f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:57.229362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e31919aa-29c7-4ae0-80aa-dba5ed56fe60 req-a897b450-f9e5-4d39-9490-90495bf6dd8f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:57.268795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e31919aa-29c7-4ae0-80aa-dba5ed56fe60 req-a897b450-f9e5-4d39-9490-90495bf6dd8f service nova] Creating event network-vif-plugged:ad4bec16-719d-4826-bf8e-6aefb10f7672 for instance f801b4d9-89bd-4232-9031-fbb661178744 on n-h2-791135-8 Oct 04 10:59:57.288055 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e31919aa-29c7-4ae0-80aa-dba5ed56fe60 req-a897b450-f9e5-4d39-9490-90495bf6dd8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095512 Oct 04 10:59:57.288694 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 170/322] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 10:59:57.312213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:57.316054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:57.331945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:57.340676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:57.344645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:57.348296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:57.349237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:57.351219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:57.708999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Calling method '.version_select at 0x7f71d4dceaf0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:57.711126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:57.711720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:57.712213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:57.735859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:57.736342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:57.736766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:57.761077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:57.762241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:57.763178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:57.773896 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-682856ac-5c2d-42cf-89a5-82ed057961ff tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.645722 Oct 04 10:59:57.776196 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 153/323] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 10:59:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:57.782488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:57.783440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:57.793417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:57.794373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:57.795103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:57.796235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:57.797064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:57.798118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:58.179643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:58.193762 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14eb763e-2d32-43a7-8997-0042785d4012 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 0.903559 Oct 04 10:59:58.194363 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 171/324] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:57 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:58.215143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3854b890-bf04-4ab4-ae07-6350fa7fbb37 tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Calling method '.version_select at 0x7f71d4ef1ca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:58.221952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854b890-bf04-4ab4-ae07-6350fa7fbb37 tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:58.222442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854b890-bf04-4ab4-ae07-6350fa7fbb37 tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:58.227671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854b890-bf04-4ab4-ae07-6350fa7fbb37 tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:58.305607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854b890-bf04-4ab4-ae07-6350fa7fbb37 tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:58.306520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854b890-bf04-4ab4-ae07-6350fa7fbb37 tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:58.306977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854b890-bf04-4ab4-ae07-6350fa7fbb37 tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:58.320969 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3854b890-bf04-4ab4-ae07-6350fa7fbb37 tempest-HypervisorAdminV228Test-1841911771 tempest-HypervisorAdminV228Test-1841911771-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.122689 Oct 04 10:59:58.321617 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 172/325] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Oct 4 10:59:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 10:59:58.335900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:58.336850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:58.349431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:58.355848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:58.356577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:58.357150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:58.358038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:58.359202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:58.359800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:58.370044 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf9bad35-b609-4c43-b2f6-d84b67a98e84 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1313 microversion: 2.1 time: 0.589123 Oct 04 10:59:58.371912 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 154/326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:57 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:58.657666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:58.678617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36860a7e-a625-4adc-b000-289c81a15fa0 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1320 microversion: 2.1 time: 0.345127 Oct 04 10:59:58.680972 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 173/327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:58 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:59.222935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:59.224425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:59.240812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 10:59:59.245429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:59.246188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:59.246795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:59.248169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:59.248773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:59.251314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:59.334426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-972f01b3-ce72-4fd7-8730-283120c1cccf req-af3257c4-6e2c-4317-8c0e-aceb1efddb98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5981b8-d0e7-43d1-89ed-0b1186788807", "name": "network-vif-plugged", "status": "completed", "tag": "5f86481a-fa5c-4dba-8d67-849aa98cd0b5"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 10:59:59.359697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-972f01b3-ce72-4fd7-8730-283120c1cccf req-af3257c4-6e2c-4317-8c0e-aceb1efddb98 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:59.362140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-972f01b3-ce72-4fd7-8730-283120c1cccf req-af3257c4-6e2c-4317-8c0e-aceb1efddb98 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:59.364520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-972f01b3-ce72-4fd7-8730-283120c1cccf req-af3257c4-6e2c-4317-8c0e-aceb1efddb98 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:59.403359 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-972f01b3-ce72-4fd7-8730-283120c1cccf req-af3257c4-6e2c-4317-8c0e-aceb1efddb98 service nova] Creating event network-vif-plugged:5f86481a-fa5c-4dba-8d67-849aa98cd0b5 for instance be5981b8-d0e7-43d1-89ed-0b1186788807 on n-h2-791135-8 Oct 04 10:59:59.420098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-972f01b3-ce72-4fd7-8730-283120c1cccf req-af3257c4-6e2c-4317-8c0e-aceb1efddb98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093876 Oct 04 10:59:59.424930 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 174/328] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 10:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 10:59:59.439784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:59.440903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:59.455554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:59.456048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:59.458498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:59.459886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:59.462905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:59.463537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:59.937472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 10:59:59.949185 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2dd0209c-63d2-4f76-9ef0-c5f514faa623 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 0.730355 Oct 04 10:59:59.961913 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 155/329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:59 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 10:59:59.976221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 10:59:59.977122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 10:59:59.991167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:59.991656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:59.992396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 10:59:59.994022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 10:59:59.994641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 10:59:59.995239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:00.295112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:00.309576 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12fc2711-efc7-4d79-98f3-785722981b09 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1313 microversion: 2.1 time: 0.882899 Oct 04 11:00:00.310548 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 175/330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:59 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:00.397900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:00.413127 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e472126-c599-4adf-8cd1-b8f36dd0733d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1320 microversion: 2.1 time: 0.441327 Oct 04 11:00:00.430500 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 156/331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 10:59:59 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:00.978819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:00.979496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:00.987690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:00.988181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:00.988994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:00.992113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:00.993844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:00.994286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:01.214232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:01.221838 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4833ed87-d095-4566-9ebd-6ef8c810db6c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1388 microversion: 2.1 time: 0.247190 Oct 04 11:00:01.224201 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 176/332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:00 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1388 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:01.335267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:01.336039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:01.345671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:01.346464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:01.347117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:01.348021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:01.348842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:01.349519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:01.439389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:01.440272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:01.458807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:01.459352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:01.460615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:01.461612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:01.462291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:01.462986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:01.614344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:01.622913 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9435a18b-0439-4e26-a62b-bc6231d30d00 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1462 microversion: 2.1 time: 0.292892 Oct 04 11:00:01.625978 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 157/333] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:01 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1462 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:01.752589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:01.763676 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-66e1a7f2-e531-4cf8-af06-c13c3037c1ac tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1320 microversion: 2.1 time: 0.331113 Oct 04 11:00:01.783498 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 177/334] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:01 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:02.108393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:02.109844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:02.121197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.121801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.122363 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.123322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.123741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.125064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.249555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:02.251430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:02.264450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.265235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.265891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.269861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.270669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.271667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.579606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:02.589641 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be28df2a-c936-493c-98aa-638ee633283f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1586 microversion: 2.1 time: 0.343816 Oct 04 11:00:02.591343 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 178/335] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:02 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1586 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:02.599905 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40d7dce1-9871-4a73-93e3-3c3d9916ad72 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1613 microversion: 2.1 time: 0.954379 Oct 04 11:00:02.600092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-591ca485-62c6-4405-8135-93308423a73d req-8f4145e8-6a8c-49a1-9bde-357d2ad05c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ada5a1-1d78-40e1-ac76-6d91c1826587", "name": "network-vif-plugged", "status": "completed", "tag": "9a19f612-454a-488b-bbf2-774c1c1d5b98"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:02.604264 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 158/336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:01 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1613 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:02.615951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-591ca485-62c6-4405-8135-93308423a73d req-8f4145e8-6a8c-49a1-9bde-357d2ad05c39 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.616490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-591ca485-62c6-4405-8135-93308423a73d req-8f4145e8-6a8c-49a1-9bde-357d2ad05c39 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.616928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-591ca485-62c6-4405-8135-93308423a73d req-8f4145e8-6a8c-49a1-9bde-357d2ad05c39 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.624950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:02.628990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:02.633918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-591ca485-62c6-4405-8135-93308423a73d req-8f4145e8-6a8c-49a1-9bde-357d2ad05c39 service nova] Creating event network-vif-plugged:9a19f612-454a-488b-bbf2-774c1c1d5b98 for instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 on n-h1-791135-8 Oct 04 11:00:02.645877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-591ca485-62c6-4405-8135-93308423a73d req-8f4145e8-6a8c-49a1-9bde-357d2ad05c39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050692 Oct 04 11:00:02.648925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.650124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.651641 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 179/337] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:02.652240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.653784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.656336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.657300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.667818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:02.680358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:02.705231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.707146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.709579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.711777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.716396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.716762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.887901 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b75440ef-4e3f-4dc6-9494-709b18d9fb76 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277585 Oct 04 11:00:02.888506 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 159/338] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:00:02 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:02.893849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:02.894628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:02.906177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.906662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.908826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.909762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:02.911139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:02.913895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:02.942325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1ce456bc797345d6acbcfceb1ef83111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137a10241e0143bfba9a11313f0ee12d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:02.942936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: f801b4d9-89bd-4232-9031-fbb661178744] flavor_id is None. Assuming migration. {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 11:00:02.943381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:00:03.188210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0efcb973-43dc-4adf-bf25-397449bc9503 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744/action" status: 202 len: 0 microversion: 2.1 time: 0.533821 Oct 04 11:00:03.190253 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 180/339] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:00:02 2022] POST /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:00:03.241312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:03.252884 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-87a06e38-1c87-4b6a-9f3d-c89f019eae0e tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1320 microversion: 2.1 time: 0.363162 Oct 04 11:00:03.273996 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 160/340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:02 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:03.299016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:03.302984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:03.319734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:03.321096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:03.323503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:03.324666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:03.325936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:03.327021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:03.497631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:03.510639 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-613471bf-de61-4d8e-8fbf-67af344e1992 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1471 microversion: 2.1 time: 0.234379 Oct 04 11:00:03.532579 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 161/341] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:03 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:03.657101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab03247a-f95f-44bf-bbe8-c6b50014b4df tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1176279015", "ram": 512, "vcpus": 1, "disk": 10, "id": 1916289258, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:03.688547 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab03247a-f95f-44bf-bbe8-c6b50014b4df tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.496615 Oct 04 11:00:03.689609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 181/342] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:00:03 2022] POST /compute/v2.1/flavors => generated 416 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:03.705585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-229674f4-3c9a-43c8-a12b-8fd85c399007 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:03.736570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=11,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:03.808635 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-229674f4-3c9a-43c8-a12b-8fd85c399007 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1916289258/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.106454 Oct 04 11:00:03.816233 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 162/343] 10.222.0.23 () {60 vars in 1224 bytes} [Tue Oct 4 11:00:03 2022] POST /compute/v2.1/flavors/1916289258/os-extra_specs => generated 66 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:00:04.281494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:04.282175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:04.298077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:04.302456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:04.303220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:04.305397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:04.307505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:04.308009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:04.328950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5738ced-2345-4094-9223-a4dc8f74471c tempest-FlavorsExtraSpecsTestJSON-1738304244 tempest-FlavorsExtraSpecsTestJSON-1738304244-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:04.350599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5738ced-2345-4094-9223-a4dc8f74471c tempest-FlavorsExtraSpecsTestJSON-1738304244 tempest-FlavorsExtraSpecsTestJSON-1738304244-project] 10.222.0.23 "GET /compute/v2.1/flavors/1916289258/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.534502 Oct 04 11:00:04.367122 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 182/344] 10.222.0.23 () {58 vars in 1203 bytes} [Tue Oct 4 11:00:03 2022] GET /compute/v2.1/flavors/1916289258/os-extra_specs => generated 66 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:00:04.387524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a73e9591-d6ff-4a58-bee0-1601db4fcbb4 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:04.458678 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a73e9591-d6ff-4a58-bee0-1601db4fcbb4 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1916289258/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083422 Oct 04 11:00:04.459960 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 183/345] 10.222.0.23 () {60 vars in 1224 bytes} [Tue Oct 4 11:00:04 2022] POST /compute/v2.1/flavors/1916289258/os-extra_specs => generated 66 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:00:04.470035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49f476bd-5784-4e41-a479-c5854754aaa8 tempest-FlavorsExtraSpecsTestJSON-1738304244 tempest-FlavorsExtraSpecsTestJSON-1738304244-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:04.489831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49f476bd-5784-4e41-a479-c5854754aaa8 tempest-FlavorsExtraSpecsTestJSON-1738304244 tempest-FlavorsExtraSpecsTestJSON-1738304244-project] 10.222.0.23 "GET /compute/v2.1/flavors/1916289258/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.024304 Oct 04 11:00:04.490822 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 184/346] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:00:04 2022] GET /compute/v2.1/flavors/1916289258/os-extra_specs/hw:numa_nodes => generated 22 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 11:00:04.502284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f87ceeeb-cb5a-4b1b-be0b-d477bd21df30 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:04.547176 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f87ceeeb-cb5a-4b1b-be0b-d477bd21df30 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1916289258/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.049752 Oct 04 11:00:04.555303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 185/347] 10.222.0.23 () {60 vars in 1224 bytes} [Tue Oct 4 11:00:04 2022] POST /compute/v2.1/flavors/1916289258/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 11:00:04.561283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:04.562633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:04.571557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:04.572206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:04.572804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:04.573949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:04.575742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:04.576321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:05.225037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:05.235592 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec9c5dfa-7348-4733-a8b6-b70ab5b08e99 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1470 microversion: 2.1 time: 0.958643 Oct 04 11:00:05.237694 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 163/348] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:04 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1470 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:05.247184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b281680f-a4e1-4da0-87d2-c4bdb2c2a0e1 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.287782 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b281680f-a4e1-4da0-87d2-c4bdb2c2a0e1 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1916289258/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045469 Oct 04 11:00:05.302455 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 164/349] 10.222.0.23 () {58 vars in 1203 bytes} [Tue Oct 4 11:00:05 2022] GET /compute/v2.1/flavors/1916289258/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:00:05.323893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:05.333709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:05.350180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:05.350944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:05.351572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:05.352953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:05.353666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:05.354277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:05.453976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:05.472963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6daff9f4-7fd5-4b22-8e6b-1ab848b41421 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1471 microversion: 2.1 time: 0.915756 Oct 04 11:00:05.473618 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 186/350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:04 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1471 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:05.482084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:05.490440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f3e64b6-bd0b-4f35-a5a8-bb244b202ac5 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:05.521780 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3f9bcb0-4d8e-49e0-bc9a-e474fed0a055 tempest-DeleteServersAdminTestJSON-1978518075 tempest-DeleteServersAdminTestJSON-1978518075-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587/action" status: 202 len: 0 microversion: 2.1 time: 0.214953 Oct 04 11:00:05.522792 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 165/351] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:00:05 2022] POST /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:00:05.534111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=5,nova_api:INSERT=2,nova_api:SAVEPOINT=6,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:05.535677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.536511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:05.559761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:05.560237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:05.564708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:05.565563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:05.566186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:05.566752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:05.587723 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f3e64b6-bd0b-4f35-a5a8-bb244b202ac5 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1916289258/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.111432 Oct 04 11:00:05.594837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 187/352] 10.222.0.23 () {60 vars in 1265 bytes} [Tue Oct 4 11:00:05 2022] PUT /compute/v2.1/flavors/1916289258/os-extra_specs/hw:numa_nodes => generated 22 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:00:05.602486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0be0b2d7-518c-437f-afb9-5a5e1c0e4217 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.635104 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0be0b2d7-518c-437f-afb9-5a5e1c0e4217 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1916289258/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037535 Oct 04 11:00:05.637383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:05.638278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:05.638929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:05.640151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lazy-loading 'fault' on Instance uuid a3ada5a1-1d78-40e1-ac76-6d91c1826587 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:00:05.641779 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 188/353] 10.222.0.23 () {58 vars in 1203 bytes} [Tue Oct 4 11:00:05 2022] GET /compute/v2.1/flavors/1916289258/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:00:05.649781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d89b96ca-98b7-43e3-bf63-78a8c7010b3b tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.715567 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d89b96ca-98b7-43e3-bf63-78a8c7010b3b tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1916289258/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.070403 Oct 04 11:00:05.724394 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 189/354] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:00:05 2022] DELETE /compute/v2.1/flavors/1916289258/os-extra_specs/hw:numa_nodes => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 11:00:05.734060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f77aa1f7-c3e6-48bd-b248-8519d0283e65 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.781717 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f77aa1f7-c3e6-48bd-b248-8519d0283e65 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1916289258/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.054202 Oct 04 11:00:05.787578 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 190/355] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:00:05 2022] DELETE /compute/v2.1/flavors/1916289258/os-extra_specs/hw:cpu_policy => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 11:00:05.798252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd92d363-48b0-4a69-bbeb-fa1c9dfbe173 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.818044 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd92d363-48b0-4a69-bbeb-fa1c9dfbe173 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1916289258/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029039 Oct 04 11:00:05.827019 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 191/356] 10.222.0.23 () {58 vars in 1203 bytes} [Tue Oct 4 11:00:05 2022] GET /compute/v2.1/flavors/1916289258/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:00:05.842473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3bb5f351-9f5e-4fe8-8b73-e27ffc6384b5 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.871856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:05.886376 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-866901e8-fc93-4138-a556-5040f00da69d tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1453 microversion: 2.1 time: 0.354294 Oct 04 11:00:05.890564 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3bb5f351-9f5e-4fe8-8b73-e27ffc6384b5 tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1916289258" status: 202 len: 0 microversion: 2.1 time: 0.059061 Oct 04 11:00:05.891379 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 192/357] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 11:00:05 2022] DELETE /compute/v2.1/flavors/1916289258 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:00:05.903332 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 166/358] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:05 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1453 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:05.927374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4260e8a-0cf0-4af8-83d0-e3f9d44a1cbd tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.930287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:05.934341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:05.957940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:05.963629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:05.965408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:05.968800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:05.969990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:05.974677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:06.005056 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4260e8a-0cf0-4af8-83d0-e3f9d44a1cbd tempest-FlavorsExtraSpecsTestJSON-1286472003 tempest-FlavorsExtraSpecsTestJSON-1286472003-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.091380 Oct 04 11:00:06.015277 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 193/359] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:00:05 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:06.031251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-9d1946ea-d87a-4e48-91ae-dcbe2bf3a1e9 req-555f26b6-b21f-431e-a447-62ec874d8920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5981b8-d0e7-43d1-89ed-0b1186788807", "tag": "5f86481a-fa5c-4dba-8d67-849aa98cd0b5"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:06.068503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d1946ea-d87a-4e48-91ae-dcbe2bf3a1e9 req-555f26b6-b21f-431e-a447-62ec874d8920 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:06.074103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:00:06.075501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d1946ea-d87a-4e48-91ae-dcbe2bf3a1e9 req-555f26b6-b21f-431e-a447-62ec874d8920 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:06.078007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d1946ea-d87a-4e48-91ae-dcbe2bf3a1e9 req-555f26b6-b21f-431e-a447-62ec874d8920 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:06.116350 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9d1946ea-d87a-4e48-91ae-dcbe2bf3a1e9 req-555f26b6-b21f-431e-a447-62ec874d8920 service nova] Creating event network-changed:5f86481a-fa5c-4dba-8d67-849aa98cd0b5 for instance be5981b8-d0e7-43d1-89ed-0b1186788807 on n-h2-791135-8 Oct 04 11:00:06.138513 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-9d1946ea-d87a-4e48-91ae-dcbe2bf3a1e9 req-555f26b6-b21f-431e-a447-62ec874d8920 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111339 Oct 04 11:00:06.140859 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 194/360] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:00:06.148419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:06.161736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:06.178320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:06.179772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:06.180830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:06.182376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:06.184379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:06.185676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:06.299144 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28ce8e62-f7fd-4f36-914a-a0520c6cc51f tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 204 len: 0 microversion: 2.1 time: 0.382950 Oct 04 11:00:06.300260 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 167/361] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:00:05 2022] DELETE /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:00:06.319661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:06.320826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:06.334564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:06.336025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:06.338502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:06.339940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:06.342215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:06.344183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:06.425979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:06.428041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:06.429143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:06.429447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lazy-loading 'fault' on Instance uuid a3ada5a1-1d78-40e1-ac76-6d91c1826587 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:00:06.578293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=24 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:06.988510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:06.997558 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b6cfe46-43b7-4eed-b348-d305564f55eb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 200 len: 1586 microversion: 2.1 time: 0.854765 Oct 04 11:00:07.000776 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 195/362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:06 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 1586 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:07.055453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:07.066088 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c006338-cd5e-4a00-90d7-afb53d52b0b8 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1459 microversion: 2.1 time: 0.760882 Oct 04 11:00:07.066678 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 168/363] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:06 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1459 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:07.085325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:07.085972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:07.107497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:07.107994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:07.108470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:07.109187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:07.109667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:07.110089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:07.951887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d4d72550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:07.970265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:07.970980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:07.980154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:07.984560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:07.993798 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56e49f92-45db-4418-be77-42e1a0fa5f6a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1471 microversion: 2.1 time: 0.926036 Oct 04 11:00:07.997278 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 169/364] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:07 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1471 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:08.025325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.026662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.027249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.043027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.043986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.044646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.053636 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c93a4d3-f25b-4d56-b5ba-ea3be7cad2df tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.043161 Oct 04 11:00:08.054953 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 196/365] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:00:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:08.072721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d4eed9d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.080832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.081696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.082512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.098840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.099727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.100346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.113644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.114796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.115479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.123472 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae35a238-0dd2-45aa-ae79-2180ac8dd838 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.060398 Oct 04 11:00:08.125398 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 197/366] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:08.130882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.131728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:08.140069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.140900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.141545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.142567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.143273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.143851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.163075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b7ea62a-032a-4bbf-a5e0-36a6486e4fc0 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Action: 'create', calling method: .version_select at 0x7f71d55a5c10>, body: {"keypair": {"name": "tempest-keypair-1802110397", "type": "ssh", "user_id": "53498142d1874468be57aa219f9b4887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzxzgtCyUaGBZ0aDCVosqTcm5YjhLAa61TR+rBXstnkSYiecpUvk8vLWJ8mmW2wkod8Ps1FxV/s/IC4nAsqH84GWHdus5H7161ecaEpcYk66ooE13x8sWbUXp+/2fctsw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:08.194749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0b7ea62a-032a-4bbf-a5e0-36a6486e4fc0 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Getting quotas for project 5a2167fc6c9b42819f95b6c4531f2593. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:08.207977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0b7ea62a-032a-4bbf-a5e0-36a6486e4fc0 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Getting quotas for user 271294a825e540308fede5f0c5e62116 and project 5a2167fc6c9b42819f95b6c4531f2593. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:08.223952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.224449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.225271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.225875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lazy-loading 'fault' on Instance uuid a3ada5a1-1d78-40e1-ac76-6d91c1826587 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:00:08.287514 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b7ea62a-032a-4bbf-a5e0-36a6486e4fc0 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.287077 Oct 04 11:00:08.292852 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 170/367] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:00:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 294 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:00:08.306373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d4d02670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.308565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.309266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.310601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.344929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.358293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.359605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.382494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.384313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.385098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.394111 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0abc8f3e-a20f-4ab5-a81c-db0b0b43322b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.099695 Oct 04 11:00:08.395932 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 171/368] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:08.406045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e15fc5d-f667-4620-9275-2f4d8120b832 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Action: 'create', calling method: .version_select at 0x7f71d4d02c10>, body: {"keypair": {"name": "tempest-keypair-2024889095", "type": "ssh", "user_id": "53498142d1874468be57aa219f9b4887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxntzzNcCMDNwLfTAeiem5nvWnk3MwiP/LAvCaC+0/casPJIIZTz/benkX8oe7Zpt/hgC5g7aBt8Mu3Zjjq/a1yUgoBXMl5ApUcc0ig2x9+NuqGXrA8A7UwaW87WKvmLw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:08.430232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3e15fc5d-f667-4620-9275-2f4d8120b832 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Getting quotas for project 5a2167fc6c9b42819f95b6c4531f2593. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:08.435498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3e15fc5d-f667-4620-9275-2f4d8120b832 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Getting quotas for user 271294a825e540308fede5f0c5e62116 and project 5a2167fc6c9b42819f95b6c4531f2593. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:08.480217 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e15fc5d-f667-4620-9275-2f4d8120b832 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.082618 Oct 04 11:00:08.482856 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 172/369] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:00:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:00:08.497160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74a56ae3-9a8d-4828-94be-b91361dcc86b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d4cef4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.499331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a56ae3-9a8d-4828-94be-b91361dcc86b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.500004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a56ae3-9a8d-4828-94be-b91361dcc86b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.500585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a56ae3-9a8d-4828-94be-b91361dcc86b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.538983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a56ae3-9a8d-4828-94be-b91361dcc86b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.540326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a56ae3-9a8d-4828-94be-b91361dcc86b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.540753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74a56ae3-9a8d-4828-94be-b91361dcc86b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.549608 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74a56ae3-9a8d-4828-94be-b91361dcc86b tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.061484 Oct 04 11:00:08.565639 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 173/370] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:08.570920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-452360db-e063-483e-bde1-9b462290a770 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Calling method '.version_select at 0x7f71d4cef040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.584018 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-452360db-e063-483e-bde1-9b462290a770 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1802110397?user_id=53498142d1874468be57aa219f9b4887" status: 200 len: 512 microversion: 2.10 time: 0.016971 Oct 04 11:00:08.586955 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 174/371] 10.222.0.23 () {60 vars in 1340 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1802110397?user_id=53498142d1874468be57aa219f9b4887 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:00:08.591530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a484e5c-a4df-429a-9bd8-51a3657b53af tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d4cefe50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.593847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a484e5c-a4df-429a-9bd8-51a3657b53af tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.594326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a484e5c-a4df-429a-9bd8-51a3657b53af tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.594825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a484e5c-a4df-429a-9bd8-51a3657b53af tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.616168 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a484e5c-a4df-429a-9bd8-51a3657b53af tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.027135 Oct 04 11:00:08.625568 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 175/372] 10.222.0.23 () {58 vars in 1179 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:08.638194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a028f8e7-8f3d-4604-b447-3b959784178d tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Action: 'create', calling method: .version_select at 0x7f71d4d02c10>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-62508111", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh8HxGGLJljSCVyRdDqUlggoaVeZB81NODzuWd4sjGU7pJ5JVJizvwG1+3cS+wk8aV2RsVBoMzY9J5NVf87CdrEEf+eneHh7Bb7+yseUo+9ftY1+MaH0i+XzkimFUMW9w=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:08.662853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a028f8e7-8f3d-4604-b447-3b959784178d tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Getting quotas for project 5a2167fc6c9b42819f95b6c4531f2593. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:08.667594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a028f8e7-8f3d-4604-b447-3b959784178d tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Getting quotas for user 271294a825e540308fede5f0c5e62116 and project 5a2167fc6c9b42819f95b6c4531f2593. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:08.695729 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a028f8e7-8f3d-4604-b447-3b959784178d tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.10 time: 0.068047 Oct 04 11:00:08.705936 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 176/373] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:00:08 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:00:08.712484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d4cefee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.714409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.722122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.725218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.746374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.746990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.747519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.808366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.812335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.815091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.826950 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30b26610-1735-4c96-b5df-df642952f86f tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.119751 Oct 04 11:00:08.833874 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 177/374] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:08.846197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8e6a9eb-4962-493a-865e-0b039c677684 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Calling method '.version_select at 0x7f71d4d02b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.850521 n-d-791135-8 devstack@n-api.service[122408]: WARNING oslo_db.sqlalchemy.utils [None req-c8e6a9eb-4962-493a-865e-0b039c677684 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 11:00:08.863954 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8e6a9eb-4962-493a-865e-0b039c677684 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=53498142d1874468be57aa219f9b4887" status: 200 len: 726 microversion: 2.10 time: 0.028695 Oct 04 11:00:08.864803 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 178/375] 10.222.0.23 () {60 vars in 1259 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-keypairs?user_id=53498142d1874468be57aa219f9b4887 => generated 726 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:00:08.869313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1949e251-847c-42f9-9575-326c45c731ef tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d4d6ac10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.871222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1949e251-847c-42f9-9575-326c45c731ef tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.871702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1949e251-847c-42f9-9575-326c45c731ef tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.872131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1949e251-847c-42f9-9575-326c45c731ef tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.889622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1949e251-847c-42f9-9575-326c45c731ef tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.890331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1949e251-847c-42f9-9575-326c45c731ef tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.890949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1949e251-847c-42f9-9575-326c45c731ef tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:08.898472 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1949e251-847c-42f9-9575-326c45c731ef tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.031854 Oct 04 11:00:08.899599 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 179/376] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:08.904416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba2c9511-0020-43dd-ab37-251e59578b88 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Calling method '.version_select at 0x7f71d4d6a700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.958774 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba2c9511-0020-43dd-ab37-251e59578b88 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-62508111" status: 204 len: 0 microversion: 2.10 time: 0.057835 Oct 04 11:00:08.959603 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 180/377] 10.222.0.23 () {60 vars in 1319 bytes} [Tue Oct 4 11:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-62508111 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:00:08.965128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40bade75-04b2-4c9f-a42b-e9435321b769 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d4d029d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:08.970558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40bade75-04b2-4c9f-a42b-e9435321b769 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:08.971310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40bade75-04b2-4c9f-a42b-e9435321b769 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:08.971760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40bade75-04b2-4c9f-a42b-e9435321b769 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:09.029872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40bade75-04b2-4c9f-a42b-e9435321b769 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:09.030525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40bade75-04b2-4c9f-a42b-e9435321b769 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:09.033053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40bade75-04b2-4c9f-a42b-e9435321b769 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:09.050617 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40bade75-04b2-4c9f-a42b-e9435321b769 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.089676 Oct 04 11:00:09.052344 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 181/378] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:09.068182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f55c1d8-4235-41ef-9dd3-82209e025cf0 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Calling method '.version_select at 0x7f71d4d02ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:09.090011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2,nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:09.110403 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f55c1d8-4235-41ef-9dd3-82209e025cf0 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024889095?user_id=53498142d1874468be57aa219f9b4887" status: 204 len: 0 microversion: 2.10 time: 0.056808 Oct 04 11:00:09.112575 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 182/379] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024889095?user_id=53498142d1874468be57aa219f9b4887 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:00:09.120487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:09.122055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:09.132123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:09.133008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:09.134059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:09.135235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:09.135968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:09.138116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:09.477114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:09.487977 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d0798f2-411c-4d9a-9293-0d32faf37f51 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1459 microversion: 2.1 time: 1.360968 Oct 04 11:00:09.489868 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 198/380] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:08 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1459 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:09.496099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Calling method '.version_select at 0x7f71d50b38b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:09.500366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:09.501586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:09.502665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:09.508106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:09.533415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:09.534309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:09.534983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:09.550677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:09.552121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:09.557623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:09.565101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:09.570460 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6160e4e1-f2f0-45a9-87d5-12bca30b496b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1471 microversion: 2.1 time: 0.456021 Oct 04 11:00:09.574514 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 183/381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:09 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1471 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:09.587125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e04dadf7-a977-4e1b-b48f-a5337e61b870 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] Calling method '.version_select at 0x7f71d4d6a4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:09.609664 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-567d985d-7033-411b-87b3-eb87ca15acf8 tempest-HypervisorAdminTestJSON-1342478288 tempest-HypervisorAdminTestJSON-1342478288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.118229 Oct 04 11:00:09.611953 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 199/382] 10.222.0.23 () {58 vars in 1173 bytes} [Tue Oct 4 11:00:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:09.641900 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e04dadf7-a977-4e1b-b48f-a5337e61b870 tempest-KeyPairsV210TestJSON-1065984527 tempest-KeyPairsV210TestJSON-1065984527-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1802110397?user_id=53498142d1874468be57aa219f9b4887" status: 204 len: 0 microversion: 2.10 time: 0.063590 Oct 04 11:00:09.652262 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 184/383] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1802110397?user_id=53498142d1874468be57aa219f9b4887 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:00:10.357170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e7f78aa7-eb67-4b9d-b0e4-b0eb1923e559 req-366dff2a-2220-4054-8f98-458367e01018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ada5a1-1d78-40e1-ac76-6d91c1826587", "name": "network-vif-deleted", "tag": "9a19f612-454a-488b-bbf2-774c1c1d5b98"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:10.402653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e7f78aa7-eb67-4b9d-b0e4-b0eb1923e559 req-366dff2a-2220-4054-8f98-458367e01018 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:10.403503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e7f78aa7-eb67-4b9d-b0e4-b0eb1923e559 req-366dff2a-2220-4054-8f98-458367e01018 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:10.404416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e7f78aa7-eb67-4b9d-b0e4-b0eb1923e559 req-366dff2a-2220-4054-8f98-458367e01018 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:10.443374 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e7f78aa7-eb67-4b9d-b0e4-b0eb1923e559 req-366dff2a-2220-4054-8f98-458367e01018 service nova] Creating event network-vif-deleted:9a19f612-454a-488b-bbf2-774c1c1d5b98 for instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 on n-h1-791135-8 Oct 04 11:00:10.459046 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e7f78aa7-eb67-4b9d-b0e4-b0eb1923e559 req-366dff2a-2220-4054-8f98-458367e01018 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109430 Oct 04 11:00:10.461896 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 200/384] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:10.511574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:10.512730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:10.520012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:10.520669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:10.521267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:10.522386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:10.529873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:10.530665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:10.598513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:10.599231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:10.599801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:10.600425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lazy-loading 'fault' on Instance uuid a3ada5a1-1d78-40e1-ac76-6d91c1826587 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:00:10.600541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:10.601487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:10.612254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:10.617260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:10.617970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:10.618799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:10.619370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:10.619940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:10.783164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2260573f8342a2ae252c245603c85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a702891ff9284b77b7d431d2ce819cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:10.794997 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b95a2d1b-96f8-4093-acb2-fb5359522a27 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 200 len: 1310 microversion: 2.1 time: 0.287108 Oct 04 11:00:10.797585 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 185/385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:10 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:11.240518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:11.252694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69f735da-1c9c-42fe-96fa-0f218ab400d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1471 microversion: 2.1 time: 0.656883 Oct 04 11:00:11.253781 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 201/386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:10 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1471 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:11.823406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:11.824107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:11.853991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:11.854859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:11.855738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:11.861790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:11.870185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:11.870979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:11.916591 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] HTTP exception thrown: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Request method failure captured: Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 HTTP/1.1 Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH8gBqOGoyRrsctV1eUqhU1BlPJ3ao5RTKGHa4UJCfSS12bpWhkW3Ufa22Nv-jePgPGGO0j4SwEd_zj-xfvKcheGE77OPgff7aNzLI5SN8mBuBTwBiiFXSVQMT_rTim1rrBKEKO1Arr4HDxM0_DZQ3xIfqHpIbOWc-G6n1PINX5FeA Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:00:11.918818 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a702891ff9284b77b7d431d2ce819cc2"}]}] Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: dd2260573f8342a2ae252c245603c85f Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:11.920068 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'a3ada5a1-1d78-40e1-ac76-6d91c1826587'} Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:11.920878 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:11.922055 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:11.928226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Returning 404 to user: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:11.929813 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4515c034-732b-4d62-b016-35c17aede334 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 404 len: 111 microversion: 2.1 time: 0.111027 Oct 04 11:00:11.933532 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 186/387] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:11 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:00:11.948241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:11.948751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:11.966194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:11.966801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:11.967418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:11.969929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:11.970391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:11.970808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.011436 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] HTTP exception thrown: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Request method failure captured: Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 HTTP/1.1 Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8gBqOGoyRrsctV1eUqhU1BlPJ3ao5RTKGHa4UJCfSS12bpWhkW3Ufa22Nv-jePgPGGO0j4SwEd_zj-xfvKcheGE77OPgff7aNzLI5SN8mBuBTwBiiFXSVQMT_rTim1rrBKEKO1Arr4HDxM0_DZQ3xIfqHpIbOWc-G6n1PINX5FeA Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:00:12.015876 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a702891ff9284b77b7d431d2ce819cc2"}]}] Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: dd2260573f8342a2ae252c245603c85f Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.017339 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a3ada5a1-1d78-40e1-ac76-6d91c1826587'} Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:12.018226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.019593 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.024636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Returning 404 to user: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:12.028162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-838e0341-4912-43c2-a988-159501a111fb tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 404 len: 111 microversion: 2.1 time: 0.088196 Oct 04 11:00:12.030725 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 202/388] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:00:11 2022] DELETE /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:12.038925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:12.039537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: a3ada5a1-1d78-40e1-ac76-6d91c1826587] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:12.054503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:12.056283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:12.057876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.058778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:12.064275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:12.064732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.105723 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] HTTP exception thrown: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Request method failure captured: Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 HTTP/1.1 Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH8gBqOGoyRrsctV1eUqhU1BlPJ3ao5RTKGHa4UJCfSS12bpWhkW3Ufa22Nv-jePgPGGO0j4SwEd_zj-xfvKcheGE77OPgff7aNzLI5SN8mBuBTwBiiFXSVQMT_rTim1rrBKEKO1Arr4HDxM0_DZQ3xIfqHpIbOWc-G6n1PINX5FeA Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:00:12.107284 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a702891ff9284b77b7d431d2ce819cc2"}]}] Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: dd2260573f8342a2ae252c245603c85f Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.108530 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'a3ada5a1-1d78-40e1-ac76-6d91c1826587'} Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:12.109173 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. Oct 04 11:00:12.110805 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.111739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Returning 404 to user: Instance a3ada5a1-1d78-40e1-ac76-6d91c1826587 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:12.111739 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e838fd42-274a-4d9d-9bbe-9d869f3d15f1 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587" status: 404 len: 111 microversion: 2.1 time: 0.073727 Oct 04 11:00:12.118219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:12.118913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:12.119100 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 187/389] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:12 2022] GET /compute/v2.1/servers/a3ada5a1-1d78-40e1-ac76-6d91c1826587 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:12.138451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:12.139049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:12.140774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.143984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:12.144714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:12.147597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.165927 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] HTTP exception thrown: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Request method failure captured: Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab HTTP/1.1 Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBH8gBqOGoyRrsctV1eUqhU1BlPJ3ao5RTKGHa4UJCfSS12bpWhkW3Ufa22Nv-jePgPGGO0j4SwEd_zj-xfvKcheGE77OPgff7aNzLI5SN8mBuBTwBiiFXSVQMT_rTim1rrBKEKO1Arr4HDxM0_DZQ3xIfqHpIbOWc-G6n1PINX5FeA Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:00:12.167827 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a702891ff9284b77b7d431d2ce819cc2"}]}] Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: dd2260573f8342a2ae252c245603c85f Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.169265 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '587b5421-7b9c-497c-a477-5d6147ee51ab'} Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:12.170131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.171416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.174846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Returning 404 to user: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:12.176918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0d30cc6d-75d5-448e-8f8b-9ce27057acd4 tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 404 len: 111 microversion: 2.1 time: 0.062886 Oct 04 11:00:12.177972 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 203/390] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:00:12 2022] DELETE /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:12.187046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:12.187579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] [instance: 587b5421-7b9c-497c-a477-5d6147ee51ab] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:12.198432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:12.198936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:12.199373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.200088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:12.204018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:12.204787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.238643 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] HTTP exception thrown: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Request method failure captured: Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab HTTP/1.1 Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBH8gBqOGoyRrsctV1eUqhU1BlPJ3ao5RTKGHa4UJCfSS12bpWhkW3Ufa22Nv-jePgPGGO0j4SwEd_zj-xfvKcheGE77OPgff7aNzLI5SN8mBuBTwBiiFXSVQMT_rTim1rrBKEKO1Arr4HDxM0_DZQ3xIfqHpIbOWc-G6n1PINX5FeA Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:00:12.240197 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a702891ff9284b77b7d431d2ce819cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a702891ff9284b77b7d431d2ce819cc2"}]}] Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: a702891ff9284b77b7d431d2ce819cc2 Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-948963974 Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: dd2260573f8342a2ae252c245603c85f Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersAdminTestJSON-948963974-project Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.241385 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '587b5421-7b9c-497c-a477-5d6147ee51ab'} Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:12.242053 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. Oct 04 11:00:12.243095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:12.244204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Returning 404 to user: Instance 587b5421-7b9c-497c-a477-5d6147ee51ab could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:12.244204 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab" status: 404 len: 111 microversion: 2.1 time: 0.059924 Oct 04 11:00:12.244204 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 188/391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:12 2022] GET /compute/v2.1/servers/587b5421-7b9c-497c-a477-5d6147ee51ab => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:12.281224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:12.282132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:12.293027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:12.295450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:12.296187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.297148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:12.300579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:12.301406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:12.885276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:12.902223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-41afd428-3068-4c16-9710-48c4f7afe78b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.624651 Oct 04 11:00:12.973965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 204/392] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:12 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:13.778371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:13.780138 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60090660-65f8-45aa-a8fe-7015fb1d196c tempest-DeleteServersAdminTestJSON-948963974 tempest-DeleteServersAdminTestJSON-948963974-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002054 Oct 04 11:00:13.780914 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 189/393] 10.222.0.23 () {56 vars in 886 bytes} [Tue Oct 4 11:00:13 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 11:00:13.930663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:13.931685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:13.950740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:13.952773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:13.953394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:13.957172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:13.962333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:13.962795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:14.295181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:14.313221 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc3a9278-dc88-420c-918a-9ff89a917191 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.386956 Oct 04 11:00:14.329383 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 205/394] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:13 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:15.344309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:15.345123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:15.361094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:15.363602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:15.364081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:15.364822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:15.365282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:15.365738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:16.043577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:16.054272 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-accc922a-cbcc-4e7a-aedf-6dea8a27710f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.716989 Oct 04 11:00:16.059617 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 190/395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:15 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:17.083862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:17.084563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:17.101274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:17.101807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:17.102240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:17.104497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:17.105029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:17.107290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:17.486950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:17.495980 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-617c35ad-c643-45ae-ae14-9b5396bcc499 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.415961 Oct 04 11:00:17.496957 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 206/396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:17 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:18.533835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:18.535041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:18.569211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:18.575283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:18.576038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:18.582114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:18.585220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:18.587152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:18.676310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:18.918038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:19.030609 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25b5157a-06ee-4ad3-a394-a63aa47cf305 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.505154 Oct 04 11:00:19.033864 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 191/397] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:18 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:20.064741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:20.069436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:20.094469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:20.095048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:20.095501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:20.096248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:20.116614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:20.117173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:20.166185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31c9cc44-cffc-4b7b-a4a3-b17bc7b717a1 tempest-InstanceUsageAuditLogTestJSON-582127936 tempest-InstanceUsageAuditLogTestJSON-582127936-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:20.208277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:20.270181 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31c9cc44-cffc-4b7b-a4a3-b17bc7b717a1 tempest-InstanceUsageAuditLogTestJSON-582127936 tempest-InstanceUsageAuditLogTestJSON-582127936-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 11:00:19" status: 200 len: 318 microversion: 2.1 time: 0.859137 Oct 04 11:00:20.285485 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 207/398] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:00:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2011%3A00%3A19 => generated 318 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:20.297438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3585bd96-dc4c-4b7a-99a5-cd30c915e88c tempest-InstanceUsageAuditLogTestJSON-582127936 tempest-InstanceUsageAuditLogTestJSON-582127936-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:20.338329 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3585bd96-dc4c-4b7a-99a5-cd30c915e88c tempest-InstanceUsageAuditLogTestJSON-582127936 tempest-InstanceUsageAuditLogTestJSON-582127936-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.052091 Oct 04 11:00:20.352679 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 208/399] 10.222.0.23 () {58 vars in 1185 bytes} [Tue Oct 4 11:00:20 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:20.629097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:20.643409 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0dce1a3-81b9-4c5a-8038-3e60c7854391 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.585666 Oct 04 11:00:20.647484 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 192/400] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:20 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:21.675713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:21.676407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:21.690930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:21.691620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:21.692219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:21.694149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:21.696575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:21.697262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:21.986459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:21.994646 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c2b264e9-b070-411e-9faf-3a81f0811c47 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.325257 Oct 04 11:00:21.997415 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 209/401] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:21 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:22.416669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-caad614d-962b-4f28-ba6a-749cd72dff6e tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Calling method '.version_select at 0x7f71d4cefe50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:23.027801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:23.028611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:23.039119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:23.041685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:23.042804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:23.044986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:23.047425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:23.048207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:23.307175 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-caad614d-962b-4f28-ba6a-749cd72dff6e tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9c8bf119f8ae40bab0f8a90454673d5b" status: 200 len: 371 microversion: 2.1 time: 1.543778 Oct 04 11:00:23.320924 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 193/402] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:00:21 2022] GET /compute/v2.1/os-quota-sets/9c8bf119f8ae40bab0f8a90454673d5b => generated 371 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:23.327903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e37745af-94b7-47df-a4fd-f12b95f5f26a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4dfeaf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:23.343590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:23.352334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c59df6ad-259f-4c59-9b84-d323bc76de2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.330480 Oct 04 11:00:23.358243 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 210/403] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:23 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:24.056599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37745af-94b7-47df-a4fd-f12b95f5f26a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:24.057199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37745af-94b7-47df-a4fd-f12b95f5f26a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:24.057641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37745af-94b7-47df-a4fd-f12b95f5f26a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:24.059654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37745af-94b7-47df-a4fd-f12b95f5f26a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:24.062572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37745af-94b7-47df-a4fd-f12b95f5f26a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:24.063235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e37745af-94b7-47df-a4fd-f12b95f5f26a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:24.287673 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e37745af-94b7-47df-a4fd-f12b95f5f26a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/9c8bf119f8ae40bab0f8a90454673d5b" status: 200 len: 328 microversion: 2.1 time: 0.963833 Oct 04 11:00:24.297331 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 194/404] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:00:23 2022] PUT /compute/v2.1/os-quota-sets/9c8bf119f8ae40bab0f8a90454673d5b => generated 328 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:24.306374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-997efed7-bccb-4d00-8f8e-a4b3e631bc00 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:24.341039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-997efed7-bccb-4d00-8f8e-a4b3e631bc00 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/9c8bf119f8ae40bab0f8a90454673d5b" status: 202 len: 0 microversion: 2.1 time: 0.043737 Oct 04 11:00:24.342841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 211/405] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:00:24 2022] DELETE /compute/v2.1/os-quota-sets/9c8bf119f8ae40bab0f8a90454673d5b => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:00:24.350885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a093870-cbec-4320-af02-66843625e7d8 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Calling method '.version_select at 0x7f71d4f253a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:24.392584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:24.396192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:24.411303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:24.415451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:24.416896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:24.420453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:24.421086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:24.433053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:24.924193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:24.933879 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35091ff1-caa4-4d63-a7eb-a8fa1bffd078 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.545679 Oct 04 11:00:24.962111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 212/406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:24 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:25.198103 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a093870-cbec-4320-af02-66843625e7d8 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/9c8bf119f8ae40bab0f8a90454673d5b" status: 200 len: 371 microversion: 2.1 time: 0.851149 Oct 04 11:00:25.213062 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 195/407] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:00:24 2022] GET /compute/v2.1/os-quota-sets/9c8bf119f8ae40bab0f8a90454673d5b => generated 371 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:25.880384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afc1bdc4-d264-495f-89b3-716a22887fe4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Calling method '.version_select at 0x7f71d4d6a550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:26.203842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-614830861", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:26.344211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:00:26.805226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:00:26.805738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:00:26.806217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:00:26.806630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:00:26.807044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:00:26.822869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:26.824015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:26.824675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:26.825730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:26.827048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:26.827639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:26.853114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Getting quotas for project bb6a52da46d849faa86fc2f417c37f6b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:26.859441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Getting quotas for user 969ad689cca044adaa015911fb7b75af and project bb6a52da46d849faa86fc2f417c37f6b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:26.874370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:00:26.878009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:00:26.941624 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e32ad9c9-934f-4fdc-b4a1-d620c3705621 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.537968 Oct 04 11:00:26.943075 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 213/408] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:00:26.948236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:26.949147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:26.958853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:26.959774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:26.960472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:26.961576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:26.962186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:26.962920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:26.996694 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afc1bdc4-d264-495f-89b3-716a22887fe4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/32541ebb7e5c48129721f1c6737d0df3/defaults" status: 200 len: 371 microversion: 2.1 time: 1.120642 Oct 04 11:00:27.007254 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 196/409] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:00:25 2022] GET /compute/v2.1/os-quota-sets/32541ebb7e5c48129721f1c6737d0df3/defaults => generated 371 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:27.027333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a55f2e8-4f4c-44d3-9501-7f7d227b2da6 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:27.030342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a55f2e8-4f4c-44d3-9501-7f7d227b2da6 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:27.184737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a55f2e8-4f4c-44d3-9501-7f7d227b2da6 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:27.194355 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a55f2e8-4f4c-44d3-9501-7f7d227b2da6 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1222 microversion: 2.1 time: 0.185604 Oct 04 11:00:27.216032 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 197/410] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:27 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:27.251925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:27.264741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab0e154e-94cd-4939-934a-64d6f6e56940 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.319463 Oct 04 11:00:27.275141 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 214/411] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:26 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:28.104097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30af7ca2-3552-4f3e-8ad6-f4e2425f0bc4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4d5b280>, body: {"quota_set": {"ram": "5120"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:28.182823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03f5e8ab-2bff-468f-828a-d02cbb0c7af0 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Calling method '.version_select at 0x7f71d4cc7160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:28.187834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03f5e8ab-2bff-468f-828a-d02cbb0c7af0 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:28.188321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03f5e8ab-2bff-468f-828a-d02cbb0c7af0 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:28.188761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03f5e8ab-2bff-468f-828a-d02cbb0c7af0 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:28.194874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03f5e8ab-2bff-468f-828a-d02cbb0c7af0 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:28.195373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03f5e8ab-2bff-468f-828a-d02cbb0c7af0 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:28.196022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03f5e8ab-2bff-468f-828a-d02cbb0c7af0 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:28.318598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30af7ca2-3552-4f3e-8ad6-f4e2425f0bc4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:28.320339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30af7ca2-3552-4f3e-8ad6-f4e2425f0bc4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:28.320921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30af7ca2-3552-4f3e-8ad6-f4e2425f0bc4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:28.321857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30af7ca2-3552-4f3e-8ad6-f4e2425f0bc4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:28.324796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30af7ca2-3552-4f3e-8ad6-f4e2425f0bc4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:28.325444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30af7ca2-3552-4f3e-8ad6-f4e2425f0bc4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:28.337510 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03f5e8ab-2bff-468f-828a-d02cbb0c7af0 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.816197 Oct 04 11:00:28.342167 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 198/412] 10.222.0.23 () {58 vars in 1128 bytes} [Tue Oct 4 11:00:27 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:28.360319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:28.361842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:28.369600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:28.370575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:28.371231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:28.372368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:28.373052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:28.374016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:28.397467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:RELEASE=2,nova_api:SELECT=87,nova_api:SAVEPOINT=1,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:28.485741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-30af7ca2-3552-4f3e-8ad6-f4e2425f0bc4 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a57d725f9dd44b578a1a0ebd8102700d" status: 200 len: 328 microversion: 2.1 time: 0.385804 Oct 04 11:00:28.490089 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 215/413] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:00:28 2022] PUT /compute/v2.1/os-quota-sets/a57d725f9dd44b578a1a0ebd8102700d => generated 328 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:00:28.504349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:28.506861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:28.526802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:28.530666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:28.531288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:28.532215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:28.534809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:28.535542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:28.615682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:28.648579 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-910587ba-b76b-475e-8c1c-7f5533ad62ec tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1218 microversion: 2.1 time: 0.304039 Oct 04 11:00:28.652692 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 199/414] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:28 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:29.016069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:29.040365 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5cf53247-f476-4a4b-8360-3021ebba7dfb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.547928 Oct 04 11:00:29.040986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 216/415] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:28 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:29.090358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb94aa90-d6df-426e-affb-4e1a72c5806f tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Calling method '.version_select at 0x7f71d4d72ca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.152595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2729862-0e95-4979-b639-9494c2917177 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Calling method '.version_select at 0x7f71d4cefc10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.178142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2729862-0e95-4979-b639-9494c2917177 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f203a7a6761742e0b840d3d74d3c0dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f66063f51aa4de8a058d64f0bd0f36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2729862-0e95-4979-b639-9494c2917177 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Request method failure captured: Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJIEjOBtrIl9oD7yEBc-gT-s_1hxvgqM5Tqc4f_FOKcI1V8D9DLgevHWRxaZ6RzIPdzzYhsnIn_m7FfcXLp-7OOEq6EDklqiTLqM4G1kTEj4IKi7lD-cLNyNRi5BJ7pnD4eTSy6Tpw5sdKFLex-liY1EM7SpOg5YmFU9i308kYTPZ0 Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:00:29.189951 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f66063f51aa4de8a058d64f0bd0f36a"}]}] Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: f203a7a6761742e0b840d3d74d3c0dcb Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: action_args: {} Oct 04 11:00:29.191799 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:29.192603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 11:00:29.195492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.199277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2729862-0e95-4979-b639-9494c2917177 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.215901 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2729862-0e95-4979-b639-9494c2917177 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.561856 Oct 04 11:00:29.216586 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 200/416] 10.222.0.23 () {58 vars in 1128 bytes} [Tue Oct 4 11:00:28 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 563 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:29.257066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51584a6e-03cb-45eb-abd9-624c226eeb6d tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Calling method '.version_select at 0x7f71d4cc73a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.265405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51584a6e-03cb-45eb-abd9-624c226eeb6d tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f203a7a6761742e0b840d3d74d3c0dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f66063f51aa4de8a058d64f0bd0f36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51584a6e-03cb-45eb-abd9-624c226eeb6d tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Request method failure captured: Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts/n-d-791135-8/reboot HTTP/1.1 Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJIEjOBtrIl9oD7yEBc-gT-s_1hxvgqM5Tqc4f_FOKcI1V8D9DLgevHWRxaZ6RzIPdzzYhsnIn_m7FfcXLp-7OOEq6EDklqiTLqM4G1kTEj4IKi7lD-cLNyNRi5BJ7pnD4eTSy6Tpw5sdKFLex-liY1EM7SpOg5YmFU9i308kYTPZ0 Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:00:29.271547 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f66063f51aa4de8a058d64f0bd0f36a"}]}] Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: f203a7a6761742e0b840d3d74d3c0dcb Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'n-d-791135-8'} Oct 04 11:00:29.272959 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:29.276221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 11:00:29.277303 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.278380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51584a6e-03cb-45eb-abd9-624c226eeb6d tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.280292 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-51584a6e-03cb-45eb-abd9-624c226eeb6d tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-791135-8/reboot" status: 403 len: 111 microversion: 2.1 time: 0.048927 Oct 04 11:00:29.283546 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 201/417] 10.222.0.23 () {58 vars in 1188 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-hosts/n-d-791135-8/reboot => generated 111 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:29.304395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf213177-500d-4183-a349-d73b8ac90d7d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Calling method '.version_select at 0x7f71d55a5c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.329235 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cf213177-500d-4183-a349-d73b8ac90d7d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf213177-500d-4183-a349-d73b8ac90d7d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Request method failure captured: Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJLQD3k1c-lPl3D5-bJndlZKjlB7VQYlqYCLE94mrnnUAuYGsNKHRC4bE28pd5fUS96KoAZXSw-S7pXb15YGAXWbOrlNICGHxuVBTeo0VHWyTBMtGVjqgGolX_7KCJwLCk1lJT8Ov_pqXcvsB1AUUVCcQLxNgZ6UENwjKBni5E2Jrw Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:00:29.334982 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cc27e51e47d4200b801236e9dc57da9"}]}] Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4764d28b9c2642c0868f58e433d2065f Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'nonexistent_hostname'} Oct 04 11:00:29.336292 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:00:29.337084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 11:00:29.338251 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf213177-500d-4183-a349-d73b8ac90d7d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf213177-500d-4183-a349-d73b8ac90d7d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.049848 Oct 04 11:00:29.339468 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 202/418] 10.222.0.23 () {58 vars in 1212 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:00:29.380556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0371424-cc4b-45be-a1da-e8ac5c724549 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Calling method '.version_select at 0x7f71d4d28dc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.390712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0371424-cc4b-45be-a1da-e8ac5c724549 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f203a7a6761742e0b840d3d74d3c0dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f66063f51aa4de8a058d64f0bd0f36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0371424-cc4b-45be-a1da-e8ac5c724549 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Request method failure captured: Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts/n-d-791135-8 HTTP/1.1 Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJIEjOBtrIl9oD7yEBc-gT-s_1hxvgqM5Tqc4f_FOKcI1V8D9DLgevHWRxaZ6RzIPdzzYhsnIn_m7FfcXLp-7OOEq6EDklqiTLqM4G1kTEj4IKi7lD-cLNyNRi5BJ7pnD4eTSy6Tpw5sdKFLex-liY1EM7SpOg5YmFU9i308kYTPZ0 Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:00:29.392748 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f66063f51aa4de8a058d64f0bd0f36a"}]}] Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: f203a7a6761742e0b840d3d74d3c0dcb Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'n-d-791135-8'} Oct 04 11:00:29.393995 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:29.394718 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 11:00:29.395741 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.396749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0371424-cc4b-45be-a1da-e8ac5c724549 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.396749 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b0371424-cc4b-45be-a1da-e8ac5c724549 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-791135-8" status: 403 len: 109 microversion: 2.1 time: 0.033205 Oct 04 11:00:29.399171 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 203/419] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-hosts/n-d-791135-8 => generated 109 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:29.417182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d842076-e748-4de6-b3db-ee9b2a002629 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Calling method '.version_select at 0x7f71d4cc7790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.445252 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7d842076-e748-4de6-b3db-ee9b2a002629 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d842076-e748-4de6-b3db-ee9b2a002629 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Request method failure captured: Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJLQD3k1c-lPl3D5-bJndlZKjlB7VQYlqYCLE94mrnnUAuYGsNKHRC4bE28pd5fUS96KoAZXSw-S7pXb15YGAXWbOrlNICGHxuVBTeo0VHWyTBMtGVjqgGolX_7KCJwLCk1lJT8Ov_pqXcvsB1AUUVCcQLxNgZ6UENwjKBni5E2Jrw Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:00:29.450038 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cc27e51e47d4200b801236e9dc57da9"}]}] Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4764d28b9c2642c0868f58e433d2065f Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'nonexistent_hostname'} Oct 04 11:00:29.451325 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.452071 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.453160 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.460734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d842076-e748-4de6-b3db-ee9b2a002629 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.462281 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d842076-e748-4de6-b3db-ee9b2a002629 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.056437 Oct 04 11:00:29.465930 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 204/420] 10.222.0.23 () {58 vars in 1191 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:00:29.481552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-beb07d65-7dfa-4b9e-b397-8a0db8dc8374 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Calling method '.version_select at 0x7f71d66bd700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.486376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-beb07d65-7dfa-4b9e-b397-8a0db8dc8374 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f203a7a6761742e0b840d3d74d3c0dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f66063f51aa4de8a058d64f0bd0f36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-beb07d65-7dfa-4b9e-b397-8a0db8dc8374 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Request method failure captured: Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts/n-d-791135-8/shutdown HTTP/1.1 Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJIEjOBtrIl9oD7yEBc-gT-s_1hxvgqM5Tqc4f_FOKcI1V8D9DLgevHWRxaZ6RzIPdzzYhsnIn_m7FfcXLp-7OOEq6EDklqiTLqM4G1kTEj4IKi7lD-cLNyNRi5BJ7pnD4eTSy6Tpw5sdKFLex-liY1EM7SpOg5YmFU9i308kYTPZ0 Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:00:29.488910 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f66063f51aa4de8a058d64f0bd0f36a"}]}] Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: f203a7a6761742e0b840d3d74d3c0dcb Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'n-d-791135-8'} Oct 04 11:00:29.490239 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:29.491088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 11:00:29.492125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.508686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-beb07d65-7dfa-4b9e-b397-8a0db8dc8374 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.511847 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-beb07d65-7dfa-4b9e-b397-8a0db8dc8374 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-791135-8/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.040267 Oct 04 11:00:29.519702 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 205/421] 10.222.0.23 () {58 vars in 1194 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-hosts/n-d-791135-8/shutdown => generated 113 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:29.551536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbae457d-e518-4ab3-ba57-a7b154d43401 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Calling method '.version_select at 0x7f71d4d6a4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.623981 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-bbae457d-e518-4ab3-ba57-a7b154d43401 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbae457d-e518-4ab3-ba57-a7b154d43401 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Request method failure captured: Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJLQD3k1c-lPl3D5-bJndlZKjlB7VQYlqYCLE94mrnnUAuYGsNKHRC4bE28pd5fUS96KoAZXSw-S7pXb15YGAXWbOrlNICGHxuVBTeo0VHWyTBMtGVjqgGolX_7KCJwLCk1lJT8Ov_pqXcvsB1AUUVCcQLxNgZ6UENwjKBni5E2Jrw Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:00:29.633715 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cc27e51e47d4200b801236e9dc57da9"}]}] Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4764d28b9c2642c0868f58e433d2065f Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'nonexistent_hostname'} Oct 04 11:00:29.635172 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:00:29.635947 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 11:00:29.637054 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.641815 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.666089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbae457d-e518-4ab3-ba57-a7b154d43401 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.671481 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bbae457d-e518-4ab3-ba57-a7b154d43401 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.150255 Oct 04 11:00:29.672138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb94aa90-d6df-426e-affb-4e1a72c5806f tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:29.674675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb94aa90-d6df-426e-affb-4e1a72c5806f tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:29.678132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb94aa90-d6df-426e-affb-4e1a72c5806f tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:29.680724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb94aa90-d6df-426e-affb-4e1a72c5806f tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:29.686405 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 206/422] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:00:29.690235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb94aa90-d6df-426e-affb-4e1a72c5806f tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:29.694965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb94aa90-d6df-426e-affb-4e1a72c5806f tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:29.710713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.713701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:29.728421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:29.729264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:29.731448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:29.734266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:29.736351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:29.737904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:29.786045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cb94aa90-d6df-426e-affb-4e1a72c5806f tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a57d725f9dd44b578a1a0ebd8102700d/detail" status: 200 len: 916 microversion: 2.1 time: 0.731452 Oct 04 11:00:29.794666 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 217/423] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-quota-sets/a57d725f9dd44b578a1a0ebd8102700d/detail => generated 916 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:29.822916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f3b47a9-4025-47c1-b636-a45d49d9c4c7 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Calling method '.version_select at 0x7f71d4d30d30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.827101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f3b47a9-4025-47c1-b636-a45d49d9c4c7 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f203a7a6761742e0b840d3d74d3c0dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f66063f51aa4de8a058d64f0bd0f36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f3b47a9-4025-47c1-b636-a45d49d9c4c7 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Request method failure captured: Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-hosts/n-d-791135-8/startup HTTP/1.1 Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJIEjOBtrIl9oD7yEBc-gT-s_1hxvgqM5Tqc4f_FOKcI1V8D9DLgevHWRxaZ6RzIPdzzYhsnIn_m7FfcXLp-7OOEq6EDklqiTLqM4G1kTEj4IKi7lD-cLNyNRi5BJ7pnD4eTSy6Tpw5sdKFLex-liY1EM7SpOg5YmFU9i308kYTPZ0 Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:00:29.833025 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f66063f51aa4de8a058d64f0bd0f36a"}]}] Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f203a7a6761742e0b840d3d74d3c0dcb Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'n-d-791135-8'} Oct 04 11:00:29.834673 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:29.835449 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 11:00:29.836516 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.843885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f3b47a9-4025-47c1-b636-a45d49d9c4c7 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.844986 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f3b47a9-4025-47c1-b636-a45d49d9c4c7 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-791135-8/startup" status: 403 len: 110 microversion: 2.1 time: 0.048889 Oct 04 11:00:29.848024 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 218/424] 10.222.0.23 () {58 vars in 1191 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-hosts/n-d-791135-8/startup => generated 110 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:29.857498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ef82222-ba53-4962-8d1f-acf7c7675ecf tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Calling method '.version_select at 0x7f71d4d72ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:29.870278 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4ef82222-ba53-4962-8d1f-acf7c7675ecf tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ef82222-ba53-4962-8d1f-acf7c7675ecf tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Request method failure captured: Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJLQD3k1c-lPl3D5-bJndlZKjlB7VQYlqYCLE94mrnnUAuYGsNKHRC4bE28pd5fUS96KoAZXSw-S7pXb15YGAXWbOrlNICGHxuVBTeo0VHWyTBMtGVjqgGolX_7KCJwLCk1lJT8Ov_pqXcvsB1AUUVCcQLxNgZ6UENwjKBni5E2Jrw Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:00:29.875510 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cc27e51e47d4200b801236e9dc57da9"}]}] Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4764d28b9c2642c0868f58e433d2065f Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'nonexistent_hostname'} Oct 04 11:00:29.877024 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:00:29.878276 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 11:00:29.879309 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:29.880366 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.885172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ef82222-ba53-4962-8d1f-acf7c7675ecf tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.886383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ef82222-ba53-4962-8d1f-acf7c7675ecf tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033052 Oct 04 11:00:29.903382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 219/425] 10.222.0.23 () {58 vars in 1215 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 11:00:29.917422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a6f6a46-0414-4863-943a-8671674ac48a tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4cf5430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a6f6a46-0414-4863-943a-8671674ac48a tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Request method failure captured: Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/os-hosts/n-d-791135-8 HTTP/1.1 Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 51 Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJLQD3k1c-lPl3D5-bJndlZKjlB7VQYlqYCLE94mrnnUAuYGsNKHRC4bE28pd5fUS96KoAZXSw-S7pXb15YGAXWbOrlNICGHxuVBTeo0VHWyTBMtGVjqgGolX_7KCJwLCk1lJT8Ov_pqXcvsB1AUUVCcQLxNgZ6UENwjKBni5E2Jrw Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:00:29.932977 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cc27e51e47d4200b801236e9dc57da9"}]}] Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4764d28b9c2642c0868f58e433d2065f Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:00:29.934255 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'n-d-791135-8', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance: Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.935005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.936475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.937646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.937646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:00:29.937646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:00:29.937646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 11:00:29.937646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.939678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a6f6a46-0414-4863-943a-8671674ac48a tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.940809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a6f6a46-0414-4863-943a-8671674ac48a tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-791135-8" status: 400 len: 199 microversion: 2.1 time: 0.034873 Oct 04 11:00:29.941976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 220/426] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 11:00:29 2022] PUT /compute/v2.1/os-hosts/n-d-791135-8 => generated 199 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:00:29.969836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fd6e722-d6b9-4e1f-892f-bb0a0b8b6065 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4d300d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fd6e722-d6b9-4e1f-892f-bb0a0b8b6065 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Request method failure captured: Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/os-hosts/n-d-791135-8 HTTP/1.1 Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 51 Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJLQD3k1c-lPl3D5-bJndlZKjlB7VQYlqYCLE94mrnnUAuYGsNKHRC4bE28pd5fUS96KoAZXSw-S7pXb15YGAXWbOrlNICGHxuVBTeo0VHWyTBMtGVjqgGolX_7KCJwLCk1lJT8Ov_pqXcvsB1AUUVCcQLxNgZ6UENwjKBni5E2Jrw Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:00:29.984676 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cc27e51e47d4200b801236e9dc57da9"}]}] Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4764d28b9c2642c0868f58e433d2065f Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:00:29.987309 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'n-d-791135-8', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance: Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.988078 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:29.989499 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:29.992236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:29.992236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:00:29.992236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:00:29.992236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 11:00:29.992236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:29.993975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fd6e722-d6b9-4e1f-892f-bb0a0b8b6065 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:29.995882 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8fd6e722-d6b9-4e1f-892f-bb0a0b8b6065 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-791135-8" status: 400 len: 189 microversion: 2.1 time: 0.040589 Oct 04 11:00:30.012093 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 221/427] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 11:00:29 2022] PUT /compute/v2.1/os-hosts/n-d-791135-8 => generated 189 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:00:30.027116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-081e3901-71b6-4110-841c-46e1bd32c7f3 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Action: 'update', calling method: .version_select at 0x7f71d4d0e8b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:30.046662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-081e3901-71b6-4110-841c-46e1bd32c7f3 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f203a7a6761742e0b840d3d74d3c0dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f66063f51aa4de8a058d64f0bd0f36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-081e3901-71b6-4110-841c-46e1bd32c7f3 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Request method failure captured: Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/os-hosts/n-d-791135-8 HTTP/1.1 Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 50 Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJIEjOBtrIl9oD7yEBc-gT-s_1hxvgqM5Tqc4f_FOKcI1V8D9DLgevHWRxaZ6RzIPdzzYhsnIn_m7FfcXLp-7OOEq6EDklqiTLqM4G1kTEj4IKi7lD-cLNyNRi5BJ7pnD4eTSy6Tpw5sdKFLex-liY1EM7SpOg5YmFU9i308kYTPZ0 Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:00:30.052836 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f66063f51aa4de8a058d64f0bd0f36a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f66063f51aa4de8a058d64f0bd0f36a"}]}] Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2f66063f51aa4de8a058d64f0bd0f36a Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1960706980 Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f203a7a6761742e0b840d3d74d3c0dcb Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1960706980-project Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 11:00:30.054219 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'n-d-791135-8', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:30.055038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 11:00:30.066837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.086089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-081e3901-71b6-4110-841c-46e1bd32c7f3 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:30.086998 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-081e3901-71b6-4110-841c-46e1bd32c7f3 tempest-HostsAdminNegativeTestJSON-1960706980 tempest-HostsAdminNegativeTestJSON-1960706980-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-791135-8" status: 403 len: 111 microversion: 2.1 time: 0.068320 Oct 04 11:00:30.089850 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 222/428] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 11:00:30 2022] PUT /compute/v2.1/os-hosts/n-d-791135-8 => generated 111 bytes in 72 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:00:30.102070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:30.102703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:30.123125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:30.123125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:30.123125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:30.124160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:30.125113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:30.125743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:30.589572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:30.606129 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f3eda5d-b2a8-41f1-8a51-141241f8260c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1292 microversion: 2.1 time: 0.913291 Oct 04 11:00:30.607081 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 207/429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:29 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1292 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:30.619035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-284a9d72-a8ac-4d0d-9355-91606204eb9d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4cc7550>, body: {"status": null, "maintenance_mode": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-284a9d72-a8ac-4d0d-9355-91606204eb9d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Request method failure captured: Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: request: PUT /compute/v2.1/os-hosts/n-d-791135-8 HTTP/1.1 Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 42 Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJLQD3k1c-lPl3D5-bJndlZKjlB7VQYlqYCLE94mrnnUAuYGsNKHRC4bE28pd5fUS96KoAZXSw-S7pXb15YGAXWbOrlNICGHxuVBTeo0VHWyTBMtGVjqgGolX_7KCJwLCk1lJT8Ov_pqXcvsB1AUUVCcQLxNgZ6UENwjKBni5E2Jrw Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:00:30.641413 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cc27e51e47d4200b801236e9dc57da9"}]}] Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4764d28b9c2642c0868f58e433d2065f Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: {"status": null, "maintenance_mode": null} Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 11:00:30.642629 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'n-d-791135-8', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance: Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi None Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:30.643423 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:30.644748 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:30.649308 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:00:30.649308 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:00:30.649308 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 11:00:30.649308 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:00:30.649308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-284a9d72-a8ac-4d0d-9355-91606204eb9d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:30.649308 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-284a9d72-a8ac-4d0d-9355-91606204eb9d tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-791135-8" status: 400 len: 127 microversion: 2.1 time: 0.033196 Oct 04 11:00:30.649308 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 208/430] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 11:00:30 2022] PUT /compute/v2.1/os-hosts/n-d-791135-8 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:00:30.661911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4cef700>, body: {"quota_set": {"ram": "2048"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:31.010691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:31.024363 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e099a1d-8946-43df-94bc-c3cec87a0721 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.932212 Oct 04 11:00:31.028662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 223/431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:30 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:31.035976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eae17c05-beeb-412b-8912-caeea9fbc593 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4d72c10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:31.058648 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.hosts [None req-eae17c05-beeb-412b-8912-caeea9fbc593 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Enabling host nonexistent_hostname. Oct 04 11:00:31.077737 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-eae17c05-beeb-412b-8912-caeea9fbc593 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eae17c05-beeb-412b-8912-caeea9fbc593 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Request method failure captured: Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 50 Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJLQD3k1c-lPl3D5-bJndlZKjlB7VQYlqYCLE94mrnnUAuYGsNKHRC4bE28pd5fUS96KoAZXSw-S7pXb15YGAXWbOrlNICGHxuVBTeo0VHWyTBMtGVjqgGolX_7KCJwLCk1lJT8Ov_pqXcvsB1AUUVCcQLxNgZ6UENwjKBni5E2Jrw Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:00:31.081129 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1cc27e51e47d4200b801236e9dc57da9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1cc27e51e47d4200b801236e9dc57da9"}]}] Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 1cc27e51e47d4200b801236e9dc57da9 Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-415584097 Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4764d28b9c2642c0868f58e433d2065f Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-HostsAdminNegativeTestJSON-415584097-project-admin Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:31.082486 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 11:00:31.083271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:00:31.084244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 11:00:31.085334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:31.093614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eae17c05-beeb-412b-8912-caeea9fbc593 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:31.097069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eae17c05-beeb-412b-8912-caeea9fbc593 tempest-HostsAdminNegativeTestJSON-415584097 tempest-HostsAdminNegativeTestJSON-415584097-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.064958 Oct 04 11:00:31.097703 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 224/432] 10.222.0.23 () {60 vars in 1211 bytes} [Tue Oct 4 11:00:31 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:00:31.125913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:31.128358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:31.129282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:31.131527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:31.132921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:31.133667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:31.214356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-312881374", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:31.219303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:31.219931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:31.220376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:31.225935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:31.226658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:31.227263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:31.316854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:00:31.378053 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-339c97d1-a5de-40b4-9189-96248297a8fd tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a57d725f9dd44b578a1a0ebd8102700d?user_id=94de4f13456944f08bfc19c2cee815f6" status: 200 len: 328 microversion: 2.1 time: 0.731404 Oct 04 11:00:31.378700 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 209/433] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:00:30 2022] PUT /compute/v2.1/os-quota-sets/a57d725f9dd44b578a1a0ebd8102700d?user_id=94de4f13456944f08bfc19c2cee815f6 => generated 328 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:31.396552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06292683-a8d2-4a5f-97e2-03c98ee572af tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Calling method '.version_select at 0x7f71d4d6a670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:31.687435 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06292683-a8d2-4a5f-97e2-03c98ee572af tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a57d725f9dd44b578a1a0ebd8102700d?user_id=94de4f13456944f08bfc19c2cee815f6" status: 200 len: 370 microversion: 2.1 time: 0.300729 Oct 04 11:00:31.689385 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 210/434] 10.222.0.23 () {58 vars in 1323 bytes} [Tue Oct 4 11:00:31 2022] GET /compute/v2.1/os-quota-sets/a57d725f9dd44b578a1a0ebd8102700d?user_id=94de4f13456944f08bfc19c2cee815f6 => generated 370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:31.694810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:31.697881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:31.730367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:31.731221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:31.732596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:31.733917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:31.734974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:31.737050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:31.938962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:31.950952 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cbec0440-cb93-4127-8033-73342b850b6a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1280 microversion: 2.1 time: 0.260247 Oct 04 11:00:31.953385 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 211/435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:31 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1280 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:32.010888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:00:32.011293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:00:32.011777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:00:32.012293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:00:32.012717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:00:32.041187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:32.043003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:32.043479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:32.046580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:32.048809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:32.049803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:32.053206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:32.054567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:32.075872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:32.079359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:32.080336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:32.081289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:32.082028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:32.082676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:32.136313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Getting quotas for project e12ae544c2fb4abcb027575847a24f28. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:32.155210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Getting quotas for user 6d826e411532459c8ae9b6e9d29965be and project e12ae544c2fb4abcb027575847a24f28. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:32.222071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:00:32.235303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:00:32.346215 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-262f1512-a2a1-4f2d-a233-2694bbe73a43 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247364 Oct 04 11:00:32.347982 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 225/436] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:00:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:00:32.354133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0bf2c963-277f-40ce-941a-5245be41e994 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Calling method '.version_select at 0x7f71d4d0eca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:32.772997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:32.786982 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33e7ca5b-de62-4d82-b50b-837826e8c118 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1476 microversion: 2.1 time: 0.739055 Oct 04 11:00:32.787570 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 212/437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:32 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1476 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:32.827259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f21fbb67-b811-4baa-a5ae-a3b0aa54afef tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:32.827890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f21fbb67-b811-4baa-a5ae-a3b0aa54afef tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:32.846777 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0bf2c963-277f-40ce-941a-5245be41e994 tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/32541ebb7e5c48129721f1c6737d0df3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.497002 Oct 04 11:00:32.849260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:32.850334 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 226/438] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:00:32 2022] GET /compute/v2.1/os-quota-sets/32541ebb7e5c48129721f1c6737d0df3/defaults => generated 371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:32.870570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b7e35b5-10be-430f-92c9-5e8eb6abc82a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4d0e3a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:33.256092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f21fbb67-b811-4baa-a5ae-a3b0aa54afef tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:33.268163 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f21fbb67-b811-4baa-a5ae-a3b0aa54afef tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1218 microversion: 2.1 time: 0.463263 Oct 04 11:00:33.272618 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 213/439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:32 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1218 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:33.278203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:33.279216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:33.285692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:33.286485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:33.287144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:33.288071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:33.288893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:33.289553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:33.622855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b7e35b5-10be-430f-92c9-5e8eb6abc82a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:33.624712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b7e35b5-10be-430f-92c9-5e8eb6abc82a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:33.627999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b7e35b5-10be-430f-92c9-5e8eb6abc82a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:33.633323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b7e35b5-10be-430f-92c9-5e8eb6abc82a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:33.635805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b7e35b5-10be-430f-92c9-5e8eb6abc82a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:33.637330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b7e35b5-10be-430f-92c9-5e8eb6abc82a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:34.056198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:34.067769 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20d32d1a-7e1c-4c72-8b28-022665a541ad tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.793481 Oct 04 11:00:34.068803 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 214/440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:33 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:34.078990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:34.084943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:34.094824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:34.101060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:34.107641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:34.109963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:34.113113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:34.113601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:34.207500 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b7e35b5-10be-430f-92c9-5e8eb6abc82a tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/32541ebb7e5c48129721f1c6737d0df3" status: 200 len: 329 microversion: 2.1 time: 1.349188 Oct 04 11:00:34.209414 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 227/441] 10.222.0.23 () {60 vars in 1263 bytes} [Tue Oct 4 11:00:32 2022] PUT /compute/v2.1/os-quota-sets/32541ebb7e5c48129721f1c6737d0df3 => generated 329 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:34.221582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-19b55b2c-1cd0-4510-bf14-cb4a10a1846c tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4d5b280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:34.489979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19b55b2c-1cd0-4510-bf14-cb4a10a1846c tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:34.491154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19b55b2c-1cd0-4510-bf14-cb4a10a1846c tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:34.495523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19b55b2c-1cd0-4510-bf14-cb4a10a1846c tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:34.498827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19b55b2c-1cd0-4510-bf14-cb4a10a1846c tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:34.500803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19b55b2c-1cd0-4510-bf14-cb4a10a1846c tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:34.502777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19b55b2c-1cd0-4510-bf14-cb4a10a1846c tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:34.711734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=21,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:35.023329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:35.047933 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a84c53b7-6c6a-41dd-a7bf-54afec34e901 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1475 microversion: 2.1 time: 0.972857 Oct 04 11:00:35.049327 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 215/442] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:34 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1475 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:35.058977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:35.061908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:35.075834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:35.077884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:35.078625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:35.079634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:35.080345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:35.081184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:35.313964 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-19b55b2c-1cd0-4510-bf14-cb4a10a1846c tempest-QuotasAdminTestJSON-70740837 tempest-QuotasAdminTestJSON-70740837-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/32541ebb7e5c48129721f1c6737d0df3" status: 200 len: 329 microversion: 2.1 time: 1.094110 Oct 04 11:00:35.331940 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 228/443] 10.222.0.23 () {60 vars in 1263 bytes} [Tue Oct 4 11:00:34 2022] PUT /compute/v2.1/os-quota-sets/32541ebb7e5c48129721f1c6737d0df3 => generated 329 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:35.353122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:35.355111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:35.371502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:35.372992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:35.375726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:35.379759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:35.380808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:35.381808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:35.566168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:35.579310 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29e74352-3c66-48e5-8b2c-3fe3e2f9d61c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1276 microversion: 2.1 time: 0.527462 Oct 04 11:00:35.585659 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 216/444] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:35 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1276 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:35.603058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-22587eda-4dcb-4d9a-8d38-b0ff90297fc1 req-59045f71-28a5-4d5b-a14e-f11e124d16e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f801b4d9-89bd-4232-9031-fbb661178744", "name": "network-vif-unplugged", "status": "completed", "tag": "ad4bec16-719d-4826-bf8e-6aefb10f7672"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:35.628854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-22587eda-4dcb-4d9a-8d38-b0ff90297fc1 req-59045f71-28a5-4d5b-a14e-f11e124d16e8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:35.632488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-22587eda-4dcb-4d9a-8d38-b0ff90297fc1 req-59045f71-28a5-4d5b-a14e-f11e124d16e8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:35.633570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-22587eda-4dcb-4d9a-8d38-b0ff90297fc1 req-59045f71-28a5-4d5b-a14e-f11e124d16e8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:35.697880 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-22587eda-4dcb-4d9a-8d38-b0ff90297fc1 req-59045f71-28a5-4d5b-a14e-f11e124d16e8 service nova] Creating event network-vif-unplugged:ad4bec16-719d-4826-bf8e-6aefb10f7672 for instance f801b4d9-89bd-4232-9031-fbb661178744 on n-h1-791135-8 Oct 04 11:00:35.749686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-22587eda-4dcb-4d9a-8d38-b0ff90297fc1 req-59045f71-28a5-4d5b-a14e-f11e124d16e8 service nova] Instance f801b4d9-89bd-4232-9031-fbb661178744 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:00:35.791998 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-22587eda-4dcb-4d9a-8d38-b0ff90297fc1 req-59045f71-28a5-4d5b-a14e-f11e124d16e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.203484 Oct 04 11:00:35.792771 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 217/445] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:36.048246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:36.061365 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-89aa1d0c-8037-4df2-99db-75af561d51b8 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.718940 Oct 04 11:00:36.073460 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 229/446] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:35 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:36.080721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:36.082816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:36.092439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:36.093126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:36.093767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:36.095381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:36.095974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:36.097008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:36.564845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:36.581784 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a2904b3-1ebe-410c-9099-77c694e2e724 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1475 microversion: 2.1 time: 0.505734 Oct 04 11:00:36.601599 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 218/447] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:36 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1475 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:36.617182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:36.618811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:36.637053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:36.642308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:36.643302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:36.648308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:36.650342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:36.651678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:37.030818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:37.047678 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0588e972-b69f-4099-afb3-9b192cbcae13 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1276 microversion: 2.1 time: 0.436677 Oct 04 11:00:37.050777 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 230/448] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:36 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1276 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:37.088078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:37.088587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:37.097271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:37.097803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:37.098231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:37.101632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:37.102562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:37.108701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:37.397933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1fbd5506-9d4e-494c-9659-b17d2ae90ea4 req-2072741e-35b4-4faa-b540-f6c762905178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e85299-d082-4a60-927f-3fa1a611ea75", "tag": "ad2a0ed9-3e3d-4f15-b07f-b258dd88b21c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:37.416918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1fbd5506-9d4e-494c-9659-b17d2ae90ea4 req-2072741e-35b4-4faa-b540-f6c762905178 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:37.417421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1fbd5506-9d4e-494c-9659-b17d2ae90ea4 req-2072741e-35b4-4faa-b540-f6c762905178 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:37.417855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1fbd5506-9d4e-494c-9659-b17d2ae90ea4 req-2072741e-35b4-4faa-b540-f6c762905178 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:37.447131 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1fbd5506-9d4e-494c-9659-b17d2ae90ea4 req-2072741e-35b4-4faa-b540-f6c762905178 service nova] Creating event network-changed:ad2a0ed9-3e3d-4f15-b07f-b258dd88b21c for instance d6e85299-d082-4a60-927f-3fa1a611ea75 on n-h1-791135-8 Oct 04 11:00:37.448025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:37.458506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1fbd5506-9d4e-494c-9659-b17d2ae90ea4 req-2072741e-35b4-4faa-b540-f6c762905178 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068604 Oct 04 11:00:37.459101 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 231/449] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:00:37.461201 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-300ef806-475b-475a-9573-b088e44bf34c tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.376863 Oct 04 11:00:37.465325 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 219/450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:37 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:37.609991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:37.610599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:37.621824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:37.622542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:37.624003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:37.624913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:37.628233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:37.628907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:38.058538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:38.077089 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56138bb6-2dd0-4a68-99fe-12e702abbeae tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1475 microversion: 2.1 time: 0.467993 Oct 04 11:00:38.081907 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 220/451] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:37 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1475 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:38.096536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e90d41e8-0362-4f44-94c4-f4a3390fd44f req-925b5923-b2a7-4e6f-a705-b9d15e84fc2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f801b4d9-89bd-4232-9031-fbb661178744", "tag": "ad4bec16-719d-4826-bf8e-6aefb10f7672"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:38.143793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e90d41e8-0362-4f44-94c4-f4a3390fd44f req-925b5923-b2a7-4e6f-a705-b9d15e84fc2e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:38.148838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e90d41e8-0362-4f44-94c4-f4a3390fd44f req-925b5923-b2a7-4e6f-a705-b9d15e84fc2e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:38.154941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e90d41e8-0362-4f44-94c4-f4a3390fd44f req-925b5923-b2a7-4e6f-a705-b9d15e84fc2e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:38.194622 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e90d41e8-0362-4f44-94c4-f4a3390fd44f req-925b5923-b2a7-4e6f-a705-b9d15e84fc2e service nova] Creating event network-changed:ad4bec16-719d-4826-bf8e-6aefb10f7672 for instance f801b4d9-89bd-4232-9031-fbb661178744 on n-h1-791135-8 Oct 04 11:00:38.210104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-e90d41e8-0362-4f44-94c4-f4a3390fd44f req-925b5923-b2a7-4e6f-a705-b9d15e84fc2e service nova] Instance f801b4d9-89bd-4232-9031-fbb661178744 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:00:38.236124 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e90d41e8-0362-4f44-94c4-f4a3390fd44f req-925b5923-b2a7-4e6f-a705-b9d15e84fc2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151987 Oct 04 11:00:38.236729 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 221/452] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:38.247382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:38.252466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:38.266185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:38.266944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:38.267537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:38.268382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:38.268976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:38.269566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:38.311584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1903877201", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "f0bf75d3-271a-43d6-b516-b6797bcc3a40"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:38.432033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] validate_networks() for [('f0bf75d3-271a-43d6-b516-b6797bcc3a40', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:00:38.438438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:38.446621 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6df58e2-e5d2-44c6-b1ef-a3143bdd5d68 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1276 microversion: 2.1 time: 0.203900 Oct 04 11:00:38.447198 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 222/453] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:38 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:38.794227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Calling method '.version_select at 0x7f71d66bd700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:38.799155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:38.799725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:38.800844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:38.847232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:38.848233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:38.848679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:38.863403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:38.863890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:38.864476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:38.871968 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3cb5224e-a235-4eb0-99fa-381d3362a545 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.419924 Oct 04 11:00:38.879663 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 223/454] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:00:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:38.885586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:38.885929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:38.893498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:38.893989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:38.894430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:38.895222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:38.895684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:38.896105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.435875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:00:39.436351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:00:39.436753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:00:39.437160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:00:39.437595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:00:39.441928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:39.444645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:39.447218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.447694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.448121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.450077 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6be69d7a-2887-44e8-8adb-e28ebe935afa tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.569165 Oct 04 11:00:39.453648 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 224/455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:38 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:39.458246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.458550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Calling method '.version_select at 0x7f71d4d6a670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:39.459197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.459809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.460545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.461227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.461897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.477129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:39.480925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for project 83765ee4f79c49f49b8af1a56a260450. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:39.486728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.487212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for user 27f40f692eac4ea39019fe4921b054f7 and project 83765ee4f79c49f49b8af1a56a260450. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:39.487870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.488504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.500998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:00:39.504605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:00:39.538190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.545797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.546586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.560016 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d67f322-178e-4862-98c8-7946930a026d tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-791135-8/servers" status: 200 len: 354 microversion: 2.1 time: 0.105076 Oct 04 11:00:39.562382 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 225/456] 10.222.0.23 () {58 vars in 1212 bytes} [Tue Oct 4 11:00:39 2022] GET /compute/v2.1/os-hypervisors/n-h1-791135-8/servers => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:39.572904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:39.583409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:39.588630 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-62b2dbe6-a766-47da-88f6-78d1403a82e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.982214 Oct 04 11:00:39.589612 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 232/457] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:00:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:00:39.603761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.605678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:39.606705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:39.608750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.610285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.613761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.614347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.614879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.683995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.684450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.684891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.692998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:39.696706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:39.699779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:39.772157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:40.031129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:40.054483 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70792429-3cff-4f54-9b78-3df0e65321f9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1473 microversion: 2.1 time: 0.485796 Oct 04 11:00:40.069376 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 226/458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:39 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1473 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:40.069764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:40.078699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Calling method '.version_select at 0x7f71d4c8fb80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:40.080906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:40.081593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:40.082226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:40.089054 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5c8276b-92b3-4585-9079-c82036a81201 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.478961 Oct 04 11:00:40.091687 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 233/459] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:39 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:40.100855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0f8fde1-fd7d-410a-9ebf-8f9c1a274355 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:40.102334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0f8fde1-fd7d-410a-9ebf-8f9c1a274355 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:40.131242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:40.132667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:40.133308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:40.154653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:40.155253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:40.155693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:40.185211 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-766a235a-01e0-40ef-9a04-4fb271ad1d76 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.126245 Oct 04 11:00:40.210615 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 227/460] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:00:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:40.219789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20e7993e-707c-4a80-ab28-fd3cbc44b049 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Calling method '.version_select at 0x7f71d4cc7280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:40.238909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e7993e-707c-4a80-ab28-fd3cbc44b049 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:40.239785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e7993e-707c-4a80-ab28-fd3cbc44b049 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:40.241900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e7993e-707c-4a80-ab28-fd3cbc44b049 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:40.302273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0f8fde1-fd7d-410a-9ebf-8f9c1a274355 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:40.304763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e7993e-707c-4a80-ab28-fd3cbc44b049 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:40.307002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e7993e-707c-4a80-ab28-fd3cbc44b049 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:40.310148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-20e7993e-707c-4a80-ab28-fd3cbc44b049 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:40.317533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0f8fde1-fd7d-410a-9ebf-8f9c1a274355 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:40.331530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0f8fde1-fd7d-410a-9ebf-8f9c1a274355 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:40.333082 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0f8fde1-fd7d-410a-9ebf-8f9c1a274355 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1262 microversion: 2.25 time: 0.237733 Oct 04 11:00:40.344153 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20e7993e-707c-4a80-ab28-fd3cbc44b049 tempest-HypervisorAdminUnderV252Test-2077751006 tempest-HypervisorAdminUnderV252Test-2077751006-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-791135-8/search" status: 200 len: 104 microversion: 2.1 time: 0.113220 Oct 04 11:00:40.346621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 234/461] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:40 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1262 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:40.356612 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 228/462] 10.222.0.23 () {58 vars in 1209 bytes} [Tue Oct 4 11:00:40 2022] GET /compute/v2.1/os-hypervisors/n-h1-791135-8/search => generated 104 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:40.476173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:40.483247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:40.494847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:40.495694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:40.496698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:40.499646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:40.500402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:40.501219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:41.085014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:41.086254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:41.107339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:41.108631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:41.111386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:41.113717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:41.118438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:41.119256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:41.217663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:41.226798 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac3757fe-c597-4199-9ff6-a9e713889039 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.754760 Oct 04 11:00:41.233102 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 235/463] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:40 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:41.246260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:41.248971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:41.273619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:41.278704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:41.291079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:41.293724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:41.303721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:41.310071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:41.311461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.018883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:42.027942 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-47425ee0-a342-40c0-9ab4-2c3605b4bdd8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.793432 Oct 04 11:00:42.041593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:42.050188 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 236/464] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:41 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:42.056986 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6e878ef-3d13-4ee0-84e9-a65ca85a689b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1470 microversion: 2.1 time: 0.977009 Oct 04 11:00:42.077380 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 229/465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:41 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1470 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:42.088681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:42.089314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:42.091320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:42.092650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:42.104445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:42.109149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:42.110034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.112019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:42.113516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:42.114125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.122431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:42.124328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:42.124768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.129901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:42.130476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:42.130922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.279266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:42.291271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:42.294246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:42.297932 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca67e8c8-690b-40aa-9fd2-c8b8a2b0a62e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1320 microversion: 2.25 time: 0.246479 Oct 04 11:00:42.302030 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 237/466] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:42 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:42.322824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:42.323607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:42.342312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:42.344066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:42.345194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.348104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:42.349288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:42.352564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.391124 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3afb7bc-5acb-442e-811f-f97a5d092e66 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744/action" status: 204 len: 0 microversion: 2.1 time: 0.302476 Oct 04 11:00:42.401565 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 230/467] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:00:42 2022] POST /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744/action => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:00:42.428181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:42.430428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:42.459354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:42.460059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:42.463670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.464473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:42.464950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:42.465398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:42.831996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:42.844674 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc7345d1-90bf-4628-b965-69eebd872e75 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.538530 Oct 04 11:00:42.845298 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 238/468] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:42 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:43.056286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:43.056929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:43.068847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:43.069338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:43.069803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:43.070507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:43.070961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:43.071388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:43.261395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:43.805236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:43.854582 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f00dc107-39a2-473b-bf13-bbafc4d58ed9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1470 microversion: 2.1 time: 1.449522 Oct 04 11:00:43.856264 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 231/469] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:42 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1470 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:43.885649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:43.887657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:43.903580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:43.906343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:43.911059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:43.916599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:43.917963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:43.918860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:44.456732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:44.465808 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95acdbc1-1800-4823-9ef3-948e311a95e3 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 1.413554 Oct 04 11:00:44.478046 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 239/470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:43 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:44.483585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f6ec9bac-272e-4010-9945-0599ef3711a9 req-4b5a5ec1-28c3-496f-a7e5-5324316c564c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d695d7-c959-4c4f-9018-0c1a72b30010", "tag": "7cb823ba-3c8a-4b76-8bf0-5becf5096e1a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:44.496123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6ec9bac-272e-4010-9945-0599ef3711a9 req-4b5a5ec1-28c3-496f-a7e5-5324316c564c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:44.496605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6ec9bac-272e-4010-9945-0599ef3711a9 req-4b5a5ec1-28c3-496f-a7e5-5324316c564c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:44.497040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6ec9bac-272e-4010-9945-0599ef3711a9 req-4b5a5ec1-28c3-496f-a7e5-5324316c564c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:44.532457 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f6ec9bac-272e-4010-9945-0599ef3711a9 req-4b5a5ec1-28c3-496f-a7e5-5324316c564c service nova] Creating event network-changed:7cb823ba-3c8a-4b76-8bf0-5becf5096e1a for instance b0d695d7-c959-4c4f-9018-0c1a72b30010 on n-h1-791135-8 Oct 04 11:00:44.554755 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f6ec9bac-272e-4010-9945-0599ef3711a9 req-4b5a5ec1-28c3-496f-a7e5-5324316c564c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067279 Oct 04 11:00:44.562733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 240/471] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:44.570652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:44.571644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:44.592261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:44.593713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:44.594348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:44.595879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:44.596545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:44.597128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:44.635546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:44.647877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:44.653485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:44.655809 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b6019e4-67ab-4dbc-9bf5-ac5d98f6f96a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1362 microversion: 2.25 time: 0.797020 Oct 04 11:00:44.656558 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 232/472] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:43 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1362 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:44.883846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:44.884456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:44.894697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:44.895192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:44.895626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:44.896335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:44.896789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:44.897210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:45.090227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:45.100936 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7d42021-4bee-4502-92e3-62a21284d9bc tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.534311 Oct 04 11:00:45.121255 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 241/473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:44 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:45.331547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:45.340257 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3195a04b-1e34-46d7-b6e4-34f60dfdc8a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1470 microversion: 2.1 time: 0.460466 Oct 04 11:00:45.354249 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 233/474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:44 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1470 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:45.506630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:45.507283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:45.517078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:45.517608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:45.518047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:45.522371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:45.523017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:45.523613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:45.686394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:45.687613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:45.699037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:45.702560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:45.703283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:45.704187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:45.707639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:45.708271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:45.979273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:45.990923 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4bbb7ce2-3d43-45e1-92ed-20d5937aedd7 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.488290 Oct 04 11:00:45.991821 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 242/475] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:45 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:46.128486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:46.129083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:46.139812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:46.140316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:46.140757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:46.141478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:46.141966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:46.148916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:46.567964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:46.581517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-163537bd-9f21-43f2-9dd1-433174beafed tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.457108 Oct 04 11:00:46.582718 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 243/476] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:46 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:46.589302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:46.590266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:46.598798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:46.599511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:46.600092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:46.601139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:46.601765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:46.602334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:46.758263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:46.771134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:46.778298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:46.780783 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28f8c5a2-10f4-45b2-bb80-ef181d7a59be tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1362 microversion: 2.25 time: 1.099050 Oct 04 11:00:46.784053 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 234/477] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:45 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1362 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:00:46.821308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3eb297e0-9aa4-4267-8b03-7e60ffafa52f req-2470eaf8-3c86-4a8b-9b0a-6139c8942582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bf74f9-21f7-4f34-9676-662ac379bf2b", "tag": "572986c9-5f62-4f60-abf7-58a1035c9adf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:46.845389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3eb297e0-9aa4-4267-8b03-7e60ffafa52f req-2470eaf8-3c86-4a8b-9b0a-6139c8942582 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:46.845810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3eb297e0-9aa4-4267-8b03-7e60ffafa52f req-2470eaf8-3c86-4a8b-9b0a-6139c8942582 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:46.846230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3eb297e0-9aa4-4267-8b03-7e60ffafa52f req-2470eaf8-3c86-4a8b-9b0a-6139c8942582 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:46.880601 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3eb297e0-9aa4-4267-8b03-7e60ffafa52f req-2470eaf8-3c86-4a8b-9b0a-6139c8942582 service nova] Creating event network-changed:572986c9-5f62-4f60-abf7-58a1035c9adf for instance 03bf74f9-21f7-4f34-9676-662ac379bf2b on n-h2-791135-8 Oct 04 11:00:46.893096 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3eb297e0-9aa4-4267-8b03-7e60ffafa52f req-2470eaf8-3c86-4a8b-9b0a-6139c8942582 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076802 Oct 04 11:00:46.896731 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 235/478] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:00:46.920096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-de5056ea-4bd0-4408-b880-c83aa1fac097 req-e0a30feb-8556-4714-b6b7-cbfd33b37677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f801b4d9-89bd-4232-9031-fbb661178744", "name": "network-vif-plugged", "status": "completed", "tag": "ad4bec16-719d-4826-bf8e-6aefb10f7672"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:46.928240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:46.943496 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99c73c71-0329-4c87-8026-99843ced024d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1462 microversion: 2.1 time: 0.358047 Oct 04 11:00:46.944095 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 244/479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:46 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1462 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:46.968027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-de5056ea-4bd0-4408-b880-c83aa1fac097 req-e0a30feb-8556-4714-b6b7-cbfd33b37677 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:46.968514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-de5056ea-4bd0-4408-b880-c83aa1fac097 req-e0a30feb-8556-4714-b6b7-cbfd33b37677 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:46.972920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-de5056ea-4bd0-4408-b880-c83aa1fac097 req-e0a30feb-8556-4714-b6b7-cbfd33b37677 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:46.976266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:46.977113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:46.993477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:46.994181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:46.996326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:46.997294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:46.999932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:47.000520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:47.014493 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-de5056ea-4bd0-4408-b880-c83aa1fac097 req-e0a30feb-8556-4714-b6b7-cbfd33b37677 service nova] Creating event network-vif-plugged:ad4bec16-719d-4826-bf8e-6aefb10f7672 for instance f801b4d9-89bd-4232-9031-fbb661178744 on n-h1-791135-8 Oct 04 11:00:47.029471 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-de5056ea-4bd0-4408-b880-c83aa1fac097 req-e0a30feb-8556-4714-b6b7-cbfd33b37677 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114972 Oct 04 11:00:47.035128 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 236/480] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:47.049911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:47.050787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:47.058964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:47.059676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:47.061180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:47.062226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:47.063515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:47.064102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:47.433207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:47.446415 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f051737d-68a1-42f4-8f97-5205cdc82aec tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.406654 Oct 04 11:00:47.448441 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 237/481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:47 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:47.579492 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d114b53a-0c4c-4e45-b189-4bdd5a9b5001 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1613 microversion: 2.1 time: 0.613267 Oct 04 11:00:47.581053 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 245/482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:46 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1613 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:47.608221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:47.610205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:47.621302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:47.621872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:47.622509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:47.623541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:47.651757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:47.652578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:47.678452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a70d17c-331c-473e-84c7-cb633aa086a8 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '.version_select at 0x7f71d4c7eca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:47.694024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a70d17c-331c-473e-84c7-cb633aa086a8 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:47.694518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a70d17c-331c-473e-84c7-cb633aa086a8 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:47.694958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a70d17c-331c-473e-84c7-cb633aa086a8 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:47.749404 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a70d17c-331c-473e-84c7-cb633aa086a8 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.106648 Oct 04 11:00:47.774960 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 246/483] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 11:00:47 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:00:47.861600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:47.862231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:47.870170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:UPDATE=12,nova_api:SELECT=74,nova_api:INSERT=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:47.887725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:47.888180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:47.894107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:47.894916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:47.895396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:47.896179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:48.076965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:48.107132 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db912438-5016-4e0f-a4ea-c38d4ada4853 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 0.502735 Oct 04 11:00:48.116115 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 238/484] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:47 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:48.134980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-888888456", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:48.228102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:48.236435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:00:48.237077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:48.238532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:48.242463 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-938cb114-a281-4aec-bce0-2c7bbabf82e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1362 microversion: 2.25 time: 0.383559 Oct 04 11:00:48.244743 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 247/485] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:47 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:48.472361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:48.480225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:48.494289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:48.497050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:48.497597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:48.500943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:48.502902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:48.503443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:48.944013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:00:48.944426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:00:48.945610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:00:48.946236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:00:48.946649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:00:48.961687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:48.962631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:48.963374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:48.964401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:48.965558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:48.966951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:48.987368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:48.991883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for user b024d221d4784e2399fd7676706cbc04 and project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:49.012950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:00:49.018496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:00:49.064127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:49.076825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91ba6322-880c-4754-8ea8-9a83d3bbf0c1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.608182 Oct 04 11:00:49.077435 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 248/486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:48 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:49.079931 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5335601f-533e-4759-a6f6-71004b214e79 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962466 Oct 04 11:00:49.081479 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 239/487] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:00:49.092597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d53176e8-c5d2-4c5e-ac34-c89f61772ace tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:49.093545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d53176e8-c5d2-4c5e-ac34-c89f61772ace tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:49.144028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:49.145273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:49.159233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:49.160121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:49.162575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:49.164582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:49.167855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:49.177860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:49.217178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d53176e8-c5d2-4c5e-ac34-c89f61772ace tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:49.227451 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d53176e8-c5d2-4c5e-ac34-c89f61772ace tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1212 microversion: 2.1 time: 0.139074 Oct 04 11:00:49.228236 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 249/488] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:49 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1212 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:49.240707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-07e97d53-ea82-4585-af62-06ca8c42e2d6 req-51983a9f-26d9-4457-b26d-89eddddfa93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e85299-d082-4a60-927f-3fa1a611ea75", "name": "network-vif-plugged", "status": "completed", "tag": "ad2a0ed9-3e3d-4f15-b07f-b258dd88b21c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:49.262870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-07e97d53-ea82-4585-af62-06ca8c42e2d6 req-51983a9f-26d9-4457-b26d-89eddddfa93b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:49.264523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-07e97d53-ea82-4585-af62-06ca8c42e2d6 req-51983a9f-26d9-4457-b26d-89eddddfa93b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:49.265677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-07e97d53-ea82-4585-af62-06ca8c42e2d6 req-51983a9f-26d9-4457-b26d-89eddddfa93b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:49.285627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-07e97d53-ea82-4585-af62-06ca8c42e2d6 req-51983a9f-26d9-4457-b26d-89eddddfa93b service nova] Creating event network-vif-plugged:ad2a0ed9-3e3d-4f15-b07f-b258dd88b21c for instance d6e85299-d082-4a60-927f-3fa1a611ea75 on n-h1-791135-8 Oct 04 11:00:49.291698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-07e97d53-ea82-4585-af62-06ca8c42e2d6 req-51983a9f-26d9-4457-b26d-89eddddfa93b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060664 Oct 04 11:00:49.292839 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 250/489] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:49.299727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:49.300688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:49.318192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:49.321855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:49.324115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:49.325244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:49.327384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:49.329966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:49.471980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:50.366899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:50.377185 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-375470c4-468a-4501-8864-aa70e860b94b tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1322 microversion: 2.1 time: 1.239710 Oct 04 11:00:50.384778 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 240/490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:49 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1322 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:50.539142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:50.548894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:50.551092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:50.557884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af473869-d295-48f4-b96d-64d1ffdcbd78 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1362 microversion: 2.25 time: 1.261182 Oct 04 11:00:50.569387 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 251/491] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:49 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1362 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:50.579547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:50.579547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:50.598001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:50.598406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:50.598863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:50.603025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:50.603533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:50.605518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:50.689993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ff8a79f-ab81-41b2-8db3-62148103c9af tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4cefa60>, body: {"quota_set": {"ram": "5120"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:50.805935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a79f-ab81-41b2-8db3-62148103c9af tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:50.812948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a79f-ab81-41b2-8db3-62148103c9af tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:50.813711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a79f-ab81-41b2-8db3-62148103c9af tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:50.817877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a79f-ab81-41b2-8db3-62148103c9af tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:50.819066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a79f-ab81-41b2-8db3-62148103c9af tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:50.821540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a79f-ab81-41b2-8db3-62148103c9af tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:50.888917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:50.920359 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d7b56fc-0496-45e7-9f95-6c731fb51d4c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.355095 Oct 04 11:00:50.921993 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 252/492] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:50 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:50.931372 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ff8a79f-ab81-41b2-8db3-62148103c9af tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/90fabe953ea347fda4afd255edef4038" status: 200 len: 240 microversion: 2.36 time: 0.545095 Oct 04 11:00:50.932225 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 241/493] 10.222.0.23 () {62 vars in 1303 bytes} [Tue Oct 4 11:00:50 2022] PUT /compute/v2.1/os-quota-sets/90fabe953ea347fda4afd255edef4038 => generated 240 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:00:50.943393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e2af2fa-1ccb-4bbe-af36-eed24f682aca tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Calling method '.version_select at 0x7f71d4e4dee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:50.949926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:50.957340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:50.995979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:50.999739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.003710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.008171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.009691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.010142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.044208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e2af2fa-1ccb-4bbe-af36-eed24f682aca tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.047589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e2af2fa-1ccb-4bbe-af36-eed24f682aca tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.048198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e2af2fa-1ccb-4bbe-af36-eed24f682aca tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.049160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e2af2fa-1ccb-4bbe-af36-eed24f682aca tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.057552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e2af2fa-1ccb-4bbe-af36-eed24f682aca tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.058302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e2af2fa-1ccb-4bbe-af36-eed24f682aca tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.097105 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e2af2fa-1ccb-4bbe-af36-eed24f682aca tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/90fabe953ea347fda4afd255edef4038/detail" status: 200 len: 672 microversion: 2.36 time: 0.157331 Oct 04 11:00:51.097983 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 242/494] 10.222.0.23 () {60 vars in 1304 bytes} [Tue Oct 4 11:00:50 2022] GET /compute/v2.1/os-quota-sets/90fabe953ea347fda4afd255edef4038/detail => generated 672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:00:51.283361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:51.286432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:51.299871 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d94a9955-a94b-4e85-b44f-ffccf697749f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1264 microversion: 2.1 time: 0.370767 Oct 04 11:00:51.305649 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 253/495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:50 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1264 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:51.345634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4c600d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:51.412359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:51.413231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:51.430413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.431189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.432745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.436330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.437083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.438890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.455516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.456978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.457676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.458632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.459307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.460122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.476845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:51.502524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.503365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.504030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.504978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.505670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.506331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.608297 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1c9d97f-01a3-49ac-8b7b-837d10118665 tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/90fabe953ea347fda4afd255edef4038?user_id=35f1e53dccca46d48cd7627241186a8a" status: 200 len: 240 microversion: 2.36 time: 0.266750 Oct 04 11:00:51.609264 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 243/496] 10.222.0.23 () {62 vars in 1384 bytes} [Tue Oct 4 11:00:51 2022] PUT /compute/v2.1/os-quota-sets/90fabe953ea347fda4afd255edef4038?user_id=35f1e53dccca46d48cd7627241186a8a => generated 240 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:00:51.620016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:51.620902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:51.633683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.634949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.637092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.638815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.641101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.641848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.649271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:00:51.773672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:51.786709 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25695059-e493-43ae-99e1-bae7b52cb76e tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1471 microversion: 2.1 time: 0.379175 Oct 04 11:00:51.787320 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 254/497] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:51 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:51.798940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-cca9a5a6-5d57-4135-b7ce-d392ca2dda39 req-734b2578-ad30-4aed-a73b-4a32a8093297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d695d7-c959-4c4f-9018-0c1a72b30010", "name": "network-vif-plugged", "status": "completed", "tag": "7cb823ba-3c8a-4b76-8bf0-5becf5096e1a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:51.839947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cca9a5a6-5d57-4135-b7ce-d392ca2dda39 req-734b2578-ad30-4aed-a73b-4a32a8093297 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:51.843544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cca9a5a6-5d57-4135-b7ce-d392ca2dda39 req-734b2578-ad30-4aed-a73b-4a32a8093297 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:51.845345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cca9a5a6-5d57-4135-b7ce-d392ca2dda39 req-734b2578-ad30-4aed-a73b-4a32a8093297 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:51.863959 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-cca9a5a6-5d57-4135-b7ce-d392ca2dda39 req-734b2578-ad30-4aed-a73b-4a32a8093297 service nova] Creating event network-vif-plugged:7cb823ba-3c8a-4b76-8bf0-5becf5096e1a for instance b0d695d7-c959-4c4f-9018-0c1a72b30010 on n-h1-791135-8 Oct 04 11:00:51.871624 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-cca9a5a6-5d57-4135-b7ce-d392ca2dda39 req-734b2578-ad30-4aed-a73b-4a32a8093297 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080470 Oct 04 11:00:51.873155 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 255/498] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:51.880898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77eaacab-99ce-4b45-9f2f-15b5abe24fcc tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] Calling method '.version_select at 0x7f71d4d300d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:52.047132 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77eaacab-99ce-4b45-9f2f-15b5abe24fcc tempest-QuotasAdminTestV236-2062139806 tempest-QuotasAdminTestV236-2062139806-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/90fabe953ea347fda4afd255edef4038?user_id=35f1e53dccca46d48cd7627241186a8a" status: 200 len: 282 microversion: 2.36 time: 0.172548 Oct 04 11:00:52.047643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:52.047797 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 256/499] 10.222.0.23 () {60 vars in 1364 bytes} [Tue Oct 4 11:00:51 2022] GET /compute/v2.1/os-quota-sets/90fabe953ea347fda4afd255edef4038?user_id=35f1e53dccca46d48cd7627241186a8a => generated 282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:00:52.061962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:52.062864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:52.070932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:52.082882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:52.087812 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-647f4793-e0e5-48f0-9e86-fd33035b4913 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1362 microversion: 2.25 time: 0.470217 Oct 04 11:00:52.089803 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 244/500] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:51 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:52.090341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.091447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.091925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.095272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.095824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.096272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.099713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:52.103853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:52.126746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.127501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.128377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.130710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.131349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.132117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.261897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Request method failure captured: Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75/diagnostics HTTP/1.1 Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJGoN_hV_NXPjub2KGDGS_U187_YTqgFmY2VwpTacIvBcwUGIL-7X8Sx0LwD-ruUrBuEx_qCI0fe6_ydV2A5lDTjyayHcCYsmR-Rd1HF6yi1yiEs6bc3Y0JUrL2anPZK1qUJIca3464TRC1yUaci4xQ37KIiwn6Vo1iqC4XxjduPRo Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bb6a52da46d849faa86fc2f417c37f6b Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2050423162 Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:00:52.276282 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bb6a52da46d849faa86fc2f417c37f6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb6a52da46d849faa86fc2f417c37f6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb6a52da46d849faa86fc2f417c37f6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bb6a52da46d849faa86fc2f417c37f6b"}]}] Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2050423162 Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bb6a52da46d849faa86fc2f417c37f6b Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2050423162 Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiagnosticsNegativeTest-2050423162-project Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 969ad689cca044adaa015911fb7b75af Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2050423162-project Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:00:52.277595 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': 'd6e85299-d082-4a60-927f-3fa1a611ea75'} Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:00:52.278260 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:52.280034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:52.281055 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-83c05384-6384-4eb2-a871-27508f10023a tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.226033 Oct 04 11:00:52.281055 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 257/501] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:00:52 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75/diagnostics => generated 117 bytes in 230 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:52.302489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:52.304103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:52.328504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.329704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.330907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.332858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.333362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.338047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.401055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:00:52.429529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:52.440381 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5aee5cf-6b7f-454a-9f72-038eb6bf6506 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.348783 Oct 04 11:00:52.440976 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 245/502] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:52 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:52.458625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:52.459858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:52.484979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.485906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.486504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.488985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.490300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.497182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.624990 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ca1927a-c985-4665-babf-8d3998040987 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 204 len: 0 microversion: 2.1 time: 0.334506 Oct 04 11:00:52.626302 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 258/503] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:00:52 2022] DELETE /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:00:52.632656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:52.640030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:52.642913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:52.645940 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-777a2fe8-8e2d-47d2-a9ff-1ec6020f67a2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1270 microversion: 2.1 time: 0.203118 Oct 04 11:00:52.647199 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 246/504] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:52 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1270 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:52.661003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.661791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.665067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.666046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:52.667127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:52.669374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:52.896024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:52.911077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f427c85c-f2a2-43dc-a622-16daa792a727 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1477 microversion: 2.1 time: 0.277653 Oct 04 11:00:52.912021 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 259/505] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:52 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:53.112162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:53.112775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:53.120643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:53.125744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:53.126699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:53.127604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:53.128208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:53.128788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:53.468343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:53.469809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:53.490049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:53.490821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:53.491437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:53.492839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:53.493480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:53.494048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:53.525163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:53.543159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:53.545378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:53.551987 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-841c9d4c-d18a-43f0-a6c4-6072028147d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1362 microversion: 2.25 time: 0.441290 Oct 04 11:00:53.554062 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 247/506] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:53 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:53.673116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:53.674034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:53.681459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:53.682180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:53.682801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:53.683764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:53.684373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:53.686026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:53.819975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:53.828457 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-027fba15-65de-4cdc-87f7-826f3060489c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.364761 Oct 04 11:00:53.850181 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 260/507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:53 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:53.939279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:53.941521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:53.954546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:53.955044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:53.955480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:53.956190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:53.956656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:53.957061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:54.186181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:54.208719 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04730577-daee-42cc-a42e-ce865c0eb0d5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.539236 Oct 04 11:00:54.209752 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 248/508] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:53 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:54.238526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f947d8f3-3932-4803-9dc4-6eb7a37c6eb0 req-a1ff9016-2d94-4109-949a-48ae7fd054b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bf74f9-21f7-4f34-9676-662ac379bf2b", "name": "network-vif-plugged", "status": "completed", "tag": "572986c9-5f62-4f60-abf7-58a1035c9adf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:54.258152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f947d8f3-3932-4803-9dc4-6eb7a37c6eb0 req-a1ff9016-2d94-4109-949a-48ae7fd054b2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:54.262489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f947d8f3-3932-4803-9dc4-6eb7a37c6eb0 req-a1ff9016-2d94-4109-949a-48ae7fd054b2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:54.263900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f947d8f3-3932-4803-9dc4-6eb7a37c6eb0 req-a1ff9016-2d94-4109-949a-48ae7fd054b2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:54.277544 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f947d8f3-3932-4803-9dc4-6eb7a37c6eb0 req-a1ff9016-2d94-4109-949a-48ae7fd054b2 service nova] Creating event network-vif-plugged:572986c9-5f62-4f60-abf7-58a1035c9adf for instance 03bf74f9-21f7-4f34-9676-662ac379bf2b on n-h2-791135-8 Oct 04 11:00:54.283845 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f947d8f3-3932-4803-9dc4-6eb7a37c6eb0 req-a1ff9016-2d94-4109-949a-48ae7fd054b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059743 Oct 04 11:00:54.285077 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 249/509] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:54.451557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:54.464173 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9015af4-78d2-404e-8fd0-b125e20aa0c7 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1477 microversion: 2.1 time: 0.530099 Oct 04 11:00:54.465015 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 261/510] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:53 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1477 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:54.586588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:54.587650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:54.606198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:54.606615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:54.607618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:54.611524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:54.612671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:54.613333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:54.855002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:54.855615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:54.862986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:54.867621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:54.869295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:54.870263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:54.871876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:54.877801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:54.955009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:54.979895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:54.985181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:54.988730 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4627da7-25a7-48a0-95ce-8e548631f499 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1362 microversion: 2.25 time: 0.409359 Oct 04 11:00:54.991285 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 250/511] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:54 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:55.242399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:55.243177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:55.313123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:55.329382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:55.330068 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f405decb-1429-48c8-b1a9-a590efcc2088 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1318 microversion: 2.1 time: 0.479322 Oct 04 11:00:55.330950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:55.331161 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 262/512] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:54 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:55.331924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:55.332806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:55.333984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:55.334576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:55.492128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:55.496484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:55.506399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:55.507220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:55.508649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:55.510596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:55.511313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:55.513165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:55.655381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ad689cca044adaa015911fb7b75af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6a52da46d849faa86fc2f417c37f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:55.667178 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1122477b-cffe-4ed0-a3dd-5a90399b01e3 tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 200 len: 1435 microversion: 2.1 time: 0.178748 Oct 04 11:00:55.668835 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 263/513] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:55 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 1435 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:55.745395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:55.755111 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db2bc09b-a878-4d06-b05c-9bde7a9b3d43 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.525193 Oct 04 11:00:55.759669 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 251/514] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:55 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:55.820937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b055874a-a2dc-4e00-b778-cb396ef3f72e req-a41c56ea-dbce-4f03-9fdb-4b271842cb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e85299-d082-4a60-927f-3fa1a611ea75", "name": "network-vif-deleted", "tag": "ad2a0ed9-3e3d-4f15-b07f-b258dd88b21c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:55.837144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b055874a-a2dc-4e00-b778-cb396ef3f72e req-a41c56ea-dbce-4f03-9fdb-4b271842cb1d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:55.837832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b055874a-a2dc-4e00-b778-cb396ef3f72e req-a41c56ea-dbce-4f03-9fdb-4b271842cb1d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:55.838400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b055874a-a2dc-4e00-b778-cb396ef3f72e req-a41c56ea-dbce-4f03-9fdb-4b271842cb1d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:55.856683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b055874a-a2dc-4e00-b778-cb396ef3f72e req-a41c56ea-dbce-4f03-9fdb-4b271842cb1d service nova] Creating event network-vif-deleted:ad2a0ed9-3e3d-4f15-b07f-b258dd88b21c for instance d6e85299-d082-4a60-927f-3fa1a611ea75 on n-h1-791135-8 Oct 04 11:00:55.870722 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b055874a-a2dc-4e00-b778-cb396ef3f72e req-a41c56ea-dbce-4f03-9fdb-4b271842cb1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050705 Oct 04 11:00:55.873286 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 264/515] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:56.016044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:56.016644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:56.044950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:56.052572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:56.053366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:56.056924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:56.058124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:56.058632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:56.353986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:56.355165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:56.374199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:56.376792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:56.378497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:56.379282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:56.383309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:56.386747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:56.401334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:56.416084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:56.418137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:56.419543 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9156f6ef-cf53-423c-96a6-c632ba1b55e3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1362 microversion: 2.25 time: 0.407808 Oct 04 11:00:56.424962 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 252/516] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:56 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:00:56.707493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:56.719368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a35b182e-7b8a-4050-9bb9-dfbea089bf37 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1467 microversion: 2.1 time: 0.369308 Oct 04 11:00:56.722107 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 265/517] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:56 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1467 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:00:56.744895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:56.749754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] [instance: d6e85299-d082-4a60-927f-3fa1a611ea75] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:56.783015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:56.783532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:56.783950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:56.789445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:56.791298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:56.792954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:56.837306 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] HTTP exception thrown: Instance d6e85299-d082-4a60-927f-3fa1a611ea75 could not be found. Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Request method failure captured: Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 HTTP/1.1 Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJGoN_hV_NXPjub2KGDGS_U187_YTqgFmY2VwpTacIvBcwUGIL-7X8Sx0LwD-ruUrBuEx_qCI0fe6_ydV2A5lDTjyayHcCYsmR-Rd1HF6yi1yiEs6bc3Y0JUrL2anPZK1qUJIca3464TRC1yUaci4xQ37KIiwn6Vo1iqC4XxjduPRo Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bb6a52da46d849faa86fc2f417c37f6b Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2050423162 Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:00:56.839520 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bb6a52da46d849faa86fc2f417c37f6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb6a52da46d849faa86fc2f417c37f6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb6a52da46d849faa86fc2f417c37f6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bb6a52da46d849faa86fc2f417c37f6b"}]}] Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2050423162 Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bb6a52da46d849faa86fc2f417c37f6b Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2050423162 Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiagnosticsNegativeTest-2050423162-project Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 969ad689cca044adaa015911fb7b75af Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2050423162-project Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance d6e85299-d082-4a60-927f-3fa1a611ea75 could not be found. Oct 04 11:00:56.840903 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'd6e85299-d082-4a60-927f-3fa1a611ea75'} Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e85299-d082-4a60-927f-3fa1a611ea75 could not be found. Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:56.841712 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e85299-d082-4a60-927f-3fa1a611ea75 could not be found. Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e85299-d082-4a60-927f-3fa1a611ea75 could not be found. Oct 04 11:00:56.842924 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:56.844900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] Returning 404 to user: Instance d6e85299-d082-4a60-927f-3fa1a611ea75 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:56.844900 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-08535e14-9a31-42fb-9210-0c3e795fb86d tempest-ServerDiagnosticsNegativeTest-2050423162 tempest-ServerDiagnosticsNegativeTest-2050423162-project] 10.222.0.23 "GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75" status: 404 len: 111 microversion: 2.1 time: 0.118020 Oct 04 11:00:56.845099 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 266/518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:56 2022] GET /compute/v2.1/servers/d6e85299-d082-4a60-927f-3fa1a611ea75 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:00:56.964193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49ca88bf-00ba-4e17-8bf8-92424cb4e865 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Action: 'create', calling method: .version_select at 0x7f71d4c4d820>, body: {"keypair": {"name": "tempest-keypair-337561591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlbsvhWZEeP7Z960wSCD0YuA8HTTwKLJkc95/WiQmRj7UO6TsUpdPKgflIEdEMpfY1VpHu5Y/NGCt5l9T+gLxAnhbuCW99Q/OjZJ70KCKwGGuKSF9loI6CcNQMPgVM44w=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:56.998469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-49ca88bf-00ba-4e17-8bf8-92424cb4e865 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Getting quotas for project c6d8efa3fb034270bb0e8c6419da5a4c. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:57.007131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-49ca88bf-00ba-4e17-8bf8-92424cb4e865 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Getting quotas for user 581e699a1c3f4b7a907981fe37bf7e6c and project c6d8efa3fb034270bb0e8c6419da5a4c. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:57.055027 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49ca88bf-00ba-4e17-8bf8-92424cb4e865 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.528432 Oct 04 11:00:57.056875 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 253/519] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:00:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:00:57.064085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:57.065058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:57.074755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.075497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.076943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.078354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.079013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.079643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.277104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:57.286570 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c05835fe-23a8-4cf5-8c4d-1e22c813a0ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.227311 Oct 04 11:00:57.287561 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 254/520] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:57 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:57.302095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e192f295-1ea8-463f-bc4b-90802b6a2fdb req-209e763f-c36a-4dd1-8275-8a0fe925e5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6ad7b9-05e4-41a3-bbd7-af165b007a63", "tag": "0b6cbe01-a672-4ba7-babc-6e79a199d6da"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:57.326991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e192f295-1ea8-463f-bc4b-90802b6a2fdb req-209e763f-c36a-4dd1-8275-8a0fe925e5c1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.330390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e192f295-1ea8-463f-bc4b-90802b6a2fdb req-209e763f-c36a-4dd1-8275-8a0fe925e5c1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.330597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1201661880", "block_migration": true, "disk_over_commit": false}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:57.332020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e192f295-1ea8-463f-bc4b-90802b6a2fdb req-209e763f-c36a-4dd1-8275-8a0fe925e5c1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.338276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:57.350985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.353534 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e192f295-1ea8-463f-bc4b-90802b6a2fdb req-209e763f-c36a-4dd1-8275-8a0fe925e5c1 service nova] Creating event network-changed:0b6cbe01-a672-4ba7-babc-6e79a199d6da for instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 on n-h2-791135-8 Oct 04 11:00:57.357848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.359985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.361755 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e192f295-1ea8-463f-bc4b-90802b6a2fdb req-209e763f-c36a-4dd1-8275-8a0fe925e5c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071592 Oct 04 11:00:57.361925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.364136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.364585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.366064 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 255/521] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:00:57.452698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:57.453027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lazy-loading 'flavor' on Instance uuid b0d695d7-c959-4c4f-9018-0c1a72b30010 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:00:57.454235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:57.468252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.470093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.470816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.474738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.475891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.476735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.529966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Going to try to live migrate instance to tempest-host-1201661880 {{(pid=122409) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:00:57.538440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] HTTP exception thrown: Compute host tempest-host-1201661880 could not be found. Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Request method failure captured: Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010/action HTTP/1.1 Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 107 Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJOgxq4_ILeA07LaTlOe_KE24T-3RzWayaQCXkNe-eKTyQ-YQ6ttX57WkgyLwNax8Tn-4X5UejqXD3BTCyxefQVJ47OPCUcKMzYIKWrMfQpe7cxxA6iUgMee6YYZUqPt8_a7h0kBSN4l3uyiZuGrJeUqfCmXeriSxWpkDbn5JAg9ds Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 30ca859b3bbc45f8957488fa5a42dc87 Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveMigrationNegativeTest-1772424176 Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:00:57.562241 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30ca859b3bbc45f8957488fa5a42dc87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30ca859b3bbc45f8957488fa5a42dc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30ca859b3bbc45f8957488fa5a42dc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30ca859b3bbc45f8957488fa5a42dc87"}]}] Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveMigrationNegativeTest-1772424176 Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 30ca859b3bbc45f8957488fa5a42dc87 Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1772424176 Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveMigrationNegativeTest-1772424176-project-admin Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3dfb726b52894a04a72f010ca32e87b1 Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveMigrationNegativeTest-1772424176-project-admin Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: {"os-migrateLive": {"host": "tempest-host-1201661880", "block_migration": true, "disk_over_commit": false}} Oct 04 11:00:57.563787 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: exception: Compute host tempest-host-1201661880 could not be found. Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b0d695d7-c959-4c4f-9018-0c1a72b30010', 'body': {'os-migrateLive': {'host': 'tempest-host-1201661880', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:00:57.564803 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1201661880 could not be found. Oct 04 11:00:57.566150 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1201661880 could not be found. Oct 04 11:00:57.567493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1201661880 could not be found. Oct 04 11:00:57.568633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:00:57.573108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Returning 400 to user: Compute host tempest-host-1201661880 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:00:57.574521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3297c81-14b3-4a54-a10c-9bb62e11f151 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010/action" status: 400 len: 100 microversion: 2.1 time: 0.727128 Oct 04 11:00:57.575302 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 267/522] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Oct 4 11:00:56 2022] POST /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010/action => generated 100 bytes in 730 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:00:57.588747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:57.589772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:57.597765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.598570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.599172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.600042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:57.600651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:57.601220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:57.828297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:57.847156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:57.849052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:57.851371 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89272949-a0a5-4598-9359-7a6942e308b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1559 microversion: 2.25 time: 0.404374 Oct 04 11:00:57.852146 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 256/523] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:57 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1559 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:00:57.903859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:00:57.917017 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98c848c5-a58f-45fc-b513-060a392ba06e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1467 microversion: 2.1 time: 0.335999 Oct 04 11:00:57.917824 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 268/524] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:57 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1467 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:00:58.189815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1429317967", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:58.287457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:58.288072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:58.299829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:58.300545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:58.301039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:00:58.301891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:58.302802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:58.303715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:58.304753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:58.807272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 03bf74f9-21f7-4f34-9676-662ac379bf2b {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:00:58.875312 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a43781cc-418e-41ff-912b-f951ed216cd9 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 2052 microversion: 2.25 time: 0.999472 Oct 04 11:00:58.876730 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 257/525] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:00:57 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 2052 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:00:59.002709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:00:59.003852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:00:59.004749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:00:59.005603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:00:59.006190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:00:59.023236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:59.024916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:59.027566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:59.029429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:59.032020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:59.033744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:59.082816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Getting quotas for project e12ae544c2fb4abcb027575847a24f28. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:00:59.095202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Getting quotas for user 6d826e411532459c8ae9b6e9d29965be and project e12ae544c2fb4abcb027575847a24f28. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:00:59.134803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:00:59.147219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:00:59.249966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e0da5e7-b28d-49c5-9db2-cc741826de3c tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065419 Oct 04 11:00:59.260926 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 269/526] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:00:59.268051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:00:59.275435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:00:59.291411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:59.292209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:59.292893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:59.295258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:00:59.295884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:00:59.297740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:00:59.413874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1373700644", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "bdc6907e-c7a8-40a6-92e7-98eb68a55c52"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:00:59.502651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] validate_networks() for [('bdc6907e-c7a8-40a6-92e7-98eb68a55c52', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:00.148551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:00.160552 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be915915-07a2-434b-81de-8f72b8e5b403 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.898201 Oct 04 11:01:00.161129 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 270/527] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:00:59 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:00.185316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:00.186000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:00.198973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:00.199467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:00.203081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:00.204028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:00.208399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:00.209053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:00.664028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 03bf74f9-21f7-4f34-9676-662ac379bf2b {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:00.760109 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6c8d0a66-30ec-4b67-9acc-b1d29f2b893a tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 2052 microversion: 2.25 time: 0.591554 Oct 04 11:01:00.761475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 271/528] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:00 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 2052 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:00.767138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:00.768054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:00.775491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:00.776284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:00.780036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:00.784242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:00.785004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:00.785666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:00.794583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:00.968636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:00.981201 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-089247ac-ec84-47ca-bdee-60c0935d85d0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1271 microversion: 2.1 time: 0.217584 Oct 04 11:01:00.986460 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 272/529] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:00 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:00.995961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1752773076", "imageRef": "a97d7338-c74f-48bd-958a-4e70a01165e0", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cd3039aa-5ffb-45a1-9f34-6e613d337328"}], "security_groups": [{"name": "tempest-securitygroup--708753882"}], "key_name": "tempest-keypair-337561591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:01.374508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] validate_networks() for [('cd3039aa-5ffb-45a1-9f34-6e613d337328', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:01.517891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=11 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:01.741502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:01.745987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:01.746730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:01.747942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:01.748938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:01.771575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:01.772462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:01.773163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:01.774574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:01.776417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:01.777878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:01.821116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Getting quotas for project 44f8bd67ef72474b926de381ef6e8f33. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:01.830404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Getting quotas for user c419136435f240788480491469fe7d62 and project 44f8bd67ef72474b926de381ef6e8f33. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:01.851642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:01:01.855582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:01:01.940533 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd530b7e-6dd8-4200-b37f-68d2756fea4c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.061821 Oct 04 11:01:01.942549 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 258/530] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:01:01.953873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a4bad15-1775-4e4c-9013-e3d6ef6ef75f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:01.960445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4bad15-1775-4e4c-9013-e3d6ef6ef75f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:01.960947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4bad15-1775-4e4c-9013-e3d6ef6ef75f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:01.961410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4bad15-1775-4e4c-9013-e3d6ef6ef75f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:01.962172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4bad15-1775-4e4c-9013-e3d6ef6ef75f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:01.967923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4bad15-1775-4e4c-9013-e3d6ef6ef75f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:01.968448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a4bad15-1775-4e4c-9013-e3d6ef6ef75f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:02.030118 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a4bad15-1775-4e4c-9013-e3d6ef6ef75f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.085834 Oct 04 11:01:02.044024 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 259/531] 10.222.0.23 () {60 vars in 1217 bytes} [Tue Oct 4 11:01:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:01:02.058156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:02.059043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:02.078916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:02.081216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:02.081791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:02.082581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:02.084723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:02.085316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:02.689933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:02.702892 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6540686-3341-49a4-b6e1-706ae7f19039 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.656709 Oct 04 11:01:02.704029 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 260/532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:02 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:02.715093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:02.715946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:02.732551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:02.733046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:02.733504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:02.734211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:02.734659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:02.735076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:02.913587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:02.914157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:02.915162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:02.915488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:02.915759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:02.916362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:02.931730 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b55f5381-21ad-4807-b3e6-c50b09581748 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1228 microversion: 2.1 time: 0.226459 Oct 04 11:01:02.938350 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 261/533] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:02 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:02.940309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:02.940729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:02.942457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:02.944169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:02.944794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:02.947240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:02.948938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:02.951436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:02.972944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:02.973326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:02.977751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:02.979447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:02.980531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:02.982656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:03.013670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Getting quotas for project c6d8efa3fb034270bb0e8c6419da5a4c. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:03.023964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Getting quotas for user 581e699a1c3f4b7a907981fe37bf7e6c and project c6d8efa3fb034270bb0e8c6419da5a4c. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:03.056033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:01:03.063613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a97d7338-c74f-48bd-958a-4e70a01165e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:01:03.162083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-334bf1c0-5bd5-4dcc-b0bd-bf95a36abc41 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.174391 Oct 04 11:01:03.163476 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 273/534] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:01:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:01:03.169564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-791135-8", "block_migration": "auto"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:03.174687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:03.193263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:03.198256 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca947a19-b507-4b75-9348-8e7de37fa8b0 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1277 microversion: 2.1 time: 0.258277 Oct 04 11:01:03.218557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:03.219500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:03.221183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:03.221746 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 262/535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:02 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:03.222677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:03.230867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4777c13-9c67-41c0-929f-1dfb33bec369 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:03.231004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:03.231501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4777c13-9c67-41c0-929f-1dfb33bec369 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:03.233513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:03.317317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'flavor' on Instance uuid 03bf74f9-21f7-4f34-9676-662ac379bf2b {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:03.346002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Going to try to live migrate instance to n-h1-791135-8 {{(pid=122409) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:01:03.425152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4777c13-9c67-41c0-929f-1dfb33bec369 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:03.440802 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4777c13-9c67-41c0-929f-1dfb33bec369 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1245 microversion: 2.1 time: 0.217284 Oct 04 11:01:03.441435 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 263/536] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:03 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1245 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:03.798762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79c47e22-be2f-4fb7-8f21-e6233d1bafbb tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:03.811082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c47e22-be2f-4fb7-8f21-e6233d1bafbb tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:03.814434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c47e22-be2f-4fb7-8f21-e6233d1bafbb tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:03.815346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c47e22-be2f-4fb7-8f21-e6233d1bafbb tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:03.820906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c47e22-be2f-4fb7-8f21-e6233d1bafbb tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:03.826760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c47e22-be2f-4fb7-8f21-e6233d1bafbb tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:03.828976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79c47e22-be2f-4fb7-8f21-e6233d1bafbb tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:03.938506 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79c47e22-be2f-4fb7-8f21-e6233d1bafbb tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.475615 Oct 04 11:01:03.939101 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 264/537] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:01:03 2022] GET /compute/v2.1/os-services => generated 944 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:03.943913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:03.949213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:03.965164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:03.966592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:03.967617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:03.988697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:03.990900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:03.991595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:04.470839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:04.474967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:04.483177 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3b3796a-12ac-4d5c-9a15-6f2f853cbfdf tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.541085 Oct 04 11:01:04.484049 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 265/538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:03 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:04.498691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b250fae-7fe4-489a-b653-e6c208b2edcc tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:04.508609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b250fae-7fe4-489a-b653-e6c208b2edcc tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:04.511109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b250fae-7fe4-489a-b653-e6c208b2edcc tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:04.511819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b250fae-7fe4-489a-b653-e6c208b2edcc tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:04.512778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b250fae-7fe4-489a-b653-e6c208b2edcc tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:04.514708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b250fae-7fe4-489a-b653-e6c208b2edcc tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:04.515309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b250fae-7fe4-489a-b653-e6c208b2edcc tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:04.573178 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b250fae-7fe4-489a-b653-e6c208b2edcc tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-791135-8" status: 200 len: 578 microversion: 2.1 time: 0.086111 Oct 04 11:01:04.579337 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 266/539] 10.222.0.23 () {58 vars in 1172 bytes} [Tue Oct 4 11:01:04 2022] GET /compute/v2.1/os-services?host=n-d-791135-8 => generated 578 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:04.587947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:04.595143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:04.603356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:04.605020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:04.627519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:04.628157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:04.629067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:04.629706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:04.630484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:04.779712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:04.793319 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f84d9f20-9161-4a72-a3b8-51133488198c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1282 microversion: 2.1 time: 0.209638 Oct 04 11:01:04.793963 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 267/540] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:04 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:04.804797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:04.811742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:04.823791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:04.825937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:04.827059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:04.831608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:04.832323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:04.833004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:05.211438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:05.222385 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14bfafe4-bc3a-4a79-a2ef-bd8e867f736f tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1319 microversion: 2.1 time: 0.425453 Oct 04 11:01:05.224056 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 268/541] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:04 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:05.231184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:05.238171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:05.255100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:05.255611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:05.257517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:05.258407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:05.274299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:05.275388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:05.436956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:05.444980 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29a00a5b-9edc-4aba-8d63-2b0019d84f87 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1297 microversion: 2.1 time: 0.219673 Oct 04 11:01:05.445816 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 269/542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:05 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1297 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:05.467883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fce21e79-15b5-4b22-a80f-147da400380c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:05.471913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce21e79-15b5-4b22-a80f-147da400380c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:05.472480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce21e79-15b5-4b22-a80f-147da400380c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:05.472984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce21e79-15b5-4b22-a80f-147da400380c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:05.473810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce21e79-15b5-4b22-a80f-147da400380c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:05.474327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce21e79-15b5-4b22-a80f-147da400380c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:05.474807 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fce21e79-15b5-4b22-a80f-147da400380c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:05.515160 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fce21e79-15b5-4b22-a80f-147da400380c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055253 Oct 04 11:01:05.516671 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 270/543] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 11:01:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:05.528937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:05.530001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:05.538085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:05.539145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:05.539836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:05.540743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:05.542398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:05.543415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:06.390450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:06.404763 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8285f659-7344-4d40-b979-d022095ca1d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.883089 Oct 04 11:01:06.419779 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 271/544] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:05 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:06.431766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f47ec14-fb51-4edf-98f9-3e682630de4c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:06.435267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f47ec14-fb51-4edf-98f9-3e682630de4c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:06.435751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f47ec14-fb51-4edf-98f9-3e682630de4c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:06.436180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f47ec14-fb51-4edf-98f9-3e682630de4c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:06.437088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f47ec14-fb51-4edf-98f9-3e682630de4c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:06.437711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f47ec14-fb51-4edf-98f9-3e682630de4c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:06.438510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f47ec14-fb51-4edf-98f9-3e682630de4c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:06.507042 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f47ec14-fb51-4edf-98f9-3e682630de4c tempest-ServicesAdminTestJSON-632991844 tempest-ServicesAdminTestJSON-632991844-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.085693 Oct 04 11:01:06.514347 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 272/545] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:01:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:06.528455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:06.529899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:06.539057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:06.548217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:06.549022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:06.550273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:06.550929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:06.551444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.265664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:07.274815 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c41fbdf9-d692-4b8b-b96f-728e66108a95 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 0.759108 Oct 04 11:01:07.277021 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 273/546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:06 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:07.306492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d42aa986-78fb-427c-bbfa-7ebb51a31d13 req-27515532-88e8-406e-a2e7-8be9381a9e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f3d04c-4626-423c-bab3-4ace8c054725", "tag": "8f2d06ce-7f4a-453f-8054-63ef82fcb6d6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:07.324630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d42aa986-78fb-427c-bbfa-7ebb51a31d13 req-27515532-88e8-406e-a2e7-8be9381a9e04 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:07.325589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d42aa986-78fb-427c-bbfa-7ebb51a31d13 req-27515532-88e8-406e-a2e7-8be9381a9e04 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:07.326371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d42aa986-78fb-427c-bbfa-7ebb51a31d13 req-27515532-88e8-406e-a2e7-8be9381a9e04 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.340552 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d42aa986-78fb-427c-bbfa-7ebb51a31d13 req-27515532-88e8-406e-a2e7-8be9381a9e04 service nova] Creating event network-changed:8f2d06ce-7f4a-453f-8054-63ef82fcb6d6 for instance c8f3d04c-4626-423c-bab3-4ace8c054725 on n-h1-791135-8 Oct 04 11:01:07.363894 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d42aa986-78fb-427c-bbfa-7ebb51a31d13 req-27515532-88e8-406e-a2e7-8be9381a9e04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085104 Oct 04 11:01:07.370424 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 274/547] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:07.383102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:07.387457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:07.415356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:07.417742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:07.421530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.422845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:07.425084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:07.427501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.499069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7624122d-e895-49be-a1e1-f8e2a9c16e9e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b/action" status: 202 len: 0 microversion: 2.25 time: 4.334068 Oct 04 11:01:07.505170 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 274/548] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:01:03 2022] POST /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b/action => generated 0 bytes in 4341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:01:07.511300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-affc1334-eb72-424d-a80d-ffdf1b11d5f8 req-5c4f925e-c40f-4b73-90ca-6e0fcbec290e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6ad7b9-05e4-41a3-bbd7-af165b007a63", "name": "network-vif-plugged", "status": "completed", "tag": "0b6cbe01-a672-4ba7-babc-6e79a199d6da"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:07.534900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:07.557847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-affc1334-eb72-424d-a80d-ffdf1b11d5f8 req-5c4f925e-c40f-4b73-90ca-6e0fcbec290e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:07.560854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-affc1334-eb72-424d-a80d-ffdf1b11d5f8 req-5c4f925e-c40f-4b73-90ca-6e0fcbec290e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:07.565222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-affc1334-eb72-424d-a80d-ffdf1b11d5f8 req-5c4f925e-c40f-4b73-90ca-6e0fcbec290e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.613502 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-affc1334-eb72-424d-a80d-ffdf1b11d5f8 req-5c4f925e-c40f-4b73-90ca-6e0fcbec290e service nova] Creating event network-vif-plugged:0b6cbe01-a672-4ba7-babc-6e79a199d6da for instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 on n-h2-791135-8 Oct 04 11:01:07.630007 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-affc1334-eb72-424d-a80d-ffdf1b11d5f8 req-5c4f925e-c40f-4b73-90ca-6e0fcbec290e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122268 Oct 04 11:01:07.640354 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 275/549] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:07.655143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:07.659393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:07.684130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:07.685572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:07.689666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.690699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:07.693314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:07.695522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.923616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:07.936973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:07.938422 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b15cb9a2-6288-46d9-a266-a3d062c0c44b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1319 microversion: 2.1 time: 0.566438 Oct 04 11:01:07.945596 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 275/550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:07 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1319 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:07.960697 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af654d4f-7f8e-464e-9195-50bb17fea01b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1303 microversion: 2.1 time: 0.318761 Oct 04 11:01:07.960945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:07.961369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:07.966182 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 276/551] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:07 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1303 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:07.968764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:07.969255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:07.970117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.971051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:07.972009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:07.972795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:07.991666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:07.992300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:08.007534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:08.008159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:08.008596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:08.009547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:08.010166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:08.017118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:08.252941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:08.263901 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd7270be-1c97-412d-ac14-92a6994c81b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.323143 Oct 04 11:01:08.264526 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 276/552] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:07 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:08.305710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:08.306525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:08.310876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:08.318994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:08.319747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:08.320354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:08.321516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:08.322141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:08.322728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:08.324934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:08.328371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:08.332020 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ef60a9a-3dec-431b-a1fc-22ef7610101e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.362660 Oct 04 11:01:08.342027 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 277/553] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:07 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:08.526212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:08.533591 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c3429df-9be0-4e29-8543-cb40dc3acc7d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 0.233959 Oct 04 11:01:08.536018 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 277/554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:08 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:08.964322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:08.965594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:08.974719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:08.975489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:08.976102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:08.976980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:08.977629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:08.978217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:08.996755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:08.997716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:09.004322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:09.004803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:09.005543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:09.006483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:09.007148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:09.007751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:09.108864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:09.119054 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e381454-e561-4a41-9af7-33af22939a99 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1303 microversion: 2.1 time: 0.131041 Oct 04 11:01:09.122519 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 278/555] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:08 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:09.273708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:09.285096 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c918ff89-41fd-4611-85f8-854fe8445f2b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1319 microversion: 2.1 time: 0.325044 Oct 04 11:01:09.287879 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 278/556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:08 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:09.288521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:09.289252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:09.302869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:09.303455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:09.303981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:09.304880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:09.305334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:09.305802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:09.366350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:09.367309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:09.384675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:09.388940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:09.389636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:09.390500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:09.391078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:09.391606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:09.867325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:09.876272 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bfda721a-6ba8-4491-859c-50bc36cfe3bd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1312 microversion: 2.1 time: 0.592028 Oct 04 11:01:09.898233 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 279/557] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:09 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1312 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:09.908022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:09.910289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:09.924544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:09.925659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:09.927773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:09.929675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:09.937389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:09.938295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:10.015713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:10.041837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:10.043801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:10.046613 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e9410c8-b41c-4626-bc06-f5d149f04443 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.687486 Oct 04 11:01:10.061772 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 279/558] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:09 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:01:10.146391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:10.147060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:10.162252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:10.179720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:10.180099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:10.180853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:10.181315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:10.192626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:10.428062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:10.436512 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccf4b2d5-c5c1-456e-91ed-a8b138b2e69f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 0.536870 Oct 04 11:01:10.462198 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 280/559] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:09 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:10.469320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:10.477591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:10.484292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:10.484822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:10.485342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:10.486249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:10.486713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:10.487339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:10.681637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:10.699916 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a4314e5-b0b1-4fb5-abc5-93a54b5879e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.557174 Oct 04 11:01:10.708965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 280/560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:10 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:10.734953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-908ccfcf-508b-4693-a20f-3c96d689c1d7 req-0299ecfa-fd61-4c8b-8158-368a5451feb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aabc9518-e1f1-42f4-8bdb-b0cba1d912cd", "tag": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:10.750590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-908ccfcf-508b-4693-a20f-3c96d689c1d7 req-0299ecfa-fd61-4c8b-8158-368a5451feb5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:10.760337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-908ccfcf-508b-4693-a20f-3c96d689c1d7 req-0299ecfa-fd61-4c8b-8158-368a5451feb5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:10.768224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-908ccfcf-508b-4693-a20f-3c96d689c1d7 req-0299ecfa-fd61-4c8b-8158-368a5451feb5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:10.802410 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-908ccfcf-508b-4693-a20f-3c96d689c1d7 req-0299ecfa-fd61-4c8b-8158-368a5451feb5 service nova] Creating event network-changed:e91f0d47-2a8c-4520-9c42-0a09d1ad0b88 for instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd on n-h1-791135-8 Oct 04 11:01:10.822184 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-908ccfcf-508b-4693-a20f-3c96d689c1d7 req-0299ecfa-fd61-4c8b-8158-368a5451feb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081087 Oct 04 11:01:10.824494 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 281/561] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:10.900806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:10.901924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:10.914260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:10.923170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:10.924011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:10.925004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:10.925717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:10.926462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:10.985225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:10.994117 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c9c68860-2c66-4476-a244-0c7d5fe54834 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1319 microversion: 2.1 time: 0.530515 Oct 04 11:01:11.001479 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 281/562] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:10 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:11.080370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:11.081103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:11.098899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:11.099570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:11.100123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:11.101511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:11.110217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:11.111094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:11.626079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:11.651247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:11.664242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:11.676010 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b694aaa-a39e-4e2c-bdfe-c45c419e4db6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.594985 Oct 04 11:01:11.678892 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 282/563] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:11 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:01:11.702230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:11.703044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:11.733316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:11.735466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:11.738018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:11.738945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:11.744712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:11.746099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:11.763834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:11.779980 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e36baa61-08fa-417f-8c1a-f5fe0a379bbd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1461 microversion: 2.1 time: 0.883299 Oct 04 11:01:11.797642 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 282/564] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:10 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1461 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:11.806540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:11.807485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:11.820632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:11.828896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:11.829715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:11.831282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:11.831928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:11.832547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:11.870012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:01:12.031492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:12.092811 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b7734ee6-a767-41f9-9972-c3fd59321296 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "DELETE /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 204 len: 0 microversion: 2.1 time: 0.412242 Oct 04 11:01:12.103357 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 283/565] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:01:11 2022] DELETE /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:01:12.109780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:12.110757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:12.117622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:12.118314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:12.118962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:12.119854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:12.120324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:12.120897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:12.482268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:12.516257 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5f99c9f-e906-4802-bc66-3a40c1b435f6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 0.715007 Oct 04 11:01:12.519132 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 283/566] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:11 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:12.542879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:12.552810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:12.582510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:12.584353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:12.584852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:12.587045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:12.588624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:12.593248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:12.594751 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be60302a-6a3d-4d0a-bf0f-6938a40b516a tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.486707 Oct 04 11:01:12.594906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:12.596947 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 284/567] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:12 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:12.608984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:12.610028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:12.623957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:12.625946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:12.631263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:12.632342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:12.632968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:12.633600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:12.923882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:12.935454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Old instance type m1.heat2, new instance type m1.heat {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:01:12.949831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:12.956603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:12.958001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:12.959522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:12.961863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:12.978813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:13.123149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=24 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:13.246683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:13.256295 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e340dc1-1026-44f4-8bca-2657a3d1e54b tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1319 microversion: 2.1 time: 0.656820 Oct 04 11:01:13.268975 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 285/568] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:12 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1319 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:13.275683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1491806614", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "1704215892", "adminPass": "***", "networks": [{"uuid": "24228c7f-bc6a-4652-9fd1-cb20e7632e8b"}], "security_groups": [{"name": "tempest-securitygroup--983720186"}], "key_name": "tempest-keypair-2090858167", "user_data": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:13.311155 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-89ece7e4-115b-4a5c-aef8-712a2d257b95 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63/action" status: 202 len: 0 microversion: 2.1 time: 0.788029 Oct 04 11:01:13.313211 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 284/569] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:01:12 2022] POST /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:01:13.320541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:13.321493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:13.331663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:13.332543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:13.333172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:13.334070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:13.334674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:13.335252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:13.442491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=40 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:13.891464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] validate_networks() for [('24228c7f-bc6a-4652-9fd1-cb20e7632e8b', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:14.987255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:15.003895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:15.009929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:15.014547 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aff0508d-823f-4087-afc2-d1e08673bfba tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 1.699945 Oct 04 11:01:15.018068 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 285/570] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:13 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:15.034768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:15.037432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:15.063618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:15.064397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:15.066246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:15.068360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:15.071176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:15.072628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:15.874933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:15.908795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-19934f39-66d7-4c8f-8503-17623bccea3e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1470 microversion: 2.1 time: 0.883560 Oct 04 11:01:15.914928 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 286/571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:15 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1470 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:15.930371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:15.940471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:15.960009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:15.963393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:15.963876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:15.968741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:15.969275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:15.971273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:16.020110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:16.020687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:16.022829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:16.023253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:16.023664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:16.037536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:16.057303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:16.062360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:16.066890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:16.067767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:16.070821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:16.071293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:16.129568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Getting quotas for project 02a6b3dcd80b41c090b9567856b9d7c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:16.135104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Getting quotas for user 6c2f73db46ee4f88a988540177a931e3 and project 02a6b3dcd80b41c090b9567856b9d7c7. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:16.170867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:01:16.170867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:01:16.307201 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-046adcbf-6143-43ad-8dc2-5f84416d8ca2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.036850 Oct 04 11:01:16.308436 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 286/572] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:01:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 3039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:01:16.318867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:16.319876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:16.331193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:16.332312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:16.334356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:16.335327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:16.336437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:16.338431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:16.972120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:16.983453 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1a445cd-5236-4316-89ac-0b958790dbd2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 1.067383 Oct 04 11:01:16.995071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 287/573] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:15 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:17.020157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:17.021034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:17.029103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:17.029879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:17.030553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:17.031501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:17.032199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:17.032848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:17.801838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:17.815119 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf0e79da-7eda-4cd6-9c53-20101f8336f2 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 1.502373 Oct 04 11:01:17.815984 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 287/574] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:16 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:17.940935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:17.961136 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf26a0ea-4092-47a8-bc42-a0737c45b45d tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1319 microversion: 2.1 time: 0.948560 Oct 04 11:01:17.964041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 288/575] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:16 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1319 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:17.978559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:17.979543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:17.994533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:17.997447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:17.997918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:17.998652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:17.999116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:18.003007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:18.065490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b368c3b3-c5fb-4dc5-b7e1-9d2394123e9f tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:18.072091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b368c3b3-c5fb-4dc5-b7e1-9d2394123e9f tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:18.072819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b368c3b3-c5fb-4dc5-b7e1-9d2394123e9f tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:18.073527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b368c3b3-c5fb-4dc5-b7e1-9d2394123e9f tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:18.074583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b368c3b3-c5fb-4dc5-b7e1-9d2394123e9f tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:18.075334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b368c3b3-c5fb-4dc5-b7e1-9d2394123e9f tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:18.076003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b368c3b3-c5fb-4dc5-b7e1-9d2394123e9f tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:18.129653 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b368c3b3-c5fb-4dc5-b7e1-9d2394123e9f tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.312232 Oct 04 11:01:18.131233 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 288/576] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:01:17 2022] GET /compute/v2.1/os-services => generated 944 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:18.157751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:18.158849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:18.166612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:18.167486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:18.169607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:18.170597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:18.171293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:18.171995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:18.689111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:18.708216 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebe233eb-9e14-445e-97a3-a227be963f88 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1261 microversion: 2.1 time: 0.571705 Oct 04 11:01:18.710974 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 289/577] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:18 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1261 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:18.728570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:18.730045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:18.756537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:18.764792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:18.766344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:18.768431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:18.769901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:18.770591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:18.833749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:18.851600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:18.896920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:18.898463 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6dff735-4bed-40a6-8908-2c9aa0099c1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.932384 Oct 04 11:01:18.902123 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 289/578] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:17 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:18.924510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-13e7b5cb-9f85-45e8-bd39-42b20f37d7b8 req-c8d5e900-3c92-4ba0-912d-5258ec861e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f3d04c-4626-423c-bab3-4ace8c054725", "name": "network-vif-plugged", "status": "completed", "tag": "8f2d06ce-7f4a-453f-8054-63ef82fcb6d6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:18.946990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-13e7b5cb-9f85-45e8-bd39-42b20f37d7b8 req-c8d5e900-3c92-4ba0-912d-5258ec861e6c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:18.948206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-13e7b5cb-9f85-45e8-bd39-42b20f37d7b8 req-c8d5e900-3c92-4ba0-912d-5258ec861e6c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:18.951212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-13e7b5cb-9f85-45e8-bd39-42b20f37d7b8 req-c8d5e900-3c92-4ba0-912d-5258ec861e6c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:18.989507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-13e7b5cb-9f85-45e8-bd39-42b20f37d7b8 req-c8d5e900-3c92-4ba0-912d-5258ec861e6c service nova] Creating event network-vif-plugged:8f2d06ce-7f4a-453f-8054-63ef82fcb6d6 for instance c8f3d04c-4626-423c-bab3-4ace8c054725 on n-h1-791135-8 Oct 04 11:01:19.000492 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-13e7b5cb-9f85-45e8-bd39-42b20f37d7b8 req-c8d5e900-3c92-4ba0-912d-5258ec861e6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096928 Oct 04 11:01:19.007314 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 290/579] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:19.027338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:19.028281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:19.059819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:19.062701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:19.063352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:19.066044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:19.068459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:19.069130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:19.990467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:20.021987 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7cb16882-6ea0-4881-802a-89e1e4e0c597 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1470 microversion: 2.1 time: 1.309436 Oct 04 11:01:20.038341 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 290/580] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:18 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1470 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:20.044835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05018e40-b3b6-4d64-9184-ff3812bec4d3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:20.051748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05018e40-b3b6-4d64-9184-ff3812bec4d3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:20.052356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05018e40-b3b6-4d64-9184-ff3812bec4d3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:20.054589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05018e40-b3b6-4d64-9184-ff3812bec4d3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:20.058212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05018e40-b3b6-4d64-9184-ff3812bec4d3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:20.059607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05018e40-b3b6-4d64-9184-ff3812bec4d3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:20.060299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05018e40-b3b6-4d64-9184-ff3812bec4d3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:20.173172 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05018e40-b3b6-4d64-9184-ff3812bec4d3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.148344 Oct 04 11:01:20.181694 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 291/581] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Oct 4 11:01:20 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:20.202602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1db26dbc-eabc-4101-845d-e20f6366823c req-e539aac8-4f3a-4c38-9443-0e7b619162fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687c5af7-ef65-4b00-b6bc-86192e25ef26", "tag": "171d8e8d-ec59-4e9f-a567-2899ab792976"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:20.242691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1db26dbc-eabc-4101-845d-e20f6366823c req-e539aac8-4f3a-4c38-9443-0e7b619162fd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:20.245438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1db26dbc-eabc-4101-845d-e20f6366823c req-e539aac8-4f3a-4c38-9443-0e7b619162fd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:20.247484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1db26dbc-eabc-4101-845d-e20f6366823c req-e539aac8-4f3a-4c38-9443-0e7b619162fd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:20.296982 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1db26dbc-eabc-4101-845d-e20f6366823c req-e539aac8-4f3a-4c38-9443-0e7b619162fd service nova] Creating event network-changed:171d8e8d-ec59-4e9f-a567-2899ab792976 for instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 on n-h1-791135-8 Oct 04 11:01:20.313623 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1db26dbc-eabc-4101-845d-e20f6366823c req-e539aac8-4f3a-4c38-9443-0e7b619162fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123576 Oct 04 11:01:20.316074 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 292/582] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:20.328874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:20.334535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:20.349522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:20.354731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:20.355961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:20.357922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:20.361056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:20.361813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:20.394528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:20.406218 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72c31b6a-96f5-456e-9de9-d13353d371fe tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 1.397326 Oct 04 11:01:20.406806 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 291/583] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:19 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:20.438831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:20.439448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:20.476176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:20.476888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:20.477341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:20.478480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:20.484553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:20.484988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:21.136827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:21.149614 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-947c0ea5-051a-4139-9d9b-61d6868f25fc tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.831204 Oct 04 11:01:21.171627 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 293/584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:20 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:21.179808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:21.180930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:21.208896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:21.209829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:21.212507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:21.216863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:21.221800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:21.222819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:21.243299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:21.258752 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2065dffc-ee0b-4871-addb-84408ed88dc8 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1319 microversion: 2.1 time: 0.832540 Oct 04 11:01:21.279845 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 292/585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:20 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1319 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:21.298556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:21.299462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:21.319469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:21.323442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:21.324058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:21.327147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:21.327256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:21.335158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:21.797897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:21.810572 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4c6a2e5-dcec-437e-91a7-6a7371bdf3cb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1323 microversion: 2.1 time: 0.637200 Oct 04 11:01:21.810963 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 294/586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:21 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:21.826791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-575451e1-06cc-47f9-9599-586dfc483681 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:21.842425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-575451e1-06cc-47f9-9599-586dfc483681 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:21.843223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-575451e1-06cc-47f9-9599-586dfc483681 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:21.851507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-575451e1-06cc-47f9-9599-586dfc483681 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:21.852668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-575451e1-06cc-47f9-9599-586dfc483681 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:21.855467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-575451e1-06cc-47f9-9599-586dfc483681 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:21.856166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-575451e1-06cc-47f9-9599-586dfc483681 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:21.942763 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-575451e1-06cc-47f9-9599-586dfc483681 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.130716 Oct 04 11:01:21.946363 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 295/587] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:01:21 2022] GET /compute/v2.1/os-services => generated 944 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:21.957187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:21.971491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:21.991237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:21.991744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:21.992187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:21.992914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:21.993437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:21.993834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.310531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:22.326523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:22.328762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:22.330376 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-939d11c9-d5fa-42b0-8660-23017154d9d9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 1.049335 Oct 04 11:01:22.351276 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 293/588] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:21 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:22.371220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:22.373658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:22.390638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:22.392012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:22.392847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.393882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:22.394964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:22.397080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.460945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:22.470050 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d3324a8c-ae1c-4fd1-b056-d525f82d01b4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1470 microversion: 2.1 time: 0.522537 Oct 04 11:01:22.477692 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 296/589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:21 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:22.482350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-763bc519-f523-4bf6-a57a-f6afe8c176b3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:22.498068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763bc519-f523-4bf6-a57a-f6afe8c176b3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:22.498903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763bc519-f523-4bf6-a57a-f6afe8c176b3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:22.499540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763bc519-f523-4bf6-a57a-f6afe8c176b3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.500455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763bc519-f523-4bf6-a57a-f6afe8c176b3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:22.501071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763bc519-f523-4bf6-a57a-f6afe8c176b3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:22.502162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-763bc519-f523-4bf6-a57a-f6afe8c176b3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.569479 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-763bc519-f523-4bf6-a57a-f6afe8c176b3 tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-791135-8&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.090495 Oct 04 11:01:22.570432 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 297/590] 10.222.0.23 () {58 vars in 1194 bytes} [Tue Oct 4 11:01:22 2022] GET /compute/v2.1/os-services?host=n-d-791135-8&binary=xxx => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:01:22.575633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:22.576245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:22.594257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:22.594759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:22.595198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.595905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:22.596362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:22.596788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.930637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:22.939780 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-127e0ac3-96aa-4bb0-8f0e-5c79dff715d6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 0.578380 Oct 04 11:01:22.940437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 294/591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:22 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:22.951519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:22.952632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:22.959778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:22.960399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:22.960938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.961801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:22.962515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:22.963016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:22.985618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:22.995515 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f749d8b6-3884-42df-95c6-e87502d325b9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.423957 Oct 04 11:01:22.996226 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 298/592] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:22 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:23.011794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9bcf0a79-a69f-4444-93b2-a611c59bf67a req-047831e0-a1d0-434b-ad02-46843659f0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5981b8-d0e7-43d1-89ed-0b1186788807", "name": "network-vif-deleted", "tag": "5f86481a-fa5c-4dba-8d67-849aa98cd0b5"}, {"server_uuid": "03bf74f9-21f7-4f34-9676-662ac379bf2b", "name": "network-vif-unplugged", "status": "completed", "tag": "572986c9-5f62-4f60-abf7-58a1035c9adf"}, {"name": "network-changed", "server_uuid": "03bf74f9-21f7-4f34-9676-662ac379bf2b", "tag": "572986c9-5f62-4f60-abf7-58a1035c9adf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:23.027107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9bcf0a79-a69f-4444-93b2-a611c59bf67a req-047831e0-a1d0-434b-ad02-46843659f0bc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.027507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9bcf0a79-a69f-4444-93b2-a611c59bf67a req-047831e0-a1d0-434b-ad02-46843659f0bc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.027964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9bcf0a79-a69f-4444-93b2-a611c59bf67a req-047831e0-a1d0-434b-ad02-46843659f0bc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.041519 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9bcf0a79-a69f-4444-93b2-a611c59bf67a req-047831e0-a1d0-434b-ad02-46843659f0bc service nova] Creating event network-vif-deleted:5f86481a-fa5c-4dba-8d67-849aa98cd0b5 for instance be5981b8-d0e7-43d1-89ed-0b1186788807 on n-h2-791135-8 Oct 04 11:01:23.042025 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9bcf0a79-a69f-4444-93b2-a611c59bf67a req-047831e0-a1d0-434b-ad02-46843659f0bc service nova] Creating event network-vif-unplugged:572986c9-5f62-4f60-abf7-58a1035c9adf for instance 03bf74f9-21f7-4f34-9676-662ac379bf2b on n-h2-791135-8 Oct 04 11:01:23.042521 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9bcf0a79-a69f-4444-93b2-a611c59bf67a req-047831e0-a1d0-434b-ad02-46843659f0bc service nova] Creating event network-changed:572986c9-5f62-4f60-abf7-58a1035c9adf for instance 03bf74f9-21f7-4f34-9676-662ac379bf2b on n-h2-791135-8 Oct 04 11:01:23.049225 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9bcf0a79-a69f-4444-93b2-a611c59bf67a req-047831e0-a1d0-434b-ad02-46843659f0bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.041053 Oct 04 11:01:23.049864 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 299/593] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:23.055035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfa58d11-47b2-4968-9dfb-305ff9d04baf tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:23.058653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa58d11-47b2-4968-9dfb-305ff9d04baf tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.059158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa58d11-47b2-4968-9dfb-305ff9d04baf tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.059594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa58d11-47b2-4968-9dfb-305ff9d04baf tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.060324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa58d11-47b2-4968-9dfb-305ff9d04baf tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.060775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa58d11-47b2-4968-9dfb-305ff9d04baf tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.061193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa58d11-47b2-4968-9dfb-305ff9d04baf tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.073975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:23.089712 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfa58d11-47b2-4968-9dfb-305ff9d04baf tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.038371 Oct 04 11:01:23.098188 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 300/594] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:01:23 2022] GET /compute/v2.1/os-services => generated 944 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:23.098188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:23.098188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:23.103828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.104336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.104771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.105507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.105962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.106609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.208476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:23.218024 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-da358157-c92e-4431-980e-edb555385178 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1469 microversion: 2.1 time: 0.276200 Oct 04 11:01:23.218908 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 295/595] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:22 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:23.224178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d79e4be-17f8-4fbf-a835-790bea2fea2a tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:23.234143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d79e4be-17f8-4fbf-a835-790bea2fea2a tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.235336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d79e4be-17f8-4fbf-a835-790bea2fea2a tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.236186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d79e4be-17f8-4fbf-a835-790bea2fea2a tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.237237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d79e4be-17f8-4fbf-a835-790bea2fea2a tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.238302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d79e4be-17f8-4fbf-a835-790bea2fea2a tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.238952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d79e4be-17f8-4fbf-a835-790bea2fea2a tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.312683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d79e4be-17f8-4fbf-a835-790bea2fea2a tempest-ServicesAdminNegativeTestJSON-1293331555 tempest-ServicesAdminNegativeTestJSON-1293331555-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.091092 Oct 04 11:01:23.328228 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 296/596] 10.222.0.23 () {58 vars in 1198 bytes} [Tue Oct 4 11:01:23 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:01:23.337798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:23.344189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:23.357457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.357956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.358386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.359083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.359703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.360363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.387109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lazy-loading 'flavor' on Instance uuid c8f3d04c-4626-423c-bab3-4ace8c054725 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:23.506792 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c1bde93-e4c0-47ca-9f04-653dc44dea7c tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725/action" status: 202 len: 0 microversion: 2.1 time: 0.176926 Oct 04 11:01:23.508093 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 297/597] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:01:23 2022] POST /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:01:23.528492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:23.546296 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5a537f8-5221-47b1-8475-e01dadaa0aba tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1390 microversion: 2.1 time: 0.451492 Oct 04 11:01:23.564676 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 301/598] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:23 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1390 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:23.589952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:23.595429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:23.613937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.618634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.620118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.624611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.626379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.627189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.692495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fa11d55-bedf-4c52-8138-07493f33a9ff tempest-ServicesAdminNegativeTestJSON-1781920146 tempest-ServicesAdminNegativeTestJSON-1781920146-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:23.697969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6fa11d55-bedf-4c52-8138-07493f33a9ff tempest-ServicesAdminNegativeTestJSON-1781920146 tempest-ServicesAdminNegativeTestJSON-1781920146-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1027841ea3f440ff94670074fdad6c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91242c3b80ea43dda9751bca10c6dc5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fa11d55-bedf-4c52-8138-07493f33a9ff tempest-ServicesAdminNegativeTestJSON-1781920146 tempest-ServicesAdminNegativeTestJSON-1781920146-project] Request method failure captured: Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJ6ituud5cb8jyIgqJj9KGbl7G2EzJBscjHvsknuUSWizSMbvlNRESXAUKIbbdZ7r8jlpLb-4-gmraXiO3mLBKW0MyX2pT3RW7MMceBNBEEkvirkrppFAuiGwdRaNKg1stHS5F3AMOluGymQohcC83FKtUhAP_P4JKNBcPL-3l0IAc Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 91242c3b80ea43dda9751bca10c6dc5a Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1781920146 Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:01:23.701757 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91242c3b80ea43dda9751bca10c6dc5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91242c3b80ea43dda9751bca10c6dc5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91242c3b80ea43dda9751bca10c6dc5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91242c3b80ea43dda9751bca10c6dc5a"}]}] Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1781920146 Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 91242c3b80ea43dda9751bca10c6dc5a Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1781920146 Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServicesAdminNegativeTestJSON-1781920146-project Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1027841ea3f440ff94670074fdad6c01 Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1781920146-project Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 11:01:23.703361 n-d-791135-8 devstack@n-api.service[122409]: action_args: {} Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:01:23.704257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 11:01:23.705608 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:23.707072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fa11d55-bedf-4c52-8138-07493f33a9ff tempest-ServicesAdminNegativeTestJSON-1781920146 tempest-ServicesAdminNegativeTestJSON-1781920146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:23.707072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6fa11d55-bedf-4c52-8138-07493f33a9ff tempest-ServicesAdminNegativeTestJSON-1781920146 tempest-ServicesAdminNegativeTestJSON-1781920146-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.193921 Oct 04 11:01:23.707072 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 298/599] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:01:23 2022] GET /compute/v2.1/os-services => generated 112 bytes in 195 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:01:23.713259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:23.714178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:23.726901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.727391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.728116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:23.729606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:23.730070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:23.731974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:24.023298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:24.031719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:24.043047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:24.044416 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-16e82268-6f45-4582-924d-b909425612d5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.478565 Oct 04 11:01:24.045121 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 302/600] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:23 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:24.067540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:24.068470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:24.075417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:24.076172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:24.076799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:24.077629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:24.078279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:24.078895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:24.114847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:24.127440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fdadfd73-d775-49d8-8304-8b4bca5c3fb6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.422457 Oct 04 11:01:24.145390 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 299/601] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:23 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:24.145390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:24.145390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:24.155403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:24.158008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:24.160545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:24.161467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:24.162036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:24.163731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:24.744018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:24.773873 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a195d6a8-9a05-4fce-bff8-87d2b2725ade tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1477 microversion: 2.1 time: 0.714986 Oct 04 11:01:24.776777 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 303/602] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:24 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1477 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:24.791982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:24.793056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:24.803505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:24.803679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:24.805240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:24.806850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:24.809396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:24.810333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:24.811112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:24.813253 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c77af62-b631-4d22-af9a-baf5ec9ef274 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 0.680335 Oct 04 11:01:24.834440 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 300/603] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:24 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:24.839423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:24.839849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:24.853795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:24.854295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:24.855423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:24.856972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:24.857463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:24.857889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.466534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:25.476415 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6cbeeeb2-1118-4680-90c5-44df5f8ba727 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.696688 Oct 04 11:01:25.489283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:25.491569 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 304/604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:24 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:25.495866 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-718dc7dc-73d0-45e3-97e5-33c80f8778de tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1390 microversion: 2.1 time: 0.661022 Oct 04 11:01:25.511778 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 301/605] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:24 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1390 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:25.511984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:25.511984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:25.512222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d3e6f712-7a84-43bf-a24b-186db0a04fcf req-8000a52e-8dd2-4053-a64c-62a9b33f6203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19f44e6-544a-463f-9b91-f68bb9d31348", "tag": "4352b0b5-7bb0-4d02-a5f0-b045ab94e932"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:25.512355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.512355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.512355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.512355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.513219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.513219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.522041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d3e6f712-7a84-43bf-a24b-186db0a04fcf req-8000a52e-8dd2-4053-a64c-62a9b33f6203 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.522659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d3e6f712-7a84-43bf-a24b-186db0a04fcf req-8000a52e-8dd2-4053-a64c-62a9b33f6203 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.523696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d3e6f712-7a84-43bf-a24b-186db0a04fcf req-8000a52e-8dd2-4053-a64c-62a9b33f6203 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.540907 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d3e6f712-7a84-43bf-a24b-186db0a04fcf req-8000a52e-8dd2-4053-a64c-62a9b33f6203 service nova] Creating event network-changed:4352b0b5-7bb0-4d02-a5f0-b045ab94e932 for instance c19f44e6-544a-463f-9b91-f68bb9d31348 on n-h2-791135-8 Oct 04 11:01:25.549774 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d3e6f712-7a84-43bf-a24b-186db0a04fcf req-8000a52e-8dd2-4053-a64c-62a9b33f6203 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050701 Oct 04 11:01:25.550549 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 302/606] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:25.565056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:25.566536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:25.567125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:25.575376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.576199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.576880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.577859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.578517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.579153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.780580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:25.790828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:25.792287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:25.798807 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82a6a3b4-d604-4133-b0bc-1149efa61718 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.304709 Oct 04 11:01:25.805055 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 305/607] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:25 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:25.828292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3d58754e-5c01-4c42-bf63-2c2763ac87af req-1cc29e2d-84e8-4c6c-9f5f-bff9ea5063dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aabc9518-e1f1-42f4-8bdb-b0cba1d912cd", "name": "network-vif-plugged", "status": "completed", "tag": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:25.838306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d58754e-5c01-4c42-bf63-2c2763ac87af req-1cc29e2d-84e8-4c6c-9f5f-bff9ea5063dc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.839016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d58754e-5c01-4c42-bf63-2c2763ac87af req-1cc29e2d-84e8-4c6c-9f5f-bff9ea5063dc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.839737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d58754e-5c01-4c42-bf63-2c2763ac87af req-1cc29e2d-84e8-4c6c-9f5f-bff9ea5063dc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.860378 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3d58754e-5c01-4c42-bf63-2c2763ac87af req-1cc29e2d-84e8-4c6c-9f5f-bff9ea5063dc service nova] Creating event network-vif-plugged:e91f0d47-2a8c-4520-9c42-0a09d1ad0b88 for instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd on n-h1-791135-8 Oct 04 11:01:25.868585 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3d58754e-5c01-4c42-bf63-2c2763ac87af req-1cc29e2d-84e8-4c6c-9f5f-bff9ea5063dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049825 Oct 04 11:01:25.877780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:25.888514 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc4a67bb-044f-49af-bf12-1cef35be6c8f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.333870 Oct 04 11:01:25.891563 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 303/608] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:25 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:25.901302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:25.903050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:25.910320 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 306/609] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:25.920165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:25.923483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:25.930215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.930710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.931143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.931846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.932293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.932711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.952217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.952713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.953149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:25.953907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:25.954359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:25.954780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.155838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:26.192074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:26.200951 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-972bd576-83fa-4bc9-8c6b-d61db7c54d4d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 0.288964 Oct 04 11:01:26.201635 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 307/610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:25 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:26.204322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:26.212678 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b4156ec-0bd6-43dd-8b06-5482dc1391bb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1460 microversion: 2.1 time: 0.319190 Oct 04 11:01:26.213859 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 304/611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:25 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1460 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:26.238324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:26.238950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:26.245805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.246367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.247015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.247913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.248544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.249135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.501920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:26.502550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:26.512265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.512764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.513215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.522854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.523449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.523890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.544329 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91152a60-e3db-47c3-8507-74c1d8249dad tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1611 microversion: 2.1 time: 0.309571 Oct 04 11:01:26.546654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:26.568233 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 308/612] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:26 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1611 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:26.586395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:26.587281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:26.594595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.595089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.595525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.596530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.597161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.597832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.727964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:26.737278 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3fc0ff1a-d74c-43d5-9ca0-05a83da943a4 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.240630 Oct 04 11:01:26.739544 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 305/613] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:26 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:26.744959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca634805-3a0c-4d74-8405-ef353aff86e7 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:26.748573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca634805-3a0c-4d74-8405-ef353aff86e7 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.749084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca634805-3a0c-4d74-8405-ef353aff86e7 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.749547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca634805-3a0c-4d74-8405-ef353aff86e7 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.750268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca634805-3a0c-4d74-8405-ef353aff86e7 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.750725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca634805-3a0c-4d74-8405-ef353aff86e7 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.751143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca634805-3a0c-4d74-8405-ef353aff86e7 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.807399 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca634805-3a0c-4d74-8405-ef353aff86e7 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.066603 Oct 04 11:01:26.808734 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 306/614] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 11:01:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:26.822514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-791135-8", "block_migration": true, "disk_over_commit": false}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:26.825517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:26.841703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.843350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.844219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.845490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.847089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.847708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.863458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:26.886473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Lazy-loading 'flavor' on Instance uuid c8f3d04c-4626-423c-bab3-4ace8c054725 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:26.892010 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1251cdb3-261d-430f-8227-44eee85bc9a4 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1390 microversion: 2.1 time: 0.315609 Oct 04 11:01:26.894041 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 309/615] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:26 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1390 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:26.901925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:26.902705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:26.910877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.911681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.912361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.913390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.914103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.914944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.927152 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c8f3d04c-4626-423c-bab3-4ace8c054725 while it is in vm_state suspended Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Request method failure captured: Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725/action HTTP/1.1 Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 97 Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJOgxq4_ILeA07LaTlOe_KE24T-3RzWayaQCXkNe-eKTyQ-YQ6ttX57WkgyLwNax8Tn-4X5UejqXD3BTCyxefQVJ47OPCUcKMzYIKWrMfQpe7cxxA6iUgMee6YYZUqPt8_a7h0kBSN4l3uyiZuGrJeUqfCmXeriSxWpkDbn5JAg9ds Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 30ca859b3bbc45f8957488fa5a42dc87 Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveMigrationNegativeTest-1772424176 Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:01:26.930628 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30ca859b3bbc45f8957488fa5a42dc87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30ca859b3bbc45f8957488fa5a42dc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30ca859b3bbc45f8957488fa5a42dc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30ca859b3bbc45f8957488fa5a42dc87"}]}] Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveMigrationNegativeTest-1772424176 Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 30ca859b3bbc45f8957488fa5a42dc87 Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1772424176 Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveMigrationNegativeTest-1772424176-project-admin Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3dfb726b52894a04a72f010ca32e87b1 Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveMigrationNegativeTest-1772424176-project-admin Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: {"os-migrateLive": {"host": "n-h2-791135-8", "block_migration": true, "disk_over_commit": false}} Oct 04 11:01:26.932036 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'os-migrateLive' instance c8f3d04c-4626-423c-bab3-4ace8c054725 while it is in vm_state suspended Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c8f3d04c-4626-423c-bab3-4ace8c054725', 'body': {'os-migrateLive': {'host': 'n-h2-791135-8', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 11:01:26.932851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c8f3d04c-4626-423c-bab3-4ace8c054725 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:26.933938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c8f3d04c-4626-423c-bab3-4ace8c054725 while it is in vm_state suspended Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c8f3d04c-4626-423c-bab3-4ace8c054725 while it is in vm_state suspended Oct 04 11:01:26.938167 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:26.946519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c8f3d04c-4626-423c-bab3-4ace8c054725 while it is in vm_state suspended {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:26.948120 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e158d49-458f-435e-a492-96e9e7ad96b8 tempest-LiveMigrationNegativeTest-1772424176 tempest-LiveMigrationNegativeTest-1772424176-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725/action" status: 409 len: 155 microversion: 2.1 time: 0.131069 Oct 04 11:01:26.949778 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 307/616] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:01:26 2022] POST /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725/action => generated 155 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:01:26.974567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:26.977488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:26.991749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.992253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.992691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:26.993419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:26.996168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:26.997258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.212993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:27.224921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:27.226394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:27.232502 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee8fa228-4664-48cc-9e74-b7a09aa8c8bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.336771 Oct 04 11:01:27.233423 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 310/617] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:26 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:27.243600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:27.246334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:27.261064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.261579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.262015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.262799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.263249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.267437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.285785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:27.307194 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fac89337-6360-4cbd-8860-672c3d0c127d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.356110 Oct 04 11:01:27.316457 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 308/618] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:26 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:27.325248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:27.327670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:27.340939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.344068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.348069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.349964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.350540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.351079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.353907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:01:27.595103 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34b9ff1e-878d-4dd0-a4cf-0db4d1723967 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 204 len: 0 microversion: 2.1 time: 0.358968 Oct 04 11:01:27.595979 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 311/619] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:01:27 2022] DELETE /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:01:27.616796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:27.617882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:27.633634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.634406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.635050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.636034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.636784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.637618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.650075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:27.660447 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b588b02c-835d-437d-9743-3ab5c8af3ba9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1324 microversion: 2.1 time: 0.341953 Oct 04 11:01:27.661935 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 309/620] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:27 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:27.762819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:27.763531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:27.772838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.774469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.775147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.780245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.785093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.786680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.895935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:27.908754 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e674fbd5-537e-4602-9f35-357a79657a55 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1466 microversion: 2.1 time: 0.298902 Oct 04 11:01:27.909629 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 312/621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:27 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1466 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:27.935199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:27.936136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:27.949915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.950647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.951247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:27.952143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:27.953100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:27.953775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:28.065932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:28.084408 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-58c47d40-cb34-4d45-a022-4844f2efd651 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.325071 Oct 04 11:01:28.085669 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 310/622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:27 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:28.154685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:28.165293 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c169f38d-fc1b-4988-82ed-2bed39193656 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1390 microversion: 2.1 time: 0.234784 Oct 04 11:01:28.168619 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 313/623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:27 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1390 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:28.263228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:28.266905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:28.279185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:28.279846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:28.280646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:28.281567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:28.282098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:28.284033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:28.319194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba69d68e-b135-4b43-b026-708b91ca8d2b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Action: 'create', calling method: .version_select at 0x7f71d49e09d0>, body: {"keypair": {"name": "tempest-keypair-1721102254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqa/H7tV57G9Sj1Xu/1knzwsumgGpqPywE/vhJKp+WQtTiCaYJXb8lrmx88ugK8+HfmkEzqeCngT6g5caqGW5cHRYYeGMzVBERYNbbb4GtXk91c7smcQtnMqjztXlYjNg=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:28.346217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ba69d68e-b135-4b43-b026-708b91ca8d2b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Getting quotas for project 86a0fc1de1644db0a9a7e77241e2c04f. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:28.351445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ba69d68e-b135-4b43-b026-708b91ca8d2b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Getting quotas for user 67875c6ae98c4184b8519b21977e23da and project 86a0fc1de1644db0a9a7e77241e2c04f. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:28.384575 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba69d68e-b135-4b43-b026-708b91ca8d2b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.297580 Oct 04 11:01:28.385944 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 311/624] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:01:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:28.397150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:28.398502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:28.420640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:28.421784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:28.423635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:28.425852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:28.427256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:28.429344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:28.478101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:28.504680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:28.507439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:28.509998 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c04a34f-fdd6-4146-bfba-147df0ae42c1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.254946 Oct 04 11:01:28.513660 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 314/625] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:28 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:28.686885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:28.691536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:28.692535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:28.698063 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5703013-4fff-4feb-a042-412651a938b9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.309040 Oct 04 11:01:28.705055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:28.708247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:28.710710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:28.711984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:28.714428 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 312/626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:28 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:28.715258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:28.716067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:28.937467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:28.938236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:28.951893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:28.952780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:28.954186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:28.955270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:28.957637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:28.958506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:29.076761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:29.085825 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5533749a-ac64-47aa-a0fe-98d8594206ee tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1520 microversion: 2.1 time: 0.401540 Oct 04 11:01:29.105396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 315/627] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:28 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:29.260966 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da0ef966-c544-4f09-9aa6-2fbc1fef1eb4 tempest-TenantUsagesNegativeTestJSON-994375258 tempest-TenantUsagesNegativeTestJSON-994375258-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T11%3A01%3A29.020338&end=2022-10-05T11%3A01%3A29.020338" status: 404 len: 112 microversion: - time: 0.167560 Oct 04 11:01:29.262093 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 316/628] 10.222.0.23 () {58 vars in 1316 bytes} [Tue Oct 4 11:01:29 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T11%3A01%3A29.020338&end=2022-10-05T11%3A01%3A29.020338 => generated 112 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 11:01:29.268911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:29.269988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:29.277033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:29.279207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:29.280061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:29.281279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:29.282166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:29.283060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:29.334461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:29.351298 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ddfa015a-2ee3-461f-aa4e-2cf8ca01b8b1 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1466 microversion: 2.1 time: 0.417749 Oct 04 11:01:29.352553 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 313/629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:28 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1466 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:29.367200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4af8cecc-ab96-4fea-b218-0c1aaf08fdf2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'create', calling method: .version_select at 0x7f71d48721f0>, body: {"pool": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:29.811312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:29.826255 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d7b82f4-3767-472e-b078-292acf587edf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.561242 Oct 04 11:01:29.828251 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 317/630] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:29 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:29.835101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:29.836181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:29.851263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:29.856802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:29.859385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:29.860985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:29.861881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:29.862794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:30.133298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:30.144523 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62b30d59-df20-44e1-aae3-23d3fee4624f tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1390 microversion: 2.1 time: 0.314388 Oct 04 11:01:30.145370 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 318/631] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:29 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1390 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:30.149699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1833ffe5-e3c0-40b1-94ab-d7972b01bcaa tempest-TenantUsagesNegativeTestJSON-994375258 tempest-TenantUsagesNegativeTestJSON-994375258-project-admin] Calling method '.version_select at 0x7f71d4c8f1f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:30.156669 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1833ffe5-e3c0-40b1-94ab-d7972b01bcaa tempest-TenantUsagesNegativeTestJSON-994375258 tempest-TenantUsagesNegativeTestJSON-994375258-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1833ffe5-e3c0-40b1-94ab-d7972b01bcaa tempest-TenantUsagesNegativeTestJSON-994375258 tempest-TenantUsagesNegativeTestJSON-994375258-project-admin] Request method failure captured: Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-simple-tenant-usage/e12db5868bf34fc489e0064d35f845aa?start=2022-10-05T11%3A01%3A29.020338&end=2022-10-03T11%3A01%3A29.020338 HTTP/1.1 Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBKIFKtLgsgTcKDPsiTJv4927K_VO_gNgVCv7vszt7yjIIp8y0l-NyTgGejsyxlRot5ee3sOnqXWc_zvDza_Vhi_lsC6YVFS5sEa7TXgx36u8g1n0s-K57Vb9XxZ7pBAadoyeUL5sjT2lVgpzGdSYojUHAtubL8ZWypPdEe05QI1xXA Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3a7c1b2a334e4a0b9686ebd4c1d41825 Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-994375258 Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:01:30.166016 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3a7c1b2a334e4a0b9686ebd4c1d41825"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3a7c1b2a334e4a0b9686ebd4c1d41825"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3a7c1b2a334e4a0b9686ebd4c1d41825"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3a7c1b2a334e4a0b9686ebd4c1d41825"}]}] Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-994375258 Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3a7c1b2a334e4a0b9686ebd4c1d41825 Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-994375258 Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TenantUsagesNegativeTestJSON-994375258-project-admin Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 8e4b4bbe04f34409a53ead1fbf662f55 Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-994375258-project-admin Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 11:01:30.167386 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'e12db5868bf34fc489e0064d35f845aa'} Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 11:01:30.168152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1833ffe5-e3c0-40b1-94ab-d7972b01bcaa tempest-TenantUsagesNegativeTestJSON-994375258 tempest-TenantUsagesNegativeTestJSON-994375258-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:30.171072 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1833ffe5-e3c0-40b1-94ab-d7972b01bcaa tempest-TenantUsagesNegativeTestJSON-994375258 tempest-TenantUsagesNegativeTestJSON-994375258-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/e12db5868bf34fc489e0064d35f845aa?start=2022-10-05T11%3A01%3A29.020338&end=2022-10-03T11%3A01%3A29.020338" status: 400 len: 111 microversion: 2.1 time: 0.021381 Oct 04 11:01:30.173941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 319/632] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Oct 4 11:01:30 2022] GET /compute/v2.1/os-simple-tenant-usage/e12db5868bf34fc489e0064d35f845aa?start=2022-10-05T11%3A01%3A29.020338&end=2022-10-03T11%3A01%3A29.020338 => generated 111 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:01:30.179625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-62f2c9e8-9c9e-454a-b141-623bd8d1a3a1 req-3fe51d45-cc6e-47c8-bcae-ffe71ddba9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687c5af7-ef65-4b00-b6bc-86192e25ef26", "name": "network-vif-plugged", "status": "completed", "tag": "171d8e8d-ec59-4e9f-a567-2899ab792976"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:30.190942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-62f2c9e8-9c9e-454a-b141-623bd8d1a3a1 req-3fe51d45-cc6e-47c8-bcae-ffe71ddba9b2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:30.191770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-62f2c9e8-9c9e-454a-b141-623bd8d1a3a1 req-3fe51d45-cc6e-47c8-bcae-ffe71ddba9b2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:30.192412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-62f2c9e8-9c9e-454a-b141-623bd8d1a3a1 req-3fe51d45-cc6e-47c8-bcae-ffe71ddba9b2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:30.204395 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-62f2c9e8-9c9e-454a-b141-623bd8d1a3a1 req-3fe51d45-cc6e-47c8-bcae-ffe71ddba9b2 service nova] Creating event network-vif-plugged:171d8e8d-ec59-4e9f-a567-2899ab792976 for instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 on n-h1-791135-8 Oct 04 11:01:30.210326 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-62f2c9e8-9c9e-454a-b141-623bd8d1a3a1 req-3fe51d45-cc6e-47c8-bcae-ffe71ddba9b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Oct 04 11:01:30.211801 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 320/633] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:30.219283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:30.220902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:30.228848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:30.229662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:30.229930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:30.231417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:30.232907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:30.233141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:30.409302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:30.421833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:30.472094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:30.473610 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ac36db5-6602-4bd9-83b4-f2b216c0d527 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.260384 Oct 04 11:01:30.481472 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 321/634] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:30 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:30.481472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:30.481472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:30.491227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:30.491821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:30.492427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:30.493148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:30.493727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:30.494456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:30.771107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:30.782419 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae8f2f94-c977-4f85-8f02-c7fcefe03691 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.306971 Oct 04 11:01:30.783635 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 322/635] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:30 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:30.979516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f786ba7e-a4ae-4681-9cae-25c2faeae5ea tempest-TenantUsagesNegativeTestJSON-1508376610 tempest-TenantUsagesNegativeTestJSON-1508376610-project] Calling method '.version_select at 0x7f71d4c60280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:30.983130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f786ba7e-a4ae-4681-9cae-25c2faeae5ea tempest-TenantUsagesNegativeTestJSON-1508376610 tempest-TenantUsagesNegativeTestJSON-1508376610-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '127bddec1e1b41a4a4e1f221f18329a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12db5868bf34fc489e0064d35f845aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f786ba7e-a4ae-4681-9cae-25c2faeae5ea tempest-TenantUsagesNegativeTestJSON-1508376610 tempest-TenantUsagesNegativeTestJSON-1508376610-project] Request method failure captured: Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T11%3A01%3A29.020338&end=2022-10-05T11%3A01%3A29.020338&detailed=1 HTTP/1.1 Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBKI9g6sQAX9mYgote4q7egDOffV5AlTaZQsU-CAZpqiI13Bz1S6KRWDFuaf7UU8hueuRt3dYIwCfjebTBazzC1O5lB6ForEg8bPkqhFh-G34XScS6YjfZZBe0vtOxTI_bfBHexzaR-7MnoRYe317PfhYPy0Rg1F7DCacDvqkPceE_Q Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: e12db5868bf34fc489e0064d35f845aa Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1508376610 Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:01:30.984913 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e12db5868bf34fc489e0064d35f845aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e12db5868bf34fc489e0064d35f845aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e12db5868bf34fc489e0064d35f845aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e12db5868bf34fc489e0064d35f845aa"}]}] Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1508376610 Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: e12db5868bf34fc489e0064d35f845aa Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1508376610 Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TenantUsagesNegativeTestJSON-1508376610-project Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 127bddec1e1b41a4a4e1f221f18329a4 Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1508376610-project Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: action_args: {} Oct 04 11:01:30.986461 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:01:30.987504 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:01:30.988750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:01:30.990098 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 11:01:30.990098 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:30.995389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f786ba7e-a4ae-4681-9cae-25c2faeae5ea tempest-TenantUsagesNegativeTestJSON-1508376610 tempest-TenantUsagesNegativeTestJSON-1508376610-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:30.997131 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f786ba7e-a4ae-4681-9cae-25c2faeae5ea tempest-TenantUsagesNegativeTestJSON-1508376610 tempest-TenantUsagesNegativeTestJSON-1508376610-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T11%3A01%3A29.020338&end=2022-10-05T11%3A01%3A29.020338&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.207909 Oct 04 11:01:30.998136 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 323/636] 10.222.0.23 () {58 vars in 1335 bytes} [Tue Oct 4 11:01:30 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T11%3A01%3A29.020338&end=2022-10-05T11%3A01%3A29.020338&detailed=1 => generated 123 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:01:31.025871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:31.029069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:31.060830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:31.069079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:31.070011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:31.072629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:31.075825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:31.076387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:31.225095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:31.229380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:31.240712 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98ec45e8-b04d-4ab3-8e5c-200d7a9ae831 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 200 len: 1295 microversion: 2.1 time: 0.241123 Oct 04 11:01:31.241467 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 324/637] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:30 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 1295 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:31.262035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:31.262646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:31.277557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:31.279004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:31.279942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:31.280943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:31.281722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:31.282336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:32.017924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:32.034825 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6517efa-4397-40d2-9ec8-742ed087dcaf tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1370 microversion: 2.1 time: 0.776402 Oct 04 11:01:32.035978 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 325/638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:31 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1370 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:32.041083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d79aa945-7696-4e5d-87ed-853e03ae2a69 req-8c159e05-5012-49b4-9c8e-3c03b3ca1791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f3d04c-4626-423c-bab3-4ace8c054725", "name": "network-vif-deleted", "tag": "8f2d06ce-7f4a-453f-8054-63ef82fcb6d6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:32.054098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d79aa945-7696-4e5d-87ed-853e03ae2a69 req-8c159e05-5012-49b4-9c8e-3c03b3ca1791 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:32.054568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d79aa945-7696-4e5d-87ed-853e03ae2a69 req-8c159e05-5012-49b4-9c8e-3c03b3ca1791 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:32.055165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d79aa945-7696-4e5d-87ed-853e03ae2a69 req-8c159e05-5012-49b4-9c8e-3c03b3ca1791 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:32.092450 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d79aa945-7696-4e5d-87ed-853e03ae2a69 req-8c159e05-5012-49b4-9c8e-3c03b3ca1791 service nova] Creating event network-vif-deleted:8f2d06ce-7f4a-453f-8054-63ef82fcb6d6 for instance c8f3d04c-4626-423c-bab3-4ace8c054725 on n-h1-791135-8 Oct 04 11:01:32.100900 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d79aa945-7696-4e5d-87ed-853e03ae2a69 req-8c159e05-5012-49b4-9c8e-3c03b3ca1791 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063162 Oct 04 11:01:32.102162 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 326/639] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:32.109126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:32.110405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:32.126311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:32.127384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:32.128046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:32.128947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:32.129954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:32.130593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:32.534172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:32.544652 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22c44790-c1d4-46f0-80a5-22f605350dc1 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1390 microversion: 2.1 time: 0.440855 Oct 04 11:01:32.545697 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 327/640] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:32 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1390 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:32.570888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:32.571508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:32.578624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:32.579624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:32.580376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:32.581256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:32.581894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:32.582323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:32.616612 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4af8cecc-ab96-4fea-b218-0c1aaf08fdf2 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.260376 Oct 04 11:01:32.630150 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 314/641] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:01:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:32.637655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1848817621", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "df4e3d84-1220-484c-bf4d-3342da9c048d"}], "security_groups": [{"name": "tempest-securitygroup--1652579064"}], "key_name": "tempest-keypair-1721102254", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:32.800878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:32.809563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:32.811874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:32.812545 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2cbb5f9-6f8b-493a-aa16-eb8e0854b38e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1569 microversion: 2.25 time: 0.253320 Oct 04 11:01:32.813112 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 328/642] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:32 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:32.823671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] validate_networks() for [('df4e3d84-1220-484c-bf4d-3342da9c048d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:32.829943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:32.830911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:32.837793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:32.838310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:32.838757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:32.839747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:32.840218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:32.840831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.065999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=24 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:33.110696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:33.119476 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5efca83-d2f7-4a13-8614-4a7492ac2709 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.296172 Oct 04 11:01:33.120566 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 329/643] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:32 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:33.125298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:33.125991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: c8f3d04c-4626-423c-bab3-4ace8c054725] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:33.132911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.133418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.133852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.134542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.134992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.135416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.149340 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] HTTP exception thrown: Instance c8f3d04c-4626-423c-bab3-4ace8c054725 could not be found. Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Request method failure captured: Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 HTTP/1.1 Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJMbLyCo0rZICg5bkN_mg3p-_A8m33uIqYhtJ1DJsi7aL0qBTDcLj0NmReDRy-zNGn_Xdqd4hIyjlhQSEqRkj-XVPwBQXUg2Mr0txBsgYTRXe1dZGkQNrvrGY1AIezhzYJIZkds7GSILByBJKsToUkiMGNdxWCEu3-uXZlPOpmjSF8 Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: e12ae544c2fb4abcb027575847a24f28 Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveMigrationNegativeTest-1925712963 Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:01:33.151000 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e12ae544c2fb4abcb027575847a24f28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e12ae544c2fb4abcb027575847a24f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e12ae544c2fb4abcb027575847a24f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e12ae544c2fb4abcb027575847a24f28"}]}] Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-LiveMigrationNegativeTest-1925712963 Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: e12ae544c2fb4abcb027575847a24f28 Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1925712963 Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-LiveMigrationNegativeTest-1925712963-project Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 6d826e411532459c8ae9b6e9d29965be Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-LiveMigrationNegativeTest-1925712963-project Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance c8f3d04c-4626-423c-bab3-4ace8c054725 could not be found. Oct 04 11:01:33.152461 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'c8f3d04c-4626-423c-bab3-4ace8c054725'} Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f3d04c-4626-423c-bab3-4ace8c054725 could not be found. Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:33.157008 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f3d04c-4626-423c-bab3-4ace8c054725 could not be found. Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f3d04c-4626-423c-bab3-4ace8c054725 could not be found. Oct 04 11:01:33.158634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:33.159828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Returning 404 to user: Instance c8f3d04c-4626-423c-bab3-4ace8c054725 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:33.159828 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-785eb6a5-f203-41d5-b74a-0a3d30dfee5e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725" status: 404 len: 111 microversion: 2.1 time: 0.030732 Oct 04 11:01:33.159828 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 330/644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:33 2022] GET /compute/v2.1/servers/c8f3d04c-4626-423c-bab3-4ace8c054725 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:01:33.159828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bd29e80d-38a8-4dc9-8d8e-b828449e924e req-6021a96b-242c-4528-afd0-195ae1ef6090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19f44e6-544a-463f-9b91-f68bb9d31348", "name": "network-vif-plugged", "status": "completed", "tag": "4352b0b5-7bb0-4d02-a5f0-b045ab94e932"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:33.169161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd29e80d-38a8-4dc9-8d8e-b828449e924e req-6021a96b-242c-4528-afd0-195ae1ef6090 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.169705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd29e80d-38a8-4dc9-8d8e-b828449e924e req-6021a96b-242c-4528-afd0-195ae1ef6090 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.170631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd29e80d-38a8-4dc9-8d8e-b828449e924e req-6021a96b-242c-4528-afd0-195ae1ef6090 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.181282 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bd29e80d-38a8-4dc9-8d8e-b828449e924e req-6021a96b-242c-4528-afd0-195ae1ef6090 service nova] Creating event network-vif-plugged:4352b0b5-7bb0-4d02-a5f0-b045ab94e932 for instance c19f44e6-544a-463f-9b91-f68bb9d31348 on n-h2-791135-8 Oct 04 11:01:33.186540 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bd29e80d-38a8-4dc9-8d8e-b828449e924e req-6021a96b-242c-4528-afd0-195ae1ef6090 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031837 Oct 04 11:01:33.187247 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 331/645] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:33.192316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1025023408", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "bdc6907e-c7a8-40a6-92e7-98eb68a55c52"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:33.256794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] validate_networks() for [('bdc6907e-c7a8-40a6-92e7-98eb68a55c52', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:33.600965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:33.601849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:33.602515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:33.603204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:33.603614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:33.612817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.613468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.613890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.614606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.615053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.615474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.627394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:33.636119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Getting quotas for project 86a0fc1de1644db0a9a7e77241e2c04f. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:33.642075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Getting quotas for user 67875c6ae98c4184b8519b21977e23da and project 86a0fc1de1644db0a9a7e77241e2c04f. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:33.657063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:01:33.659674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:01:33.717067 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-917570f6-6411-4ecd-b07c-7c853bb8c834 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.085367 Oct 04 11:01:33.718181 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 315/646] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:01:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:01:33.730062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:33.730974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:33.739174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.739899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.740334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.741041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.741531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.741961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.912360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:33.912816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:33.913282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:33.913781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:33.914310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:33.929912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.930406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.930837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.931605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.932989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.933441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.949189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:33.957121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Getting quotas for project 44f8bd67ef72474b926de381ef6e8f33. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:33.960799 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1804bdc6-929c-4fb4-a4d6-ffcbb1578c94 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1556 microversion: 2.1 time: 0.241349 Oct 04 11:01:33.962487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Getting quotas for user c419136435f240788480491469fe7d62 and project 44f8bd67ef72474b926de381ef6e8f33. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:33.973953 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 316/647] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:33 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:33.974597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:01:33.977318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:01:33.986495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:33.986983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:33.994108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.994836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.995421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:33.997102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:33.997907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:33.998535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.038026 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c14cd5a9-082d-4db0-b153-e28de431bc1a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849532 Oct 04 11:01:34.039273 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 332/648] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:01:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:01:34.043954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.044739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:34.052211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.053099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.053645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.054522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.055156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.055443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.066209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:01:34.203777 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f9080d0-9767-4e95-83d7-40530326114e tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 204 len: 0 microversion: 2.1 time: 0.226339 Oct 04 11:01:34.204731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 317/649] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:01:33 2022] DELETE /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:01:34.215994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96de28b8-447a-498f-94f1-535e342d20a8 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.216855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96de28b8-447a-498f-94f1-535e342d20a8 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:34.266895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:34.275103 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6659dc2-2b9c-464a-a74a-05d564a158a2 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1390 microversion: 2.1 time: 0.234694 Oct 04 11:01:34.275685 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 333/650] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:34.287687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.288309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:34.302446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.303128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.304785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.307668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.308156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.308587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.320679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96de28b8-447a-498f-94f1-535e342d20a8 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:34.333389 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96de28b8-447a-498f-94f1-535e342d20a8 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1242 microversion: 2.1 time: 0.122686 Oct 04 11:01:34.340984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 318/651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:34.349641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.350166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:34.359876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.360449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.361019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.362013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.363076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.363798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.482933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-41666f9d-4de8-4978-bac8-577c38e68a88 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140729 Oct 04 11:01:34.484303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 319/652] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:34.491758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-577b3a52-5491-4583-a2e5-a89ba302a7f7 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.493425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-577b3a52-5491-4583-a2e5-a89ba302a7f7 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:34.520537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:34.529609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:34.531408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:34.532926 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-165023d6-b9af-4f1e-9cfa-5773be536684 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1559 microversion: 2.25 time: 0.256326 Oct 04 11:01:34.533716 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 334/653] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1559 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:34.538476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.539345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:34.547279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.548021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.548711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.549755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.550439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.551094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.575368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-577b3a52-5491-4583-a2e5-a89ba302a7f7 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:34.584711 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-577b3a52-5491-4583-a2e5-a89ba302a7f7 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1224 microversion: 2.1 time: 0.099006 Oct 04 11:01:34.600001 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 320/654] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:34.615279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.616065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:34.627314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.628071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.629217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.630233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.630895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.631601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.842289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:34.852030 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-caba5274-6dc9-4b68-828a-5cdfe6978d4a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.316971 Oct 04 11:01:34.852249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:34.852811 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 335/655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:34.861679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5fee7e44-71d1-4bf6-8049-86b07c4b9da9 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1473 microversion: 2.1 time: 0.260335 Oct 04 11:01:34.862760 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 321/656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1473 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:34.866775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b1bfb03-9ccc-4359-9ddd-0a73181b4c35 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '.version_select at 0x7f71d4d6a4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.870486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b1bfb03-9ccc-4359-9ddd-0a73181b4c35 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.870955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b1bfb03-9ccc-4359-9ddd-0a73181b4c35 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.871963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b1bfb03-9ccc-4359-9ddd-0a73181b4c35 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.884082 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b1bfb03-9ccc-4359-9ddd-0a73181b4c35 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.030067 Oct 04 11:01:34.884654 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 336/657] 10.222.0.23 () {60 vars in 1184 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:34.898886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:34.899489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:34.905557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.906041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.906698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:34.907400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:34.907850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:34.908272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.045908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 03bf74f9-21f7-4f34-9676-662ac379bf2b {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:35.059945 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a13988bd-fe3b-47bc-b7d0-012b2509f457 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 2052 microversion: 2.25 time: 0.164117 Oct 04 11:01:35.072624 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 322/658] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:34 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 2052 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:01:35.229540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1091061644", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "f0bf75d3-271a-43d6-b516-b6797bcc3a40"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:35.303223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:35.304137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:35.320416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] validate_networks() for [('f0bf75d3-271a-43d6-b516-b6797bcc3a40', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:35.321320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:35.323018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:35.323642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.325901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:35.329079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:35.332018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.586390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:35.594834 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7180621b-106b-4ff2-9e28-2389eb28c55b tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1589 microversion: 2.1 time: 0.300379 Oct 04 11:01:35.595412 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 323/659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:35 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1589 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:35.604599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:35.605204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:35.612067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:35.612549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:35.612984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.613709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:35.614159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:35.614778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.725879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:35.737743 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c28fc92c-6974-463d-81af-ea22c5ae018d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1294 microversion: 2.1 time: 0.136736 Oct 04 11:01:35.742671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 324/660] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:35 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1294 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:35.763513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:35.764202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:35.770600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:35.771159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:35.772418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.773369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:35.774029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:35.774653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.909124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf43d91c-fc78-4003-b285-4c0e77626e67 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164389 Oct 04 11:01:35.909912 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 325/661] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:01:35 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:35.925166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:35.926891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:35.935153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:35.935935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:35.936375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.937148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:35.937627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:35.938202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:35.941047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:36.312652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:36.331398 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5511c389-93ac-43d8-ba27-4c5f11fadc81 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1220 microversion: 2.1 time: 0.420086 Oct 04 11:01:36.345390 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 326/662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:35 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1220 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:36.345390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:36.345390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:36.355518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:36.357262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:36.358607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:36.359392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:36.360171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:36.377788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:36.379280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:36.380398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:36.381859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:36.382105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:36.382661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:36.383384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:36.383889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:36.384371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:36.388815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:36.389419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:36.389852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:36.417821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for project 83765ee4f79c49f49b8af1a56a260450. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:36.422141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for user 27f40f692eac4ea39019fe4921b054f7 and project 83765ee4f79c49f49b8af1a56a260450. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:36.436388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:01:36.438894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:01:36.460139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:36.517865 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e7f92b3-eafd-491b-a2d6-b7975bfbcc14 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.292607 Oct 04 11:01:36.519040 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 337/663] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:01:36.524850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:36.534998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:36.562313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:36.563983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:36.564508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:36.565325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:36.565908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:36.566828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:36.699874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:36.710367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f4f25dd-bbff-426e-9d5e-309a0363dfb1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.375092 Oct 04 11:01:36.714550 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 327/664] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:36 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:36.720117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec933bd4-5dcf-4019-9a7a-d8fb12de9e4c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:36.720881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec933bd4-5dcf-4019-9a7a-d8fb12de9e4c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:36.936531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec933bd4-5dcf-4019-9a7a-d8fb12de9e4c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:36.951000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec933bd4-5dcf-4019-9a7a-d8fb12de9e4c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:36.952446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec933bd4-5dcf-4019-9a7a-d8fb12de9e4c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:36.953729 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec933bd4-5dcf-4019-9a7a-d8fb12de9e4c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1262 microversion: 2.25 time: 0.237586 Oct 04 11:01:36.969433 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 328/665] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:36 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1262 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:36.976764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:36.977703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:36.994266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:36.994801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:36.995339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:36.996088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:36.997225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:36.999741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:37.067985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:37.077477 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-317ee05b-da63-47d7-aab4-1234c8d533cb tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1473 microversion: 2.1 time: 0.556217 Oct 04 11:01:37.082875 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 338/666] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:36 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1473 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:37.249642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ef7cc095-6019-4fb1-af0f-3c85c52daa61 req-a09ac826-5403-4da7-9b5a-5c391b8d1c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687c5af7-ef65-4b00-b6bc-86192e25ef26", "tag": "171d8e8d-ec59-4e9f-a567-2899ab792976"}, {"server_uuid": "b0d695d7-c959-4c4f-9018-0c1a72b30010", "name": "network-vif-deleted", "tag": "7cb823ba-3c8a-4b76-8bf0-5becf5096e1a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:37.271746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ef7cc095-6019-4fb1-af0f-3c85c52daa61 req-a09ac826-5403-4da7-9b5a-5c391b8d1c42 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:37.279936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ef7cc095-6019-4fb1-af0f-3c85c52daa61 req-a09ac826-5403-4da7-9b5a-5c391b8d1c42 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:37.281747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ef7cc095-6019-4fb1-af0f-3c85c52daa61 req-a09ac826-5403-4da7-9b5a-5c391b8d1c42 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:37.327271 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ef7cc095-6019-4fb1-af0f-3c85c52daa61 req-a09ac826-5403-4da7-9b5a-5c391b8d1c42 service nova] Creating event network-changed:171d8e8d-ec59-4e9f-a567-2899ab792976 for instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 on n-h1-791135-8 Oct 04 11:01:37.337760 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ef7cc095-6019-4fb1-af0f-3c85c52daa61 req-a09ac826-5403-4da7-9b5a-5c391b8d1c42 service nova] Creating event network-vif-deleted:7cb823ba-3c8a-4b76-8bf0-5becf5096e1a for instance b0d695d7-c959-4c4f-9018-0c1a72b30010 on n-h1-791135-8 Oct 04 11:01:37.360070 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ef7cc095-6019-4fb1-af0f-3c85c52daa61 req-a09ac826-5403-4da7-9b5a-5c391b8d1c42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.110332 Oct 04 11:01:37.362016 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 339/667] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:01:37.375773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:37.376518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:37.389032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:37.400746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:37.401573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:37.402639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:37.403298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:37.403962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:37.554741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:37.564273 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78771a18-8107-4424-b163-1c96ba3de814 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1300 microversion: 2.1 time: 0.608685 Oct 04 11:01:37.569321 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 329/668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:36 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1300 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:37.595336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:37.604572 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90d0d348-20f7-4cb5-a758-9bd92340ad51 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1294 microversion: 2.1 time: 0.241095 Oct 04 11:01:37.614254 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 340/669] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:37 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1294 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:37.734034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:37.734893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:37.750309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:37.752600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:37.753342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:37.755761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:37.756463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:37.759602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:37.987718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:37.990286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:38.006472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.007247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.009367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.012490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.013230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.014446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.291963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:38.303635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:38.311006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:38.312123 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1dcce1d8-1803-4b5b-8f8c-ab01db3a9c33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1314 microversion: 2.25 time: 0.334577 Oct 04 11:01:38.336704 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 341/670] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:37 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:38.347081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:38.350137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:38.373650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.374251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.379516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.381815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.382650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.383454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.463662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.464388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.465647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.466251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lazy-loading 'fault' on Instance uuid b0d695d7-c959-4c4f-9018-0c1a72b30010 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:38.484862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:38.508455 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fe8e44f-5c65-4695-91f4-32394c9562d6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.778248 Oct 04 11:01:38.511222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 330/671] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:37 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:38.596935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:38.597623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:38.608045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.608604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.611959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.612427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d826e411532459c8ae9b6e9d29965be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12ae544c2fb4abcb027575847a24f28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:38.612749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.613233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.613697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.624150 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f268b17b-eccd-4055-8738-f56b02fa22b4 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 200 len: 1308 microversion: 2.1 time: 0.283047 Oct 04 11:01:38.627152 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 342/672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:38 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:38.692871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:38.698612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:38.713718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.717060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.718345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.721190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:38.722918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:38.724946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:38.875505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:38.904212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c518ef99-02e7-4c00-9be1-420012130bbd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1300 microversion: 2.1 time: 0.307912 Oct 04 11:01:38.904964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 331/673] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:38 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1300 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:38.938580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:38.948743 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-548d77a3-d723-453d-a5cf-c16b17bd78ae tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1282 microversion: 2.1 time: 0.280298 Oct 04 11:01:38.949899 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 343/674] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:38 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1282 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:39.338490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:39.339101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:39.353647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:39.353852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:39.354450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:39.355184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:39.356194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:39.356661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:39.535911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:39.536452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:39.559859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:39.560351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:39.560800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:39.561968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:39.562424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:39.562848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:39.869680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:39.879269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:39.880976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:39.882291 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81218c45-d720-4eac-9075-0dd71c23f16e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1320 microversion: 2.25 time: 0.547838 Oct 04 11:01:39.886086 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 332/675] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:39 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1320 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:39.894530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:39.895150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] [instance: b0d695d7-c959-4c4f-9018-0c1a72b30010] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:39.919104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:39.919662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:39.920128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:39.921970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:39.921970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:39.921970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:39.941511 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] HTTP exception thrown: Instance b0d695d7-c959-4c4f-9018-0c1a72b30010 could not be found. Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Request method failure captured: Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 HTTP/1.1 Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJMbLyCo0rZICg5bkN_mg3p-_A8m33uIqYhtJ1DJsi7aL0qBTDcLj0NmReDRy-zNGn_Xdqd4hIyjlhQSEqRkj-XVPwBQXUg2Mr0txBsgYTRXe1dZGkQNrvrGY1AIezhzYJIZkds7GSILByBJKsToUkiMGNdxWCEu3-uXZlPOpmjSF8 Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e12ae544c2fb4abcb027575847a24f28 Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveMigrationNegativeTest-1925712963 Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:01:39.943629 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e12ae544c2fb4abcb027575847a24f28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e12ae544c2fb4abcb027575847a24f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e12ae544c2fb4abcb027575847a24f28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e12ae544c2fb4abcb027575847a24f28"}]}] Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveMigrationNegativeTest-1925712963 Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e12ae544c2fb4abcb027575847a24f28 Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1925712963 Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveMigrationNegativeTest-1925712963-project Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6d826e411532459c8ae9b6e9d29965be Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveMigrationNegativeTest-1925712963-project Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b0d695d7-c959-4c4f-9018-0c1a72b30010 could not be found. Oct 04 11:01:39.945036 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b0d695d7-c959-4c4f-9018-0c1a72b30010'} Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d695d7-c959-4c4f-9018-0c1a72b30010 could not be found. Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:39.945997 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d695d7-c959-4c4f-9018-0c1a72b30010 could not be found. Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d695d7-c959-4c4f-9018-0c1a72b30010 could not be found. Oct 04 11:01:39.947220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:39.950368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] Returning 404 to user: Instance b0d695d7-c959-4c4f-9018-0c1a72b30010 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:39.951438 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-33773936-cf94-4c4b-aa82-10c639056c57 tempest-LiveMigrationNegativeTest-1925712963 tempest-LiveMigrationNegativeTest-1925712963-project] 10.222.0.23 "GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010" status: 404 len: 111 microversion: 2.1 time: 0.063595 Oct 04 11:01:39.952750 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 333/676] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:39 2022] GET /compute/v2.1/servers/b0d695d7-c959-4c4f-9018-0c1a72b30010 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:01:39.958525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:39.959519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:39.970554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:39.971342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:39.974983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:39.975998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:39.976679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:39.979016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:40.318462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:40.342246 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f8f0003-a520-4e1e-b855-b0776e11bc23 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1475 microversion: 2.1 time: 0.808968 Oct 04 11:01:40.378071 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 344/677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:39 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1475 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:40.392121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:40.392739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:40.427769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:40.431025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:40.431660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:40.433684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:40.435717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:40.438931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:40.750894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:40.769462 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d555bf87-a022-4bc7-bb6c-89ca779185ea tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.815304 Oct 04 11:01:40.772420 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 334/678] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:39 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:40.783448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:40.784464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:40.797210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:40.802882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:40.803583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:40.805000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:40.805751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:40.806682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:41.077203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:41.080955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:41.090990 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-804126e9-f822-482c-bec1-30f6b2f08ce3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.709316 Oct 04 11:01:41.091919 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 345/679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:40 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:41.106842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-420e91c2-9c5f-48e3-8930-7910e3fdb765 req-73a47ba4-5b90-4a18-a91f-5c2cd24e688f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19f44e6-544a-463f-9b91-f68bb9d31348", "tag": "4352b0b5-7bb0-4d02-a5f0-b045ab94e932"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:41.139969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-420e91c2-9c5f-48e3-8930-7910e3fdb765 req-73a47ba4-5b90-4a18-a91f-5c2cd24e688f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:41.148823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-420e91c2-9c5f-48e3-8930-7910e3fdb765 req-73a47ba4-5b90-4a18-a91f-5c2cd24e688f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:41.149643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-420e91c2-9c5f-48e3-8930-7910e3fdb765 req-73a47ba4-5b90-4a18-a91f-5c2cd24e688f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:41.165771 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-420e91c2-9c5f-48e3-8930-7910e3fdb765 req-73a47ba4-5b90-4a18-a91f-5c2cd24e688f service nova] Creating event network-changed:4352b0b5-7bb0-4d02-a5f0-b045ab94e932 for instance c19f44e6-544a-463f-9b91-f68bb9d31348 on n-h2-791135-8 Oct 04 11:01:41.182969 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-420e91c2-9c5f-48e3-8930-7910e3fdb765 req-73a47ba4-5b90-4a18-a91f-5c2cd24e688f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079666 Oct 04 11:01:41.184004 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 346/680] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:41.189095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:41.195390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:41.206634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:41.218135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:41.218751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:41.219612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:41.220175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:41.220723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:41.409188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:41.427810 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-799000eb-9799-4a32-a036-d54689109307 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1589 microversion: 2.1 time: 0.653997 Oct 04 11:01:41.430359 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 335/681] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:40 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1589 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:41.452323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:41.453859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:41.463719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:41.466259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:41.466994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:41.467976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:41.468832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:41.470568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:41.635275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:41.646389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:41.648077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:41.649417 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da7d6839-fccf-405a-9e9c-b864f80520dc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1320 microversion: 2.25 time: 0.464428 Oct 04 11:01:41.650160 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 347/682] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:41 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:41.799443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:41.800358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:41.817635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:41.818608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:41.819361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:41.820295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:41.820976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:41.821761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:42.052730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:42.062342 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e81c633-c193-4a3c-b73e-e7e210e09282 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1474 microversion: 2.1 time: 0.629480 Oct 04 11:01:42.078772 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 336/683] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:41 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1474 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:42.120520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:42.121785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:42.136728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:42.143007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:42.143709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:42.144466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:42.144946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:42.145400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:42.461217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:42.484867 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae9df317-9566-43df-932e-ecd1fb85f3af tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.688246 Oct 04 11:01:42.485578 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 348/684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:41 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:42.505281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c871d949-cb72-4e10-bc34-14a3be44ce30 req-9fea5955-a519-42f5-8174-70a83e58d000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6ad7b9-05e4-41a3-bbd7-af165b007a63", "name": "network-vif-unplugged", "status": "completed", "tag": "0b6cbe01-a672-4ba7-babc-6e79a199d6da"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:42.542488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c871d949-cb72-4e10-bc34-14a3be44ce30 req-9fea5955-a519-42f5-8174-70a83e58d000 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:42.543427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c871d949-cb72-4e10-bc34-14a3be44ce30 req-9fea5955-a519-42f5-8174-70a83e58d000 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:42.545559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c871d949-cb72-4e10-bc34-14a3be44ce30 req-9fea5955-a519-42f5-8174-70a83e58d000 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:42.579074 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c871d949-cb72-4e10-bc34-14a3be44ce30 req-9fea5955-a519-42f5-8174-70a83e58d000 service nova] Creating event network-vif-unplugged:0b6cbe01-a672-4ba7-babc-6e79a199d6da for instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 on n-h2-791135-8 Oct 04 11:01:42.587674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-c871d949-cb72-4e10-bc34-14a3be44ce30 req-9fea5955-a519-42f5-8174-70a83e58d000 service nova] Instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:01:42.597950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:42.610918 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c871d949-cb72-4e10-bc34-14a3be44ce30 req-9fea5955-a519-42f5-8174-70a83e58d000 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119141 Oct 04 11:01:42.612884 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 349/685] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:42.615417 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d170931e-e413-4953-bace-f4b90305522b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.502617 Oct 04 11:01:42.616392 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 337/686] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:42 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:42.675335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:42.676031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:42.684739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:42.685471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:42.686152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:42.687186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:42.687729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:42.688223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:42.700429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b03e7fca-ac42-4614-ba5e-a49b347bf2d5 req-a3e00142-2546-45bc-a7e7-d0bb2f74bfec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133e0337-b85f-489a-9545-7582c99ba173", "tag": "30a28d0b-9016-4e57-9f4a-46a137d05c43"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:42.719501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b03e7fca-ac42-4614-ba5e-a49b347bf2d5 req-a3e00142-2546-45bc-a7e7-d0bb2f74bfec service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:42.719985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b03e7fca-ac42-4614-ba5e-a49b347bf2d5 req-a3e00142-2546-45bc-a7e7-d0bb2f74bfec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:42.720408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b03e7fca-ac42-4614-ba5e-a49b347bf2d5 req-a3e00142-2546-45bc-a7e7-d0bb2f74bfec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:42.954355 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b03e7fca-ac42-4614-ba5e-a49b347bf2d5 req-a3e00142-2546-45bc-a7e7-d0bb2f74bfec service nova] Creating event network-changed:30a28d0b-9016-4e57-9f4a-46a137d05c43 for instance 133e0337-b85f-489a-9545-7582c99ba173 on n-h2-791135-8 Oct 04 11:01:42.959509 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b03e7fca-ac42-4614-ba5e-a49b347bf2d5 req-a3e00142-2546-45bc-a7e7-d0bb2f74bfec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263254 Oct 04 11:01:42.961459 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 338/687] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:43.089514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:43.090281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:43.096849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:43.097341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:43.097975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:43.098675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:43.099308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:43.099881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:43.172154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:43.182909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:43.187995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:43.189485 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46225653-5e78-4c74-8e68-f70e82cf7384 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1362 microversion: 2.25 time: 0.518287 Oct 04 11:01:43.190872 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 350/688] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:42 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:43.302338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-56239e3d-7adc-4dee-a264-0ec52d383314 req-54db904c-5a7e-49d1-b549-f92d14d8b6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb", "tag": "69dc7eab-9033-43f0-bfc5-6dd0517f23d9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:43.312854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-56239e3d-7adc-4dee-a264-0ec52d383314 req-54db904c-5a7e-49d1-b549-f92d14d8b6e1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:43.313443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-56239e3d-7adc-4dee-a264-0ec52d383314 req-54db904c-5a7e-49d1-b549-f92d14d8b6e1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:43.313884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-56239e3d-7adc-4dee-a264-0ec52d383314 req-54db904c-5a7e-49d1-b549-f92d14d8b6e1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:43.325721 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-56239e3d-7adc-4dee-a264-0ec52d383314 req-54db904c-5a7e-49d1-b549-f92d14d8b6e1 service nova] Creating event network-changed:69dc7eab-9033-43f0-bfc5-6dd0517f23d9 for instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb on n-h2-791135-8 Oct 04 11:01:43.341415 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-56239e3d-7adc-4dee-a264-0ec52d383314 req-54db904c-5a7e-49d1-b549-f92d14d8b6e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042233 Oct 04 11:01:43.342506 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 351/689] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:43.509067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:43.510588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:43.517742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:43.518507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:43.518947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:43.519835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:43.520302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:43.520882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:43.585480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:43.594582 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77b304b2-5d06-4142-9710-b3630304d7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1474 microversion: 2.1 time: 0.509861 Oct 04 11:01:43.595302 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 339/690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:43 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1474 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:43.639524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:43.640172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:43.643378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:43.647552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:43.648207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:43.648883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:43.649722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:43.650256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:43.650878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:43.892037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:43.922053 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e12e0bcc-e9ae-478f-be26-5d91101729d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.417763 Oct 04 11:01:43.943467 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 352/691] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:43 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:43.976445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:43.986512 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b1e4146-2990-47fc-b4ee-bb6e7ad8d5af tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.351206 Oct 04 11:01:44.005115 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 340/692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:43 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:44.216980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:44.218735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:44.226390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:44.227049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:44.227822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:44.228760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:44.229391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:44.230122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:44.620228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:44.621251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:44.632900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:44.637131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:44.638346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:44.640947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:44.642078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:44.642666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:44.931518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:44.949057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:44.950573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:44.956425 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c5d2bb5-9c19-4cce-ac24-7db4b934bb07 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1362 microversion: 2.25 time: 0.744974 Oct 04 11:01:44.964495 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 353/693] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:44 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1362 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:44.977865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:44.980138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:45.000093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:45.000989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:45.001593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:45.002791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:45.003498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:45.003891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:45.063932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:45.076458 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f05db59e-b4db-4d2e-aba3-3def1c3368fb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1472 microversion: 2.1 time: 0.462902 Oct 04 11:01:45.093457 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 341/694] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:44 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:45.093457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8b806853-e6ba-497a-964f-c644fbefd40e req-1c19f6d0-ad7c-4fc2-ab68-60e9fe1d7024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240456d4-736b-475f-a025-74e9d41f65e5", "tag": "f2941df9-a2f4-43d4-bf97-726d9c9a9ab8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:45.110976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8b806853-e6ba-497a-964f-c644fbefd40e req-1c19f6d0-ad7c-4fc2-ab68-60e9fe1d7024 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:45.111753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8b806853-e6ba-497a-964f-c644fbefd40e req-1c19f6d0-ad7c-4fc2-ab68-60e9fe1d7024 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:45.112352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8b806853-e6ba-497a-964f-c644fbefd40e req-1c19f6d0-ad7c-4fc2-ab68-60e9fe1d7024 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:45.130638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8b806853-e6ba-497a-964f-c644fbefd40e req-1c19f6d0-ad7c-4fc2-ab68-60e9fe1d7024 service nova] Creating event network-changed:f2941df9-a2f4-43d4-bf97-726d9c9a9ab8 for instance 240456d4-736b-475f-a025-74e9d41f65e5 on n-h1-791135-8 Oct 04 11:01:45.144644 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8b806853-e6ba-497a-964f-c644fbefd40e req-1c19f6d0-ad7c-4fc2-ab68-60e9fe1d7024 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056389 Oct 04 11:01:45.145300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 342/695] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:45.161119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:45.161916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:45.168556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:45.169000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:45.169466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:45.170178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:45.171171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:45.171612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:45.349016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:45.358569 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39b415cc-0648-4932-a908-a0eeda21a9d9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.390535 Oct 04 11:01:45.359326 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 354/696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:44 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:45.455875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:45.464917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2dcd4f20-fa45-4188-980c-5b0908cd1414 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.318360 Oct 04 11:01:45.465750 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 343/697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:45 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:45.678782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e860b531-8db7-47e3-92fb-54de89e9d7ff tempest-NetworksTest-1384378506 tempest-NetworksTest-1384378506-project-admin] Calling method '.version_select at 0x7f71d4e4dc10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:45.864618 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e860b531-8db7-47e3-92fb-54de89e9d7ff tempest-NetworksTest-1384378506 tempest-NetworksTest-1384378506-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 8836 microversion: 2.1 time: 0.318198 Oct 04 11:01:45.865665 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 355/698] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:01:45 2022] GET /compute/v2.1/os-networks => generated 8836 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:45.874167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f741f317-3d37-4683-9e1b-58d7d75520f3 tempest-NetworksTest-1384378506 tempest-NetworksTest-1384378506-project-admin] Calling method '.version_select at 0x7f71d48cb0d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:45.984146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:45.984768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:46.002110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:46.002993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:46.003634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:46.004552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:46.005287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:46.005964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:46.184051 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f741f317-3d37-4683-9e1b-58d7d75520f3 tempest-NetworksTest-1384378506 tempest-NetworksTest-1384378506-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/afa91231-c695-414b-8934-c531a3447aaa" status: 200 len: 652 microversion: 2.1 time: 0.313609 Oct 04 11:01:46.184958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 344/699] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:01:45 2022] GET /compute/v2.1/os-networks/afa91231-c695-414b-8934-c531a3447aaa => generated 652 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:46.194072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:46.194908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:46.207271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:46.210029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:46.210656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:46.222474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:46.222971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:46.223450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:46.324255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:46.333427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:46.334581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:46.335899 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58825815-4bed-47a7-a2cc-cc11fe0c5b86 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1362 microversion: 2.25 time: 0.356363 Oct 04 11:01:46.351861 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 356/700] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:45 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:01:46.355175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c39e09c-1c1d-42b5-93b4-f9d4e2b8cb5a tempest-NetworksTest-1384378506 tempest-NetworksTest-1384378506-project-admin] Calling method '.version_select at 0x7f71d4c609d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:46.408761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:46.431297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:46.667236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:46.680829 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0725a498-dff6-4225-9527-4bcd2bd4646d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1472 microversion: 2.1 time: 0.489662 Oct 04 11:01:46.682193 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 345/701] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:46 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1472 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:46.684581 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c39e09c-1c1d-42b5-93b4-f9d4e2b8cb5a tempest-NetworksTest-1384378506 tempest-NetworksTest-1384378506-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 8836 microversion: 2.1 time: 0.333614 Oct 04 11:01:46.685516 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 357/702] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:01:46 2022] GET /compute/v2.1/os-networks => generated 8836 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:46.695952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:46.698369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:46.699459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:46.705416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:46.715200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:46.716030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:46.716684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:46.717490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:46.717843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:46.717981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:46.718403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:46.718870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:46.719504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:46.722297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:46.722782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:46.723218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:46.940754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=16 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:47.067873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:47.077339 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba9c2758-818c-4402-a5e0-815591f6a562 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.390567 Oct 04 11:01:47.078433 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 358/703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:46 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:47.113257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:47.119476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:47.144047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-492d2d8d-3813-49bb-892f-ad7baa369f56 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.457531 Oct 04 11:01:47.146122 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 346/704] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:46 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:47.363499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:47.364321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:47.371494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:47.372251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:47.372886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:47.382646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:47.383452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:47.384111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:47.604401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:47.623159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:47.625325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:47.634216 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9cd399a-296e-49ce-9d6c-826decb62fed tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1362 microversion: 2.25 time: 0.274548 Oct 04 11:01:47.641237 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 359/705] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:47 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:47.707801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:47.708421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:47.714360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:47.715479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:47.716079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:47.717331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:47.717976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:47.718583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:47.941194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:47.950895 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40c43751-2c82-4854-bdf7-435fce12a9cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1472 microversion: 2.1 time: 0.247075 Oct 04 11:01:47.952125 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 360/706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:47 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:48.051263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5cb6488a-4da3-47b0-b718-92be99aed3e6 tempest-FloatingIPDetailsNegativeTestJSON-2063580356 tempest-FloatingIPDetailsNegativeTestJSON-2063580356-project] Calling method '.version_select at 0x7f71d488fc10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:48.101901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:48.103328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:48.116699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:48.117602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:48.121487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-5cb6488a-4da3-47b0-b718-92be99aed3e6 tempest-FloatingIPDetailsNegativeTestJSON-2063580356 tempest-FloatingIPDetailsNegativeTestJSON-2063580356-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ebf99d30-0874-4d23-babc-f65158f89fbd could not be found", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:01:48.122448 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5cb6488a-4da3-47b0-b718-92be99aed3e6 tempest-FloatingIPDetailsNegativeTestJSON-2063580356 tempest-FloatingIPDetailsNegativeTestJSON-2063580356-project] HTTP exception thrown: Floating IP not found for ID ebf99d30-0874-4d23-babc-f65158f89fbd Oct 04 11:01:48.128027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:48.129791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:48.130892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:48.131347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5cb6488a-4da3-47b0-b718-92be99aed3e6 tempest-FloatingIPDetailsNegativeTestJSON-2063580356 tempest-FloatingIPDetailsNegativeTestJSON-2063580356-project] Request method failure captured: Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-floating-ips/ebf99d30-0874-4d23-babc-f65158f89fbd HTTP/1.1 Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKbFTuBUo2S7EyIgiVF41TbHCQfByG29acWGIYEYUzuQ8K94G5P6FsFM19EHIcN4MRFd77cBMp2IruvWFONFd68WMRozubnYgjai-9m2RZxGamqXfmbaQ7qAj8Q62hn3XHrLdANYqjUmc94-UbmZkAd1keqmdRI2jb975F2SqnE-PY Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 66d955d23d624fc98310922f9825032c Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2063580356 Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:01:48.151996 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66d955d23d624fc98310922f9825032c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66d955d23d624fc98310922f9825032c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66d955d23d624fc98310922f9825032c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66d955d23d624fc98310922f9825032c"}]}] Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2063580356 Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 66d955d23d624fc98310922f9825032c Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2063580356 Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2063580356-project Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: ff5429fa22e44d7085436d7ec08855cf Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2063580356-project Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: exception: Floating IP not found for ID ebf99d30-0874-4d23-babc-f65158f89fbd Oct 04 11:01:48.153945 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'ebf99d30-0874-4d23-babc-f65158f89fbd'} Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:01:48.154715 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ebf99d30-0874-4d23-babc-f65158f89fbd could not be found Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61fef8cf-43e4-4dec-8841-1b56b394864b'] Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ebf99d30-0874-4d23-babc-f65158f89fbd. Oct 04 11:01:48.155802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ebf99d30-0874-4d23-babc-f65158f89fbd Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:48.156966 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:01:48.160171 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:01:48.160171 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ebf99d30-0874-4d23-babc-f65158f89fbd Oct 04 11:01:48.160171 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:48.160171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5cb6488a-4da3-47b0-b718-92be99aed3e6 tempest-FloatingIPDetailsNegativeTestJSON-2063580356 tempest-FloatingIPDetailsNegativeTestJSON-2063580356-project] Returning 404 to user: Floating IP not found for ID ebf99d30-0874-4d23-babc-f65158f89fbd {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:48.160171 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5cb6488a-4da3-47b0-b718-92be99aed3e6 tempest-FloatingIPDetailsNegativeTestJSON-2063580356 tempest-FloatingIPDetailsNegativeTestJSON-2063580356-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/ebf99d30-0874-4d23-babc-f65158f89fbd" status: 404 len: 111 microversion: 2.1 time: 0.535221 Oct 04 11:01:48.160171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 347/707] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:01:47 2022] GET /compute/v2.1/os-floating-ips/ebf99d30-0874-4d23-babc-f65158f89fbd => generated 111 bytes in 537 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:01:48.169328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:48.169974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:48.182193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:48.182685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:48.183117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:48.183855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:48.184307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:48.184740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:48.477053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:48.485911 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed92aef2-5b4f-4737-8010-fec2c4866541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.389420 Oct 04 11:01:48.501015 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 361/708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:48 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:48.501593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:48.505943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93d7eeb0-e642-42b5-b949-a0bd3ec9143e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.336199 Oct 04 11:01:48.506802 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 348/709] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:48 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:48.669028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:48.670211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:48.683178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:48.684444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:48.685727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:48.686901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:48.687660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:48.688566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:48.976301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:48.977101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:48.993112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:48.994069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:48.995096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:48.996715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:48.998229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:48.999374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:49.299415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:49.313718 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9475ae49-b762-489b-a021-36dfab9bfb35 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1472 microversion: 2.1 time: 0.335099 Oct 04 11:01:49.313718 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 349/710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:48 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1472 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:49.333739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:49.344425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:49.346289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:49.347603 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef0937fa-929f-4982-8448-6404c0c28ea2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1362 microversion: 2.25 time: 0.685358 Oct 04 11:01:49.348339 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 362/711] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:48 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1362 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:49.515482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:49.516367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:49.532091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:49.534383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:49.535045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:49.535865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:49.536521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:49.537703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:49.538369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:49.538998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:49.546826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:49.547502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:49.547957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:49.551507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:49.552934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:49.553586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:49.846254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:49.853902 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f679d91-4ecd-45e3-b794-b3bed08d028a tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.345039 Oct 04 11:01:49.855212 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 350/712] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:49 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:49.903702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:49.913249 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df9b7cb1-7922-4917-8d91-943a17269055 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.382710 Oct 04 11:01:49.914075 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 363/713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:49 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:50.335018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:50.336349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:50.345945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.346714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.347149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.347856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.348304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.348717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.444727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-245fb4da-a318-4137-9ea2-c1498d84b317 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Calling method '.version_select at 0x7f71d4ad0550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:50.574000 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-245fb4da-a318-4137-9ea2-c1498d84b317 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 371 microversion: 2.1 time: 0.361255 Oct 04 11:01:50.575496 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 351/714] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:01:50 2022] GET /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:50.586899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:50.588731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:50.596626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.597131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.597709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.598427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.598886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.599315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.721531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:50.736379 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec44988a-72ed-4653-a3c8-31f885afa02c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1472 microversion: 2.1 time: 0.406736 Oct 04 11:01:50.739915 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 364/715] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:50 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:50.758151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2876d005-33e2-4753-9812-c138f9eca8e9 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4c8f1f0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:50.862572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2876d005-33e2-4753-9812-c138f9eca8e9 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.862801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:50.863648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2876d005-33e2-4753-9812-c138f9eca8e9 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.865013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2876d005-33e2-4753-9812-c138f9eca8e9 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.866161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2876d005-33e2-4753-9812-c138f9eca8e9 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.866810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2876d005-33e2-4753-9812-c138f9eca8e9 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.867410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2876d005-33e2-4753-9812-c138f9eca8e9 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.880374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:50.881877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:50.883029 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6a46479-306c-433f-9f47-c4a0219ba482 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1362 microversion: 2.25 time: 0.306504 Oct 04 11:01:50.883593 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 352/716] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:50 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:50.888900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7a00c790-cf6f-49fd-ab9a-694087985b92 req-eff0dae7-c81f-4caa-b5ba-f8a527118d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6ad7b9-05e4-41a3-bbd7-af165b007a63", "name": "network-vif-plugged", "status": "completed", "tag": "0b6cbe01-a672-4ba7-babc-6e79a199d6da"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:50.911397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7a00c790-cf6f-49fd-ab9a-694087985b92 req-eff0dae7-c81f-4caa-b5ba-f8a527118d39 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.912106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7a00c790-cf6f-49fd-ab9a-694087985b92 req-eff0dae7-c81f-4caa-b5ba-f8a527118d39 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.912757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7a00c790-cf6f-49fd-ab9a-694087985b92 req-eff0dae7-c81f-4caa-b5ba-f8a527118d39 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.928183 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7a00c790-cf6f-49fd-ab9a-694087985b92 req-eff0dae7-c81f-4caa-b5ba-f8a527118d39 service nova] Creating event network-vif-plugged:0b6cbe01-a672-4ba7-babc-6e79a199d6da for instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 on n-h2-791135-8 Oct 04 11:01:50.940744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-7a00c790-cf6f-49fd-ab9a-694087985b92 req-eff0dae7-c81f-4caa-b5ba-f8a527118d39 service nova] Instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:01:50.949548 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7a00c790-cf6f-49fd-ab9a-694087985b92 req-eff0dae7-c81f-4caa-b5ba-f8a527118d39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064586 Oct 04 11:01:50.950174 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 353/717] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:50.960316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:50.961057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:50.968023 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2876d005-33e2-4753-9812-c138f9eca8e9 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 328 microversion: 2.1 time: 0.226297 Oct 04 11:01:50.969071 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 365/718] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:01:50 2022] PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:50.971661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.972222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.972966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.973931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.974691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.975272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.980036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:50.981376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:50.988930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.989593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.990468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:50.991622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:50.992185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:50.992712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:51.298095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:51.303948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:51.313151 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13e12155-9709-47a8-959b-5673ad56f72b tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.340511 Oct 04 11:01:51.320356 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 366/719] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:50 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:51.395882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:51.404083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82a4d289-3c89-4d40-8c86-af7037aa560c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.448182 Oct 04 11:01:51.404630 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 354/720] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:50 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:51.443565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-959320916", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:51.530277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:51.767372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:51.768780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:51.774924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:51.777740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:51.778755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:51.779378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:51.780836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:51.781631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:51.782331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:52.311472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:52.311890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:52.312355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:52.312751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:52.313146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:52.322247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:52.322776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:52.323200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:52.324719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:52.325169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:52.325610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:52.347402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Getting quotas for project 380b82c344a14f4dbaaaa7a4c97b0a2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:52.351236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Getting quotas for user d03968e7ad8442d1843ffdae94e3ff1f and project 380b82c344a14f4dbaaaa7a4c97b0a2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:52.362156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.utils [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] cores quota exceeded for 380b82c344a14f4dbaaaa7a4c97b0a2b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122408) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 11:01:52.362981 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Request method failure captured: Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 144 Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBKdW_vxsF4byYOjWVii4YLQqYhrpyE4r2093b4r9P_TeZ40HTxjlHhCCa0ERgpikJSekgrZHv3hzsAVJuo5OzLEghjiyE3FFpmq6gvSpTxpf2gHD1EURkAjUgv5GfuSm-6b8V13bngeOsgP11goHyzQ2tJ5AprFSbwh8dmKuM0mS_4 Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 380b82c344a14f4dbaaaa7a4c97b0a2b Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:01:52.390930 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}] Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 380b82c344a14f4dbaaaa7a4c97b0a2b Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-QuotasAdminNegativeTest-609572887-project Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: d03968e7ad8442d1843ffdae94e3ff1f Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-QuotasAdminNegativeTest-609572887-project Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-959320916", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} Oct 04 11:01:52.392507 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-959320916', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452'}}} Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 11:01:52.393295 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:52.394933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:52.398244 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdf549ac-8ba5-4605-ac52-cd6f9e3b109b tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.072163 Oct 04 11:01:52.402820 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 367/721] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:01:51 2022] POST /compute/v2.1/servers => generated 111 bytes in 1074 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:01:52.404778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:52.404778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:52.410911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:52.411519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:52.411900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:52.412591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:52.413049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:52.413496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:52.454488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:52.463007 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bcf9c569-1bdb-47e7-aae7-00b5c0df37cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1469 microversion: 2.1 time: 0.699869 Oct 04 11:01:52.466840 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 355/722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:51 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1469 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:01:52.474703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:52.474703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:52.481787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:52.482504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:52.483362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:52.484234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:52.484921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:52.485559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:52.895343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:52.904156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:52.905658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:52.906777 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a074571-8441-4b3b-be52-96a3fbf1d832 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1362 microversion: 2.25 time: 0.511157 Oct 04 11:01:52.907340 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 368/723] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:52 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:52.911661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d48471d-dc0b-47e5-b9bf-bf560f20becc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4c4d310>, body: {"quota_set": {"cores": 20}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:52.920437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:52.929763 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fde5f94c-0439-4c41-b34a-393b2854f528 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.461848 Oct 04 11:01:52.930335 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 356/724] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:52 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:52.935624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:52.936166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:52.942674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:52.943448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:52.944059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:52.944934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:52.945598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:52.946252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.024727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d48471d-dc0b-47e5-b9bf-bf560f20becc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.025306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d48471d-dc0b-47e5-b9bf-bf560f20becc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.025830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d48471d-dc0b-47e5-b9bf-bf560f20becc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.026870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d48471d-dc0b-47e5-b9bf-bf560f20becc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.027536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d48471d-dc0b-47e5-b9bf-bf560f20becc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.027960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d48471d-dc0b-47e5-b9bf-bf560f20becc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.089638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:53.092545 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d48471d-dc0b-47e5-b9bf-bf560f20becc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 329 microversion: 2.1 time: 0.184201 Oct 04 11:01:53.093547 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 369/725] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:01:52 2022] PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 329 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:53.098857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:53.099627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:53.111526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.112195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.112817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.113664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.114376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.114917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.178324 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66f7c389-890c-4de1-8950-def2e9b24165 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63/action" status: 204 len: 0 microversion: 2.1 time: 0.082947 Oct 04 11:01:53.179488 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 370/726] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:01:53 2022] POST /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:01:53.188270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3a695b57-b459-4f8e-9487-2b382ef25f89 req-d5c0ba3c-a5ce-4c2e-860a-9db36387616a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240456d4-736b-475f-a025-74e9d41f65e5", "name": "network-vif-plugged", "status": "completed", "tag": "f2941df9-a2f4-43d4-bf97-726d9c9a9ab8"}, {"server_uuid": "133e0337-b85f-489a-9545-7582c99ba173", "name": "network-vif-plugged", "status": "completed", "tag": "30a28d0b-9016-4e57-9f4a-46a137d05c43"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:53.199065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3a695b57-b459-4f8e-9487-2b382ef25f89 req-d5c0ba3c-a5ce-4c2e-860a-9db36387616a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.199810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3a695b57-b459-4f8e-9487-2b382ef25f89 req-d5c0ba3c-a5ce-4c2e-860a-9db36387616a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.200241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3a695b57-b459-4f8e-9487-2b382ef25f89 req-d5c0ba3c-a5ce-4c2e-860a-9db36387616a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.213137 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3a695b57-b459-4f8e-9487-2b382ef25f89 req-d5c0ba3c-a5ce-4c2e-860a-9db36387616a service nova] Creating event network-vif-plugged:f2941df9-a2f4-43d4-bf97-726d9c9a9ab8 for instance 240456d4-736b-475f-a025-74e9d41f65e5 on n-h1-791135-8 Oct 04 11:01:53.213676 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3a695b57-b459-4f8e-9487-2b382ef25f89 req-d5c0ba3c-a5ce-4c2e-860a-9db36387616a service nova] Creating event network-vif-plugged:30a28d0b-9016-4e57-9f4a-46a137d05c43 for instance 133e0337-b85f-489a-9545-7582c99ba173 on n-h2-791135-8 Oct 04 11:01:53.222295 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3a695b57-b459-4f8e-9487-2b382ef25f89 req-d5c0ba3c-a5ce-4c2e-860a-9db36387616a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040899 Oct 04 11:01:53.222891 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 371/727] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:53.227938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d70fd32-ad98-441e-9bc9-f0f081d907bc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Calling method '.version_select at 0x7f71d4b42d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:53.295761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:53.298709 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d70fd32-ad98-441e-9bc9-f0f081d907bc tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 371 microversion: 2.1 time: 0.074624 Oct 04 11:01:53.299570 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 372/728] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:01:53 2022] GET /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:53.311156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:53.312208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:53.314803 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c46314f5-8fd6-4c02-b359-dc8206b75a0c tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.383219 Oct 04 11:01:53.315644 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 357/729] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:52 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:53.320902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56745638-035c-4546-86e8-8eeefc22189a tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Action: 'update', calling method: .version_select at 0x7f71d488fdc0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:53.326777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.327501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.328503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.329081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.330526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.333992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.411405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56745638-035c-4546-86e8-8eeefc22189a tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.412244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56745638-035c-4546-86e8-8eeefc22189a tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.412876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56745638-035c-4546-86e8-8eeefc22189a tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.413817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56745638-035c-4546-86e8-8eeefc22189a tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.414562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56745638-035c-4546-86e8-8eeefc22189a tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.415182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56745638-035c-4546-86e8-8eeefc22189a tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.512665 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-56745638-035c-4546-86e8-8eeefc22189a tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 328 microversion: 2.1 time: 0.195593 Oct 04 11:01:53.513973 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 358/730] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:01:53 2022] PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 328 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:53.535800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:53.567254 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2aaab63f-3091-4766-85fe-cca2a0a8b9d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1469 microversion: 2.1 time: 0.266457 Oct 04 11:01:53.571208 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 373/731] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:53 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:53.622505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-343880461", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:53.695077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:53.934728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:53.936286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:53.945784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.946404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.947039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:53.950071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:53.950538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:53.951128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.095265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:54.096236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:54.096709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:54.097152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:54.097632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:54.107390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.108010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.108612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.109604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.110217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.111171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.129717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Getting quotas for project 380b82c344a14f4dbaaaa7a4c97b0a2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:54.133545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Getting quotas for user d03968e7ad8442d1843ffdae94e3ff1f and project 380b82c344a14f4dbaaaa7a4c97b0a2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:54.145604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.utils [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] instances quota exceeded for 380b82c344a14f4dbaaaa7a4c97b0a2b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122409) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 11:01:54.146428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Request method failure captured: Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 144 Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKdW_vxsF4byYOjWVii4YLQqYhrpyE4r2093b4r9P_TeZ40HTxjlHhCCa0ERgpikJSekgrZHv3hzsAVJuo5OzLEghjiyE3FFpmq6gvSpTxpf2gHD1EURkAjUgv5GfuSm-6b8V13bngeOsgP11goHyzQ2tJ5AprFSbwh8dmKuM0mS_4 Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 380b82c344a14f4dbaaaa7a4c97b0a2b Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:01:54.150559 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}] Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 380b82c344a14f4dbaaaa7a4c97b0a2b Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-QuotasAdminNegativeTest-609572887-project Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d03968e7ad8442d1843ffdae94e3ff1f Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-QuotasAdminNegativeTest-609572887-project Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-343880461", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} Oct 04 11:01:54.151918 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-343880461', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452'}}} Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 11:01:54.152665 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:54.154895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:54.156136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de1060cd-cd61-4a56-b4c7-cf3ac08f4c1e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.538756 Oct 04 11:01:54.157412 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 359/732] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:01:53 2022] POST /compute/v2.1/servers => generated 119 bytes in 540 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:01:54.160003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:54.160611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:54.167489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.168010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.168440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.169644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.170103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.170904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.284729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:54.293675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:54.295333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:54.296628 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ad77a5ca-9a6e-4710-b7b8-51de57c31b51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1362 microversion: 2.25 time: 0.368155 Oct 04 11:01:54.314781 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 374/733] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:53 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:01:54.314781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55c07c3f-27ae-4915-a1df-a644abd9b099 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4b42670>, body: {"quota_set": {"instances": 10}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:54.380959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c07c3f-27ae-4915-a1df-a644abd9b099 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.381469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c07c3f-27ae-4915-a1df-a644abd9b099 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.381925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c07c3f-27ae-4915-a1df-a644abd9b099 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.382736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c07c3f-27ae-4915-a1df-a644abd9b099 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.383313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c07c3f-27ae-4915-a1df-a644abd9b099 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.383737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c07c3f-27ae-4915-a1df-a644abd9b099 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.437141 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55c07c3f-27ae-4915-a1df-a644abd9b099 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 329 microversion: 2.1 time: 0.138561 Oct 04 11:01:54.447633 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 375/734] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:01:54 2022] PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 329 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:54.447633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:54.447633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:54.452198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:54.461147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f01c808-fbf1-48d0-ae61-6860029ef270 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1368 microversion: 2.1 time: 0.307491 Oct 04 11:01:54.462070 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 360/735] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:54 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:54.467821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c40fa65-c345-400c-8050-9331aaa1e151 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Calling method '.version_select at 0x7f71d4a18f70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:54.478775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.479343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.479866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.481404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.481912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.482404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.563135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c40fa65-c345-400c-8050-9331aaa1e151 tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 371 microversion: 2.1 time: 0.099297 Oct 04 11:01:54.563679 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 361/736] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:01:54 2022] GET /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:54.575368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-629a1350-d302-4552-9df2-901c240964ad tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4d27f70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:54.643217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629a1350-d302-4552-9df2-901c240964ad tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.643711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629a1350-d302-4552-9df2-901c240964ad tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.644148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629a1350-d302-4552-9df2-901c240964ad tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.645069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629a1350-d302-4552-9df2-901c240964ad tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.645735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629a1350-d302-4552-9df2-901c240964ad tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.646171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629a1350-d302-4552-9df2-901c240964ad tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.706807 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-629a1350-d302-4552-9df2-901c240964ad tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 325 microversion: 2.1 time: 0.135195 Oct 04 11:01:54.719200 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 362/737] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:01:54 2022] PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 325 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:54.719200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:54.719200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:54.719200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.726052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.726898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.727810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:54.728654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:54.729092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:54.956582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:54.966369 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71de30cf-4233-4b99-9e35-d0523932e051 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.526551 Oct 04 11:01:54.966953 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 376/738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:54 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:54.979424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1071228638", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:55.078242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:01:55.109563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:55.117385 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8c67fff-f4e5-419f-91b1-9eb480c7a53f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1469 microversion: 2.1 time: 0.408785 Oct 04 11:01:55.117953 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 363/739] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:54 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:55.324459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:55.325582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:55.336041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:55.337269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:55.338084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:55.344600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:55.345526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:55.345986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:55.389712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:01:55.390403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:01:55.391166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:01:55.391737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:01:55.392314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:01:55.410677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:55.411560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:55.412190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:55.413075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:55.413723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:55.414297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:55.458044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Getting quotas for project 380b82c344a14f4dbaaaa7a4c97b0a2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:55.463815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Getting quotas for user d03968e7ad8442d1843ffdae94e3ff1f and project 380b82c344a14f4dbaaaa7a4c97b0a2b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:55.484739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.utils [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] ram quota exceeded for 380b82c344a14f4dbaaaa7a4c97b0a2b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122408) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 11:01:55.485280 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Request method failure captured: Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 145 Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBKdW_vxsF4byYOjWVii4YLQqYhrpyE4r2093b4r9P_TeZ40HTxjlHhCCa0ERgpikJSekgrZHv3hzsAVJuo5OzLEghjiyE3FFpmq6gvSpTxpf2gHD1EURkAjUgv5GfuSm-6b8V13bngeOsgP11goHyzQ2tJ5AprFSbwh8dmKuM0mS_4 Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 380b82c344a14f4dbaaaa7a4c97b0a2b Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:01:55.487478 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}] Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 380b82c344a14f4dbaaaa7a4c97b0a2b Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-QuotasAdminNegativeTest-609572887-project Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: d03968e7ad8442d1843ffdae94e3ff1f Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-QuotasAdminNegativeTest-609572887-project Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1071228638", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} Oct 04 11:01:55.488869 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1071228638', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452'}}} Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 11:01:55.490217 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:55.491404 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:55.492640 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:55.493977 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:55.493977 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:55.493977 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:01:55.493977 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:01:55.493977 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 11:01:55.493977 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:01:55.493977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:55.493977 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a1de10d-12e4-481a-9d2a-93a47adb8c2e tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.520823 Oct 04 11:01:55.496607 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 377/740] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:01:54 2022] POST /compute/v2.1/servers => generated 110 bytes in 526 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:01:55.499994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:55.500603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:55.507757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:55.508248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:55.508676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:55.509382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:55.509845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:55.510456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:55.689517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:55.697777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:55.699626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:55.701034 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eea4e801-b85e-46a6-be6c-957dbef5cfcb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1558 microversion: 2.25 time: 0.382346 Oct 04 11:01:55.701644 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 364/741] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:55 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1558 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:55.709564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f46e8dc0-7e81-4e44-a38c-25e3e9ac169f tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Action: 'update', calling method: .version_select at 0x7f71d4d273a0>, body: {"quota_set": {"ram": 51200}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:55.763732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:55.775637 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff0fe0a6-c5c2-4a9b-b392-de76f9958e69 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1559 microversion: 2.1 time: 0.280225 Oct 04 11:01:55.776896 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 378/742] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:55 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1559 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:55.782887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:55.783878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:55.790830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:55.791683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:55.793084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:55.794157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:55.794846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:55.795481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:55.944009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 240456d4-736b-475f-a025-74e9d41f65e5 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:55.991328 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc097dee-c750-4213-b36b-3fc2533d1415 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 2051 microversion: 2.25 time: 0.210634 Oct 04 11:01:55.995729 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 379/743] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:55 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 2051 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:56.009773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:56.009773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:56.017407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.017407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.017407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.017407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.018105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.018105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.129674 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98d1acc8-189f-451b-afd7-1f5cf9a23add tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128185 Oct 04 11:01:56.130273 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 380/744] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:01:55 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:56.145556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:56.146046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46e8dc0-7e81-4e44-a38c-25e3e9ac169f tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.146605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46e8dc0-7e81-4e44-a38c-25e3e9ac169f tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.147105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46e8dc0-7e81-4e44-a38c-25e3e9ac169f tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.147699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:56.148115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46e8dc0-7e81-4e44-a38c-25e3e9ac169f tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.148577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46e8dc0-7e81-4e44-a38c-25e3e9ac169f tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.149212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46e8dc0-7e81-4e44-a38c-25e3e9ac169f tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.158887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.160860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.162246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.164926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.168120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.168735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.265936 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f46e8dc0-7e81-4e44-a38c-25e3e9ac169f tempest-QuotasAdminNegativeTest-5535832 tempest-QuotasAdminNegativeTest-5535832-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 200 len: 329 microversion: 2.1 time: 0.563182 Oct 04 11:01:56.266971 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 365/745] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:01:55 2022] PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 329 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:56.281018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:56.287287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:56.295503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.296127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.296819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.301258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.302034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.303585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.353974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:56.363569 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3cd39831-5518-4b0f-92c6-13b2f7a05360 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.232252 Oct 04 11:01:56.364470 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 381/746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:56 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:56.380718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:56.384120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:56.399852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.400669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.401399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.402908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.403557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.404172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.557400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 240456d4-736b-475f-a025-74e9d41f65e5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:56.592301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c66622e9-d84a-4bb8-a94f-6b7d83882e20 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 2051 microversion: 2.25 time: 0.323917 Oct 04 11:01:56.592923 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 366/747] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:56 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 2051 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:56.601390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56292cf2-575c-4681-b143-7bae03bebb74 tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Action: 'update', calling method: .version_select at 0x7f71d4cf55e0>, body: {"quota_set": {"ram": 0}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:56.610028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-56292cf2-575c-4681-b143-7bae03bebb74 tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'd03968e7ad8442d1843ffdae94e3ff1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380b82c344a14f4dbaaaa7a4c97b0a2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:56.617728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56292cf2-575c-4681-b143-7bae03bebb74 tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Request method failure captured: Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b HTTP/1.1 Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 25 Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKdW_vxsF4byYOjWVii4YLQqYhrpyE4r2093b4r9P_TeZ40HTxjlHhCCa0ERgpikJSekgrZHv3hzsAVJuo5OzLEghjiyE3FFpmq6gvSpTxpf2gHD1EURkAjUgv5GfuSm-6b8V13bngeOsgP11goHyzQ2tJ5AprFSbwh8dmKuM0mS_4 Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 380b82c344a14f4dbaaaa7a4c97b0a2b Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:01:56.626210 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/380b82c344a14f4dbaaaa7a4c97b0a2b"}]}] Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 380b82c344a14f4dbaaaa7a4c97b0a2b Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-609572887 Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-QuotasAdminNegativeTest-609572887-project Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d03968e7ad8442d1843ffdae94e3ff1f Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-QuotasAdminNegativeTest-609572887-project Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: {"quota_set": {"ram": 0}} Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 11:01:56.627878 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '380b82c344a14f4dbaaaa7a4c97b0a2b', 'body': {'quota_set': {'ram': 0}}} Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:01:56.628709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:56.630230 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:01:56.633009 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:01:56.633009 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:01:56.633009 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:01:56.633009 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:01:56.633009 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 11:01:56.633009 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:01:56.633884 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7937cfb2-34b8-4b8b-8309-3792b8dc9074 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1469 microversion: 2.1 time: 0.266117 Oct 04 11:01:56.649596 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 382/748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:56 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:56.649596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72101b00-7e45-4214-9265-75249785fcb5 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:56.650596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72101b00-7e45-4214-9265-75249785fcb5 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.651388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72101b00-7e45-4214-9265-75249785fcb5 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.651388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72101b00-7e45-4214-9265-75249785fcb5 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.652690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72101b00-7e45-4214-9265-75249785fcb5 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.653637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56292cf2-575c-4681-b143-7bae03bebb74 tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:01:56.654675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72101b00-7e45-4214-9265-75249785fcb5 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.655356 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-56292cf2-575c-4681-b143-7bae03bebb74 tempest-QuotasAdminNegativeTest-609572887 tempest-QuotasAdminNegativeTest-609572887-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b" status: 403 len: 116 microversion: 2.1 time: 0.058041 Oct 04 11:01:56.656347 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 367/749] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:01:56 2022] PUT /compute/v2.1/os-quota-sets/380b82c344a14f4dbaaaa7a4c97b0a2b => generated 116 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:01:56.665707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72101b00-7e45-4214-9265-75249785fcb5 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.705693 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72101b00-7e45-4214-9265-75249785fcb5 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.067050 Oct 04 11:01:56.705693 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 383/750] 10.222.0.23 () {60 vars in 1217 bytes} [Tue Oct 4 11:01:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:01:56.718395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:56.719243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:56.733397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.736428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.738019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.739433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.741783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.743845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.837061 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a2f72fd-2ca0-46d3-b46d-0c73acc58070 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5/action" status: 202 len: 0 microversion: 2.25 time: 0.123396 Oct 04 11:01:56.842202 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 368/751] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:01:56 2022] POST /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:01:56.845920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3fcc56c6-4dce-4fb3-88ea-a0c42684de02 req-de5151c0-e277-4356-a8bb-7b0d89cba63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb", "name": "network-vif-plugged", "status": "completed", "tag": "69dc7eab-9033-43f0-bfc5-6dd0517f23d9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:56.850900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:56.852545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:56.864751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.865939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.866833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.867834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.869045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.869786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.878187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:56.881730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3fcc56c6-4dce-4fb3-88ea-a0c42684de02 req-de5151c0-e277-4356-a8bb-7b0d89cba63e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:56.882772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3fcc56c6-4dce-4fb3-88ea-a0c42684de02 req-de5151c0-e277-4356-a8bb-7b0d89cba63e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:56.885928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3fcc56c6-4dce-4fb3-88ea-a0c42684de02 req-de5151c0-e277-4356-a8bb-7b0d89cba63e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:56.924444 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3fcc56c6-4dce-4fb3-88ea-a0c42684de02 req-de5151c0-e277-4356-a8bb-7b0d89cba63e service nova] Creating event network-vif-plugged:69dc7eab-9033-43f0-bfc5-6dd0517f23d9 for instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb on n-h2-791135-8 Oct 04 11:01:56.939597 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3fcc56c6-4dce-4fb3-88ea-a0c42684de02 req-de5151c0-e277-4356-a8bb-7b0d89cba63e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098060 Oct 04 11:01:56.942974 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 384/752] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:01:57.121448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 240456d4-736b-475f-a025-74e9d41f65e5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:57.141557 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e030c61-d960-467d-bd39-2680f71b682b tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 2056 microversion: 2.25 time: 0.297455 Oct 04 11:01:57.142463 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 369/753] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:56 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 2056 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:01:57.388777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:57.389662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:57.396238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:57.396729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:57.397139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:57.397860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:57.398300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:57.398714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:57.658030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:57.660342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:57.672182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:57.672758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:57.673437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:57.674575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:57.675117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:57.675759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:57.813036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:57.821439 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-045cfc3b-7c00-404e-8814-619ca94d9194 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.436827 Oct 04 11:01:57.822039 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 385/754] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:57 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:57.834030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-277bfe86-d37d-467d-a956-904c098a3c11 req-f94b3a31-6988-4af7-9e00-c6e8d3c074bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133e0337-b85f-489a-9545-7582c99ba173", "tag": "30a28d0b-9016-4e57-9f4a-46a137d05c43"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:57.846611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-277bfe86-d37d-467d-a956-904c098a3c11 req-f94b3a31-6988-4af7-9e00-c6e8d3c074bd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:57.847383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-277bfe86-d37d-467d-a956-904c098a3c11 req-f94b3a31-6988-4af7-9e00-c6e8d3c074bd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:57.847911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-277bfe86-d37d-467d-a956-904c098a3c11 req-f94b3a31-6988-4af7-9e00-c6e8d3c074bd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:57.864046 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-277bfe86-d37d-467d-a956-904c098a3c11 req-f94b3a31-6988-4af7-9e00-c6e8d3c074bd service nova] Creating event network-changed:30a28d0b-9016-4e57-9f4a-46a137d05c43 for instance 133e0337-b85f-489a-9545-7582c99ba173 on n-h2-791135-8 Oct 04 11:01:57.870409 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-277bfe86-d37d-467d-a956-904c098a3c11 req-f94b3a31-6988-4af7-9e00-c6e8d3c074bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046552 Oct 04 11:01:57.871588 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 386/755] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:58.043935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:58.056776 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c42b3810-0a3b-4ce9-ab82-944a2d5cce4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1461 microversion: 2.1 time: 0.403061 Oct 04 11:01:58.058761 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 370/756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:57 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1461 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:58.080960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:58.083720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:58.091828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:58.092640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:58.093294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:58.094251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:58.094917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:58.095549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:58.167380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:58.168064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:58.174292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:58.175132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:58.175815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:58.176755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:58.177592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:58.178244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:58.402234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:58.418805 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b78c57c-cf7e-4f5a-a130-27059fa073bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1461 microversion: 2.1 time: 0.341318 Oct 04 11:01:58.420941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 387/757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:58 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1461 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:01:58.449819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3163b4e5-b368-4a31-949b-c193c97910e3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'create', calling method: .version_select at 0x7f71d4e20700>, body: {"keypair": {"name": "tempest-keypair-536118098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtyBYFXD40CPB/YlI8271HkhFYpwlqckq9RtIknP48OqVigtRjDHWvdPF9bQHfWnbdTz0S+Dc4T7WoBMArVb5iI8l1UEJRDTuVYoQ0sgy6/3ZzfdYm3vY367oa7GAST5Q=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:58.467319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 240456d4-736b-475f-a025-74e9d41f65e5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:58.483516 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9e744cb-1805-4fd6-bdca-352c5bcd7283 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 2036 microversion: 2.25 time: 0.319811 Oct 04 11:01:58.484783 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 371/758] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:01:58 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 2036 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:01:58.485074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3163b4e5-b368-4a31-949b-c193c97910e3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:01:58.490645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3163b4e5-b368-4a31-949b-c193c97910e3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for user b024d221d4784e2399fd7676706cbc04 and project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:01:58.512697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-791135-8", "block_migration": "auto"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:01:58.515606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:58.528355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:58.529381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:58.530124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:58.530577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:58.531359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:58.531618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:58.574836 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3163b4e5-b368-4a31-949b-c193c97910e3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128456 Oct 04 11:01:58.575923 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 388/759] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:01:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:01:58.598262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'flavor' on Instance uuid 240456d4-736b-475f-a025-74e9d41f65e5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:01:58.619343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Going to try to live migrate instance to n-h2-791135-8 {{(pid=122409) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:01:58.847878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:01:58.849266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:01:58.867106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:58.867615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:58.869770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:58.872074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:01:58.874591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:01:58.876064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:01:59.172328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:01:59.175702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:01:59.196835 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ad17b2b3-686c-4f94-8032-2d187fee81d3 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1324 microversion: 2.1 time: 0.355169 Oct 04 11:01:59.197480 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 389/760] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:01:58 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:00.231765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:00.233618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:00.242551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:00.243633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:00.244577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:00.245466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:00.246997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:00.248236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:00.591928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:00.604462 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f31b20b-5e2e-41d5-8e77-77a1fb4b8541 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 200 len: 1521 microversion: 2.1 time: 0.384250 Oct 04 11:02:00.606386 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 390/761] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:00 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:00.647902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'action', calling method: .version_select at 0x7f71d61b2b80>, body: {"addFloatingIp": {"address": "172.25.1.196"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:00.650338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:00.664138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:00.664624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:00.665053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:00.666518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:00.672621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:00.673084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:00.779904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:02:00.780296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquired lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:02:01.179642 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31cf42ef-177a-41e8-9f89-4621214e0e2d tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5/action" status: 202 len: 0 microversion: 2.25 time: 2.671385 Oct 04 11:02:01.181134 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 372/762] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:01:58 2022] POST /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5/action => generated 0 bytes in 2674 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:02:01.202784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:01.205005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:01.215707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:01.216706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:01.217569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:01.219977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:01.220639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:01.221838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:01.727075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:01.736434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:01.739977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:01.742763 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-07e406b9-e8b4-421c-b028-202f6608d0e8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1568 microversion: 2.25 time: 0.556314 Oct 04 11:02:01.747204 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 373/763] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:01 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1568 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:02.496749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2178806-d376-4a09-8711-80346d608130 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] Action: 'create', calling method: .version_select at 0x7f71d51ab790>, body: {"security_group": {"name": "tempest-securitygroup-1705369628", "description": "tempest-description-121057074"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:03.681389 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2178806-d376-4a09-8711-80346d608130 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.530686 Oct 04 11:02:03.682314 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 374/764] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:02:02 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:03.689740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:03.690858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:03.697665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:03.698168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:03.699154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:03.700065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:03.700528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:03.700957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:04.102864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:04.111736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:04.113192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:04.114376 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96c89281-e54e-477e-b79c-fcf7563943a7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1568 microversion: 2.25 time: 0.430853 Oct 04 11:02:04.114934 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 375/765] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:03 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:04.180647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-621962841", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "41df1f22-b8b5-4c21-8eb3-7f794a2e7bb6"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:04.256776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] validate_networks() for [('41df1f22-b8b5-4c21-8eb3-7f794a2e7bb6', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:02:04.439104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Building network info cache for instance {{(pid=122408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:02:05.557579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:05.559367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:05.560065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:05.560692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:05.561330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:05.571614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:05.572192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:05.572655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:05.573412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:05.574428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:05.574858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:05.594865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Getting quotas for project 2070b5bd76a54fa6b3cbc9c9bee8500d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:05.599005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Getting quotas for user 3ae296c06e8e490db21812b28044533c and project 2070b5bd76a54fa6b3cbc9c9bee8500d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:05.609854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:05.612989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:02:05.615874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:02:05.676340 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4213193e-0914-49ee-8aa8-92c97586f735 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560306 Oct 04 11:02:05.677067 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 376/766] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:02:05.695454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-388da734-704f-4165-9452-8d1134674887 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] Action: 'create', calling method: .version_select at 0x7f71d4d30550>, body: {"security_group": {"name": "tempest-securitygroup-234347853", "description": "tempest-description-848888272"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:06.137553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Updating instance_info_cache with network_info: [{"id": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88", "address": "fa:16:3e:69:4b:e7", "network": {"id": "bdc6907e-c7a8-40a6-92e7-98eb68a55c52", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1771678574-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44f8bd67ef72474b926de381ef6e8f33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape91f0d47-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:02:06.147842 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-388da734-704f-4165-9452-8d1134674887 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.458990 Oct 04 11:02:06.154418 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 377/767] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:02:05 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:06.159404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd63c9f6-cd88-4754-aae2-72fdfe36fd68 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '.version_select at 0x7f71d4d30700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:06.174818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd63c9f6-cd88-4754-aae2-72fdfe36fd68 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:06.176338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd63c9f6-cd88-4754-aae2-72fdfe36fd68 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:06.176792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd63c9f6-cd88-4754-aae2-72fdfe36fd68 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:06.182244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Releasing lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:02:06.184220 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b21be70-8e8c-4ba0-8240-fec0d2751d0d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action" status: 202 len: 0 microversion: 2.1 time: 5.548704 Oct 04 11:02:06.187047 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 391/768] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:00 2022] POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action => generated 0 bytes in 5553 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:02:06.188705 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd63c9f6-cd88-4754-aae2-72fdfe36fd68 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.033053 Oct 04 11:02:06.189593 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 378/769] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 11:02:06 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:06.193948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-af765d2e-6399-4e1c-866a-e92cc6a3325d req-2ae9d4c0-c26c-437d-ab1b-724cd03e5086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aabc9518-e1f1-42f4-8bdb-b0cba1d912cd", "tag": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:06.198526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:06.200021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:06.208019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:06.208956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:06.210081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:06.210901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:06.211746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:06.212369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:06.216469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-af765d2e-6399-4e1c-866a-e92cc6a3325d req-2ae9d4c0-c26c-437d-ab1b-724cd03e5086 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:06.217174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-af765d2e-6399-4e1c-866a-e92cc6a3325d req-2ae9d4c0-c26c-437d-ab1b-724cd03e5086 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:06.218067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-af765d2e-6399-4e1c-866a-e92cc6a3325d req-2ae9d4c0-c26c-437d-ab1b-724cd03e5086 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:06.234788 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-af765d2e-6399-4e1c-866a-e92cc6a3325d req-2ae9d4c0-c26c-437d-ab1b-724cd03e5086 service nova] Creating event network-changed:e91f0d47-2a8c-4520-9c42-0a09d1ad0b88 for instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd on n-h1-791135-8 Oct 04 11:02:06.240650 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-af765d2e-6399-4e1c-866a-e92cc6a3325d req-2ae9d4c0-c26c-437d-ab1b-724cd03e5086 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052210 Oct 04 11:02:06.243660 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 392/770] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:06.257887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:06.258837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:06.274901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:06.286035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:06.286886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:06.287804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:06.288459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:06.296921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:06.399543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:06.408564 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b992470e-492b-4cdb-be54-a583fa922500 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1228 microversion: 2.1 time: 0.161503 Oct 04 11:02:06.409495 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 393/771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:06 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1228 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:06.437700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:06.446619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:06.448047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:06.449289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-87798295-88db-48af-b089-be2e066d0052 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1568 microversion: 2.25 time: 0.258782 Oct 04 11:02:06.449875 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 379/772] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:06 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:06.454569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'action', calling method: .version_select at 0x7f71d61b2b80>, body: {"addFloatingIp": {"address": "172.25.1.196"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:06.457543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:06.464583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:06.465223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:06.465851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:06.466708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:06.467322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:06.467748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:06.489493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e59b79cc-1308-4533-9c26-bd6f96cc6b78 tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] Action: 'create', calling method: .version_select at 0x7f71d4adb280>, body: {"security_group": {"name": "tempest-securitygroup-2047970050", "description": "tempest-description-882244518"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:06.540077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "refresh_cache-46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:02:06.540489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquired lock "refresh_cache-46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:02:06.685436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:07.064181 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e59b79cc-1308-4533-9c26-bd6f96cc6b78 tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.652655 Oct 04 11:02:07.077117 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 394/773] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:02:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:07.087816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a17b4dae-4594-42a4-b227-95cb2e54c407 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:07.099419 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a17b4dae-4594-42a4-b227-95cb2e54c407 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019150 Oct 04 11:02:07.101258 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 395/774] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:02:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:07.106642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-419d6be4-4ac0-4666-99ed-ae70b56118cf tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] Action: 'create', calling method: .version_select at 0x7f71d4e20700>, body: {"security_group": {"name": "tempest-securitygroup-68387717", "description": "tempest-description-1027775583"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:07.459428 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-419d6be4-4ac0-4666-99ed-ae70b56118cf tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.356070 Oct 04 11:02:07.460041 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 396/775] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:02:07 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:07.478734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-121e4017-727b-4c61-97d1-7d7ca3eefc3b tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-71356239", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:07.511487 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-121e4017-727b-4c61-97d1-7d7ca3eefc3b tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.039017 Oct 04 11:02:07.523681 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 397/776] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Oct 4 11:02:07 2022] POST /compute/v2.1/flavors => generated 497 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:07.529141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:07.529986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:07.541830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:07.543174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:07.545968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:07.546964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:07.547620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:07.552432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:07.653689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:07.665813 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a0b9ae14-c557-4d69-949d-f26df721c932 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1284 microversion: 2.1 time: 0.140722 Oct 04 11:02:07.669941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 398/777] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:07 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:07.678362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f47e969-d030-4c46-905e-6d111f9231f2 tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] Calling method '.version_select at 0x7f71d4adb430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:08.499344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=42 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:09.686491 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.neutron [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] re-assign floating IP 172.25.1.196 from instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd Oct 04 11:02:09.750269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Building network info cache for instance {{(pid=122409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:02:10.507737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Updating instance_info_cache with network_info: [{"id": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88", "address": "fa:16:3e:69:4b:e7", "network": {"id": "bdc6907e-c7a8-40a6-92e7-98eb68a55c52", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1771678574-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44f8bd67ef72474b926de381ef6e8f33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape91f0d47-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:02:10.522222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Building network info cache for instance {{(pid=122409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:02:11.247605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Updating instance_info_cache with network_info: [{"id": "69dc7eab-9033-43f0-bfc5-6dd0517f23d9", "address": "fa:16:3e:40:3a:eb", "network": {"id": "bdc6907e-c7a8-40a6-92e7-98eb68a55c52", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1771678574-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44f8bd67ef72474b926de381ef6e8f33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap69dc7eab-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:02:11.259587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Releasing lock "refresh_cache-46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:02:11.260858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a67dd017-69be-451c-abca-3be0cece93b6 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb/action" status: 202 len: 0 microversion: 2.1 time: 4.809881 Oct 04 11:02:11.261782 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 380/778] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:06 2022] POST /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb/action => generated 0 bytes in 4811 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:02:11.267080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:11.268106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:11.275213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:11.275931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:11.277311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:11.278446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:11.279096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:11.279715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:11.475899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:11.488527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:11.490971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:11.492164 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ce2bb82-cf38-48bd-8992-9e9f4645ec51 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1568 microversion: 2.25 time: 0.229155 Oct 04 11:02:11.505881 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 381/779] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:11 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:11.505881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2307e99f-7f95-4e17-9beb-7ec6cd8ef6e5 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:11.508278 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2307e99f-7f95-4e17-9beb-7ec6cd8ef6e5 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013886 Oct 04 11:02:11.509432 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 382/780] 10.222.0.23 () {58 vars in 1182 bytes} [Tue Oct 4 11:02:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:02:11.514010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-66d7dc8f-37fb-400d-960d-aba5f39b6801 req-8643564c-be69-48fb-9b91-79a85e33d165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240456d4-736b-475f-a025-74e9d41f65e5", "name": "network-vif-unplugged", "status": "completed", "tag": "f2941df9-a2f4-43d4-bf97-726d9c9a9ab8"}, {"name": "network-changed", "server_uuid": "240456d4-736b-475f-a025-74e9d41f65e5", "tag": "f2941df9-a2f4-43d4-bf97-726d9c9a9ab8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:11.530570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-66d7dc8f-37fb-400d-960d-aba5f39b6801 req-8643564c-be69-48fb-9b91-79a85e33d165 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:11.531301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-66d7dc8f-37fb-400d-960d-aba5f39b6801 req-8643564c-be69-48fb-9b91-79a85e33d165 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:11.531742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-66d7dc8f-37fb-400d-960d-aba5f39b6801 req-8643564c-be69-48fb-9b91-79a85e33d165 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:11.543570 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-66d7dc8f-37fb-400d-960d-aba5f39b6801 req-8643564c-be69-48fb-9b91-79a85e33d165 service nova] Creating event network-vif-unplugged:f2941df9-a2f4-43d4-bf97-726d9c9a9ab8 for instance 240456d4-736b-475f-a025-74e9d41f65e5 on n-h1-791135-8 Oct 04 11:02:11.544068 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-66d7dc8f-37fb-400d-960d-aba5f39b6801 req-8643564c-be69-48fb-9b91-79a85e33d165 service nova] Creating event network-changed:f2941df9-a2f4-43d4-bf97-726d9c9a9ab8 for instance 240456d4-736b-475f-a025-74e9d41f65e5 on n-h1-791135-8 Oct 04 11:02:11.550346 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-66d7dc8f-37fb-400d-960d-aba5f39b6801 req-8643564c-be69-48fb-9b91-79a85e33d165 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.039581 Oct 04 11:02:11.551298 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 383/781] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:11.561050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:11.565090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:11.571847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:11.572556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:11.573202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:11.574792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:11.575421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:11.576016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:11.804757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:11.813621 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ced28223-62b9-46a3-a5e5-02838681dd59 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1324 microversion: 2.1 time: 0.258712 Oct 04 11:02:11.814545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 384/782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:11 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1324 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:11.821464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c9ab3baa-c4f8-4c12-8f0f-4bbf1234d962 req-4ce41022-0ad3-4cd8-b1ab-983b6c738c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2", "tag": "65751e5d-029a-406a-9f6c-e8ecccdf34ad"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:11.835328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c9ab3baa-c4f8-4c12-8f0f-4bbf1234d962 req-4ce41022-0ad3-4cd8-b1ab-983b6c738c17 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:11.835807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c9ab3baa-c4f8-4c12-8f0f-4bbf1234d962 req-4ce41022-0ad3-4cd8-b1ab-983b6c738c17 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:11.836236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c9ab3baa-c4f8-4c12-8f0f-4bbf1234d962 req-4ce41022-0ad3-4cd8-b1ab-983b6c738c17 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:11.851413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c9ab3baa-c4f8-4c12-8f0f-4bbf1234d962 req-4ce41022-0ad3-4cd8-b1ab-983b6c738c17 service nova] Creating event network-changed:65751e5d-029a-406a-9f6c-e8ecccdf34ad for instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 on n-h1-791135-8 Oct 04 11:02:11.859778 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c9ab3baa-c4f8-4c12-8f0f-4bbf1234d962 req-4ce41022-0ad3-4cd8-b1ab-983b6c738c17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043898 Oct 04 11:02:11.860900 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 385/783] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:11.868674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'action', calling method: .version_select at 0x7f71d6c3aa60>, body: {"removeFloatingIp": {"address": "172.25.1.196"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:11.870903 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f47e969-d030-4c46-905e-6d111f9231f2 tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 14974 microversion: 2.1 time: 4.198133 Oct 04 11:02:11.885391 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 399/784] 10.222.0.23 () {58 vars in 1191 bytes} [Tue Oct 4 11:02:07 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 14974 bytes in 4201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:02:11.885391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-693260505", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "b0647c8b-c798-43aa-a114-5e7af2fe554b"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:11.975193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:02:12.169606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:12.181109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:12.181109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:12.181109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:12.182340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:12.182892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:12.183329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:12.222329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:12.361710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:12.362351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:12.363148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:12.363712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:12.364293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:12.373739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:12.374454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:12.375050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:12.375971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:12.376586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:12.377453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:12.390605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:12.400541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:12.409015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for user b024d221d4784e2399fd7676706cbc04 and project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:12.432507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:02:12.436742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:02:12.494734 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4fba829-1fb8-4bab-9617-f9ac744fac12 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621458 Oct 04 11:02:12.503208 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 400/785] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:02:12.506259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff3df1bd-5187-4c46-a52f-a192cbf332c0 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] Calling method '.version_select at 0x7f71d4adb3a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:12.622549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] HTTP exception thrown: Floating IP 172.25.1.196 is not associated with instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd. Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Request method failure captured: Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action HTTP/1.1 Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 49 Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJpBXODnECvReMfrHs94fzTUZMlQP9pjgFiTsbLWLpgisU6dA27sjXIN32yCV_zRAvrcYoYiYknQNd4pMYWC1qCkpz3sYIKw276lYWUiZFWac2Fzu4-kJUAFidULD6GGuw0BmHCYiSKPfI5EUFc4joSa6mAx6eyCVuMyxKOruqdwWo Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 44f8bd67ef72474b926de381ef6e8f33 Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:12.624778 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f8bd67ef72474b926de381ef6e8f33"}]}] Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 44f8bd67ef72474b926de381ef6e8f33 Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsAssociationTestJSON-1548549554-project Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: c419136435f240788480491469fe7d62 Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1548549554-project Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: {"removeFloatingIp": {"address": "172.25.1.196"}} Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:02:12.626745 n-d-791135-8 devstack@n-api.service[122409]: exception: Floating IP 172.25.1.196 is not associated with instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd. Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'aabc9518-e1f1-42f4-8bdb-b0cba1d912cd', 'body': {'removeFloatingIp': {'address': '172.25.1.196'}}} Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.196 is not associated with instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd. Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:12.627920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.196 is not associated with instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd. Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Returning 409 to user: Floating IP 172.25.1.196 is not associated with instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3105746a-ad2d-42ce-9aa0-f64894142804 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action" status: 409 len: 146 microversion: 2.1 time: 0.763165 Oct 04 11:02:12.629378 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 386/786] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:11 2022] POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action => generated 146 bytes in 765 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:12.635563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3913f0bd-8ec4-44e4-8ccb-01e62711b497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:12.635563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3913f0bd-8ec4-44e4-8ccb-01e62711b497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:12.734980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3913f0bd-8ec4-44e4-8ccb-01e62711b497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:12.763629 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3913f0bd-8ec4-44e4-8ccb-01e62711b497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1278 microversion: 2.1 time: 0.135479 Oct 04 11:02:12.764606 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 387/787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:12 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:12.798522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:12.800630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:12.824123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:12.824706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:12.826532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:12.827287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:12.827767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:12.829941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:12.902619 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff3df1bd-5187-4c46-a52f-a192cbf332c0 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.399914 Oct 04 11:02:12.903201 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 401/788] 10.222.0.23 () {58 vars in 1191 bytes} [Tue Oct 4 11:02:12 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:12.918381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'action', calling method: .version_select at 0x7f71d6c3aa60>, body: {"removeFloatingIp": {"address": "172.25.1.196"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:13.128642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:13.135558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:13.136812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:13.137288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:13.138684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:13.140633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:13.141691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:13.189197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:13.197924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:13.209384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:13.210622 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0a1bb68-4152-4782-abec-74955b48f6f2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1568 microversion: 2.25 time: 0.445053 Oct 04 11:02:13.211207 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 388/789] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:12 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1568 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:13.221514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:13.222353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:13.233265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:13.234220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:13.234826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:13.235703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:13.236319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:13.236902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:13.509194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:13.534240 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ee139b6-9422-4279-9e3b-8f72de5c20f3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1324 microversion: 2.1 time: 0.321747 Oct 04 11:02:13.547330 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 389/790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:13 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:13.557334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c50bf7b-f114-4e33-9802-fecb1f9deaab tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] Calling method '.version_select at 0x7f71d4c7eca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:13.647535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "refresh_cache-46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:02:13.648263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquired lock "refresh_cache-46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:02:14.012614 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c50bf7b-f114-4e33-9802-fecb1f9deaab tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/de9fd6c2-1b9d-4ae8-a39b-519b7b0fec60" status: 202 len: 0 microversion: 2.1 time: 0.462238 Oct 04 11:02:14.016389 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 390/791] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:02:13 2022] DELETE /compute/v2.1/os-security-groups/de9fd6c2-1b9d-4ae8-a39b-519b7b0fec60 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:14.020935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-67ddcb8e-6365-44cd-a2cb-b4ced2ffefe7 req-c76fd90a-8ab3-4d20-9ef5-f3fe8fdfb0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aabc9518-e1f1-42f4-8bdb-b0cba1d912cd", "tag": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88"}, {"name": "network-changed", "server_uuid": "46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb", "tag": "69dc7eab-9033-43f0-bfc5-6dd0517f23d9"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:14.033932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-67ddcb8e-6365-44cd-a2cb-b4ced2ffefe7 req-c76fd90a-8ab3-4d20-9ef5-f3fe8fdfb0a2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:14.034662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-67ddcb8e-6365-44cd-a2cb-b4ced2ffefe7 req-c76fd90a-8ab3-4d20-9ef5-f3fe8fdfb0a2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:14.035281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-67ddcb8e-6365-44cd-a2cb-b4ced2ffefe7 req-c76fd90a-8ab3-4d20-9ef5-f3fe8fdfb0a2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:14.056039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-67ddcb8e-6365-44cd-a2cb-b4ced2ffefe7 req-c76fd90a-8ab3-4d20-9ef5-f3fe8fdfb0a2 service nova] Creating event network-changed:e91f0d47-2a8c-4520-9c42-0a09d1ad0b88 for instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd on n-h1-791135-8 Oct 04 11:02:14.057157 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-67ddcb8e-6365-44cd-a2cb-b4ced2ffefe7 req-c76fd90a-8ab3-4d20-9ef5-f3fe8fdfb0a2 service nova] Creating event network-changed:69dc7eab-9033-43f0-bfc5-6dd0517f23d9 for instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb on n-h2-791135-8 Oct 04 11:02:14.074942 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-67ddcb8e-6365-44cd-a2cb-b4ced2ffefe7 req-c76fd90a-8ab3-4d20-9ef5-f3fe8fdfb0a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057286 Oct 04 11:02:14.083813 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 391/792] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:14.107715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:14.110448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:14.127279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:14.128143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:14.128738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:14.129629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:14.130431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:14.131045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:14.239787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:14.257848 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a4547b9-03da-49d0-91c4-add17bf54e2e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1330 microversion: 2.1 time: 0.172575 Oct 04 11:02:14.262189 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 392/793] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:14 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1330 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:14.280939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5549dec-d651-4280-b843-0e274eb00d8b tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] Calling method '.version_select at 0x7f71d49b7940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:15.122955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Building network info cache for instance {{(pid=122408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:02:15.142392 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5549dec-d651-4280-b843-0e274eb00d8b tempest-SecurityGroupsTestAdminJSON-552098853 tempest-SecurityGroupsTestAdminJSON-552098853-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/63075fad-f4d3-434e-bf21-56310871aa11" status: 202 len: 0 microversion: 2.1 time: 0.878064 Oct 04 11:02:15.143622 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 393/794] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:02:14 2022] DELETE /compute/v2.1/os-security-groups/63075fad-f4d3-434e-bf21-56310871aa11 => generated 0 bytes in 881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:15.155293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:15.156276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:15.164954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:15.166238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:15.166944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:15.169222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:15.170034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:15.170692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:15.505005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:15.528027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:15.530700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:15.537530 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e78d3676-9e80-4247-b805-6302c65de67e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1568 microversion: 2.25 time: 0.385342 Oct 04 11:02:15.543270 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 394/795] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:15 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1568 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:15.548879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:15.554729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:15.571277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:15.572164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:15.577997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:15.578837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:15.579318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:15.579751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:15.590146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:16.021631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:16.032963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f04fa8e-7481-46ff-8bfc-a7535b8744ca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1324 microversion: 2.1 time: 0.488126 Oct 04 11:02:16.033796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 395/796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:15 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1324 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:16.062367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-587cc2bb-7c99-4949-96bc-601bdbc98be6 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] Calling method '.version_select at 0x7f71d48d3280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:16.520288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Updating instance_info_cache with network_info: [{"id": "69dc7eab-9033-43f0-bfc5-6dd0517f23d9", "address": "fa:16:3e:40:3a:eb", "network": {"id": "bdc6907e-c7a8-40a6-92e7-98eb68a55c52", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1771678574-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44f8bd67ef72474b926de381ef6e8f33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap69dc7eab-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:02:16.530779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Releasing lock "refresh_cache-46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:02:16.531638 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3a9f42c-daa8-4392-a293-76df20bfb6dd tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb/action" status: 202 len: 0 microversion: 2.1 time: 3.617933 Oct 04 11:02:16.541555 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 402/797] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:12 2022] POST /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb/action => generated 0 bytes in 3635 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:02:16.544769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:16.545401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:16.561241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:16.563281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:16.564254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:16.564441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:16.564906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:16.565336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:16.820790 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-587cc2bb-7c99-4949-96bc-601bdbc98be6 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0fab1c06-ef12-4815-a50a-e5b24aa20862" status: 202 len: 0 microversion: 2.1 time: 0.772244 Oct 04 11:02:16.825325 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 396/798] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:02:16 2022] DELETE /compute/v2.1/os-security-groups/0fab1c06-ef12-4815-a50a-e5b24aa20862 => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:16.830924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-648c5111-e3e8-4f96-923d-5442e89d5235 req-e0c712df-7a5f-47e0-97f3-58ac29712e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2", "name": "network-vif-plugged", "status": "completed", "tag": "65751e5d-029a-406a-9f6c-e8ecccdf34ad"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:16.851966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-648c5111-e3e8-4f96-923d-5442e89d5235 req-e0c712df-7a5f-47e0-97f3-58ac29712e8a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:16.852711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-648c5111-e3e8-4f96-923d-5442e89d5235 req-e0c712df-7a5f-47e0-97f3-58ac29712e8a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:16.853147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-648c5111-e3e8-4f96-923d-5442e89d5235 req-e0c712df-7a5f-47e0-97f3-58ac29712e8a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:16.870818 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-648c5111-e3e8-4f96-923d-5442e89d5235 req-e0c712df-7a5f-47e0-97f3-58ac29712e8a service nova] Creating event network-vif-plugged:65751e5d-029a-406a-9f6c-e8ecccdf34ad for instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 on n-h1-791135-8 Oct 04 11:02:16.883633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:16.884277 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-648c5111-e3e8-4f96-923d-5442e89d5235 req-e0c712df-7a5f-47e0-97f3-58ac29712e8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056916 Oct 04 11:02:16.885382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 397/799] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:16.901031 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb19b981-6ac2-4268-b54e-454120eb86a3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1378 microversion: 2.1 time: 0.360943 Oct 04 11:02:16.917744 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 403/800] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:16 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1378 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:16.917744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-65ca1d5c-1589-42ab-9ea5-9d354311f355 req-2dcc8607-1bde-44fe-8a3c-8c5a1b88267f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb", "tag": "69dc7eab-9033-43f0-bfc5-6dd0517f23d9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:16.921437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "530aa55d-6e5b-41ef-b063-0722809f9d63"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:16.926585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:16.938451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-65ca1d5c-1589-42ab-9ea5-9d354311f355 req-2dcc8607-1bde-44fe-8a3c-8c5a1b88267f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:16.939211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-65ca1d5c-1589-42ab-9ea5-9d354311f355 req-2dcc8607-1bde-44fe-8a3c-8c5a1b88267f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:16.940292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:16.941143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:16.941906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:16.943032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:16.943513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-65ca1d5c-1589-42ab-9ea5-9d354311f355 req-2dcc8607-1bde-44fe-8a3c-8c5a1b88267f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:16.944080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:16.944631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:16.969410 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-65ca1d5c-1589-42ab-9ea5-9d354311f355 req-2dcc8607-1bde-44fe-8a3c-8c5a1b88267f service nova] Creating event network-changed:69dc7eab-9033-43f0-bfc5-6dd0517f23d9 for instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb on n-h2-791135-8 Oct 04 11:02:16.976069 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-65ca1d5c-1589-42ab-9ea5-9d354311f355 req-2dcc8607-1bde-44fe-8a3c-8c5a1b88267f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070006 Oct 04 11:02:16.977076 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 404/801] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:16.982504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:16.983134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:16.995097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:16.995942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:16.996297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:16.997256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:16.998905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:16.999334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.032764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:02:17.140003 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6715b7b-ca61-4922-8b7a-a2a225187269 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 204 len: 0 microversion: 2.1 time: 0.161220 Oct 04 11:02:17.140896 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 405/802] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:02:16 2022] DELETE /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:02:17.147753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:17.148765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:17.162351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.162852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.163288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.164924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.165751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.166183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.340697 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d309f9c-964d-4c4a-9e21-b4fca49c4af9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "POST /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452599 Oct 04 11:02:17.345557 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 398/803] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:02:16 2022] POST /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:17.346654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cfbba9f-352b-4a38-b4c7-61b544d70d31 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] Calling method '.version_select at 0x7f71d46b5af0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:17.386263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:17.395501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:17.396937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:17.398133 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-063a3ac6-f1bc-4f61-9f20-12df4b1ff2b1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1543 microversion: 2.25 time: 0.255189 Oct 04 11:02:17.398681 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 406/804] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:17 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1543 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:17.402943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-386ebeed-d558-4ba6-ab2d-aa620109ea8c req-53797561-a2cc-4ae8-a358-06bd22731d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:17.412261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-386ebeed-d558-4ba6-ab2d-aa620109ea8c req-53797561-a2cc-4ae8-a358-06bd22731d74 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.413012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-386ebeed-d558-4ba6-ab2d-aa620109ea8c req-53797561-a2cc-4ae8-a358-06bd22731d74 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.413461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-386ebeed-d558-4ba6-ab2d-aa620109ea8c req-53797561-a2cc-4ae8-a358-06bd22731d74 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.424234 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-386ebeed-d558-4ba6-ab2d-aa620109ea8c req-53797561-a2cc-4ae8-a358-06bd22731d74 service nova] Creating event network-changed:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h1-791135-8 Oct 04 11:02:17.429238 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-386ebeed-d558-4ba6-ab2d-aa620109ea8c req-53797561-a2cc-4ae8-a358-06bd22731d74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029461 Oct 04 11:02:17.429878 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 407/805] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:17.435338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:17.436031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:17.442204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.442680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.443111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.443799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.444247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.444668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.629275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:17.640440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cfbba9f-352b-4a38-b4c7-61b544d70d31 tempest-SecurityGroupsTestAdminJSON-727908984 tempest-SecurityGroupsTestAdminJSON-727908984-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d2e6a327-7df2-4480-9f8c-badc9921812e" status: 202 len: 0 microversion: 2.1 time: 0.297681 Oct 04 11:02:17.648518 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6dc0b2b1-b9ea-4e4c-8f33-444a8d45bdba tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1324 microversion: 2.1 time: 0.212234 Oct 04 11:02:17.650747 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 399/806] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:02:17 2022] DELETE /compute/v2.1/os-security-groups/d2e6a327-7df2-4480-9f8c-badc9921812e => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:17.661484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.196"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:17.664274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:17.671678 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 408/807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:17 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1324 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:17.685604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.686743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.687440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.691492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3db06fce-f5b2-4b42-9389-797909435b45 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '.version_select at 0x7f71d4c4de50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:17.697742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3db06fce-f5b2-4b42-9389-797909435b45 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.698361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3db06fce-f5b2-4b42-9389-797909435b45 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.698834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3db06fce-f5b2-4b42-9389-797909435b45 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.704142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.705099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.706578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.721171 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3db06fce-f5b2-4b42-9389-797909435b45 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.048116 Oct 04 11:02:17.725919 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 409/808] 10.222.0.23 () {60 vars in 1184 bytes} [Tue Oct 4 11:02:17 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:17.742600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:17.743496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:17.746607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:02:17.747042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquired lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:02:17.753827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.754577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.755023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:17.755730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:17.756236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:17.756730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:18.041674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 240456d4-736b-475f-a025-74e9d41f65e5 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:02:18.059055 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8916869a-dbde-43c2-99e4-ca39817fa098 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 2036 microversion: 2.25 time: 0.320388 Oct 04 11:02:18.060210 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 410/809] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:17 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 2036 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:18.065823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:18.066728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:18.073047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:18.073928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:18.074684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:18.075639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:18.076295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:18.076923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:18.863369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:18.872320 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1dd9ff4c-3017-4541-960c-6f7957d327f1 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1378 microversion: 2.1 time: 0.811002 Oct 04 11:02:18.872990 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 411/810] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:18 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1378 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:18.878102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e869f179-2242-4257-bbc9-190e97948221 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Action: 'create', calling method: .version_select at 0x7f71d4d6a670>, body: {"keypair": {"name": "tempest-keypair-1561121247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHEl/AGxsrN/01knpLtFNtMFT/Mwy27g6unvS103b7hFd9Wtcvngx7wbdUn1a79BqfBkQRhSLffmGIlUHkOSOYfpkv496IbUyx5KeJwZh6lTAsZtO6GUSY4WjgL300SPA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:18.895984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e869f179-2242-4257-bbc9-190e97948221 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for project 83765ee4f79c49f49b8af1a56a260450. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:18.901428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e869f179-2242-4257-bbc9-190e97948221 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for user 27f40f692eac4ea39019fe4921b054f7 and project 83765ee4f79c49f49b8af1a56a260450. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:18.939193 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e869f179-2242-4257-bbc9-190e97948221 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.064605 Oct 04 11:02:18.942192 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 412/811] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:02:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:02:18.947008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:18.957921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:18.966146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:18.968354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:18.968887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:18.970813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:18.971815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:18.972331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:18.978844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:19.451111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:19.471777 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2fc1581-7549-4b11-b372-df2a12cbbf95 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.526195 Oct 04 11:02:19.473949 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 413/812] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:18 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:19.508485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:19.509559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:19.527548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:19.529325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:19.531057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:19.532646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:19.536078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:19.537651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:20.189122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:20.207200 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5c2c1a5-0bd4-4e7b-9dff-d551324e65ef tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.707989 Oct 04 11:02:20.208173 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 414/813] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:19 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:20.216899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:20.217985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:20.234285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:20.237836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:20.238551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:20.239497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:20.240892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:20.241561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:20.731610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:20.739309 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7bd7b303-1cb3-4f85-a281-d95519c42704 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1378 microversion: 2.1 time: 0.529834 Oct 04 11:02:20.766952 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 415/814] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:20 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1378 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:20.780183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9746b0a-5f7d-4475-ba7a-e4657fd5b786 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1422416814", "metadata": {"": ""}}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9746b0a-5f7d-4475-ba7a-e4657fd5b786 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action HTTP/1.1 Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 107 Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:20.788790 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1422416814", "metadata": {"": ""}}} Oct 04 11:02:20.790327 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1422416814', 'metadata': {'': ''}}}} Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:20.791226 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:20.793152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:20.794419 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:20.794419 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:20.794419 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:02:20.794419 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:02:20.794419 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:02:20.794419 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:20.794419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9746b0a-5f7d-4475-ba7a-e4657fd5b786 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:20.794419 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9746b0a-5f7d-4475-ba7a-e4657fd5b786 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action" status: 400 len: 170 microversion: 2.1 time: 0.022442 Oct 04 11:02:20.799282 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 416/815] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Oct 4 11:02:20 2022] POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action => generated 170 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:02:20.806885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:20.808107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:20.808734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Building network info cache for instance {{(pid=122409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:02:20.815103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:20.815599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:20.816024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:20.816731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:20.817186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:20.817655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:21.201441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:21.215738 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43d50e08-daa2-4946-a7be-e8fce435fc70 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.413666 Oct 04 11:02:21.216326 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 417/816] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:20 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:21.228461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-496181de-ad64-44a1-8f55-1babc1981fb9 req-5a7887da-648f-42e3-a8d3-765f3e34f009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aabc9518-e1f1-42f4-8bdb-b0cba1d912cd", "tag": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:21.254683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-496181de-ad64-44a1-8f55-1babc1981fb9 req-5a7887da-648f-42e3-a8d3-765f3e34f009 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:21.269866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-496181de-ad64-44a1-8f55-1babc1981fb9 req-5a7887da-648f-42e3-a8d3-765f3e34f009 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:21.271201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-496181de-ad64-44a1-8f55-1babc1981fb9 req-5a7887da-648f-42e3-a8d3-765f3e34f009 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:21.290583 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-496181de-ad64-44a1-8f55-1babc1981fb9 req-5a7887da-648f-42e3-a8d3-765f3e34f009 service nova] Creating event network-changed:e91f0d47-2a8c-4520-9c42-0a09d1ad0b88 for instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd on n-h1-791135-8 Oct 04 11:02:21.298200 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-496181de-ad64-44a1-8f55-1babc1981fb9 req-5a7887da-648f-42e3-a8d3-765f3e34f009 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080364 Oct 04 11:02:21.298820 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 418/817] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:21.304539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:21.305239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:21.332484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:21.332983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:21.334252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:21.336334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:21.336772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:21.337205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:21.883398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:21.897939 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30b34a08-192e-4058-853f-e2d11e92ea6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.597865 Oct 04 11:02:21.898533 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 419/818] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:21 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:21.912154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-293cb0e0-902d-44dd-acfa-e63e1291eaaf req-6dc69f42-a17f-4c4d-a3f4-e6657522c0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb", "name": "network-vif-deleted", "tag": "69dc7eab-9033-43f0-bfc5-6dd0517f23d9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:21.948237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-293cb0e0-902d-44dd-acfa-e63e1291eaaf req-6dc69f42-a17f-4c4d-a3f4-e6657522c0cc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:21.948808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-293cb0e0-902d-44dd-acfa-e63e1291eaaf req-6dc69f42-a17f-4c4d-a3f4-e6657522c0cc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:21.949478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-293cb0e0-902d-44dd-acfa-e63e1291eaaf req-6dc69f42-a17f-4c4d-a3f4-e6657522c0cc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:21.991080 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-293cb0e0-902d-44dd-acfa-e63e1291eaaf req-6dc69f42-a17f-4c4d-a3f4-e6657522c0cc service nova] Creating event network-vif-deleted:69dc7eab-9033-43f0-bfc5-6dd0517f23d9 for instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb on n-h2-791135-8 Oct 04 11:02:22.004319 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-293cb0e0-902d-44dd-acfa-e63e1291eaaf req-6dc69f42-a17f-4c4d-a3f4-e6657522c0cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101577 Oct 04 11:02:22.008049 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 420/819] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:22.020401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:22.021306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:22.041142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:22.042631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:22.043514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:22.045298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:22.047838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:22.048508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:22.387472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:22.414890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Updating instance_info_cache with network_info: [{"id": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88", "address": "fa:16:3e:69:4b:e7", "network": {"id": "bdc6907e-c7a8-40a6-92e7-98eb68a55c52", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1771678574-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44f8bd67ef72474b926de381ef6e8f33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape91f0d47-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:02:22.428629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:22.434969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Releasing lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:02:22.436588 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ceb5ea10-ee51-4070-86ed-13f178d2eb33 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action" status: 202 len: 0 microversion: 2.1 time: 4.783625 Oct 04 11:02:22.437691 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 400/820] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:17 2022] POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action => generated 0 bytes in 4786 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:02:22.439799 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b15c9884-bfae-4596-9e94-c5d8782c90b6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1378 microversion: 2.1 time: 0.430296 Oct 04 11:02:22.449168 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 421/821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:22 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1378 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:22.466758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27ce570a-db43-4f71-9b28-d55d10ef7b09 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-763218586", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27ce570a-db43-4f71-9b28-d55d10ef7b09 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action HTTP/1.1 Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 618 Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:22.472643 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:22.474006 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:02:22.474610 n-d-791135-8 devstack@n-api.service[122408]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-763218586", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 11:02:22.474610 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:02:22.474610 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-763218586', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 11:02:22.474856 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:22.475525 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:22.476511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:22.477390 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:22.477390 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:22.477390 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:02:22.477390 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:02:22.477390 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:02:22.477390 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:22.477792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27ce570a-db43-4f71-9b28-d55d10ef7b09 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:22.477792 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27ce570a-db43-4f71-9b28-d55d10ef7b09 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action" status: 400 len: 938 microversion: 2.1 time: 0.023675 Oct 04 11:02:22.477792 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 422/822] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Oct 4 11:02:22 2022] POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action => generated 938 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:02:22.489739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94a2a195-1e76-43e1-a4b8-0b3c780e673d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '.version_select at 0x7f71d4a43820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:22.740508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=42 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:22.764735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1027526241", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": "none"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:22.818284 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-94a2a195-1e76-43e1-a4b8-0b3c780e673d tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/47bf1faf-6f3f-4d50-b90f-3192a9b9716d" status: 200 len: 184 microversion: 2.1 time: 0.339285 Oct 04 11:02:22.818873 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 423/823] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:02:22 2022] GET /compute/v2.1/os-floating-ips/47bf1faf-6f3f-4d50-b90f-3192a9b9716d => generated 184 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:22.831310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:22.833123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:22.845940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:22.846730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:22.847186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:22.848695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:22.849395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:22.850436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:22.880532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:22.881787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:22.882389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:22.883064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:22.883862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:22.898186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:22.899027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:22.899735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:22.900829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:22.902878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:22.904303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:22.956588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Getting quotas for project b32aad4d3c7647bdb0b055d46b6d5f21. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:22.968737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Getting quotas for user 5910087ffa4c435295406ea7b18c42eb and project b32aad4d3c7647bdb0b055d46b6d5f21. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:22.994481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:02:22.997680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:02:23.039618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:23.051568 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-301575d1-cd6c-4213-bdb5-fb9050918882 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.230399 Oct 04 11:02:23.053845 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 424/824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:22 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:23.060762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.196"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:23.100928 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0c24941-ebcf-4732-a7a4-9abcb5719a3d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.658328 Oct 04 11:02:23.109205 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 401/825] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:02:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:02:23.116880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:23.120099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:23.129448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:23.130291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:23.131525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:23.132838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:23.133320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:23.133790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:23.328444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:23.336252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:23.336964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:23.337830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:23.340380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:23.341670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:23.343857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:23.476132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:23.486873 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5aa8c034-dbb1-4da3-a553-4583fd972637 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.375816 Oct 04 11:02:23.489560 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 402/826] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:23 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:23.514657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c942537-eb09-4101-ab2b-e211e0478a5b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:23.517227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c942537-eb09-4101-ab2b-e211e0478a5b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:23.634508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9c942537-eb09-4101-ab2b-e211e0478a5b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:23.646387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9c942537-eb09-4101-ab2b-e211e0478a5b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:23.653689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9c942537-eb09-4101-ab2b-e211e0478a5b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:23.679712 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9c942537-eb09-4101-ab2b-e211e0478a5b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "PUT /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1359 microversion: 2.75 time: 0.174404 Oct 04 11:02:23.680604 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 403/827] 10.222.0.23 () {62 vars in 1297 bytes} [Tue Oct 4 11:02:23 2022] PUT /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:23.714873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:23.716156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:23.732081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:23.733107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:23.736167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:23.739446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:02:23.739942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquired lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:02:23.748302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:23.749596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:23.750646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:24.081144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:24.089655 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5ebd6e98-37a1-4f60-a390-dbf2dec5e041 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1378 microversion: 2.1 time: 0.391975 Oct 04 11:02:24.090328 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 404/828] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:23 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1378 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:24.097571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecff266d-5666-4ce4-b9e6-da18a7041c57 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecff266d-5666-4ce4-b9e6-da18a7041c57 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action HTTP/1.1 Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 285 Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:24.101984 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:02:24.103287 n-d-791135-8 devstack@n-api.service[122409]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:02:24.104001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:02:24.105413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:02:24.106615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:02:24.107398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:02:24.107398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:24.108627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecff266d-5666-4ce4-b9e6-da18a7041c57 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:24.109683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecff266d-5666-4ce4-b9e6-da18a7041c57 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action" status: 400 len: 619 microversion: 2.1 time: 0.017931 Oct 04 11:02:24.110255 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 405/829] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Oct 4 11:02:24 2022] POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:02:24.115357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:24.115958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:24.124914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:24.125418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:24.128085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:24.132994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:24.133519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:24.134118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:24.287499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:24.303104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:24.304929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:24.311651 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e28db479-46ae-4307-b3a6-b08a3af2a173 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1411 microversion: 2.75 time: 0.200000 Oct 04 11:02:24.312583 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 406/830] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:24 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1411 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:24.323621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4318134a-3a27-4018-b9b6-b9af61896a1d req-cb186c53-2fc0-4846-9e4f-249f21826da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "name": "network-vif-plugged", "status": "completed", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:24.345203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4318134a-3a27-4018-b9b6-b9af61896a1d req-cb186c53-2fc0-4846-9e4f-249f21826da5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:24.345906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4318134a-3a27-4018-b9b6-b9af61896a1d req-cb186c53-2fc0-4846-9e4f-249f21826da5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:24.346830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4318134a-3a27-4018-b9b6-b9af61896a1d req-cb186c53-2fc0-4846-9e4f-249f21826da5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:24.367267 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4318134a-3a27-4018-b9b6-b9af61896a1d req-cb186c53-2fc0-4846-9e4f-249f21826da5 service nova] Creating event network-vif-plugged:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h1-791135-8 Oct 04 11:02:24.374050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4318134a-3a27-4018-b9b6-b9af61896a1d req-cb186c53-2fc0-4846-9e4f-249f21826da5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059906 Oct 04 11:02:24.374870 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 407/831] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:24.380931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-445485093", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "f0bf75d3-271a-43d6-b516-b6797bcc3a40"}], "security_groups": [{"name": "tempest-securitygroup--1710359047"}], "key_name": "tempest-keypair-1561121247", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:24.774561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] validate_networks() for [('f0bf75d3-271a-43d6-b516-b6797bcc3a40', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:02:25.225719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Building network info cache for instance {{(pid=122408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:02:25.450772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:25.451200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:25.451679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:25.452082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:25.452490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:25.462598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:25.463081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:25.464255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:25.464986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:25.465718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:25.466154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:25.483738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for project 83765ee4f79c49f49b8af1a56a260450. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:25.487891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for user 27f40f692eac4ea39019fe4921b054f7 and project 83765ee4f79c49f49b8af1a56a260450. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:25.500163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:02:25.504676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:02:25.567416 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c3f9e43-55b2-446c-92a5-d9ff20d5aa84 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.191381 Oct 04 11:02:25.574570 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 408/832] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:02:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1193 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:02:25.574570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:25.575049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:25.584801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:25.585307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:25.585993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:25.587537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:25.588008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:25.589037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:25.818749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:25.827595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f0e6e02-6182-415c-ab00-c42ea9edc5de tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.258039 Oct 04 11:02:25.841813 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 409/833] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:25 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:25.851930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:25.853506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:25.859724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:25.861338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:25.862037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:25.862658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:25.863531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:25.864144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:25.864726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.026020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Updating instance_info_cache with network_info: [{"id": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88", "address": "fa:16:3e:69:4b:e7", "network": {"id": "bdc6907e-c7a8-40a6-92e7-98eb68a55c52", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1771678574-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "44f8bd67ef72474b926de381ef6e8f33", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape91f0d47-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:02:26.044420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Releasing lock "refresh_cache-aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" {{(pid=122408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:02:26.045958 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db033dae-bb8b-4a4b-b2f4-444afbedb424 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action" status: 202 len: 0 microversion: 2.1 time: 2.991065 Oct 04 11:02:26.052808 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 425/834] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:23 2022] POST /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd/action => generated 0 bytes in 2998 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:02:26.059661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c08a63d4-cd51-4947-b60d-be8b7fa75f26 req-e90849c1-dded-4b58-8171-1d53f3c34c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aabc9518-e1f1-42f4-8bdb-b0cba1d912cd", "tag": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:26.069487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c08a63d4-cd51-4947-b60d-be8b7fa75f26 req-e90849c1-dded-4b58-8171-1d53f3c34c69 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.070321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c08a63d4-cd51-4947-b60d-be8b7fa75f26 req-e90849c1-dded-4b58-8171-1d53f3c34c69 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.071089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c08a63d4-cd51-4947-b60d-be8b7fa75f26 req-e90849c1-dded-4b58-8171-1d53f3c34c69 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.071808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.080046 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4683262-ae3e-4ba1-9cc9-c257c6da15f7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1528 microversion: 2.1 time: 0.237082 Oct 04 11:02:26.083454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 410/835] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:25 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1528 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:26.088653 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c08a63d4-cd51-4947-b60d-be8b7fa75f26 req-e90849c1-dded-4b58-8171-1d53f3c34c69 service nova] Creating event network-changed:e91f0d47-2a8c-4520-9c42-0a09d1ad0b88 for instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd on n-h1-791135-8 Oct 04 11:02:26.089271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.089922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:26.097490 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c08a63d4-cd51-4947-b60d-be8b7fa75f26 req-e90849c1-dded-4b58-8171-1d53f3c34c69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042983 Oct 04 11:02:26.097914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.098398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.099038 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 426/836] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:26.101479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.102745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.103224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.103819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.108312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.109178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:26.116963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.117561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.118027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.118770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.119173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.119590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.142596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:26.215085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.224938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.226916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.230431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.234667 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77d0635a-c36d-430a-bc64-98d3097b48da tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1417 microversion: 2.75 time: 0.149648 Oct 04 11:02:26.235251 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 411/837] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:26 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1417 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:26.245179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.246251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.247986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.248802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:26.253271 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82c4afb8-0cec-434c-8c78-093763974e34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1289 microversion: 2.25 time: 0.152846 Oct 04 11:02:26.254063 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 427/838] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:26 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1289 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:26.260456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.262494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.262984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.263408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.264100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.264544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.264959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.268289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:26.281994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.283273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.283978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.285498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.286868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.287755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.318819 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] HTTP exception thrown: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Request method failure captured: Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb HTTP/1.1 Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJpBXODnECvReMfrHs94fzTUZMlQP9pjgFiTsbLWLpgisU6dA27sjXIN32yCV_zRAvrcYoYiYknQNd4pMYWC1qCkpz3sYIKw276lYWUiZFWac2Fzu4-kJUAFidULD6GGuw0BmHCYiSKPfI5EUFc4joSa6mAx6eyCVuMyxKOruqdwWo Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 44f8bd67ef72474b926de381ef6e8f33 Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:26.320998 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f8bd67ef72474b926de381ef6e8f33"}]}] Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 44f8bd67ef72474b926de381ef6e8f33 Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsAssociationTestJSON-1548549554-project Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: c419136435f240788480491469fe7d62 Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1548549554-project Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.322599 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb'} Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:26.323530 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.325796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.334775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Returning 404 to user: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:26.336094 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ff75172-26c7-4e0a-8424-fce654a8de6e tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 404 len: 111 microversion: 2.1 time: 0.081173 Oct 04 11:02:26.338021 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 428/839] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:02:26 2022] DELETE /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:02:26.350992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.351696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:26.358722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.359212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.359682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.360397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.361661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.362108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.492445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.501457 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc029a9a-3023-4d20-93ed-571641f7ceab tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.264913 Oct 04 11:02:26.513949 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 412/840] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:26 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:26.524958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.525846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:26.533293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.535127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.535793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.537805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.538938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.539702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.568433 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] HTTP exception thrown: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Request method failure captured: Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb HTTP/1.1 Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJpBXODnECvReMfrHs94fzTUZMlQP9pjgFiTsbLWLpgisU6dA27sjXIN32yCV_zRAvrcYoYiYknQNd4pMYWC1qCkpz3sYIKw276lYWUiZFWac2Fzu4-kJUAFidULD6GGuw0BmHCYiSKPfI5EUFc4joSa6mAx6eyCVuMyxKOruqdwWo Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 44f8bd67ef72474b926de381ef6e8f33 Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:26.570181 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f8bd67ef72474b926de381ef6e8f33"}]}] Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 44f8bd67ef72474b926de381ef6e8f33 Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsAssociationTestJSON-1548549554-project Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: c419136435f240788480491469fe7d62 Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1548549554-project Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.571874 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb'} Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:26.572763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. Oct 04 11:02:26.574988 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.576418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Returning 404 to user: Instance 46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:26.576418 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e981ea6-66c3-4c2a-927d-5f41d4874a89 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb" status: 404 len: 111 microversion: 2.1 time: 0.056536 Oct 04 11:02:26.576616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:26.576719 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 413/841] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:26 2022] GET /compute/v2.1/servers/46c2ad7c-ee19-4bc9-9a33-b7eaae6865eb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:02:26.581557 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c25567f4-7109-4997-b76f-8e3e127dd99c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1528 microversion: 2.1 time: 0.240335 Oct 04 11:02:26.582200 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 429/842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:26 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1528 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:26.589689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1545982600"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:26.590834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1825b76b-c9a1-47f5-adc9-9185f49a8721 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '.version_select at 0x7f71d4b42a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.592326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:26.602409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.602912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.603567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.605643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.606140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.606575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.823334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b24ec4dd-1004-44c9-9055-2de1a9c5c955 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action" status: 202 len: 0 microversion: 2.1 time: 0.245506 Oct 04 11:02:26.825837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 414/843] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:26 2022] POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:02:26.830924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1e2228fa-b68b-499c-994d-a375c63807bb tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.851715 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1e2228fa-b68b-499c-994d-a375c63807bb tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/b0647c8b-c798-43aa-a114-5e7af2fe554b" status: 202 len: 0 microversion: 2.1 time: 0.024626 Oct 04 11:02:26.852429 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 415/844] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:02:26 2022] DELETE /compute/v2.1/flavors/b0647c8b-c798-43aa-a114-5e7af2fe554b => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:26.858511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-639993795"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:26.861005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:26.869754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.870432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.870878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.871655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:26.872175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:26.872670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:26.905052 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Cannot 'createImage' instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 while it is in task_state image_snapshot_pending Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action HTTP/1.1 Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 84 Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:26.906735 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-639993795"}} Oct 04 11:02:26.908300 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'createImage' instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 while it is in task_state image_snapshot_pending Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-639993795'}}} Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:26.909081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 while it is in task_state image_snapshot_pending Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 while it is in task_state image_snapshot_pending Oct 04 11:02:26.910819 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:26.912562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 409 to user: Cannot 'createImage' instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 while it is in task_state image_snapshot_pending {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:26.912562 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a515a9da-132d-4b32-a07b-d07a800c030f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action" status: 409 len: 167 microversion: 2.1 time: 0.054714 Oct 04 11:02:26.912562 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 416/845] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:26 2022] POST /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2/action => generated 167 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:26.913538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d3a7f59-5850-4f5a-a294-2bad3fa8f4e9 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:26.934292 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d3a7f59-5850-4f5a-a294-2bad3fa8f4e9 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.024631 Oct 04 11:02:26.934877 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 417/846] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:02:26 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:26.944992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c67e0ff2-a456-4c2b-bf7d-b5a989881d3e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '.version_select at 0x7f71d49fadc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:27.082054 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c67e0ff2-a456-4c2b-bf7d-b5a989881d3e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/images/76239643-a501-4899-a5df-c267559c1cfc" status: 204 len: 0 microversion: 2.1 time: 0.146101 Oct 04 11:02:27.082651 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 418/847] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:26 2022] DELETE /compute/v2.1/images/76239643-a501-4899-a5df-c267559c1cfc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:02:27.087736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:27.090140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:27.096086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.096573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.097004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.097716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.098166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.098591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.128965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.134876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Old instance type tempest-test_resize_flavor_-71356239, new instance type m1.heat {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:02:27.142036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:27.142472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:27.142937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:27.143333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:27.143733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:27.212848 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-691edd31-412c-4035-a564-c755a3fdc53e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d/action" status: 202 len: 0 microversion: 2.1 time: 0.128810 Oct 04 11:02:27.216826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 419/848] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:27 2022] POST /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:27.221957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:27.222838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:27.229433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.230250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.230928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.231855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.232614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.233133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.473846 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1825b76b-c9a1-47f5-adc9-9185f49a8721 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/47bf1faf-6f3f-4d50-b90f-3192a9b9716d" status: 202 len: 0 microversion: 2.1 time: 0.890659 Oct 04 11:02:27.474530 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 430/849] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:02:26 2022] DELETE /compute/v2.1/os-floating-ips/47bf1faf-6f3f-4d50-b90f-3192a9b9716d => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:27.480667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:27.481540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:27.487072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.487602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.488240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.488861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.489796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.490407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.490835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.497814 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09c86fad-d3d2-486a-b24f-16a2186d6ab6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1532 microversion: 2.1 time: 0.279782 Oct 04 11:02:27.498910 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 420/850] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:27 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1532 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:27.520087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:27.520927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:27.527835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.528333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.528764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.529539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.530001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.530420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.612920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.628898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.630768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.636932 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82e5fa6f-a60b-4af7-8b5f-47031eb2a155 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1417 microversion: 2.75 time: 0.122006 Oct 04 11:02:27.638008 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 421/851] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:27 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1417 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:27.644012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:27.644613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:27.658043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.658536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.658969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.659675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.660126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.660549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.674515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.683092 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-492e1193-7f09-4ed7-95ac-c407c99db6e2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1537 microversion: 2.1 time: 0.206717 Oct 04 11:02:27.683668 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 431/852] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:27 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1537 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:27.689057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:27.689576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:27.695332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.695809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.696236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.696927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.697397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.698055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.725964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:02:27.740822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.751148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.753267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.754443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f98a48d-e7cb-47f2-8557-0ee9f7d26a34 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1289 microversion: 2.25 time: 0.115394 Oct 04 11:02:27.755185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 422/853] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:27 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:27.816105 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-131f054c-5149-47d2-90e9-5c771280b65f tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 204 len: 0 microversion: 2.1 time: 0.130808 Oct 04 11:02:27.816692 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 432/854] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:02:27 2022] DELETE /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:02:27.824633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:27.825376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:27.831428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.831928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.832433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.833198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:27.833748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:27.834245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:27.989007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:27.997016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b6152cf-2de2-4ed7-a00f-179bde939a21 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1526 microversion: 2.1 time: 0.176263 Oct 04 11:02:27.997900 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 423/855] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:27 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1526 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:28.529565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:28.530449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:28.536498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:28.536971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:28.537417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:28.538099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:28.538548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:28.538963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:28.664056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:28.664790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:28.670980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:28.671243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:28.671727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:28.672159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:28.672866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:28.673303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:28.673745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:28.678749 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff7ea6d8-b096-43fb-aaac-b4a6127fbd87 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1538 microversion: 2.1 time: 0.154146 Oct 04 11:02:28.679348 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 433/856] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:28 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1538 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:28.707130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:28.707833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:28.713925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:28.714482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:28.714986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:28.715748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:28.716275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:28.716695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:28.720880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:28.737262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:28.746238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:28.747716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:28.753038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a5c6197-928b-49d0-b0c9-5efed3f5caf2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1417 microversion: 2.75 time: 0.092900 Oct 04 11:02:28.753650 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 424/857] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:28 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1417 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:28.779429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:28.780041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:28.786058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:28.786619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:28.787057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:28.787752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:28.788203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:28.788624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:28.866422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:28.875100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:28.876524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:28.877910 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e827f32a-511e-4fb5-8e6c-e68cf4ddd6c4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1281 microversion: 2.25 time: 0.102460 Oct 04 11:02:28.878466 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 425/858] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:28 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:28.884087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:28.892103 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9858f038-9fa6-4c7e-94bc-9a3678123680 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1537 microversion: 2.1 time: 0.188783 Oct 04 11:02:28.892846 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 434/859] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:28 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:29.020247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:29.020766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:29.026695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.027177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.027611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.028320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.028771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.029192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.157905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:29.166045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f8f14e21-cbb5-41ac-a3f6-4c321bee1286 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1526 microversion: 2.1 time: 0.149817 Oct 04 11:02:29.167136 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 426/860] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:29 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1526 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:29.703245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:29.703851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:29.705751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:29.715006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.715513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.716113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.717006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.717984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.718927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.782819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:29.783426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:29.792069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.792069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.792436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.793109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.793588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.794007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.881590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:29.894399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:29.895975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:29.904343 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e1d1730-8384-439e-93de-4c619b5e72a7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1417 microversion: 2.75 time: 0.125460 Oct 04 11:02:29.904961 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 427/861] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:29 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1417 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:29.911358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ffc82e14-dfb5-4e2e-a908-abde71a02b88 req-99ad1da2-5573-4b48-ba0e-a7feb084d0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aabc9518-e1f1-42f4-8bdb-b0cba1d912cd", "name": "network-vif-deleted", "tag": "e91f0d47-2a8c-4520-9c42-0a09d1ad0b88"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:29.922098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ffc82e14-dfb5-4e2e-a908-abde71a02b88 req-99ad1da2-5573-4b48-ba0e-a7feb084d0a0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.923160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ffc82e14-dfb5-4e2e-a908-abde71a02b88 req-99ad1da2-5573-4b48-ba0e-a7feb084d0a0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.923594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ffc82e14-dfb5-4e2e-a908-abde71a02b88 req-99ad1da2-5573-4b48-ba0e-a7feb084d0a0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.928428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:29.936305 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efd0b4c1-b52e-4d77-8941-08f8591f206f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1538 microversion: 2.1 time: 0.236929 Oct 04 11:02:29.936833 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ffc82e14-dfb5-4e2e-a908-abde71a02b88 req-99ad1da2-5573-4b48-ba0e-a7feb084d0a0 service nova] Creating event network-vif-deleted:e91f0d47-2a8c-4520-9c42-0a09d1ad0b88 for instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd on n-h1-791135-8 Oct 04 11:02:29.942297 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ffc82e14-dfb5-4e2e-a908-abde71a02b88 req-99ad1da2-5573-4b48-ba0e-a7feb084d0a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036160 Oct 04 11:02:29.942896 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 428/862] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:29.949073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:29.949788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:29.952703 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 435/863] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:29 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1538 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:29.956293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.956845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.957282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.958007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.958457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.958885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.960079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:29.960878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:29.968623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.969393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.969979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:29.970847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:29.971486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:29.972073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:30.075066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:30.078691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:30.087958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:30.100057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:30.102093 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db193515-31f1-4abd-b050-5f0e37415cd0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1337 microversion: 2.25 time: 0.157775 Oct 04 11:02:30.103620 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 429/864] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:29 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1337 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:30.158844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:30.169340 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d3d40bb3-89b0-4849-a1fd-fe993f0ad81f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1537 microversion: 2.1 time: 0.213868 Oct 04 11:02:30.170334 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 436/865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:29 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:30.190180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:30.191065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:30.199360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:30.199858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:30.200350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:30.201262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:30.201886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:30.202416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:30.265720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:30.266190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:30.266623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:30.267068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lazy-loading 'fault' on Instance uuid aabc9518-e1f1-42f4-8bdb-b0cba1d912cd {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:02:30.313143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:30.322374 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8132aaa8-cf38-466a-94af-eecf49001656 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1314 microversion: 2.1 time: 0.134983 Oct 04 11:02:30.324060 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 430/866] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:30 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:30.931603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:30.932787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:30.938729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:30.939202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:30.939627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:30.940306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:30.940758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:30.941178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:30.960306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:30.961644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:30.968387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:30.968969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:30.969572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:30.970712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:30.971274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:30.971766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.087374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.096279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.098822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.107696 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e45c50e-fbc4-47f3-be3d-b031b1334ca1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1438 microversion: 2.75 time: 0.180019 Oct 04 11:02:31.108279 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 437/867] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:30 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1438 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:31.129845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:31.130463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:31.144352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.146236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.146782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.148595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.149527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.150113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.162763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.171970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-90a40ddf-a788-4b08-980a-723b725ccde9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1538 microversion: 2.1 time: 0.215478 Oct 04 11:02:31.173120 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 431/868] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:30 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1538 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:31.177841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:31.180568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:31.187351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.187851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.188499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.189426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.190036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.190714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.294546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:31.298234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:31.298828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:31.299336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:31.299967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:31.358466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.383688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.387103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.391297 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4fa4e59-0f51-4985-9236-c9abb65186cb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1411 microversion: 2.25 time: 0.264991 Oct 04 11:02:31.394226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:31.398095 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 438/869] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:31 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1411 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:31.403092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.403891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.404838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.406379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.407327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.408529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.411889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:31.412964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:31.417975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:31.425086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.425675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.426251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.426989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.427564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.428210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.575490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.587111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.589185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.606286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2409b96f-3160-4857-b88f-d4a974c8957a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "POST /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2/action" status: 202 len: 1495 microversion: 2.75 time: 0.431645 Oct 04 11:02:31.627404 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 432/870] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:02:31 2022] POST /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2/action => generated 1495 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 11:02:31.633803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.638129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:31.639133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:31.646384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.646877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.647312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.648010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.648702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.649137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.656540 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5e35a9b-8cdd-4093-884f-875447b0c7d7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1537 microversion: 2.1 time: 0.255985 Oct 04 11:02:31.657141 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 439/871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:31 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:31.671114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:31.671719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:31.678120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.678727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.679265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.680376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.680837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.681901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.707126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.708797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.709464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:31.710182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lazy-loading 'fault' on Instance uuid aabc9518-e1f1-42f4-8bdb-b0cba1d912cd {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:02:31.762702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c419136435f240788480491469fe7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f8bd67ef72474b926de381ef6e8f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.777610 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12ae1a51-bdfd-499e-958a-0a4370c274c9 tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 200 len: 1314 microversion: 2.1 time: 0.148644 Oct 04 11:02:31.789418 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 433/872] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:31 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:31.796214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.810851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.812632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:31.818462 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ce25c6e-0841-4995-97f5-3c42486611bc tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.154915 Oct 04 11:02:31.819511 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 440/873] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:31 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:31.973046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ca766ad5-ef38-4d88-8f8c-fbdf05401a2a req-99808c73-b0c7-44bf-a027-6fe95ba1e28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2", "name": "network-vif-plugged", "status": "completed", "tag": "65751e5d-029a-406a-9f6c-e8ecccdf34ad"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:31.990929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ca766ad5-ef38-4d88-8f8c-fbdf05401a2a req-99808c73-b0c7-44bf-a027-6fe95ba1e28c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:31.991546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ca766ad5-ef38-4d88-8f8c-fbdf05401a2a req-99808c73-b0c7-44bf-a027-6fe95ba1e28c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:31.992074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ca766ad5-ef38-4d88-8f8c-fbdf05401a2a req-99808c73-b0c7-44bf-a027-6fe95ba1e28c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.008605 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ca766ad5-ef38-4d88-8f8c-fbdf05401a2a req-99808c73-b0c7-44bf-a027-6fe95ba1e28c service nova] Creating event network-vif-plugged:65751e5d-029a-406a-9f6c-e8ecccdf34ad for instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 on n-h1-791135-8 Oct 04 11:02:32.016715 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ca766ad5-ef38-4d88-8f8c-fbdf05401a2a req-99808c73-b0c7-44bf-a027-6fe95ba1e28c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048065 Oct 04 11:02:32.017594 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 434/874] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:32.026225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4501d8e5-ecb2-434e-a8ea-82c58b33f699 req-c62ddf67-047f-4ad0-9a9e-d4bfc29e5c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5813e7a4-1b03-438c-bf70-c2b544030ce4", "tag": "b429cae8-ebcb-4a50-988d-0ebd70deba67"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:32.035793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4501d8e5-ecb2-434e-a8ea-82c58b33f699 req-c62ddf67-047f-4ad0-9a9e-d4bfc29e5c1d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.036336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4501d8e5-ecb2-434e-a8ea-82c58b33f699 req-c62ddf67-047f-4ad0-9a9e-d4bfc29e5c1d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.036970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4501d8e5-ecb2-434e-a8ea-82c58b33f699 req-c62ddf67-047f-4ad0-9a9e-d4bfc29e5c1d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.049677 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4501d8e5-ecb2-434e-a8ea-82c58b33f699 req-c62ddf67-047f-4ad0-9a9e-d4bfc29e5c1d service nova] Creating event network-changed:b429cae8-ebcb-4a50-988d-0ebd70deba67 for instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 on n-h2-791135-8 Oct 04 11:02:32.054317 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4501d8e5-ecb2-434e-a8ea-82c58b33f699 req-c62ddf67-047f-4ad0-9a9e-d4bfc29e5c1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031713 Oct 04 11:02:32.054911 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 441/875] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:32.197644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:32.198358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:32.204683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.205172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.205646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.206363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.206821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.207248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.392203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:32.408857 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5718c4b-d0ac-447c-8705-267a711ccff2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1538 microversion: 2.1 time: 0.215390 Oct 04 11:02:32.409691 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 435/876] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:32 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1538 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:32.428787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:32.429370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:32.447433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.449391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.451188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.454600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.456758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.457554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.624598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:32.632976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:32.634471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:32.636460 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b134a68-00af-4406-bc40-19122a2b2b5a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1411 microversion: 2.25 time: 0.215786 Oct 04 11:02:32.637365 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 442/877] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:32 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1411 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:32.681484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:32.682322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:32.689206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.689968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.690621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.691591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.692133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.692793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.810406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:32.811140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] [instance: aabc9518-e1f1-42f4-8bdb-b0cba1d912cd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:32.824544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.825051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.826606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.827336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.827794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.833429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.849054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:32.859775 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-972ae7b7-cd10-49ac-ada2-3c3337311e21 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1537 microversion: 2.1 time: 0.183402 Oct 04 11:02:32.860984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 436/878] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:32 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1537 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:32.863839 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] HTTP exception thrown: Instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd could not be found. Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Request method failure captured: Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd HTTP/1.1 Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJpBXODnECvReMfrHs94fzTUZMlQP9pjgFiTsbLWLpgisU6dA27sjXIN32yCV_zRAvrcYoYiYknQNd4pMYWC1qCkpz3sYIKw276lYWUiZFWac2Fzu4-kJUAFidULD6GGuw0BmHCYiSKPfI5EUFc4joSa6mAx6eyCVuMyxKOruqdwWo Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 44f8bd67ef72474b926de381ef6e8f33 Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:32.865510 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44f8bd67ef72474b926de381ef6e8f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44f8bd67ef72474b926de381ef6e8f33"}]}] Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 44f8bd67ef72474b926de381ef6e8f33 Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1548549554 Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsAssociationTestJSON-1548549554-project Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: c419136435f240788480491469fe7d62 Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1548549554-project Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd could not be found. Oct 04 11:02:32.866928 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'aabc9518-e1f1-42f4-8bdb-b0cba1d912cd'} Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd could not be found. Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:32.867792 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd could not be found. Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd could not be found. Oct 04 11:02:32.869232 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:32.872503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] Returning 404 to user: Instance aabc9518-e1f1-42f4-8bdb-b0cba1d912cd could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:32.872503 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34854d36-8264-4236-811a-e026b1b78a2b tempest-FloatingIPsAssociationTestJSON-1548549554 tempest-FloatingIPsAssociationTestJSON-1548549554-project] 10.222.0.23 "GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd" status: 404 len: 111 microversion: 2.1 time: 0.069816 Oct 04 11:02:32.872503 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 443/879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:32 2022] GET /compute/v2.1/servers/aabc9518-e1f1-42f4-8bdb-b0cba1d912cd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:02:32.874713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:32.876729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:32.896620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.897170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.897709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.898527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.899052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.899646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.943605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:32.949172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:32.971767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.972442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.973023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:32.973887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:32.974440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:32.975709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:33.013051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:33.021318 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c86e389c-f58c-4903-81d0-841b8538bb0c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081569 Oct 04 11:02:33.022342 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 444/880] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:02:32 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:02:33.030143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:33.031570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:33.035606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:33.037496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:33.038824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9a1b1122-54d6-4118-8fe5-22206fb849e9 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.176161 Oct 04 11:02:33.039703 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 437/881] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:32 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:33.045556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:33.046759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:33.047605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:33.048641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:33.049378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:33.049975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:33.207519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lazy-loading 'services' on Instance uuid 687c5af7-ef65-4b00-b6bc-86192e25ef26 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:02:33.342792 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0361818c-1155-4762-99f9-d8b1e124b35c tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "DELETE /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments/530aa55d-6e5b-41ef-b063-0722809f9d63" status: 202 len: 0 microversion: 2.1 time: 0.313486 Oct 04 11:02:33.346936 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 445/882] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:02:33 2022] DELETE /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments/530aa55d-6e5b-41ef-b063-0722809f9d63 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:33.434677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:33.435279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:33.441048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:33.441565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:33.441995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:33.442682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:33.443124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:33.443538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:33.662650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:33.663465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:33.670105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:33.670709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:33.671150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:33.671851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:33.672301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:33.672721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:33.961770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:33.969969 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51260829-316c-444f-85e1-cf3f9306859a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1520 microversion: 2.1 time: 0.539034 Oct 04 11:02:33.970608 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 438/883] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:33 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1520 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:33.975211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:33.976183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:33.982126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:33.982843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:33.983487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:33.984277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:33.984830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:33.985362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:34.091758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:34.101235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:34.102850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:34.105222 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-667c9373-079a-4ea9-bb79-e888fdd247e5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1411 microversion: 2.25 time: 0.445782 Oct 04 11:02:34.105892 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 446/884] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:33 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1411 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:34.116093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:34.116825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:34.123781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:34.124470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:34.125088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:34.126002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:34.126491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:34.126918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:34.225289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:34.242146 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5b3e685-69a9-4653-bbd9-c7b8dfc88aa7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.270262 Oct 04 11:02:34.243716 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 439/885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:33 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:34.250146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:34.252390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:34.259493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:34.260303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:34.261318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:34.262256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:34.262893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:34.263491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:34.323634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:02:34.409452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:34.421605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:34.425801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:34.437595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de795e11-84fb-4736-9a4c-0070eb37f8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.191288 Oct 04 11:02:34.438227 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 440/886] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:34 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:34.441489 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e792f16-88c3-4c79-a6b2-e7ce860dc1a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 204 len: 0 microversion: 2.1 time: 0.333932 Oct 04 11:02:34.442405 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 447/887] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:02:34 2022] DELETE /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:02:34.458220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:34.459141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:34.470546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:34.471310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:34.471908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:34.472797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:34.473471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:34.474047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:34.722586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:34.731433 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-244369b1-a772-4184-b1dd-7c3ebcf5ed68 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1526 microversion: 2.1 time: 0.280862 Oct 04 11:02:34.732665 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 441/888] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:34 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1526 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:35.133604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:35.135751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:35.142622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:35.143501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:35.144215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:35.145229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:35.146103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:35.146863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:35.268857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:35.270332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:35.283977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:35.285107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:35.286256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:35.287215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:35.287892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:35.288794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:35.452662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:35.461344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:35.463750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:35.465073 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-545215e3-08e4-4fcc-be2d-fd143d6fa98c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1411 microversion: 2.25 time: 0.336487 Oct 04 11:02:35.466228 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 448/889] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:35 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1411 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:35.470864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:35.471736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:35.475178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:35.487732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:35.488643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:35.489244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:35.490444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:35.497162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:35.499105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:35.499856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:35.615946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:35.618660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:35.626503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:35.628411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:35.634730 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-257c7c22-ca9f-464f-9132-06cd723a59ec tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.167316 Oct 04 11:02:35.637397 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 449/890] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:35 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:35.677989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:35.687131 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6dfbbd3-1f88-4438-9591-1bbd47659b46 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.422588 Oct 04 11:02:35.694004 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 442/891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:35 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:35.757604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:35.758175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:35.764865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:35.765280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:35.765756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:35.775455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:35.775939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:35.776374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:35.989107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:36.000996 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65f7e307-d336-4301-86c1-42ab99098875 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1526 microversion: 2.1 time: 0.249052 Oct 04 11:02:36.002649 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 450/892] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:35 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1526 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:36.496534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:36.499406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:36.508806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:36.509673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:36.514708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:36.515892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:36.516312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:36.516815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:36.662546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:36.663150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:36.674544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:36.675051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:36.675476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:36.686509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:36.687112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:36.687680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:36.731892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:36.742667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:36.749482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:36.750645 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8d09e3b-37c3-426a-8659-a31e044a4470 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1411 microversion: 2.25 time: 0.258708 Oct 04 11:02:36.751215 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 443/893] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:36 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1411 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:36.768699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:36.769785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:36.806276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:36.807456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:36.810716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:36.811650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:36.812118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:36.812548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:36.827329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:36.827521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:36.840371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:36.846129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:36.858129 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4efb0a77-4857-4893-9679-d3452f7cd07f tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.199357 Oct 04 11:02:36.863319 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 451/894] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:36 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:37.007965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:37.016968 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14d89b49-6f51-4ff5-9b97-fb7acb243482 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.252489 Oct 04 11:02:37.038331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:37.039260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:37.046160 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 444/895] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:36 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:37.046896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:37.048740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:37.049457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:37.050419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:37.051096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:37.051745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:37.203874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:37.214692 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d755e722-f8ca-4e08-aae9-4d928656df47 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 200 len: 1526 microversion: 2.1 time: 0.179831 Oct 04 11:02:37.229462 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 452/896] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:37 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 1526 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:37.325078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-cf593de5-2efb-4d08-a655-8e0a9296b9fd req-2ed9c55b-f1ae-44d0-9702-f5ec9bdb4b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2", "name": "network-vif-deleted", "tag": "65751e5d-029a-406a-9f6c-e8ecccdf34ad"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:37.332402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:37.341869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cf593de5-2efb-4d08-a655-8e0a9296b9fd req-2ed9c55b-f1ae-44d0-9702-f5ec9bdb4b3d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:37.342705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cf593de5-2efb-4d08-a655-8e0a9296b9fd req-2ed9c55b-f1ae-44d0-9702-f5ec9bdb4b3d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:37.343352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cf593de5-2efb-4d08-a655-8e0a9296b9fd req-2ed9c55b-f1ae-44d0-9702-f5ec9bdb4b3d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:37.392139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-cf593de5-2efb-4d08-a655-8e0a9296b9fd req-2ed9c55b-f1ae-44d0-9702-f5ec9bdb4b3d service nova] Creating event network-vif-deleted:65751e5d-029a-406a-9f6c-e8ecccdf34ad for instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 on n-h1-791135-8 Oct 04 11:02:37.408223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-cf593de5-2efb-4d08-a655-8e0a9296b9fd req-2ed9c55b-f1ae-44d0-9702-f5ec9bdb4b3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086982 Oct 04 11:02:37.408729 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 445/897] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:02:37.778387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:37.779677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:37.792993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:37.793610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:37.794305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:37.795274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:37.795957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:37.796591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:37.896848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:37.897591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:37.913600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:37.914044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:37.914671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:37.915562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:37.916973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:37.919304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:37.972791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:37.983301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:37.985442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:37.986907 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd93bf22-638c-4f81-9f58-6b1cc5307081 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1411 microversion: 2.25 time: 0.212436 Oct 04 11:02:37.988028 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 453/898] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:37 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1411 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:38.041073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:38.041934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:38.042655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:38.051786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:38.053932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:38.054532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:38.054743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:38.055627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:38.056470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:38.057855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:38.059006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:38.071093 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dbd98cf3-bb0a-43e8-ba14-88867f635427 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.178755 Oct 04 11:02:38.076409 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 446/899] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:37 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:38.222055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:38.230689 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39627de1-cc3c-43da-8201-3fdf910a69bb tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.193982 Oct 04 11:02:38.231524 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 454/900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:38 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:38.249291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:38.250075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:38.256672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:38.257229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:38.257953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:38.258888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:38.259404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:38.260065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:38.273878 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 HTTP/1.1 Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:38.276156 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:02:38.277941 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2'} Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:38.278851 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:02:38.280282 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:38.281626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:38.281626 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01175f02-cbcf-4e3a-a888-f22a5d956e9a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 404 len: 111 microversion: 2.1 time: 0.044541 Oct 04 11:02:38.282132 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 447/901] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:38 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:02:38.294121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df314b45-6664-475b-b30e-cfe3ccc4b861 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'create', calling method: .version_select at 0x7f71d4927d30>, body: {"keypair": {"name": "tempest-keypair-1152735420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWVEU6pmrRsGKBYDFffaLlZPsa4pfA8b+JQaVuaWNROcD2cb1PUjp7fE8oM4rjJ/H1ez8KH3W2jvqH2ROdcOCh/eOvlXoct6AI/8fJ4lFoo4c4tkcFCwKGL9/IW6gNywg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:38.310029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-df314b45-6664-475b-b30e-cfe3ccc4b861 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Getting quotas for project 2070b5bd76a54fa6b3cbc9c9bee8500d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:38.314002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-df314b45-6664-475b-b30e-cfe3ccc4b861 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Getting quotas for user 3ae296c06e8e490db21812b28044533c and project 2070b5bd76a54fa6b3cbc9c9bee8500d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:38.340106 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df314b45-6664-475b-b30e-cfe3ccc4b861 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050191 Oct 04 11:02:38.341457 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 455/902] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:02:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:38.870382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:38.872778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:38.879694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:38.880034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:38.880778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:38.881621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:38.882085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:38.882615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:38.922641 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a0cb7c9d-3245-4a2a-8c9d-1dc6043d8b9f tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050179 Oct 04 11:02:38.923333 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 448/903] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:02:38 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:39.020793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:39.021395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:39.028037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.028694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.029299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.030183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.030803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.031227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.109174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:39.111005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:39.121417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.123171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.123829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.124897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.125672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.126458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.237950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:39.245275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:39.251324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:39.253275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:39.259728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:39.262581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:39.264041 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67d154e5-366b-48ae-acbc-4ea36b42af1a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1411 microversion: 2.25 time: 0.250885 Oct 04 11:02:39.266897 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 456/904] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:39 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1411 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:39.273684 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dba51838-dc6e-4bb9-9d53-4ac519fed8d1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.174454 Oct 04 11:02:39.274757 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 449/905] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:39 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:39.293143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:39.294022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:39.301834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.302509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.303188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.304114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.304763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.305446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.416353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-22e06120-ef5f-4313-936d-240b2af536ce req-1689f2ac-20b8-4cd1-9b48-4b2a23454161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5813e7a4-1b03-438c-bf70-c2b544030ce4", "name": "network-vif-plugged", "status": "completed", "tag": "b429cae8-ebcb-4a50-988d-0ebd70deba67"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:39.427019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22e06120-ef5f-4313-936d-240b2af536ce req-1689f2ac-20b8-4cd1-9b48-4b2a23454161 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.427649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22e06120-ef5f-4313-936d-240b2af536ce req-1689f2ac-20b8-4cd1-9b48-4b2a23454161 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.428092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22e06120-ef5f-4313-936d-240b2af536ce req-1689f2ac-20b8-4cd1-9b48-4b2a23454161 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.443493 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-22e06120-ef5f-4313-936d-240b2af536ce req-1689f2ac-20b8-4cd1-9b48-4b2a23454161 service nova] Creating event network-vif-plugged:b429cae8-ebcb-4a50-988d-0ebd70deba67 for instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 on n-h2-791135-8 Oct 04 11:02:39.450581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-22e06120-ef5f-4313-936d-240b2af536ce req-1689f2ac-20b8-4cd1-9b48-4b2a23454161 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038437 Oct 04 11:02:39.451470 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 450/906] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:02:39.465750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:39.475790 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a4b6235f-869a-4788-8524-0bb5b6e41557 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.207659 Oct 04 11:02:39.482205 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 457/907] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:39 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:39.661656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54c93e7b-41f2-4a44-b56b-22d5f6a2c31c tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Calling method '.version_select at 0x7f71d457ac10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:39.686301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-54c93e7b-41f2-4a44-b56b-22d5f6a2c31c tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] HTTP exception thrown: Image not found. Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54c93e7b-41f2-4a44-b56b-22d5f6a2c31c tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Request method failure captured: Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/5a210398-c5d6-450a-a3c8-1670dc7a7a18/metadata/os_distro HTTP/1.1 Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBLP0YMQaXAOBOVdhnlQ4n2jWXNSQl-Am_vtLTgmsGw-Xg8wZkzALdatRQdE_frYmnN3vMy6Wr04ZrUMNvutC9f3wbyAxD78Wq7wJ8TTkRGM9cWw1h9IfsNQKsw8oOLzFEEhOnoTnRq1k7fYuCLczYGIsOoRjS3w7usgpNdvDuOS_Rs Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:39.704993 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d842c0020f644e2bce2bd682296730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d842c0020f644e2bce2bd682296730c"}]}] Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f505b3859a6841768f8b5d5e1a7bf917 Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'image_id': '5a210398-c5d6-450a-a3c8-1670dc7a7a18', 'id': 'os_distro'} Oct 04 11:02:39.706590 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.707513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a210398-c5d6-450a-a3c8-1670dc7a7a18 Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.708706 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a210398-c5d6-450a-a3c8-1670dc7a7a18 could not be found. Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:02:39.710187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.711936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54c93e7b-41f2-4a44-b56b-22d5f6a2c31c tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:39.713692 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-54c93e7b-41f2-4a44-b56b-22d5f6a2c31c tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] 10.222.0.23 "DELETE /compute/v2.1/images/5a210398-c5d6-450a-a3c8-1670dc7a7a18/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.181890 Oct 04 11:02:39.713692 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 451/908] 10.222.0.23 () {58 vars in 1293 bytes} [Tue Oct 4 11:02:39 2022] DELETE /compute/v2.1/images/5a210398-c5d6-450a-a3c8-1670dc7a7a18/metadata/os_distro => generated 62 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:39.719435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61a5843e-829c-413a-a71b-a5ea8b4084fd tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Calling method '.version_select at 0x7f71d4a5e040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:39.742015 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-61a5843e-829c-413a-a71b-a5ea8b4084fd tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] HTTP exception thrown: Image not found. Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61a5843e-829c-413a-a71b-a5ea8b4084fd tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Request method failure captured: Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/images/368b5da9-3330-48c3-9374-a60875b27eb0/metadata/os_version HTTP/1.1 Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBLP0YMQaXAOBOVdhnlQ4n2jWXNSQl-Am_vtLTgmsGw-Xg8wZkzALdatRQdE_frYmnN3vMy6Wr04ZrUMNvutC9f3wbyAxD78Wq7wJ8TTkRGM9cWw1h9IfsNQKsw8oOLzFEEhOnoTnRq1k7fYuCLczYGIsOoRjS3w7usgpNdvDuOS_Rs Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:39.746130 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d842c0020f644e2bce2bd682296730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d842c0020f644e2bce2bd682296730c"}]}] Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: f505b3859a6841768f8b5d5e1a7bf917 Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: exception: Image not found. Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'image_id': '368b5da9-3330-48c3-9374-a60875b27eb0', 'id': 'os_version'} Oct 04 11:02:39.747681 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.748517 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 368b5da9-3330-48c3-9374-a60875b27eb0 Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.749866 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 368b5da9-3330-48c3-9374-a60875b27eb0 could not be found. Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:02:39.751188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.753133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61a5843e-829c-413a-a71b-a5ea8b4084fd tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:39.754855 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61a5843e-829c-413a-a71b-a5ea8b4084fd tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] 10.222.0.23 "GET /compute/v2.1/images/368b5da9-3330-48c3-9374-a60875b27eb0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.032564 Oct 04 11:02:39.757668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f4a8469-defc-4d87-8dc7-9dc3e551bc4a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Calling method '.version_select at 0x7f71d457a550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:39.762869 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 458/909] 10.222.0.23 () {58 vars in 1293 bytes} [Tue Oct 4 11:02:39 2022] GET /compute/v2.1/images/368b5da9-3330-48c3-9374-a60875b27eb0/metadata/os_version => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:39.779125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0f4a8469-defc-4d87-8dc7-9dc3e551bc4a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] HTTP exception thrown: Image not found. Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f4a8469-defc-4d87-8dc7-9dc3e551bc4a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Request method failure captured: Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/images/c44ddc9a-f638-47ae-bb97-2df02246f33a/metadata HTTP/1.1 Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBLP0YMQaXAOBOVdhnlQ4n2jWXNSQl-Am_vtLTgmsGw-Xg8wZkzALdatRQdE_frYmnN3vMy6Wr04ZrUMNvutC9f3wbyAxD78Wq7wJ8TTkRGM9cWw1h9IfsNQKsw8oOLzFEEhOnoTnRq1k7fYuCLczYGIsOoRjS3w7usgpNdvDuOS_Rs Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:39.781183 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d842c0020f644e2bce2bd682296730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d842c0020f644e2bce2bd682296730c"}]}] Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f505b3859a6841768f8b5d5e1a7bf917 Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'image_id': 'c44ddc9a-f638-47ae-bb97-2df02246f33a'} Oct 04 11:02:39.782780 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.783622 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c44ddc9a-f638-47ae-bb97-2df02246f33a Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.785071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c44ddc9a-f638-47ae-bb97-2df02246f33a could not be found. Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:02:39.787719 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.789489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f4a8469-defc-4d87-8dc7-9dc3e551bc4a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:39.790869 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f4a8469-defc-4d87-8dc7-9dc3e551bc4a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] 10.222.0.23 "GET /compute/v2.1/images/c44ddc9a-f638-47ae-bb97-2df02246f33a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.028940 Oct 04 11:02:39.790869 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 452/910] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:02:39 2022] GET /compute/v2.1/images/c44ddc9a-f638-47ae-bb97-2df02246f33a/metadata => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:39.793426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5db7c262-8f93-4e56-a21d-ba04bc01d37a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Action: 'update_all', calling method: .version_select at 0x7f71d4927940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:39.816915 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-5db7c262-8f93-4e56-a21d-ba04bc01d37a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] HTTP exception thrown: Image not found. Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5db7c262-8f93-4e56-a21d-ba04bc01d37a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Request method failure captured: Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: request: PUT /compute/v2.1/images/9e383f5e-d77f-41c7-a4fc-150b8ee4a4bc/metadata HTTP/1.1 Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 57 Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBLP0YMQaXAOBOVdhnlQ4n2jWXNSQl-Am_vtLTgmsGw-Xg8wZkzALdatRQdE_frYmnN3vMy6Wr04ZrUMNvutC9f3wbyAxD78Wq7wJ8TTkRGM9cWw1h9IfsNQKsw8oOLzFEEhOnoTnRq1k7fYuCLczYGIsOoRjS3w7usgpNdvDuOS_Rs Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:39.819026 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d842c0020f644e2bce2bd682296730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d842c0020f644e2bce2bd682296730c"}]}] Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: f505b3859a6841768f8b5d5e1a7bf917 Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:02:39.820456 n-d-791135-8 devstack@n-api.service[122408]: exception: Image not found. Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'image_id': '9e383f5e-d77f-41c7-a4fc-150b8ee4a4bc', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.821249 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9e383f5e-d77f-41c7-a4fc-150b8ee4a4bc Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.822777 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9e383f5e-d77f-41c7-a4fc-150b8ee4a4bc could not be found. Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:39.824904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:02:39.826492 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.828150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5db7c262-8f93-4e56-a21d-ba04bc01d37a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:39.828150 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5db7c262-8f93-4e56-a21d-ba04bc01d37a tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] 10.222.0.23 "PUT /compute/v2.1/images/9e383f5e-d77f-41c7-a4fc-150b8ee4a4bc/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031447 Oct 04 11:02:39.828150 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 459/911] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:02:39 2022] PUT /compute/v2.1/images/9e383f5e-d77f-41c7-a4fc-150b8ee4a4bc/metadata => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:39.831368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73968885-29c9-4dac-921d-5a2670e1b391 tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Action: 'update', calling method: .version_select at 0x7f71d4591a60>, body: {"meta": {"os_distro": "alt"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:39.855661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-73968885-29c9-4dac-921d-5a2670e1b391 tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] HTTP exception thrown: Image not found. Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73968885-29c9-4dac-921d-5a2670e1b391 tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Request method failure captured: Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/images/6fce80d9-ecb6-4700-9ba4-82491661b8c3/metadata/os_distro HTTP/1.1 Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 30 Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBLP0YMQaXAOBOVdhnlQ4n2jWXNSQl-Am_vtLTgmsGw-Xg8wZkzALdatRQdE_frYmnN3vMy6Wr04ZrUMNvutC9f3wbyAxD78Wq7wJ8TTkRGM9cWw1h9IfsNQKsw8oOLzFEEhOnoTnRq1k7fYuCLczYGIsOoRjS3w7usgpNdvDuOS_Rs Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:39.857767 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d842c0020f644e2bce2bd682296730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d842c0020f644e2bce2bd682296730c"}]}] Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f505b3859a6841768f8b5d5e1a7bf917 Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: {"meta": {"os_distro": "alt"}} Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:02:39.859090 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'image_id': '6fce80d9-ecb6-4700-9ba4-82491661b8c3', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.860019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6fce80d9-ecb6-4700-9ba4-82491661b8c3 Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.861172 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6fce80d9-ecb6-4700-9ba4-82491661b8c3 could not be found. Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:39.862458 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:02:39.864041 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.865923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73968885-29c9-4dac-921d-5a2670e1b391 tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:39.865923 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73968885-29c9-4dac-921d-5a2670e1b391 tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] 10.222.0.23 "PUT /compute/v2.1/images/6fce80d9-ecb6-4700-9ba4-82491661b8c3/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.031822 Oct 04 11:02:39.865923 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 453/912] 10.222.0.23 () {60 vars in 1310 bytes} [Tue Oct 4 11:02:39 2022] PUT /compute/v2.1/images/6fce80d9-ecb6-4700-9ba4-82491661b8c3/metadata/os_distro => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:39.870585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53cb808c-23a4-4c0e-bfda-42366bd69eef tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Action: 'create', calling method: .version_select at 0x7f71d4a43af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:39.893433 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-53cb808c-23a4-4c0e-bfda-42366bd69eef tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] HTTP exception thrown: Image not found. Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53cb808c-23a4-4c0e-bfda-42366bd69eef tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Request method failure captured: Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/images/fe1c0e64-ba03-45a5-87a1-40c2be25a8f3/metadata HTTP/1.1 Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 57 Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBLP0YMQaXAOBOVdhnlQ4n2jWXNSQl-Am_vtLTgmsGw-Xg8wZkzALdatRQdE_frYmnN3vMy6Wr04ZrUMNvutC9f3wbyAxD78Wq7wJ8TTkRGM9cWw1h9IfsNQKsw8oOLzFEEhOnoTnRq1k7fYuCLczYGIsOoRjS3w7usgpNdvDuOS_Rs Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:39.895615 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3d842c0020f644e2bce2bd682296730c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3d842c0020f644e2bce2bd682296730c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3d842c0020f644e2bce2bd682296730c"}]}] Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3d842c0020f644e2bce2bd682296730c Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964 Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: f505b3859a6841768f8b5d5e1a7bf917 Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1347763964-project Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: exception: Image not found. Oct 04 11:02:39.897569 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'image_id': 'fe1c0e64-ba03-45a5-87a1-40c2be25a8f3', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.898854 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fe1c0e64-ba03-45a5-87a1-40c2be25a8f3 Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:39.899933 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe1c0e64-ba03-45a5-87a1-40c2be25a8f3 could not be found. Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:39.902971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:02:39.904460 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:39.906759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53cb808c-23a4-4c0e-bfda-42366bd69eef tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:39.906759 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53cb808c-23a4-4c0e-bfda-42366bd69eef tempest-ImagesMetadataNegativeTestJSON-1347763964 tempest-ImagesMetadataNegativeTestJSON-1347763964-project] 10.222.0.23 "POST /compute/v2.1/images/fe1c0e64-ba03-45a5-87a1-40c2be25a8f3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030603 Oct 04 11:02:39.906759 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 460/913] 10.222.0.23 () {60 vars in 1281 bytes} [Tue Oct 4 11:02:39 2022] POST /compute/v2.1/images/fe1c0e64-ba03-45a5-87a1-40c2be25a8f3/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:39.937510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:39.940442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:39.948135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.948771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.949271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.950203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:39.950935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:39.951358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:39.984329 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0de1fea-34b6-4d57-a70a-67042c6d126e tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052884 Oct 04 11:02:39.985280 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 454/914] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:02:39 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:02:40.019926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1778770641", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:40.055785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:40.058565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:40.064503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.065080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.065542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.066241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.066697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.067127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.088183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] validate_networks() for [('41df1f22-b8b5-4c21-8eb3-7f794a2e7bb6', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:02:40.105773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2c53438e-fc9b-4f62-a4d8-ce772b52992b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053809 Oct 04 11:02:40.106346 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 455/915] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:02:40 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 11:02:40.177884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:40.178500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:40.185161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.185682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.186104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.187190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.187646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.188065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.214432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:02:40.297990 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6884cc14-67fa-433e-90ad-e76cea314b10 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "DELETE /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 204 len: 0 microversion: 2.1 time: 0.123477 Oct 04 11:02:40.298571 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 456/916] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:02:40 2022] DELETE /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:02:40.307723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:40.308625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:40.315650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.316129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.316619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.317333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.317816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.318236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.512991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:40.521291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:40.523053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:40.524401 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f50203c0-90c6-4135-b534-4d4b26ef3ba0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1411 microversion: 2.25 time: 0.224363 Oct 04 11:02:40.525172 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 457/917] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:40 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1411 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:40.530623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:40.531483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:40.537949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.538724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.539383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.540289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.540944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.542169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.630737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:40.639546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:40.641452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:40.647021 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95d44eff-e8c1-4a11-b0d1-3b0a1df03403 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.119919 Oct 04 11:02:40.647505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:40.648092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:40.648428 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 458/918] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:40 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:40.648771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:40.649293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:40.650092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:40.662634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.663223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.663847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.665096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.665829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.666434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.670849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:40.672753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:40.686198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.690116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.690823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.691456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Getting quotas for project 2070b5bd76a54fa6b3cbc9c9bee8500d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:40.694362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.695375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.695821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.696722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Getting quotas for user 3ae296c06e8e490db21812b28044533c and project 2070b5bd76a54fa6b3cbc9c9bee8500d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:40.710858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:02:40.714548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:02:40.772936 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb450b19-c936-4c8a-9f7d-685ae6190794 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.757965 Oct 04 11:02:40.774465 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 461/919] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:02:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:02:40.781686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:40.782732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:40.790238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.791046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.792111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.793393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:40.794112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:40.794635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:40.937546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:40.948769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b92adc1b-7235-49e6-9d39-5c337628c3a9 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1681 microversion: 2.1 time: 0.298839 Oct 04 11:02:40.950622 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 459/920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:40 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:40.955521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab8ef276-a641-49a3-b8b6-516d25e06cb7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:40.956241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab8ef276-a641-49a3-b8b6-516d25e06cb7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:40.981571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:41.000297 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b727aa73-32c6-445c-b646-2c3e6131856b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.223984 Oct 04 11:02:41.000580 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 462/921] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:40 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:41.023295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab8ef276-a641-49a3-b8b6-516d25e06cb7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:41.032280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab8ef276-a641-49a3-b8b6-516d25e06cb7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1225 microversion: 2.1 time: 0.080655 Oct 04 11:02:41.032875 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 460/922] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:40 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:41.570705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:41.573529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:41.579990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:41.580680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:41.581108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:41.582039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:41.582494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:41.583080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:41.680402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:41.681407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:41.698541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:41.703686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:41.704272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:41.705582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:41.705582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:41.706137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:41.763203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:41.771928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:41.773390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:41.775444 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c95f9abd-f703-4e9a-90d3-66715afd2ba1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1608 microversion: 2.25 time: 0.208698 Oct 04 11:02:41.776394 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 463/923] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:41 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1608 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:41.801236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:41.801945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:41.807603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:41.808480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:41.808965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:41.809780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:41.810676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:41.811807 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:41.812356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:41.816122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:41.817663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:41.823078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d52d0af5-734a-434c-95d0-66816b8dcee3 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.147706 Oct 04 11:02:41.823928 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 461/924] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:41 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:41.900218 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58c4922d-232a-477d-968a-ec38c4bc2f40 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.103162 Oct 04 11:02:41.901027 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 464/925] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Oct 4 11:02:41 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:02:41.973452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:41.975425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:41.984205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:41.985103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:41.985728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:41.986845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:41.987473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:41.988057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:42.029132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:42.030002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:42.038633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:42.039642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:42.040580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:42.042081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:42.042701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:42.043285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:42.632504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:42.642176 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-da9ef14a-1b3a-468b-94bf-99866c3cc0e5 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1681 microversion: 2.1 time: 0.672559 Oct 04 11:02:42.642898 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 462/926] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:41 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1681 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:42.651142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:42.660231 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bd08884-0e2a-4be5-80ee-0dd8e322b60b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.635375 Oct 04 11:02:42.660839 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 465/927] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:42 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:42.662626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:42.663244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:42.672916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:42.673774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:42.674742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:42.675695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:42.676377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:42.676866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:42.782049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:42.797475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78f235b1-8f5f-42dd-9d45-dc69453243c2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1283 microversion: 2.1 time: 0.144470 Oct 04 11:02:42.798287 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 463/928] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:42 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1283 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:42.851693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:42.852338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:42.858929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:42.859507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:42.860012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:42.860848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:42.861395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:42.861899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:42.965124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:42.977783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:42.979273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:42.996823 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0bf5428-f016-44d4-84d1-89ada603d30c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.149004 Oct 04 11:02:43.001304 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 466/929] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:42 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:43.257859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-144b97fc-f554-45ce-a8bd-b5cb917ebdfc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d46355e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:43.345023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a2f85655-b5ca-41e2-996f-9e105dc51062 req-f10de3b1-8d22-4f86-93d8-066613aec561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687c5af7-ef65-4b00-b6bc-86192e25ef26", "name": "network-vif-deleted", "tag": "171d8e8d-ec59-4e9f-a567-2899ab792976"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:43.346427 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-144b97fc-f554-45ce-a8bd-b5cb917ebdfc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/8d8badee-f820-47bf-a601-db37d72e6c9f" status: 200 len: 662 microversion: 2.1 time: 0.093762 Oct 04 11:02:43.347563 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 464/930] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:02:43 2022] GET /compute/v2.1/images/8d8badee-f820-47bf-a601-db37d72e6c9f => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:43.365054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a2f85655-b5ca-41e2-996f-9e105dc51062 req-f10de3b1-8d22-4f86-93d8-066613aec561 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.365595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a2f85655-b5ca-41e2-996f-9e105dc51062 req-f10de3b1-8d22-4f86-93d8-066613aec561 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.366203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a2f85655-b5ca-41e2-996f-9e105dc51062 req-f10de3b1-8d22-4f86-93d8-066613aec561 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:43.368604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-220346ec-3b87-4ef1-8293-6eb801356276 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d45805e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:43.384174 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a2f85655-b5ca-41e2-996f-9e105dc51062 req-f10de3b1-8d22-4f86-93d8-066613aec561 service nova] Creating event network-vif-deleted:171d8e8d-ec59-4e9f-a567-2899ab792976 for instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 on n-h1-791135-8 Oct 04 11:02:43.390969 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a2f85655-b5ca-41e2-996f-9e105dc51062 req-f10de3b1-8d22-4f86-93d8-066613aec561 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049558 Oct 04 11:02:43.391819 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 467/931] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:02:43.440083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-220346ec-3b87-4ef1-8293-6eb801356276 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/8d8badee-f820-47bf-a601-db37d72e6c9f" status: 200 len: 662 microversion: 2.1 time: 0.082370 Oct 04 11:02:43.440810 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 465/932] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:02:43 2022] GET /compute/v2.1/images/8d8badee-f820-47bf-a601-db37d72e6c9f => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:43.620116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b2965004-3a8e-4302-bc93-6a476f2088f1 req-eb441f7d-c82b-4e33-aa56-9ef86ed407af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5813e7a4-1b03-438c-bf70-c2b544030ce4", "tag": "b429cae8-ebcb-4a50-988d-0ebd70deba67"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:43.632602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b2965004-3a8e-4302-bc93-6a476f2088f1 req-eb441f7d-c82b-4e33-aa56-9ef86ed407af service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.633407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b2965004-3a8e-4302-bc93-6a476f2088f1 req-eb441f7d-c82b-4e33-aa56-9ef86ed407af service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.634002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b2965004-3a8e-4302-bc93-6a476f2088f1 req-eb441f7d-c82b-4e33-aa56-9ef86ed407af service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:43.646659 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b2965004-3a8e-4302-bc93-6a476f2088f1 req-eb441f7d-c82b-4e33-aa56-9ef86ed407af service nova] Creating event network-changed:b429cae8-ebcb-4a50-988d-0ebd70deba67 for instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 on n-h2-791135-8 Oct 04 11:02:43.653104 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b2965004-3a8e-4302-bc93-6a476f2088f1 req-eb441f7d-c82b-4e33-aa56-9ef86ed407af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037485 Oct 04 11:02:43.659700 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 468/933] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:43.666679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:43.667536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:43.673976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.674842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.675608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:43.676539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.677272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.677912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:43.686976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:43.688102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:43.714227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.718742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.719505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:43.720757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.721469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.723569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:43.740310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.740819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.741248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:43.741931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lazy-loading 'fault' on Instance uuid 687c5af7-ef65-4b00-b6bc-86192e25ef26 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:02:43.811516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e699a1c3f4b7a907981fe37bf7e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d8efa3fb034270bb0e8c6419da5a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:43.815371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:43.824842 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5ffcd08-08fd-49e5-8f9b-37f2770be8bb tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 200 len: 1331 microversion: 2.1 time: 0.162517 Oct 04 11:02:43.830911 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 466/934] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:43 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:43.835888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:43.843722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:43.864581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.865078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.865578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:43.866292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:43.866748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:43.867172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:44.089188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:44.102573 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b382845e-77dd-45a2-8284-78579b65db9b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.421520 Oct 04 11:02:44.104280 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 469/935] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:43 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:44.111620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:44.112505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:44.121546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:44.122320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:44.123609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:44.125466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:44.126138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:44.127183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:44.228198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:44.238277 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8f70a13-8c14-4ac0-8d08-519c18988a76 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1325 microversion: 2.1 time: 0.405997 Oct 04 11:02:44.242566 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 467/936] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:43 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:44.272961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:44.284381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:44.288470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:44.300719 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf6baf17-cada-422a-a74e-1cd70c44092d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.195137 Oct 04 11:02:44.301462 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 470/937] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:44 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:44.851399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:44.852697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:44.862690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:44.863382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:44.864002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:44.864904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:44.865693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:44.866284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:44.886859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] HTTP exception thrown: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Request method failure captured: Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 HTTP/1.1 Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIwhY4CxvQ5eCk05nErDPB7rbfZueQftVkA2frGySef628Abei5iDxY9mgtQl6WJBVkDBfXztUHZVbNJwpYspU-MTb6TXciphu5iyHb_8OkJGyDSfJnmimirnkfXq90OK2vHU2LBHUShC7A-ITdwAarYro2Sh21E6HSMn-ydouGCyA Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c6d8efa3fb034270bb0e8c6419da5a4c Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:44.888550 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6d8efa3fb034270bb0e8c6419da5a4c"}]}] Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c6d8efa3fb034270bb0e8c6419da5a4c Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachSCSIVolumeTestJSON-1675105268-project Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 581e699a1c3f4b7a907981fe37bf7e6c Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1675105268-project Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:44.890233 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '687c5af7-ef65-4b00-b6bc-86192e25ef26'} Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:44.891056 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:44.892255 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:44.894771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Returning 404 to user: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:44.894771 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-60fcfc9d-6694-4be3-9e20-32ba1e7dab8b tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 404 len: 111 microversion: 2.1 time: 0.042435 Oct 04 11:02:44.894771 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 468/938] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:44 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:02:44.900208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c558ff3-6ee9-4fa3-9557-91503de74f01 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '.version_select at 0x7f71d488ed30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:44.912572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-463e6355-5648-40a6-8f66-6c998f8cef2d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4502c10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:44.923981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:44.934263 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c558ff3-6ee9-4fa3-9557-91503de74f01 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337561591" status: 202 len: 0 microversion: 2.1 time: 0.037452 Oct 04 11:02:44.934880 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 471/939] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:02:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337561591 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:02:44.970799 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-463e6355-5648-40a6-8f66-6c998f8cef2d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/84a67a42-7ec5-47e4-8ba1-4e171439a354" status: 200 len: 662 microversion: 2.1 time: 0.062782 Oct 04 11:02:44.973503 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 469/940] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:02:44 2022] GET /compute/v2.1/images/84a67a42-7ec5-47e4-8ba1-4e171439a354 => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:44.989905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac627477-2795-445f-a931-bf9468151cfc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4ba6670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:45.058039 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac627477-2795-445f-a931-bf9468151cfc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/84a67a42-7ec5-47e4-8ba1-4e171439a354" status: 200 len: 662 microversion: 2.1 time: 0.076310 Oct 04 11:02:45.059173 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 472/941] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:02:44 2022] GET /compute/v2.1/images/84a67a42-7ec5-47e4-8ba1-4e171439a354 => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:45.130910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:45.131669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:45.139790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:45.140297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:45.140910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:45.142122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:45.142774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:45.143369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:45.267841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:45.268647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:45.277551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:45.279033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:45.280243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:45.281541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:45.282572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:45.283246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:45.534001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:45.547517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3073c2b5-56ba-4acd-937e-44434d02cc15 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.420951 Oct 04 11:02:45.548648 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 470/942] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:45 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:45.556653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:45.557883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:45.564303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:45.564727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:45.565316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:45.566073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:45.566537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:45.566972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:45.596532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:45.605032 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ebcc88f-31d6-44bc-af10-96547a709150 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1325 microversion: 2.1 time: 0.343185 Oct 04 11:02:45.605644 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 473/943] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:45 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:45.611129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a246a084-9c27-46b6-811d-d1b9f899ee64 req-908cb735-ffeb-47c1-8497-62cc90a22f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc83d7b6-ee89-4d05-a410-0522214854fd", "tag": "97ab77f5-bde3-4735-befc-ba424622a42c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:45.623796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a246a084-9c27-46b6-811d-d1b9f899ee64 req-908cb735-ffeb-47c1-8497-62cc90a22f97 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:45.624444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a246a084-9c27-46b6-811d-d1b9f899ee64 req-908cb735-ffeb-47c1-8497-62cc90a22f97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:45.625090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a246a084-9c27-46b6-811d-d1b9f899ee64 req-908cb735-ffeb-47c1-8497-62cc90a22f97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:45.636942 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a246a084-9c27-46b6-811d-d1b9f899ee64 req-908cb735-ffeb-47c1-8497-62cc90a22f97 service nova] Creating event network-changed:97ab77f5-bde3-4735-befc-ba424622a42c for instance cc83d7b6-ee89-4d05-a410-0522214854fd on n-h1-791135-8 Oct 04 11:02:45.642521 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a246a084-9c27-46b6-811d-d1b9f899ee64 req-908cb735-ffeb-47c1-8497-62cc90a22f97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035422 Oct 04 11:02:45.643431 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 474/944] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:45.651061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:45.660774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:45.662408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:45.667991 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b9430c2-a01a-4694-9cac-3573c7505f7c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.118169 Oct 04 11:02:45.668823 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 471/945] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:45 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:46.433722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c889064b-ab51-44ee-93af-726e36436b2f tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4c4d1f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:46.488371 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c889064b-ab51-44ee-93af-726e36436b2f tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/4b3bbafa-aa8f-4a4f-867a-e6b779240569" status: 200 len: 661 microversion: 2.1 time: 0.058829 Oct 04 11:02:46.490431 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 475/946] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:02:46 2022] GET /compute/v2.1/images/4b3bbafa-aa8f-4a4f-867a-e6b779240569 => generated 661 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:46.503984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-afa1745a-6452-4d87-be43-d59ef5f36b88 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d45e5700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:46.549719 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-afa1745a-6452-4d87-be43-d59ef5f36b88 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/4b3bbafa-aa8f-4a4f-867a-e6b779240569" status: 200 len: 661 microversion: 2.1 time: 0.050198 Oct 04 11:02:46.550327 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 472/947] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:02:46 2022] GET /compute/v2.1/images/4b3bbafa-aa8f-4a4f-867a-e6b779240569 => generated 661 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:46.572651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:46.573297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:46.579791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:46.580273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:46.580697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:46.581610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:46.582061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:46.582481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:46.598821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:46.606224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-694907430", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:46.660967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:02:46.791712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:46.803530 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aca392f2-d29d-48e1-9989-40e3fbd149fe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.235292 Oct 04 11:02:46.821260 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 476/948] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:46 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:46.827984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:46.828634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:46.837185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:46.837721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:46.846002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:46.847079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:46.847879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:46.848592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:46.920307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:46.920794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:46.921556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:46.922311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:46.922931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:46.932177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:46.933109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:46.933798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:46.934787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:46.935478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:46.936091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:46.954986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Getting quotas for project 8436fc8200e24cfba225f7509d1e8362. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:46.959445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Getting quotas for user 29d1012a243d4941897d32e0b2856e63 and project 8436fc8200e24cfba225f7509d1e8362. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:46.972360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:02:46.975532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:02:47.027026 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4de057b7-88c4-4710-8018-40eac75c5c79 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.426503 Oct 04 11:02:47.029419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:47.029654 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 473/949] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:02:47.038012 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c29d2951-eacc-4a4f-b4e2-e59119a7c6c9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1325 microversion: 2.1 time: 0.215295 Oct 04 11:02:47.039230 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 477/950] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:46 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:47.049672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:47.050296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:47.062503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:47.063005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:47.063441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:47.064223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:47.064683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:47.065112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:47.157019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1708796647", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:47.157769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:47.166034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:47.167494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:47.173730 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17ce49da-e1e4-4687-a86c-52e9e422e9a2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.142660 Oct 04 11:02:47.174356 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 474/951] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:47 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:47.229144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:02:47.486168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:02:47.486738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:02:47.486891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:02:47.487287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:02:47.487842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:02:47.497845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:47.499161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:47.499746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:47.500767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:47.501459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:47.502053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:47.523383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Getting quotas for project 8436fc8200e24cfba225f7509d1e8362. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:02:47.528123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Getting quotas for user 29d1012a243d4941897d32e0b2856e63 and project 8436fc8200e24cfba225f7509d1e8362. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:02:47.540905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:02:47.543446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:02:47.611140 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3787c42d-e7e6-4762-99e8-3dbc11c1bd76 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.458738 Oct 04 11:02:47.612211 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 478/952] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:02:47.625024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe49cc62-6f9e-4acb-88cf-d944aad59c66 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:47.626350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe49cc62-6f9e-4acb-88cf-d944aad59c66 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:47.711733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe49cc62-6f9e-4acb-88cf-d944aad59c66 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:47.725496 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe49cc62-6f9e-4acb-88cf-d944aad59c66 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1218 microversion: 2.1 time: 0.104360 Oct 04 11:02:47.727446 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 475/953] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:47 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:47.829127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:47.829767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:47.836194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:47.836678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:47.837108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:47.837846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:47.838308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:47.838726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:47.998909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:48.008625 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5463f171-e037-46a0-b0c9-806c069c0ae0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.183106 Oct 04 11:02:48.026559 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 479/954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:47 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:48.066050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:48.066695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:48.079651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:48.080215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:48.080707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:48.081455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:48.081925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:48.082355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:48.203802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:48.204675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:48.212130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:48.213840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:48.214571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:48.215555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:48.216123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:48.216770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:48.250057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:48.259027 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f944627-59ab-4f64-ab06-2c1705e303c5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1325 microversion: 2.1 time: 0.196845 Oct 04 11:02:48.259613 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 476/955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:48 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:48.295950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:48.304452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:48.305951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:48.310918 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d31a9ac2-3e82-4345-a3e4-ac89d98f29ac tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.111259 Oct 04 11:02:48.311492 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 480/956] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:48 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:48.750063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:48.751327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:48.759250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:48.768268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:48.768924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:48.769694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:48.770155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:48.770580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:48.856278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:48.864905 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-805c97c8-a050-4857-b856-58f4c87461ff tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1270 microversion: 2.1 time: 0.120373 Oct 04 11:02:48.865508 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 477/957] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:48 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:49.033607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:49.034216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:49.040610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.041306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.041933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.042636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.043354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.043784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.189567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:49.197231 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c41471eb-00ea-4dcd-a7bd-2999c360aede tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.167518 Oct 04 11:02:49.198141 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 481/958] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:49 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:49.283922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:49.285061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:49.295138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.296020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.296852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.297838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.298524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.299199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.340381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:49.341496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:49.349073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.349595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.350262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.350973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.351482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.352106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.437254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:49.464392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:49.466772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:49.475810 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-270382d0-4f4a-49cf-bac1-4a29c1c2c17b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.140470 Oct 04 11:02:49.477960 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 482/959] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:49 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:49.514550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:49.523546 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fca5cae0-04a2-47c1-8ddf-c1157d3b39b3 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1325 microversion: 2.1 time: 0.244759 Oct 04 11:02:49.524168 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 478/960] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:49 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:49.707349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:49.707838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:49.714313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.714789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.715209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.715895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.716341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.716759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.731019 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] HTTP exception thrown: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Request method failure captured: Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 HTTP/1.1 Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIwhY4CxvQ5eCk05nErDPB7rbfZueQftVkA2frGySef628Abei5iDxY9mgtQl6WJBVkDBfXztUHZVbNJwpYspU-MTb6TXciphu5iyHb_8OkJGyDSfJnmimirnkfXq90OK2vHU2LBHUShC7A-ITdwAarYro2Sh21E6HSMn-ydouGCyA Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: c6d8efa3fb034270bb0e8c6419da5a4c Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:49.732689 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6d8efa3fb034270bb0e8c6419da5a4c"}]}] Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: c6d8efa3fb034270bb0e8c6419da5a4c Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachSCSIVolumeTestJSON-1675105268-project Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 581e699a1c3f4b7a907981fe37bf7e6c Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1675105268-project Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.734116 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '687c5af7-ef65-4b00-b6bc-86192e25ef26'} Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:49.734860 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.736125 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.737338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Returning 404 to user: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:49.737338 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a08db117-b7f7-4126-9638-16946d004a80 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "DELETE /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 404 len: 111 microversion: 2.1 time: 0.030616 Oct 04 11:02:49.737338 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 483/961] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:02:49 2022] DELETE /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:02:49.742452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:49.743058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] [instance: 687c5af7-ef65-4b00-b6bc-86192e25ef26] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:49.749517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.750193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.751205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.752116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.753008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.753462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.767287 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] HTTP exception thrown: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Request method failure captured: Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 HTTP/1.1 Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIwhY4CxvQ5eCk05nErDPB7rbfZueQftVkA2frGySef628Abei5iDxY9mgtQl6WJBVkDBfXztUHZVbNJwpYspU-MTb6TXciphu5iyHb_8OkJGyDSfJnmimirnkfXq90OK2vHU2LBHUShC7A-ITdwAarYro2Sh21E6HSMn-ydouGCyA Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c6d8efa3fb034270bb0e8c6419da5a4c Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:02:49.769016 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6d8efa3fb034270bb0e8c6419da5a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6d8efa3fb034270bb0e8c6419da5a4c"}]}] Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c6d8efa3fb034270bb0e8c6419da5a4c Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1675105268 Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachSCSIVolumeTestJSON-1675105268-project Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 581e699a1c3f4b7a907981fe37bf7e6c Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1675105268-project Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.770732 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '687c5af7-ef65-4b00-b6bc-86192e25ef26'} Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:49.771646 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. Oct 04 11:02:49.773058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:02:49.775043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] Returning 404 to user: Instance 687c5af7-ef65-4b00-b6bc-86192e25ef26 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:49.776598 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b573f93-38a9-4c9c-9b95-b5c7562a9916 tempest-AttachSCSIVolumeTestJSON-1675105268 tempest-AttachSCSIVolumeTestJSON-1675105268-project] 10.222.0.23 "GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26" status: 404 len: 111 microversion: 2.1 time: 0.037918 Oct 04 11:02:49.777693 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 479/962] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:49 2022] GET /compute/v2.1/servers/687c5af7-ef65-4b00-b6bc-86192e25ef26 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:02:49.888955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:49.889610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:49.896138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.896625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.897046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.898752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:49.899423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:49.900053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:49.977453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:49.990892 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b994e1a-6aa8-43e8-b43f-1651d60fb221 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1270 microversion: 2.1 time: 0.106319 Oct 04 11:02:49.991775 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 484/963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:49 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:50.222331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:50.222954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:50.232349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:50.234215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:50.234855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:50.235839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:50.236527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:50.237608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:50.476117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:50.486285 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b703e13d-625f-437b-9fe4-33a35736d9a5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1542 microversion: 2.1 time: 0.268960 Oct 04 11:02:50.487558 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 480/964] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:50 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1542 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:50.506037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:50.506831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:50.518159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:50.518737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:50.519229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:50.520017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:50.521980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:50.522568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:50.547829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:50.548443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:50.572920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:50.573567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:50.574179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:50.575725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:50.576364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:50.576952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:50.727243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:50.736942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:50.743315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:50.762515 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c07b0a86-3076-487d-b40d-9bf9f90676e5 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.261496 Oct 04 11:02:50.763667 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 485/965] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:50 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:50.873526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:50.883282 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b94f3f9-880f-4596-902f-7637b657b30f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1325 microversion: 2.1 time: 0.339192 Oct 04 11:02:50.885087 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 481/966] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:50 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1325 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:51.016880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:51.017377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:51.024560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.024560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.024953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.025761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.026213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.027076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.115350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:51.123923 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdfe5bee-6565-48b7-bbda-2872bee45e39 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1276 microversion: 2.1 time: 0.110895 Oct 04 11:02:51.133831 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 486/967] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:51 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1276 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:51.513597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:51.514248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:51.520248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.520960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.521593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.522468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.522917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.523334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.746631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1a47f0b0-2e6a-49e0-ad8a-90d032023009 req-7c4167f4-bd6d-4787-8f47-925ec8d14fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59b04194-7767-4636-9ed0-3869ff18e425", "tag": "c9b6f444-374d-48a3-a78e-32dff234e6dd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:51.770518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a47f0b0-2e6a-49e0-ad8a-90d032023009 req-7c4167f4-bd6d-4787-8f47-925ec8d14fd7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.771344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a47f0b0-2e6a-49e0-ad8a-90d032023009 req-7c4167f4-bd6d-4787-8f47-925ec8d14fd7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.774151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a47f0b0-2e6a-49e0-ad8a-90d032023009 req-7c4167f4-bd6d-4787-8f47-925ec8d14fd7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.777119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:51.800503 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17a23a11-5f37-40a8-9204-f5cfe539bb5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1541 microversion: 2.1 time: 0.291480 Oct 04 11:02:51.802129 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 482/968] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:51 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1541 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:51.814378 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1a47f0b0-2e6a-49e0-ad8a-90d032023009 req-7c4167f4-bd6d-4787-8f47-925ec8d14fd7 service nova] Creating event network-changed:c9b6f444-374d-48a3-a78e-32dff234e6dd for instance 59b04194-7767-4636-9ed0-3869ff18e425 on n-h1-791135-8 Oct 04 11:02:51.822145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:51.826079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:51.830718 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1a47f0b0-2e6a-49e0-ad8a-90d032023009 req-7c4167f4-bd6d-4787-8f47-925ec8d14fd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089577 Oct 04 11:02:51.832181 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 487/969] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:51.833047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:51.835432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.835956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.836406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.837108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.837697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.838327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.909217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:51.910925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:51.919371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.920177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.921922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.922975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:51.923527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:51.924183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:51.926170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:51.944618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:51.947025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:51.954497 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af084820-63ad-4c4a-887d-02ffeeb3b78b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.150930 Oct 04 11:02:51.955545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 483/970] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:51 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:51.988062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4339285e-57ba-427e-b1ef-edf584a2de44 req-5cd1771d-1547-4a31-a459-f212a26bb2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc83d7b6-ee89-4d05-a410-0522214854fd", "name": "network-vif-plugged", "status": "completed", "tag": "97ab77f5-bde3-4735-befc-ba424622a42c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:52.003599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4339285e-57ba-427e-b1ef-edf584a2de44 req-5cd1771d-1547-4a31-a459-f212a26bb2db service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:52.004286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4339285e-57ba-427e-b1ef-edf584a2de44 req-5cd1771d-1547-4a31-a459-f212a26bb2db service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:52.005101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4339285e-57ba-427e-b1ef-edf584a2de44 req-5cd1771d-1547-4a31-a459-f212a26bb2db service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:52.023482 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4339285e-57ba-427e-b1ef-edf584a2de44 req-5cd1771d-1547-4a31-a459-f212a26bb2db service nova] Creating event network-vif-plugged:97ab77f5-bde3-4735-befc-ba424622a42c for instance cc83d7b6-ee89-4d05-a410-0522214854fd on n-h1-791135-8 Oct 04 11:02:52.035726 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4339285e-57ba-427e-b1ef-edf584a2de44 req-5cd1771d-1547-4a31-a459-f212a26bb2db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051905 Oct 04 11:02:52.037433 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 484/971] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:02:52.148695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:52.150386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:52.160515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:52.160968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:52.162125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:52.163082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:52.164559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:52.165380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:52.176424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:52.184870 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df98db05-172f-4403-9511-c2324e2130a9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1325 microversion: 2.1 time: 0.281154 Oct 04 11:02:52.185730 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 488/972] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:51 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1325 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:52.257655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:52.268670 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ccf9a18-db40-4aed-a605-d140b5de1aef tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1276 microversion: 2.1 time: 0.123205 Oct 04 11:02:52.276836 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 485/973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:52 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:52.832272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:52.832821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:52.839501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:52.839990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:52.840424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:52.841339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:52.841838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:52.842258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:52.989869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:52.990470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:52.991605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:52.997844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:52.998322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:52.999070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:52.999781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:53.000232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:53.000348 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34847c67-c5c9-4e42-a680-152aa56da922 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1541 microversion: 2.1 time: 0.172132 Oct 04 11:02:53.000645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:53.000962 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 489/974] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:52 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1541 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:53.071085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:53.080610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:53.082211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:53.087608 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-261d454f-54e1-4cd5-a05d-2e90587bf7b1 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.101946 Oct 04 11:02:53.088709 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 486/975] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:52 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:53.207873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:53.208901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:53.215617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:53.216092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:53.216519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:53.217205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:53.217849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:53.218273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:53.299966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:53.301165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:53.309758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:53.310443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:53.311040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:53.311746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:53.312195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:53.312846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:53.387539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:53.412900 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc7ce1d7-b456-4ebe-a254-158e0fc9c98b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1325 microversion: 2.1 time: 0.208733 Oct 04 11:02:53.414273 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 490/976] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:53 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:53.581736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:53.591349 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77828764-8c2e-4091-a608-7f907b9e0113 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.301240 Oct 04 11:02:53.592725 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 487/977] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:53 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:53.905638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9eeafa21-a88a-460c-86cc-8c701bcbe9b2 req-07b3b486-78fe-4928-b69c-667215eaffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "name": "network-vif-unplugged", "status": "completed", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}, {"name": "network-changed", "server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:53.915136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9eeafa21-a88a-460c-86cc-8c701bcbe9b2 req-07b3b486-78fe-4928-b69c-667215eaffb5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:53.915611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9eeafa21-a88a-460c-86cc-8c701bcbe9b2 req-07b3b486-78fe-4928-b69c-667215eaffb5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:53.916059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9eeafa21-a88a-460c-86cc-8c701bcbe9b2 req-07b3b486-78fe-4928-b69c-667215eaffb5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:53.929119 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9eeafa21-a88a-460c-86cc-8c701bcbe9b2 req-07b3b486-78fe-4928-b69c-667215eaffb5 service nova] Creating event network-vif-unplugged:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h2-791135-8 Oct 04 11:02:53.929655 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9eeafa21-a88a-460c-86cc-8c701bcbe9b2 req-07b3b486-78fe-4928-b69c-667215eaffb5 service nova] Creating event network-changed:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h2-791135-8 Oct 04 11:02:53.935056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-9eeafa21-a88a-460c-86cc-8c701bcbe9b2 req-07b3b486-78fe-4928-b69c-667215eaffb5 service nova] Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:02:53.959444 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9eeafa21-a88a-460c-86cc-8c701bcbe9b2 req-07b3b486-78fe-4928-b69c-667215eaffb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.057430 Oct 04 11:02:53.960230 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 491/978] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:54.023986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:54.025214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:54.032232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.032725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.033186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.034091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.034547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.034969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.118047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:54.119560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:54.126200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.126939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.127682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.128723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.129179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.129665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.187992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:54.195972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2eceb877-e710-4647-bea9-03a79461ef6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1541 microversion: 2.1 time: 0.175861 Oct 04 11:02:54.196763 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 488/979] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:54 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:54.214327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:54.223898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:54.226024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:54.231138 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6beb6903-0c51-48a8-902b-f93610cbe63b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.118962 Oct 04 11:02:54.231722 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 492/980] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:54 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:54.509341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:54.509969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:54.519723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.520236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.520675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.523148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.523148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.523148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.531656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:54.617335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:54.619423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:54.644419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.644932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.646977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.648975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.654437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.655095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.808338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:54.819315 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24aa6060-77ba-4e6a-bed8-e8c941b27e6d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1520 microversion: 2.1 time: 0.313745 Oct 04 11:02:54.820501 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 489/981] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:54 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:54.848041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:54.848974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:54.855570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.856062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.856700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.857486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:54.857951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:54.858379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:54.924831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:54.933092 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb81a9f8-5cfd-4ed5-9ef3-3b8328bfb4d2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.321747 Oct 04 11:02:54.933734 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 493/982] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:54 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:55.106743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:55.120322 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4865f651-3c4d-414c-bb86-2c2f3c0c8a0e tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1520 microversion: 2.1 time: 0.276984 Oct 04 11:02:55.121234 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 490/983] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:54 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:55.151699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1672455365"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:55.155030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:55.162643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.163612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.164464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.165328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.166062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.167169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.219717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:55.220336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:55.235276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.236041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.236479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.237178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.237672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.238098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.429904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:55.463980 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b50d2a1b-04ca-4b63-9238-64d243df437a tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd/action" status: 202 len: 0 microversion: 2.1 time: 0.319347 Oct 04 11:02:55.471561 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 494/984] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:02:55 2022] POST /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:02:55.480499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:55.481702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:55.489694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.490587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.491307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.492353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.494504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.495530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.539285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:55.550092 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-598707ad-db6d-4789-957b-542af653019c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1473 microversion: 2.1 time: 0.334079 Oct 04 11:02:55.551024 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 491/985] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:55 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1473 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:55.557529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8684852-a6fb-4b70-84c3-fc44f5056785 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '.version_select at 0x7f71d4629790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:55.602496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:55.623361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:55.625305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:55.651695 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc983213-b472-40d3-8592-baeaa2b6b561 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.178729 Oct 04 11:02:55.653857 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 495/986] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:55 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:55.775971 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8684852-a6fb-4b70-84c3-fc44f5056785 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/images/e8c45dfa-af5a-4a7f-8541-dbccec946d39" status: 204 len: 0 microversion: 2.1 time: 0.223543 Oct 04 11:02:55.776561 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 492/987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:55 2022] DELETE /compute/v2.1/images/e8c45dfa-af5a-4a7f-8541-dbccec946d39 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:02:55.788036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6aef5281-86a9-4cb3-9676-133f38b6743d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '.version_select at 0x7f71d4c8fee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:55.812590 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6aef5281-86a9-4cb3-9676-133f38b6743d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Image not found. Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6aef5281-86a9-4cb3-9676-133f38b6743d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/images/e8c45dfa-af5a-4a7f-8541-dbccec946d39 HTTP/1.1 Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:02:55.816374 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: exception: Image not found. Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'e8c45dfa-af5a-4a7f-8541-dbccec946d39'} Oct 04 11:02:55.817909 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:55.818782 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e8c45dfa-af5a-4a7f-8541-dbccec946d39 Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:02:55.821081 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8c45dfa-af5a-4a7f-8541-dbccec946d39 could not be found. Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:02:55.824586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:02:55.827157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6aef5281-86a9-4cb3-9676-133f38b6743d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Image not found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:02:55.830784 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6aef5281-86a9-4cb3-9676-133f38b6743d tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/images/e8c45dfa-af5a-4a7f-8541-dbccec946d39" status: 404 len: 62 microversion: 2.1 time: 0.035484 Oct 04 11:02:55.830784 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 496/988] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:02:55 2022] GET /compute/v2.1/images/e8c45dfa-af5a-4a7f-8541-dbccec946d39 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:02:55.831338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:55.832303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:55.839822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.841100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.841826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.842842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.843534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.844341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.960031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:55.961526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:55.972127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.977290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:55.983962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:55.990112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:55.993145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:56.002877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:56.076059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:56.084294 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0a94f580-fa10-46e6-8a2e-e8c12fc2f9f7 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1532 microversion: 2.1 time: 0.258558 Oct 04 11:02:56.084871 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 493/989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:55 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1532 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:56.171650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:56.179506 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2735c024-8ae0-4a5a-8feb-a47034aaadf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.225644 Oct 04 11:02:56.180077 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 497/990] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:55 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:56.579257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:56.580015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:56.586682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:56.587242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:56.587744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:56.588523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:56.589042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:56.589564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:56.684948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:56.685899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:56.693180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:56.694171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:56.694680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:56.695454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:56.695905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:56.696555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:56.720660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:56.729546 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8dea19d7-936e-48f2-8cb1-6eafbae60418 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1473 microversion: 2.1 time: 0.154140 Oct 04 11:02:56.730265 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 494/991] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:56 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1473 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:56.766307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:56.774918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:56.776532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:56.782282 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53215bd6-ffe1-4569-902d-a4c295b6d50d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.101915 Oct 04 11:02:56.791325 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 498/992] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:56 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:56.880990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-02b8066b-eda2-444d-903b-c69f6f68ddad req-c69e012a-a8fe-4a63-b8d8-22cfe069f974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e63ee3-3a6c-446a-b69b-eb8e79ad477a", "tag": "6aeb5add-c4a0-4408-aa02-652effd838a2"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:02:56.891200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02b8066b-eda2-444d-903b-c69f6f68ddad req-c69e012a-a8fe-4a63-b8d8-22cfe069f974 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:56.891683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02b8066b-eda2-444d-903b-c69f6f68ddad req-c69e012a-a8fe-4a63-b8d8-22cfe069f974 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:56.892143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02b8066b-eda2-444d-903b-c69f6f68ddad req-c69e012a-a8fe-4a63-b8d8-22cfe069f974 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:56.903753 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-02b8066b-eda2-444d-903b-c69f6f68ddad req-c69e012a-a8fe-4a63-b8d8-22cfe069f974 service nova] Creating event network-changed:6aeb5add-c4a0-4408-aa02-652effd838a2 for instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a on n-h1-791135-8 Oct 04 11:02:56.908534 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-02b8066b-eda2-444d-903b-c69f6f68ddad req-c69e012a-a8fe-4a63-b8d8-22cfe069f974 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032425 Oct 04 11:02:56.909145 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 495/993] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:02:57.108824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:57.109406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:57.115543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:57.116033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:57.116461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:57.117163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:57.117636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:57.118062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:57.203842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:57.204764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:57.207083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:57.216818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:57.217718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:57.218376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:57.219344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:57.220041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:57.221192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:57.257053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:57.265245 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76ebf75e-117b-4056-99f6-1e401f469e4b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1538 microversion: 2.1 time: 0.160392 Oct 04 11:02:57.265868 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 499/994] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:57 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1538 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:57.357289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:57.365285 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ef6960c-1a21-4f1a-a95b-b8681de05169 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.166711 Oct 04 11:02:57.366178 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 496/995] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:57 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:57.754437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:57.755059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:57.758314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:57.759566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=16 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:57.767632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:57.768624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:57.769066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:57.769809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:57.770709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:57.771140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:57.817328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:57.819182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:57.828321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:02:57.830608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:57.831949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:57.832562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:57.834790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:57.835014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:57.835474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:57.943863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:57.958836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:57.962309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:57.971080 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b60b299-e12b-42e3-8e9e-9ee1f82d3011 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.162058 Oct 04 11:02:57.971959 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 497/996] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:57 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:02:57.978891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:57.995027 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ae2f2a2-08c8-4085-9a9b-28b9e14e8659 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1473 microversion: 2.1 time: 0.246045 Oct 04 11:02:57.995829 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 500/997] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:57 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1473 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:58.289420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:58.290272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:58.297694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:58.298175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:58.298780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:58.299475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:58.299924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:58.300345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:58.388205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:58.388811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:58.396854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:58.397391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:58.397829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:58.398798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:58.398975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:58.401544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:58.477831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:58.486434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cca9f3e9-b28a-49cf-b1cf-f7ad18a63046 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1538 microversion: 2.1 time: 0.200870 Oct 04 11:02:58.487152 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 498/998] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:58 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1538 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:58.552877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:58.564028 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3c20cde-1ad3-4980-900c-263ad1a90a63 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.179424 Oct 04 11:02:58.564795 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 501/999] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:58 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:59.001632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:59.002270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:59.017940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:59.018594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:59.022025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.022621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.030024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.032790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.033292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.033757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.034468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.034924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.035348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.039811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.040717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.041463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.143186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:59.157788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:59.159677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:59.173581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-87afee2d-2e91-4296-8707-47df626caad4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.175728 Oct 04 11:02:59.177787 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 499/1000] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:02:58 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:02:59.287292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:59.298326 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b661a82d-6529-47ec-871d-bd79af4916ea tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1473 microversion: 2.1 time: 0.284695 Oct 04 11:02:59.299949 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 502/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:59 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:59.510110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:59.510889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:59.526433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.527509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.528223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.529414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.530033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.530626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.588232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:59.589624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:59.596702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.597259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.597810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.598708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.599224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.599992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.720482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:59.734706 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-477b7aa7-9791-41f9-9f5b-5246fc814e63 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1520 microversion: 2.1 time: 0.228606 Oct 04 11:02:59.736557 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 500/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:59 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:02:59.758409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:59.759152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:59.765580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.766304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.766901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.767761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.768387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.768965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.772061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:02:59.794318 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e98a058-3dc0-4c10-b27c-624807e264c7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.209985 Oct 04 11:02:59.795349 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 503/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:59 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:02:59.797426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:02:59.884039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6538f12c-be1d-4621-b3b5-9890ffbc6ea6 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 204 len: 0 microversion: 2.1 time: 0.129294 Oct 04 11:02:59.889340 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 501/1004] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:02:59 2022] DELETE /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:02:59.897040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:02:59.897940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:02:59.910107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.910859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.912585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:02:59.913535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:02:59.914200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:02:59.914779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.081828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:00.094265 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57705fef-614a-4512-9f93-9476b18134cc tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1526 microversion: 2.1 time: 0.203226 Oct 04 11:03:00.095753 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 504/1005] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:02:59 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1526 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:00.137931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5a19e66f-0eb0-451e-a81a-d804a0fca2d1 req-79e4935a-b0f7-4f36-bb70-215b440d0e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b04194-7767-4636-9ed0-3869ff18e425", "name": "network-vif-plugged", "status": "completed", "tag": "c9b6f444-374d-48a3-a78e-32dff234e6dd"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:00.148572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5a19e66f-0eb0-451e-a81a-d804a0fca2d1 req-79e4935a-b0f7-4f36-bb70-215b440d0e56 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.149326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5a19e66f-0eb0-451e-a81a-d804a0fca2d1 req-79e4935a-b0f7-4f36-bb70-215b440d0e56 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.155176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5a19e66f-0eb0-451e-a81a-d804a0fca2d1 req-79e4935a-b0f7-4f36-bb70-215b440d0e56 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.172251 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5a19e66f-0eb0-451e-a81a-d804a0fca2d1 req-79e4935a-b0f7-4f36-bb70-215b440d0e56 service nova] Creating event network-vif-plugged:c9b6f444-374d-48a3-a78e-32dff234e6dd for instance 59b04194-7767-4636-9ed0-3869ff18e425 on n-h1-791135-8 Oct 04 11:03:00.178896 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5a19e66f-0eb0-451e-a81a-d804a0fca2d1 req-79e4935a-b0f7-4f36-bb70-215b440d0e56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044892 Oct 04 11:03:00.179948 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 502/1006] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:00.206421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:00.207297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:00.216137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.216634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.217081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.218242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.218892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.223380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.307979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:00.322031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:00.322949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:00.326253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:00.330233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:00.331379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.331874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.332323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.333262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.333780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.334211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.350036 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ab4ba6f-533c-40c0-a5ee-bac5577f9643 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.149942 Oct 04 11:03:00.351396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 505/1007] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:00 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:00.626086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:00.635265 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29fe5422-30b8-4eae-a1b6-590c91e029e9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1470 microversion: 2.1 time: 0.317088 Oct 04 11:03:00.635771 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 503/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:00 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:00.658562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:00.659208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:00.665435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.665903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.666334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.667210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.667859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.668324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.712184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.713276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.713719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.714437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.714889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.715298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.738179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:00.742915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for user b024d221d4784e2399fd7676706cbc04 and project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:00.746342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:00.819969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:00.820780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:00.827424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.828106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.828754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.829731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.830462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.831137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.883417 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-09f8381d-5b1b-4515-87b1-4d0caca54f6c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d/action" status: 202 len: 0 microversion: 2.1 time: 0.228183 Oct 04 11:03:00.884037 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 506/1009] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:03:00 2022] POST /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:03:00.895596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:00.896269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:00.902873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.903351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.903778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:00.904528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:00.904983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:00.905557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:01.114549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:01.123434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3cd0daa-2d62-423f-9065-7cf5c1701841 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.306553 Oct 04 11:03:01.124788 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 504/1010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:00 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:01.130678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:01.131291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:01.147768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:01.148312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:01.148851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:01.149703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:01.150785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:01.151302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:01.166427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:01.176385 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a76a1f6-0564-4c0a-b1b6-da7ac341affd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1469 microversion: 2.1 time: 0.287089 Oct 04 11:03:01.177825 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 507/1011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:00 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:01.388894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:01.390643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:01.402037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:01.403482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:01.404143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:01.405114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:01.406010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:01.407219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:01.434505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:01.445942 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2516b2e2-3678-409e-8ffa-8a6b633a4b38 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1526 microversion: 2.1 time: 0.319672 Oct 04 11:03:01.447398 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 505/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:01 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:01.580101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:01.583874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:01.617136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:01.619377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:01.627650 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8559740b-9ed7-4c0b-bfb2-3f3b5313522a tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.243128 Oct 04 11:03:01.645395 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 508/1013] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:01 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:02.147478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5895c739-a228-47f9-84e4-82508b4ba6f3 req-8eeeed03-f8c4-45e6-a9b6-601f3194fe92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc83d7b6-ee89-4d05-a410-0522214854fd", "name": "network-vif-deleted", "tag": "97ab77f5-bde3-4735-befc-ba424622a42c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:02.153043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:02.153632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:02.168021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.168528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.168982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.171131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.171614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.172055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.181800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5895c739-a228-47f9-84e4-82508b4ba6f3 req-8eeeed03-f8c4-45e6-a9b6-601f3194fe92 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.184861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5895c739-a228-47f9-84e4-82508b4ba6f3 req-8eeeed03-f8c4-45e6-a9b6-601f3194fe92 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.185550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5895c739-a228-47f9-84e4-82508b4ba6f3 req-8eeeed03-f8c4-45e6-a9b6-601f3194fe92 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.219830 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5895c739-a228-47f9-84e4-82508b4ba6f3 req-8eeeed03-f8c4-45e6-a9b6-601f3194fe92 service nova] Creating event network-vif-deleted:97ab77f5-bde3-4735-befc-ba424622a42c for instance cc83d7b6-ee89-4d05-a410-0522214854fd on n-h1-791135-8 Oct 04 11:03:02.228138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5895c739-a228-47f9-84e4-82508b4ba6f3 req-8eeeed03-f8c4-45e6-a9b6-601f3194fe92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084139 Oct 04 11:03:02.229202 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 506/1014] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:02.245914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:02.249068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:02.260059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.260877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.261613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.262737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.263438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.264107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.272534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:02.481819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:02.508439 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d922d15-8cc7-4bec-80ee-d33b08fced1d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.359729 Oct 04 11:03:02.509402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:02.509816 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 509/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:02 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:02.515293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-26127f7a-cb6c-4a40-9f7b-405953686f9b req-db41b3e2-9d26-4970-8a5e-5313310ebbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "name": "network-vif-plugged", "status": "completed", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:02.518229 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7884945f-46d2-480d-84f5-d5597b1d3fe3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1469 microversion: 2.1 time: 0.286821 Oct 04 11:03:02.529335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-26127f7a-cb6c-4a40-9f7b-405953686f9b req-db41b3e2-9d26-4970-8a5e-5313310ebbc8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.530157 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 507/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:02 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1469 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:02.530747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-26127f7a-cb6c-4a40-9f7b-405953686f9b req-db41b3e2-9d26-4970-8a5e-5313310ebbc8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.531664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-26127f7a-cb6c-4a40-9f7b-405953686f9b req-db41b3e2-9d26-4970-8a5e-5313310ebbc8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.537522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:02.538583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:02.552778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.553693 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-26127f7a-cb6c-4a40-9f7b-405953686f9b req-db41b3e2-9d26-4970-8a5e-5313310ebbc8 service nova] Creating event network-vif-plugged:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h2-791135-8 Oct 04 11:03:02.554387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.554899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.556185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.556971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.557931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.566360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-26127f7a-cb6c-4a40-9f7b-405953686f9b req-db41b3e2-9d26-4970-8a5e-5313310ebbc8 service nova] Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:03:02.588744 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-26127f7a-cb6c-4a40-9f7b-405953686f9b req-db41b3e2-9d26-4970-8a5e-5313310ebbc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077539 Oct 04 11:03:02.589894 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 510/1017] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:02.598832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.599314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.599790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.600232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lazy-loading 'fault' on Instance uuid cc83d7b6-ee89-4d05-a410-0522214854fd {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:02.658308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:02.659079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:02.666452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:02.668678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.669166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.669624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.671599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:02.672053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:02.675183 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c9acb60-a4a4-4753-8c36-33572da148a0 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 200 len: 1315 microversion: 2.1 time: 0.144228 Oct 04 11:03:02.676225 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 508/1018] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:02 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:02.678018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:02.760047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:02.772236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:02.774089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:02.780113 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac81e925-3287-4d86-8f7d-2705b18aaa31 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.127980 Oct 04 11:03:02.780781 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 511/1019] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:02 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:03.534827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:03.535545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:03.544015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:03.544644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:03.545093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:03.545735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:03.546126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:03.546238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:03.546742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:03.547449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:03.556958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:03.557477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:03.557918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:03.558620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:03.565005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:03.565482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:03.768647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:03.781160 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c6d4a9bd-f349-4562-9169-f6e34d7f2fcd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.250124 Oct 04 11:03:03.783051 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 509/1020] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:03 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:03.789282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:03.790313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:03.803689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:03.804512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:03.804984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:03.806096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:03.806613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:03.807430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:03.829572 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd HTTP/1.1 Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:03.831556 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:03.833133 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'cc83d7b6-ee89-4d05-a410-0522214854fd'} Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:03.834058 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:03.835529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:03.838267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:03.839329 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2342d0a7-8562-4825-9727-64e57189d213 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 404 len: 111 microversion: 2.1 time: 0.055273 Oct 04 11:03:03.840445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 510/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:03 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:03.841428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:03.845217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:03.846678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:03.859048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:03.859205 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6db13c64-3811-4963-8088-213e2029f16a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1469 microversion: 2.1 time: 0.318460 Oct 04 11:03:03.859647 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 512/1022] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:03 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1469 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:03.861655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:03.862967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:03.864165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:03.864780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:03.865409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:03.961436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:03.972184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:03.974318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:03.980055 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc9c684e-3f67-4927-a833-f8dcf1ed484c tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1447 microversion: 2.75 time: 0.138440 Oct 04 11:03:03.981023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 511/1023] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:03 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:03.990263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1197620703", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:04.059124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] validate_networks() for [('41df1f22-b8b5-4c21-8eb3-7f794a2e7bb6', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:03:04.136584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ebc9a77-0ede-4a99-b716-523f14a7da3f tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Action: 'create', calling method: .version_select at 0x7f71d4580820>, body: {"keypair": {"name": "tempest-keypair-1908418362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQyfjnjWBuInd7z2YaVzcTueMbIsJb/Xbj30IadT3yUw3qUxWW0S0ZVy5WVBWAkHWn9HAZbhkaOxEDZkkFrATshDsF9dDOBcMf+r9I69G7Zwuyh2TQFtKDtj6qcgl2MJg=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:04.151700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7ebc9a77-0ede-4a99-b716-523f14a7da3f tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:04.155586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7ebc9a77-0ede-4a99-b716-523f14a7da3f tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for user 15fcf22083e645c5938b27b186c6e6b0 and project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:04.178766 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ebc9a77-0ede-4a99-b716-523f14a7da3f tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175433 Oct 04 11:03:04.179373 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 512/1024] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:03:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:04.191275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c18059c4-d421-495c-a341-12187365f17f tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Calling method '.version_select at 0x7f71d46cf670>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.201378 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c18059c4-d421-495c-a341-12187365f17f tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1908418362" status: 200 len: 498 microversion: 2.1 time: 0.014303 Oct 04 11:03:04.201971 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 513/1025] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:03:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1908418362 => generated 498 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:03:04.214419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e73b2e3-87c7-4484-bc7f-d29308656466 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Calling method '.version_select at 0x7f71d4507550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.238027 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e73b2e3-87c7-4484-bc7f-d29308656466 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908418362" status: 202 len: 0 microversion: 2.1 time: 0.027519 Oct 04 11:03:04.238619 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 514/1026] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908418362 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:03:04.251343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10de8de5-70c2-42c2-bfe1-c52a372b61eb tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Action: 'create', calling method: .version_select at 0x7f71d4507280>, body: {"keypair": {"name": "tempest-keypair-1079134722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTkR4Q6HbeXcBotzUD3l7A30RDNW51uBp9EmD9rVAu2d55OkXZJO31oU5xl/SC/qIU/fdhrBn0RHMFA6xIOvx0P38cvx1F9JkSW+xH166hAII7XKnYKciT45//tFrOziQ=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:04.267955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-10de8de5-70c2-42c2-bfe1-c52a372b61eb tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:04.272039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-10de8de5-70c2-42c2-bfe1-c52a372b61eb tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for user 15fcf22083e645c5938b27b186c6e6b0 and project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:04.281479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:04.297890 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10de8de5-70c2-42c2-bfe1-c52a372b61eb tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050498 Oct 04 11:03:04.300405 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 515/1027] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:03:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:03:04.310017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0aae69dd-1a7d-4fc1-bf78-6f261f800b6c tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Calling method '.version_select at 0x7f71d45e5b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.331089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0aae69dd-1a7d-4fc1-bf78-6f261f800b6c tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079134722" status: 202 len: 0 microversion: 2.1 time: 0.025644 Oct 04 11:03:04.331681 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 516/1028] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079134722 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:03:04.341666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c0406d6-2b6e-499c-99be-22fadb28ce7b tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Action: 'create', calling method: .version_select at 0x7f71d46be670>, body: {"keypair": {"name": "tempest-keypair-92272991", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:04.358797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3c0406d6-2b6e-499c-99be-22fadb28ce7b tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:04.362930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3c0406d6-2b6e-499c-99be-22fadb28ce7b tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for user 15fcf22083e645c5938b27b186c6e6b0 and project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:04.386386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c0406d6-2b6e-499c-99be-22fadb28ce7b tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.049215 Oct 04 11:03:04.387261 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 517/1029] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:03:04 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:04.397805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17d2459b-7766-45f6-a6f7-6ef1d409bf8a tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Calling method '.version_select at 0x7f71d450ea60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.417400 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17d2459b-7766-45f6-a6f7-6ef1d409bf8a tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92272991" status: 202 len: 0 microversion: 2.1 time: 0.023338 Oct 04 11:03:04.417982 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 518/1030] 10.222.0.23 () {58 vars in 1215 bytes} [Tue Oct 4 11:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92272991 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:03:04.429866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9600d43-f6ad-4f14-bdeb-06479144cf1b tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Action: 'create', calling method: .version_select at 0x7f71d4580ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1532258269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2jJ/3Z/wqkRFVWIyDEMSu420Wu9fkUATG/i+A4mcxR+ePleU+v/oX681ApB2Sfbvj76m5yFp9N3Hlh/BiOX4a/fEbcMTgwapSCUzQDr5x15zdYYAitkzQhcvG8QYywUw=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:04.445921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b9600d43-f6ad-4f14-bdeb-06479144cf1b tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:04.449811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b9600d43-f6ad-4f14-bdeb-06479144cf1b tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for user 15fcf22083e645c5938b27b186c6e6b0 and project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:04.472158 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9600d43-f6ad-4f14-bdeb-06479144cf1b tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.046242 Oct 04 11:03:04.478665 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 519/1031] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:03:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:03:04.485865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c23895a-0ed2-42e1-8950-f512e0af4ee6 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Action: 'create', calling method: .version_select at 0x7f71d44f9670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1822213241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlxTP8i7k0ab1MylWqkE5jn9ttJzRByiaqWTOpzM7HUz4wtksNqh5UUmg1CFVKaeeRPfDjYuZmF9OinJdzVFlIqxnjZBjC4c6c8WF8BIpXzL5TTuFl6y+0BqHwgSJKwyA=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:04.501919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0c23895a-0ed2-42e1-8950-f512e0af4ee6 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:04.506039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0c23895a-0ed2-42e1-8950-f512e0af4ee6 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for user 15fcf22083e645c5938b27b186c6e6b0 and project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:04.528712 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c23895a-0ed2-42e1-8950-f512e0af4ee6 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.046467 Oct 04 11:03:04.529554 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 520/1032] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:03:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:03:04.542897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2227c9e-6494-4946-9fb7-0b76c9532c06 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Action: 'create', calling method: .version_select at 0x7f71d44f93a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-39350293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFPaPkEhs5bSc3gbILKKFRgR3qkvAmeFRDg4Q3anZ5HpHJThv66H/OSGtsUM8tzBKLIJ2SJb1sqdFhbY8Fbe1NY29jNYIg0YT0jM3Ia5ZxZsmF+Ibo33900gH1AzyfeSw=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:04.559473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f2227c9e-6494-4946-9fb7-0b76c9532c06 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:04.563741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f2227c9e-6494-4946-9fb7-0b76c9532c06 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Getting quotas for user 15fcf22083e645c5938b27b186c6e6b0 and project 19d74eaa134e49b79ed714483a25ddf8. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:04.586094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2227c9e-6494-4946-9fb7-0b76c9532c06 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047811 Oct 04 11:03:04.592455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 521/1033] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:03:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:03:04.598082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a0c327b-90d7-4ba6-9b98-0237ba02d1e6 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Calling method '.version_select at 0x7f71d45803a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.602687 n-d-791135-8 devstack@n-api.service[122409]: WARNING oslo_db.sqlalchemy.utils [None req-2a0c327b-90d7-4ba6-9b98-0237ba02d1e6 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 11:03:04.611259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a0c327b-90d7-4ba6-9b98-0237ba02d1e6 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.016958 Oct 04 11:03:04.611955 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 522/1034] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:03:04 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:04.618709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-13681c57-58d0-4d53-be4a-79195990aca1 req-87f05ded-918b-42dd-827c-8c09679a77c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e63ee3-3a6c-446a-b69b-eb8e79ad477a", "name": "network-vif-plugged", "status": "completed", "tag": "6aeb5add-c4a0-4408-aa02-652effd838a2"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:04.629645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-13681c57-58d0-4d53-be4a-79195990aca1 req-87f05ded-918b-42dd-827c-8c09679a77c9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:04.630153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-13681c57-58d0-4d53-be4a-79195990aca1 req-87f05ded-918b-42dd-827c-8c09679a77c9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:04.630588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-13681c57-58d0-4d53-be4a-79195990aca1 req-87f05ded-918b-42dd-827c-8c09679a77c9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:04.642213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-13681c57-58d0-4d53-be4a-79195990aca1 req-87f05ded-918b-42dd-827c-8c09679a77c9 service nova] Creating event network-vif-plugged:6aeb5add-c4a0-4408-aa02-652effd838a2 for instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a on n-h1-791135-8 Oct 04 11:03:04.646753 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-13681c57-58d0-4d53-be4a-79195990aca1 req-87f05ded-918b-42dd-827c-8c09679a77c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Oct 04 11:03:04.647435 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 523/1035] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:04.652996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-128dac69-7f5c-4c26-ae71-38246da627f5 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Calling method '.version_select at 0x7f71d45805e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.675035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-128dac69-7f5c-4c26-ae71-38246da627f5 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-39350293" status: 202 len: 0 microversion: 2.1 time: 0.026325 Oct 04 11:03:04.675633 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 524/1036] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-39350293 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:03:04.683843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-029df5bd-2365-43da-bb59-3b28c107fd9f tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Calling method '.version_select at 0x7f71d4635e50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.710604 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-029df5bd-2365-43da-bb59-3b28c107fd9f tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1822213241" status: 202 len: 0 microversion: 2.1 time: 0.030488 Oct 04 11:03:04.711480 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 525/1037] 10.222.0.23 () {58 vars in 1278 bytes} [Tue Oct 4 11:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1822213241 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:03:04.720260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ee30cb5-cb08-4fea-8303-40d60c81bb59 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] Calling method '.version_select at 0x7f71d450e5e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.742067 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ee30cb5-cb08-4fea-8303-40d60c81bb59 tempest-KeyPairsV2TestJSON-920835436 tempest-KeyPairsV2TestJSON-920835436-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1532258269" status: 202 len: 0 microversion: 2.1 time: 0.025921 Oct 04 11:03:04.745476 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 526/1038] 10.222.0.23 () {58 vars in 1278 bytes} [Tue Oct 4 11:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1532258269 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:03:04.748358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:03:04.748834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:03:04.749305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:03:04.750776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:03:04.751405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:03:04.763107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:04.763987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:04.764608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:04.765556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:04.766175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:04.766754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:04.786905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Getting quotas for project 2070b5bd76a54fa6b3cbc9c9bee8500d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:04.791572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Getting quotas for user 3ae296c06e8e490db21812b28044533c and project 2070b5bd76a54fa6b3cbc9c9bee8500d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:04.804289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:03:04.806157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.806914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:04.808157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:03:04.815200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:04.815899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:04.816530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:04.817226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:04.817872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:04.818456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:04.864481 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68c890f1-58bb-4d4e-8350-032941ec7f73 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.879523 Oct 04 11:03:04.865791 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 513/1039] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:03:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:03:04.876698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0689ab2-37cb-4177-81a4-5e3715ca4aca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.886475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b0689ab2-37cb-4177-81a4-5e3715ca4aca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:04.976204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0689ab2-37cb-4177-81a4-5e3715ca4aca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:04.990076 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b0689ab2-37cb-4177-81a4-5e3715ca4aca tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1225 microversion: 2.1 time: 0.116580 Oct 04 11:03:04.991143 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 514/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:04 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:04.998361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:04.998899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:05.005764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:05.006601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:05.007120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:05.007643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:05.008249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:05.008706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:05.009987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:05.018532 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8e8b905-2c12-411a-8505-149c7870b1c1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1318 microversion: 2.1 time: 0.216160 Oct 04 11:03:05.033792 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 527/1041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:04 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:05.039025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:05.039641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:05.046368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:05.046859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:05.047293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:05.048077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:05.048443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:05.048880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:05.136139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:05.163531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:05.168221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:05.179682 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e4502c5-864f-463b-868d-241dc9744814 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1453 microversion: 2.75 time: 0.144615 Oct 04 11:03:05.181737 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 528/1042] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:05 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:05.184666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:05.192622 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4da749c-6220-45bc-8ea8-17ca084b7171 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1469 microversion: 2.1 time: 0.198570 Oct 04 11:03:05.193202 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 515/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:04 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:05.804753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:05.806042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:05.814163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:05.814940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:05.815397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:05.816378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:05.817106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:05.818286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:05.848722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:03:05.936982 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-826912b3-d0c4-4af4-bbd2-d575a511bc1d tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 204 len: 0 microversion: 2.1 time: 0.135087 Oct 04 11:03:05.938328 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 529/1044] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:03:05 2022] DELETE /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:03:05.947214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:05.948100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:05.955771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:05.956260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:05.956723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:05.957455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:05.957914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:05.958337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.015782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:06.016486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:06.025431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.025431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.025431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.025431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.026021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.026117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.127161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:06.140823 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e458e6e4-f16b-4149-b89c-44965bad8de5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1277 microversion: 2.1 time: 0.129815 Oct 04 11:03:06.142585 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 530/1045] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:06 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:06.162678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:06.165244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:06.174009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.176376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.176815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.177562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.178015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.178152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:06.178435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.188354 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab67d60d-174f-4204-8764-d3fe1a98ad49 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1714 microversion: 2.1 time: 0.245856 Oct 04 11:03:06.188935 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 516/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:05 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1714 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:06.217556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:06.218322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:06.225544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.226056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.226470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.227420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.228242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.228995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.422911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:06.430558 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d893888-0e22-4c27-b228-d4b9a8759fd8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1468 microversion: 2.1 time: 0.283314 Oct 04 11:03:06.445379 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 531/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:06 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:06.446094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:06.446309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:06.446309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:06.446309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.446309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.447195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.447195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.447195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.447195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.467345 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f240b54c-6e91-4d45-b5da-1d51a61d1956 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1535 microversion: 2.1 time: 0.254723 Oct 04 11:03:06.468159 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 517/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:06 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1535 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:06.473246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:06.474241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:06.480585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.481720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.482333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.483191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.484134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.484717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.531030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:06.542562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:06.544615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:06.555035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-41802331-77fd-4c57-a916-513880676cb2 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1453 microversion: 2.75 time: 0.122425 Oct 04 11:03:06.556439 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 532/1049] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:06 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:06.742345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:06.751419 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b2ad0264-c267-47e0-bea5-9423a3df6748 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425" status: 200 len: 1467 microversion: 2.1 time: 0.282068 Oct 04 11:03:06.753888 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 518/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:06 2022] GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 => generated 1467 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:06.777836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-460415428"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:06.780939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:06.790646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.792482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.793426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:06.794455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:06.795130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:06.795863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.030046 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4063b4ce-a892-452f-9ad4-961b92788bad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "POST /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425/action" status: 202 len: 0 microversion: 2.1 time: 0.256171 Oct 04 11:03:07.030827 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 533/1051] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:03:06 2022] POST /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:03:07.045096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d854411a-56a6-4a58-b49b-165133e8d8c5 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4a43a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:07.120804 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d854411a-56a6-4a58-b49b-165133e8d8c5 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.081079 Oct 04 11:03:07.122090 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 519/1052] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:07 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:07.165179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:07.167123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:07.171135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:07.178952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.179599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.180113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.181101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.181526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.182036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.219358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:07.220976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:07.243326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.245025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.246284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.250063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.251707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.252803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.290203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:07.299957 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97c907f6-f3f0-4eab-a4b6-bf9e83228564 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1283 microversion: 2.1 time: 0.139316 Oct 04 11:03:07.316953 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 534/1053] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:07 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:07.491006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:07.491629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:07.505111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.506003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.508614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.510971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.516149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.516945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.576772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:07.585721 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-919ed182-c218-4bc4-8fa1-ea61d58abd79 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1714 microversion: 2.1 time: 0.374565 Oct 04 11:03:07.589682 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 520/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:07 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1714 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:07.597274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-eea24925-9933-43ed-a90d-ce3339841f16 req-667b8dba-3fe4-4e7f-8ac9-f6d6135b3a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "name": "network-vif-unplugged", "status": "completed", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:07.624080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-eea24925-9933-43ed-a90d-ce3339841f16 req-667b8dba-3fe4-4e7f-8ac9-f6d6135b3a48 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.624831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-eea24925-9933-43ed-a90d-ce3339841f16 req-667b8dba-3fe4-4e7f-8ac9-f6d6135b3a48 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.625826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-eea24925-9933-43ed-a90d-ce3339841f16 req-667b8dba-3fe4-4e7f-8ac9-f6d6135b3a48 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.654821 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-eea24925-9933-43ed-a90d-ce3339841f16 req-667b8dba-3fe4-4e7f-8ac9-f6d6135b3a48 service nova] Creating event network-vif-unplugged:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h1-791135-8 Oct 04 11:03:07.683487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-eea24925-9933-43ed-a90d-ce3339841f16 req-667b8dba-3fe4-4e7f-8ac9-f6d6135b3a48 service nova] Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:03:07.711574 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-eea24925-9933-43ed-a90d-ce3339841f16 req-667b8dba-3fe4-4e7f-8ac9-f6d6135b3a48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120426 Oct 04 11:03:07.713471 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 521/1055] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:07.720855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:07.721593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:07.733317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.734098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.734702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.735565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:07.736174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:07.736786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:07.837344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:07.845683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:07.847470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:07.852780 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6d06822-4ae2-4948-a436-a55951f9592b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1453 microversion: 2.75 time: 0.136460 Oct 04 11:03:07.854103 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 522/1056] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:07 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:07.898033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:07.905391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:07.909260 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e233a458-509c-4668-b435-2a955ed1ebee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1535 microversion: 2.1 time: 0.422670 Oct 04 11:03:07.910359 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 535/1057] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:07 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1535 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:08.139591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88c62961-873a-468a-92aa-ecf542043434 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d488e040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:08.195016 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88c62961-873a-468a-92aa-ecf542043434 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.059542 Oct 04 11:03:08.197222 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 523/1058] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:08 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:08.324940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:08.325828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:08.333382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:08.334413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:08.335103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:08.336165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:08.336841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:08.338049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:08.532469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-15dd552d-20ff-4032-996b-cbc863b377bf req-7c006254-d04d-4c02-96ea-5edfa6201c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6824acb-eefa-4bca-b75a-60b5c8fec272", "tag": "4c27a722-231b-4dad-ba63-380265db5958"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:08.551361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15dd552d-20ff-4032-996b-cbc863b377bf req-7c006254-d04d-4c02-96ea-5edfa6201c96 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:08.551835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15dd552d-20ff-4032-996b-cbc863b377bf req-7c006254-d04d-4c02-96ea-5edfa6201c96 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:08.552512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15dd552d-20ff-4032-996b-cbc863b377bf req-7c006254-d04d-4c02-96ea-5edfa6201c96 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:08.578361 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-15dd552d-20ff-4032-996b-cbc863b377bf req-7c006254-d04d-4c02-96ea-5edfa6201c96 service nova] Creating event network-changed:4c27a722-231b-4dad-ba63-380265db5958 for instance d6824acb-eefa-4bca-b75a-60b5c8fec272 on n-h1-791135-8 Oct 04 11:03:08.583672 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-15dd552d-20ff-4032-996b-cbc863b377bf req-7c006254-d04d-4c02-96ea-5edfa6201c96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054881 Oct 04 11:03:08.584502 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 524/1059] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:03:08.611502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:08.612550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:08.621691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:08.622442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:08.623079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:08.624316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:08.625274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:08.626000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:08.788916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:08.798031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0422b5b2-abb0-416a-a77e-9b1ffebcf3f8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1325 microversion: 2.1 time: 0.477698 Oct 04 11:03:08.799271 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 536/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:08 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1325 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:08.882999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:08.883902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:08.890544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:08.892554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:08.893184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:08.894921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:08.895557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:08.896629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:09.045055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:09.070185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:09.071785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:09.081246 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe55fd0a-cb88-4a2e-85b2-96a1ef9d6ff4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1453 microversion: 2.75 time: 0.203479 Oct 04 11:03:09.100138 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 537/1061] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:08 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1453 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:09.117441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:09.118235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:09.125332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:09.125536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:09.125969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:09.126665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:09.127797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:09.128389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:09.145394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:09.154976 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-865b179e-ccb2-4a3e-8823-5c91f8595a04 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1714 microversion: 2.1 time: 0.549422 Oct 04 11:03:09.158241 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 525/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:08 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1714 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:09.211737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44a4677f-3f60-4a9d-aeb0-ee829649a183 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4927f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:09.282374 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44a4677f-3f60-4a9d-aeb0-ee829649a183 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.073975 Oct 04 11:03:09.283296 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 526/1063] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:09 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:09.502004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:09.515001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-07d4acfa-1ed5-45f7-b4c6-4de6eb620a72 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1535 microversion: 2.1 time: 0.412464 Oct 04 11:03:09.515983 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 538/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:09 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1535 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:09.767820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-21b1fa83-2df9-4d9a-9459-39fa3d82bb0c req-4f5eaba8-b931-4a70-b093-df7378cb157e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:09.782719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21b1fa83-2df9-4d9a-9459-39fa3d82bb0c req-4f5eaba8-b931-4a70-b093-df7378cb157e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:09.783205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21b1fa83-2df9-4d9a-9459-39fa3d82bb0c req-4f5eaba8-b931-4a70-b093-df7378cb157e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:09.787146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21b1fa83-2df9-4d9a-9459-39fa3d82bb0c req-4f5eaba8-b931-4a70-b093-df7378cb157e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:09.813943 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-21b1fa83-2df9-4d9a-9459-39fa3d82bb0c req-4f5eaba8-b931-4a70-b093-df7378cb157e service nova] Creating event network-changed:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h1-791135-8 Oct 04 11:03:09.827545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:09.829283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:09.836691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:09.840763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-21b1fa83-2df9-4d9a-9459-39fa3d82bb0c req-4f5eaba8-b931-4a70-b093-df7378cb157e service nova] Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:03:09.841963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:09.842493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:09.843302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:09.843926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:09.845893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:09.876429 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-21b1fa83-2df9-4d9a-9459-39fa3d82bb0c req-4f5eaba8-b931-4a70-b093-df7378cb157e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114111 Oct 04 11:03:09.877782 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 527/1065] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:10.120255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:10.121645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:10.129986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:10.130919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:10.131666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:10.132547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:10.133209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:10.133975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:10.154957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:10.172063 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70610cfb-6075-4dd6-804a-0291bf21a83f tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1325 microversion: 2.1 time: 0.351741 Oct 04 11:03:10.173439 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 539/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:09 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:10.190797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:10.191889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:10.200234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:10.200872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:10.203749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:10.204665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:10.205137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:10.205603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:10.291611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:10.307747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:10.309190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:10.326817 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59ba6ce8-4421-4b7a-9c21-53ce0fd2bab4 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1453 microversion: 2.75 time: 0.212438 Oct 04 11:03:10.338889 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 528/1067] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:10 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:10.344564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4c6874f-d90a-43af-94db-16e9a75649e6 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d488edc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:10.397740 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b4c6874f-d90a-43af-94db-16e9a75649e6 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.067696 Oct 04 11:03:10.406204 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 529/1068] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:10 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:10.541047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:10.541957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:10.568088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:10.568849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:10.570325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:10.571707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:10.572370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:10.572976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:10.880424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:10.892213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e6910c8-b7bb-4391-8cc4-8384b044024c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1714 microversion: 2.1 time: 0.713637 Oct 04 11:03:10.893037 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 540/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:10 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1714 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:10.944002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:10.951953 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1935fc6d-5bf1-4c23-9671-1a8830ece0cc tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1535 microversion: 2.1 time: 0.415687 Oct 04 11:03:10.952720 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 530/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:10 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1535 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:11.196615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:11.197219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:11.203624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:11.204136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:11.204569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:11.205406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:11.205929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:11.206268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:11.357737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:11.358409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:11.372551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:11.373144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:11.373681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:11.376843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:11.379307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:11.379761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:11.385599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:11.396566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-252d84b0-fbe2-4d0a-b66b-224973522cd5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1325 microversion: 2.1 time: 0.203719 Oct 04 11:03:11.398621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 541/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:11 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:11.416814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ad9e390-bfe2-4d79-ad29-c5b856feddeb tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d450d670>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:11.485281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:11.493253 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ad9e390-bfe2-4d79-ad29-c5b856feddeb tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.083174 Oct 04 11:03:11.496926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:11.498595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:11.502201 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 542/1072] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:11 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:11.504613 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bfb8d26b-1d94-49b8-8436-f7715b43962b tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1453 microversion: 2.75 time: 0.152376 Oct 04 11:03:11.505174 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 531/1073] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:11 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:11.917324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:11.918781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:11.934595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:11.935329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:11.939052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:11.941105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:11.945440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:11.947760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:11.976354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:11.976966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:11.998526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:11.999040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:11.999480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:12.012612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:12.013299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:12.013858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:12.201091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:12.215943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34278011-b65b-40ad-afed-d6301e8c4376 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1647 microversion: 2.1 time: 0.300300 Oct 04 11:03:12.217180 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 543/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:11 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1647 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:12.233987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7c99661b-b243-4419-bb8d-4380c4e73e75 req-15f88702-2e47-4213-9ef4-ac2b8b2d04cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19f44e6-544a-463f-9b91-f68bb9d31348", "name": "network-vif-deleted", "tag": "4352b0b5-7bb0-4d02-a5f0-b045ab94e932"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:12.256434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c99661b-b243-4419-bb8d-4380c4e73e75 req-15f88702-2e47-4213-9ef4-ac2b8b2d04cb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:12.257287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c99661b-b243-4419-bb8d-4380c4e73e75 req-15f88702-2e47-4213-9ef4-ac2b8b2d04cb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:12.260010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c99661b-b243-4419-bb8d-4380c4e73e75 req-15f88702-2e47-4213-9ef4-ac2b8b2d04cb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:12.286749 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7c99661b-b243-4419-bb8d-4380c4e73e75 req-15f88702-2e47-4213-9ef4-ac2b8b2d04cb service nova] Creating event network-vif-deleted:4352b0b5-7bb0-4d02-a5f0-b045ab94e932 for instance c19f44e6-544a-463f-9b91-f68bb9d31348 on n-h2-791135-8 Oct 04 11:03:12.301077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7c99661b-b243-4419-bb8d-4380c4e73e75 req-15f88702-2e47-4213-9ef4-ac2b8b2d04cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082491 Oct 04 11:03:12.302404 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 544/1075] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:12.393250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:12.395654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:12.410195 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58a60e39-6216-43e5-b918-34aebdde8cf3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1535 microversion: 2.1 time: 0.436209 Oct 04 11:03:12.416019 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 532/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:11 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1535 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:12.436625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:12.438173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:12.451240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:12.454825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:12.455527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:12.457030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:12.458454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:12.462220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:12.509524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4036025d-52a8-44d5-9b7a-52e6b0f7243d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4c4d8b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:12.597725 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4036025d-52a8-44d5-9b7a-52e6b0f7243d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.092541 Oct 04 11:03:12.598381 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 533/1077] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:12 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:12.624150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5eedb954-3515-4ed2-b2a3-0d67f2f33f8c req-70e0fb80-8a9b-430f-85ec-b4cbc8c26378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b04194-7767-4636-9ed0-3869ff18e425", "name": "network-vif-plugged", "status": "completed", "tag": "c9b6f444-374d-48a3-a78e-32dff234e6dd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:12.679868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5eedb954-3515-4ed2-b2a3-0d67f2f33f8c req-70e0fb80-8a9b-430f-85ec-b4cbc8c26378 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:12.680367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5eedb954-3515-4ed2-b2a3-0d67f2f33f8c req-70e0fb80-8a9b-430f-85ec-b4cbc8c26378 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:12.680835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5eedb954-3515-4ed2-b2a3-0d67f2f33f8c req-70e0fb80-8a9b-430f-85ec-b4cbc8c26378 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:12.741676 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5eedb954-3515-4ed2-b2a3-0d67f2f33f8c req-70e0fb80-8a9b-430f-85ec-b4cbc8c26378 service nova] Creating event network-vif-plugged:c9b6f444-374d-48a3-a78e-32dff234e6dd for instance 59b04194-7767-4636-9ed0-3869ff18e425 on n-h1-791135-8 Oct 04 11:03:12.761958 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5eedb954-3515-4ed2-b2a3-0d67f2f33f8c req-70e0fb80-8a9b-430f-85ec-b4cbc8c26378 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162290 Oct 04 11:03:12.765179 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 534/1078] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:12.786686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:12.791735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:12.816996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:12.820978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:12.823992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:12.825992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:12.826473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:12.826904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:13.339339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:13.353200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:13.355854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:13.371649 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a14b0e4-9773-4c5e-b369-7a1eba9f4f8d tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1438 microversion: 2.75 time: 0.604967 Oct 04 11:03:13.372795 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 535/1079] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:12 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1438 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:13.383331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:13.386299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:13.402663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:13.404169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:13.404608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:13.405321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:13.405797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:13.406211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:13.410834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:13.419670 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9ee4d3b5-348d-4948-a0fe-67178f57da43 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1325 microversion: 2.1 time: 0.989517 Oct 04 11:03:13.422284 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 545/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:12 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1325 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:13.491687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:13.492094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:13.492572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:13.492950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lazy-loading 'fault' on Instance uuid c19f44e6-544a-463f-9b91-f68bb9d31348 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:13.565783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c2f73db46ee4f88a988540177a931e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a6b3dcd80b41c090b9567856b9d7c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:13.580851 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c899d757-a1fc-4768-8b3c-ec0f840e45ea tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 200 len: 1355 microversion: 2.1 time: 0.206554 Oct 04 11:03:13.581463 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 536/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:13 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 1355 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:13.590638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:13.591238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:13.610335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:13.610812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:13.611575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:13.614371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:13.615127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:13.624343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:13.819278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:13.823243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:13.833179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:13.836079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:13.837170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:13.838710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:13.839342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:13.839935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:13.923089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:13.939112 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-382cccbb-b431-4a66-aaf0-85cd4c6f7a07 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1528 microversion: 2.1 time: 0.356479 Oct 04 11:03:13.940142 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 537/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:13 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1528 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:13.948291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15d1e90b-6f8a-4ba1-a18a-3999bb457271 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4c4d0d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:14.017680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:03:14.018154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:03:14.021319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:03:14.022661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:03:14.023113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:03:14.079540 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15d1e90b-6f8a-4ba1-a18a-3999bb457271 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.136822 Oct 04 11:03:14.081751 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 538/1083] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:13 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:14.094595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:14.095376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:14.107383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.111522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.112178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.113998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.114916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.115551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.136095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:14.146293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.147093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.148025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.149110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.150522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.152104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.452785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:14.496259 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59ff2340-6ab5-4ce2-9066-750f66c68954 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1528 microversion: 2.1 time: 0.413323 Oct 04 11:03:14.500083 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 539/1084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:14 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1528 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:14.535421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:14.539403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:14.571132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=24 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:14.574409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.575242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.575925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.577492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.580579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.581310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.606288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:14.627083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e26aad75-59f1-480b-af5d-e45af035fa2d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2/action" status: 202 len: 1942 microversion: 2.75 time: 1.203342 Oct 04 11:03:14.628858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 546/1085] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:03:13 2022] POST /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2/action => generated 1942 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 11:03:14.635689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d94fba99-914f-4865-b91d-03e51d62a281 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:14.643432 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d94fba99-914f-4865-b91d-03e51d62a281 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] HTTP exception thrown: Flavor b0647c8b-c798-43aa-a114-5e7af2fe554b could not be found. Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d94fba99-914f-4865-b91d-03e51d62a281 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Request method failure captured: Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/flavors/b0647c8b-c798-43aa-a114-5e7af2fe554b HTTP/1.1 Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIfC4r3bOXqrCxhGaCPhBshjto1dMUjPcgjrI9IC8ShjY5Aoa_R3obsFfgM4sf6XxV-wl3CsFNV7iLP2a45wvc9w-a4orJF_oMqCpU31aB2y5YQbVVD6_9DP1kIGsFersnV9v6GqVUwOw1f06e0CZQ5OqUIDaZwxc20Jn9xXjPvZTA Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 137a10241e0143bfba9a11313f0ee12d Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MigrationsAdminTest-1922827443 Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:03:14.650638 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_137a10241e0143bfba9a11313f0ee12d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/137a10241e0143bfba9a11313f0ee12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/137a10241e0143bfba9a11313f0ee12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/137a10241e0143bfba9a11313f0ee12d"}]}] Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MigrationsAdminTest-1922827443 Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 137a10241e0143bfba9a11313f0ee12d Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MigrationsAdminTest-1922827443 Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MigrationsAdminTest-1922827443-project-admin Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1ce456bc797345d6acbcfceb1ef83111 Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MigrationsAdminTest-1922827443-project-admin Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: exception: Flavor b0647c8b-c798-43aa-a114-5e7af2fe554b could not be found. Oct 04 11:03:14.652072 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b0647c8b-c798-43aa-a114-5e7af2fe554b'} Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b0647c8b-c798-43aa-a114-5e7af2fe554b could not be found. Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:14.652929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor b0647c8b-c798-43aa-a114-5e7af2fe554b could not be found. Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b0647c8b-c798-43aa-a114-5e7af2fe554b could not be found. Oct 04 11:03:14.654242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.670929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d94fba99-914f-4865-b91d-03e51d62a281 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Returning 404 to user: Flavor b0647c8b-c798-43aa-a114-5e7af2fe554b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:14.675996 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d94fba99-914f-4865-b91d-03e51d62a281 tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/b0647c8b-c798-43aa-a114-5e7af2fe554b" status: 404 len: 109 microversion: 2.1 time: 0.045673 Oct 04 11:03:14.678738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 547/1086] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:03:14 2022] DELETE /compute/v2.1/flavors/b0647c8b-c798-43aa-a114-5e7af2fe554b => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:14.702013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:14.703020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:14.726601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.731521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.733495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.745025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.748905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.751565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.778786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:14.805270 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] HTTP exception thrown: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Request method failure captured: Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 HTTP/1.1 Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIFr2lanSWlrBlkdsNYBKLHJ4GRE6ItQF7gdMvso-6vSrUuJlFVD24yyQZZp0IlrApovmh1vPmOQfLupE6gBsMQc-iuBv0tCVnVaz5D4vzmuwuSdFVe20zqHlN0IcPx-Zr-R-p3dJGoNof3uz25qIsOEZX9lZHBuEw-7OWoKCPyGBw Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:14.807567 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02a6b3dcd80b41c090b9567856b9d7c7"}]}] Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6c2f73db46ee4f88a988540177a931e3 Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:14.809450 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c19f44e6-544a-463f-9b91-f68bb9d31348'} Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:14.810398 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:14.812961 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:14.829812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Returning 404 to user: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:14.832102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f90577e-8615-49ae-942f-bef26f157a43 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 404 len: 111 microversion: 2.1 time: 0.150805 Oct 04 11:03:14.835099 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 548/1087] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:14 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:14.845173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:14.846324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:14.853666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.854452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.855054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.856151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.856773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.857593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.925613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:14.937221 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75ed53b6-0a33-4c80-a954-3ea6c771cca9 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1325 microversion: 2.1 time: 0.432312 Oct 04 11:03:14.941686 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 540/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:14 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1325 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:14.953317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:14.954253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:14.968257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.969243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.969946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.970881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:14.971544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:14.972197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:14.988477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:15.005199 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] HTTP exception thrown: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.006697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Request method failure captured: Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 HTTP/1.1 Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIFr2lanSWlrBlkdsNYBKLHJ4GRE6ItQF7gdMvso-6vSrUuJlFVD24yyQZZp0IlrApovmh1vPmOQfLupE6gBsMQc-iuBv0tCVnVaz5D4vzmuwuSdFVe20zqHlN0IcPx-Zr-R-p3dJGoNof3uz25qIsOEZX9lZHBuEw-7OWoKCPyGBw Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:15.007793 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02a6b3dcd80b41c090b9567856b9d7c7"}]}] Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 6c2f73db46ee4f88a988540177a931e3 Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.009252 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'be5981b8-d0e7-43d1-89ed-0b1186788807'} Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:15.010060 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.011278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.014092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Returning 404 to user: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:15.015199 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d99b579-c102-4452-b23c-6cb89d82deb8 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "DELETE /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 404 len: 111 microversion: 2.1 time: 0.071765 Oct 04 11:03:15.018101 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 541/1089] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:03:14 2022] DELETE /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:15.023611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-998755123", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:15.051687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06d1d888-3682-4157-a6f3-b1b549d75b75 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.215090 Oct 04 11:03:15.052774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 549/1090] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:14 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:15.058209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:15.059053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:15.079219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:15.080329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:15.081897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:15.083343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:15.084235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:15.084821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:15.097045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:03:15.104812 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] HTTP exception thrown: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Request method failure captured: Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 HTTP/1.1 Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIFr2lanSWlrBlkdsNYBKLHJ4GRE6ItQF7gdMvso-6vSrUuJlFVD24yyQZZp0IlrApovmh1vPmOQfLupE6gBsMQc-iuBv0tCVnVaz5D4vzmuwuSdFVe20zqHlN0IcPx-Zr-R-p3dJGoNof3uz25qIsOEZX9lZHBuEw-7OWoKCPyGBw Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:15.107096 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02a6b3dcd80b41c090b9567856b9d7c7"}]}] Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6c2f73db46ee4f88a988540177a931e3 Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.108634 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'be5981b8-d0e7-43d1-89ed-0b1186788807'} Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:15.109512 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:15.110934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:15.113511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Returning 404 to user: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:15.114826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10106813-1908-4ddf-9f10-39974b33e841 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 404 len: 111 microversion: 2.1 time: 0.060982 Oct 04 11:03:15.115917 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 550/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:15 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:15.123457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a59b8bb5-924d-416d-8c28-217b9f7d32cd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44970d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:15.195256 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a59b8bb5-924d-416d-8c28-217b9f7d32cd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.078073 Oct 04 11:03:15.206370 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 551/1092] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:15 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:15.212029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c71e494a-ab51-46b6-ac1d-8ea15120ffdb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '.version_select at 0x7f71d44f9ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:15.244738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c71e494a-ab51-46b6-ac1d-8ea15120ffdb tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090858167" status: 202 len: 0 microversion: 2.1 time: 0.036389 Oct 04 11:03:15.245921 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 552/1093] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:03:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090858167 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:03:15.512740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:03:15.513172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:03:15.513699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:03:15.514183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:03:15.514877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:03:15.538382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:15.539215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:15.540756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:15.547882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:15.548729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:15.558403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:15.576515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:15.585062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:15.598090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Getting quotas for user b024d221d4784e2399fd7676706cbc04 and project 64b6b184def140dba0ea1ac0a56a98e1. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:15.620081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:03:15.623833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:03:15.722793 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d77b926-dc9a-4185-8341-ccbca4304213 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703247 Oct 04 11:03:15.723856 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 542/1094] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:03:15.737313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24d761b7-d5c3-4a5e-9906-4b3dd2d414ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:15.738097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-24d761b7-d5c3-4a5e-9906-4b3dd2d414ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:15.918016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-24d761b7-d5c3-4a5e-9906-4b3dd2d414ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:15.931305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24d761b7-d5c3-4a5e-9906-4b3dd2d414ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1212 microversion: 2.1 time: 0.198622 Oct 04 11:03:15.932790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 553/1095] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:15 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1212 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:15.966692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:15.967458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:15.982815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:15.983433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:15.983979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:15.985075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:15.985809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:15.987326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:16.082184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:16.083795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:16.097670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:16.101032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:16.101696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:16.111553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:16.116413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:16.117270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:16.368020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:16.423854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8bc3ecd1-b430-4a7f-aede-845e69c911e1 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.347298 Oct 04 11:03:16.427611 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 554/1096] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:16 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:16.440936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22c99a62-3ce1-41a1-84f3-9d6d042e1019 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44d44c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:16.518676 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22c99a62-3ce1-41a1-84f3-9d6d042e1019 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.089097 Oct 04 11:03:16.520718 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 555/1097] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:16 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:16.730615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1e133bdb-ee86-4b6c-ae7d-50b9b5c6939b req-9e25d6e5-ba16-4d17-b26b-b42d5e5df300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6824acb-eefa-4bca-b75a-60b5c8fec272", "name": "network-vif-plugged", "status": "completed", "tag": "4c27a722-231b-4dad-ba63-380265db5958"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:16.771158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1e133bdb-ee86-4b6c-ae7d-50b9b5c6939b req-9e25d6e5-ba16-4d17-b26b-b42d5e5df300 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:16.773643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1e133bdb-ee86-4b6c-ae7d-50b9b5c6939b req-9e25d6e5-ba16-4d17-b26b-b42d5e5df300 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:16.775159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1e133bdb-ee86-4b6c-ae7d-50b9b5c6939b req-9e25d6e5-ba16-4d17-b26b-b42d5e5df300 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:16.814087 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1e133bdb-ee86-4b6c-ae7d-50b9b5c6939b req-9e25d6e5-ba16-4d17-b26b-b42d5e5df300 service nova] Creating event network-vif-plugged:4c27a722-231b-4dad-ba63-380265db5958 for instance d6824acb-eefa-4bca-b75a-60b5c8fec272 on n-h1-791135-8 Oct 04 11:03:16.824818 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1e133bdb-ee86-4b6c-ae7d-50b9b5c6939b req-9e25d6e5-ba16-4d17-b26b-b42d5e5df300 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097147 Oct 04 11:03:16.826466 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 556/1098] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:03:16.959209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:16.970926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:16.991377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:17.006283 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de262915-ea71-4c59-bbf1-a03ba3e77a7b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1325 microversion: 2.1 time: 1.044183 Oct 04 11:03:17.029653 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 543/1099] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:15 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1325 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:17.032883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.039555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.040844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.042938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.045594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.046470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.214443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:17.218656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:17.230561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-894d1a67-91c8-4974-ada0-abb38bf75d83 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1208 microversion: 2.1 time: 0.276982 Oct 04 11:03:17.233312 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 557/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:16 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1208 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:17.381680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85ad7bd1-603c-4a77-9b84-dddeaf5bb16a tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.419647 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85ad7bd1-603c-4a77-9b84-dddeaf5bb16a tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/464592950" status: 202 len: 0 microversion: 2.1 time: 0.045948 Oct 04 11:03:17.422380 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 544/1101] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 11:03:17 2022] DELETE /compute/v2.1/flavors/464592950 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:03:17.434173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92de2dfb-027c-416f-ae39-5246d032eeab tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.459213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.460994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:17.479706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.480478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.481103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.483014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.484756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.489370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.500475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92de2dfb-027c-416f-ae39-5246d032eeab tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.075327 Oct 04 11:03:17.505321 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 558/1102] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:03:17 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:17.534447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b21a7538-15e5-4978-b25f-3c9c714eed6f tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.569969 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b21a7538-15e5-4978-b25f-3c9c714eed6f tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1704215892" status: 202 len: 0 microversion: 2.1 time: 0.046284 Oct 04 11:03:17.570928 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 559/1103] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 11:03:17 2022] DELETE /compute/v2.1/flavors/1704215892 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:03:17.582278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8bc2f0dc-f5bb-42be-a2a5-6fd56df17e28 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d45803a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.681845 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8bc2f0dc-f5bb-42be-a2a5-6fd56df17e28 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.109130 Oct 04 11:03:17.682429 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 560/1104] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:17 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:17.708648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b7e7c7f7-f088-47a0-af58-49afd81d9984 tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.761574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:17.764877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b7e7c7f7-f088-47a0-af58-49afd81d9984 tempest-ServersWithSpecificFlavorTestJSON-1821815969 tempest-ServersWithSpecificFlavorTestJSON-1821815969-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066469 Oct 04 11:03:17.772212 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 561/1105] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:03:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:17.793664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.794319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:17.806739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.811240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.811746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.812493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.812951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.813414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.830124 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e53c515c-6939-40c5-b5ac-01b7e48f5e9a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.376364 Oct 04 11:03:17.842136 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 545/1106] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:17 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:17.863576 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] HTTP exception thrown: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Request method failure captured: Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 HTTP/1.1 Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIFr2lanSWlrBlkdsNYBKLHJ4GRE6ItQF7gdMvso-6vSrUuJlFVD24yyQZZp0IlrApovmh1vPmOQfLupE6gBsMQc-iuBv0tCVnVaz5D4vzmuwuSdFVe20zqHlN0IcPx-Zr-R-p3dJGoNof3uz25qIsOEZX9lZHBuEw-7OWoKCPyGBw Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:17.866557 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02a6b3dcd80b41c090b9567856b9d7c7"}]}] Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6c2f73db46ee4f88a988540177a931e3 Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.868338 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c19f44e6-544a-463f-9b91-f68bb9d31348'} Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:17.869184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.870664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.874287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Returning 404 to user: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:17.876316 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1903d130-bc5a-4a08-a8c1-dd90b1fa114c tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 404 len: 111 microversion: 2.1 time: 0.086954 Oct 04 11:03:17.877855 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 562/1107] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:03:17 2022] DELETE /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:17.887569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.888201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: c19f44e6-544a-463f-9b91-f68bb9d31348] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:17.900185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.900582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.909464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.910586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.913051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.913705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.953917 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] HTTP exception thrown: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Request method failure captured: Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 HTTP/1.1 Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIFr2lanSWlrBlkdsNYBKLHJ4GRE6ItQF7gdMvso-6vSrUuJlFVD24yyQZZp0IlrApovmh1vPmOQfLupE6gBsMQc-iuBv0tCVnVaz5D4vzmuwuSdFVe20zqHlN0IcPx-Zr-R-p3dJGoNof3uz25qIsOEZX9lZHBuEw-7OWoKCPyGBw Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:17.956522 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02a6b3dcd80b41c090b9567856b9d7c7"}]}] Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 6c2f73db46ee4f88a988540177a931e3 Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.958143 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'c19f44e6-544a-463f-9b91-f68bb9d31348'} Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:17.958983 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. Oct 04 11:03:17.960511 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:17.963636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Returning 404 to user: Instance c19f44e6-544a-463f-9b91-f68bb9d31348 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:17.964683 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a934903b-cd16-4355-b288-15d699a5f5ce tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348" status: 404 len: 111 microversion: 2.1 time: 0.083023 Oct 04 11:03:17.965425 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 546/1108] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:17 2022] GET /compute/v2.1/servers/c19f44e6-544a-463f-9b91-f68bb9d31348 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:03:17.974547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:17.975307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:17.989625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.990471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.991088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:17.991989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:17.992605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:17.994354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.028871 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] HTTP exception thrown: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.033974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:18.035399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:18.044079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.048340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.048795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.049570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.050026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.050445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Request method failure captured: Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 HTTP/1.1 Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIFr2lanSWlrBlkdsNYBKLHJ4GRE6ItQF7gdMvso-6vSrUuJlFVD24yyQZZp0IlrApovmh1vPmOQfLupE6gBsMQc-iuBv0tCVnVaz5D4vzmuwuSdFVe20zqHlN0IcPx-Zr-R-p3dJGoNof3uz25qIsOEZX9lZHBuEw-7OWoKCPyGBw Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:18.053451 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02a6b3dcd80b41c090b9567856b9d7c7"}]}] Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6c2f73db46ee4f88a988540177a931e3 Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.055043 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'be5981b8-d0e7-43d1-89ed-0b1186788807'} Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:18.056502 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.057945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.064411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Returning 404 to user: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:18.066330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff47923a-07a3-4968-b646-1720b6fe96d3 tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "DELETE /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 404 len: 111 microversion: 2.1 time: 0.096595 Oct 04 11:03:18.074950 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 563/1109] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:03:17 2022] DELETE /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:18.082842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:18.083466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] [instance: be5981b8-d0e7-43d1-89ed-0b1186788807] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:18.119662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.120159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.125123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.129740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.130230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.137601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.186098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] HTTP exception thrown: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Request method failure captured: Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 HTTP/1.1 Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIFr2lanSWlrBlkdsNYBKLHJ4GRE6ItQF7gdMvso-6vSrUuJlFVD24yyQZZp0IlrApovmh1vPmOQfLupE6gBsMQc-iuBv0tCVnVaz5D4vzmuwuSdFVe20zqHlN0IcPx-Zr-R-p3dJGoNof3uz25qIsOEZX9lZHBuEw-7OWoKCPyGBw Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:18.187663 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02a6b3dcd80b41c090b9567856b9d7c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02a6b3dcd80b41c090b9567856b9d7c7"}]}] Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 02a6b3dcd80b41c090b9567856b9d7c7 Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550 Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6c2f73db46ee4f88a988540177a931e3 Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1290956550-project Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.189780 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'be5981b8-d0e7-43d1-89ed-0b1186788807'} Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:18.190690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. Oct 04 11:03:18.191976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:18.193316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] Returning 404 to user: Instance be5981b8-d0e7-43d1-89ed-0b1186788807 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:18.193316 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d9c944c-2bbe-4fd4-aac2-de22be88c7df tempest-ServersWithSpecificFlavorTestJSON-1290956550 tempest-ServersWithSpecificFlavorTestJSON-1290956550-project] 10.222.0.23 "GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807" status: 404 len: 111 microversion: 2.1 time: 0.110391 Oct 04 11:03:18.193316 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 564/1110] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:18 2022] GET /compute/v2.1/servers/be5981b8-d0e7-43d1-89ed-0b1186788807 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:18.263391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:18.264081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:18.273071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.273071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.273071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.281818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.282443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.282957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.498713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:18.507680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-141dbff2-342e-40bb-838b-c4d24686103b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1282 microversion: 2.1 time: 0.249379 Oct 04 11:03:18.515131 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 565/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:18 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1282 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:18.706245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5ce88279-7ca1-49ac-b0c3-7803b18bd54c tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44f9a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:18.710069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:18.720588 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7c2f51a-eeea-48d2-bc76-cf88511cf5b2 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1325 microversion: 2.1 time: 0.690182 Oct 04 11:03:18.729695 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 547/1112] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:18 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1325 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:18.848713 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5ce88279-7ca1-49ac-b0c3-7803b18bd54c tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.154512 Oct 04 11:03:18.849634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 566/1113] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:18 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:18.864111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:18.864681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:18.899212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.906266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.907131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.917187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.921160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.921672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.928805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7d81d732-d82f-4cd6-bd1f-dcea276684aa req-5d40a27b-ca3b-4ee0-916b-973a595592d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "name": "network-vif-plugged", "status": "completed", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:18.942788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7d81d732-d82f-4cd6-bd1f-dcea276684aa req-5d40a27b-ca3b-4ee0-916b-973a595592d1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:18.943694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7d81d732-d82f-4cd6-bd1f-dcea276684aa req-5d40a27b-ca3b-4ee0-916b-973a595592d1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:18.944382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7d81d732-d82f-4cd6-bd1f-dcea276684aa req-5d40a27b-ca3b-4ee0-916b-973a595592d1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:18.960110 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7d81d732-d82f-4cd6-bd1f-dcea276684aa req-5d40a27b-ca3b-4ee0-916b-973a595592d1 service nova] Creating event network-vif-plugged:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h1-791135-8 Oct 04 11:03:18.976972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7d81d732-d82f-4cd6-bd1f-dcea276684aa req-5d40a27b-ca3b-4ee0-916b-973a595592d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052385 Oct 04 11:03:18.977866 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 567/1114] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:19.318172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:19.392302 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db41222f-4bb0-4ba4-9e41-f0e45cdb0e6a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.532749 Oct 04 11:03:19.393130 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 548/1115] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:18 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:19.542237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:19.543192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:19.564973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:19.566649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:19.568794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:19.570497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:19.573120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:19.573827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:19.749175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:19.749978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:19.771038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:19.773623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:19.774219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:19.782173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:19.782757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:19.783265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:19.928536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:19.942966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f6d0d082-30e7-4b79-9dbb-abbb67352649 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1270 microversion: 2.1 time: 0.403931 Oct 04 11:03:19.945486 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 568/1116] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:19 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1270 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:19.968077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e5c066d-42bf-472b-94a3-18f3ccb6f165 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44d4940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:20.051166 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e5c066d-42bf-472b-94a3-18f3ccb6f165 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.098149 Oct 04 11:03:20.051744 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 569/1117] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:19 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:20.422513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:20.423121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:20.446449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:20.446449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:20.446449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:20.446886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:20.447152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:20.447583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:21.047065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:21.055281 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b8a64ec-1ae2-41f3-84ad-4add74150981 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1521 microversion: 2.1 time: 1.310924 Oct 04 11:03:21.061680 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 549/1118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:19 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1521 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:21.066465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:21.067086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:21.083113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:21.083605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:21.086570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:21.091334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:21.094278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:21.094956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:21.206039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:21.279486 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25407cf4-f2e1-48e7-8fcb-0a0c8b794778 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.860338 Oct 04 11:03:21.295255 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 570/1119] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:20 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:21.309405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b97a738-dc2c-4638-b009-de855e30b333 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d440e8b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:21.412731 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b97a738-dc2c-4638-b009-de855e30b333 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.116086 Oct 04 11:03:21.413490 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 571/1120] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:21 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:21.425696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:21.436268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:21.461661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:21.465822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:21.468015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:21.473014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:21.474660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:21.475334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:21.574419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:03:21.838965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ce8aba2-c3be-4eef-b366-585fae12e41b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 204 len: 0 microversion: 2.1 time: 0.421534 Oct 04 11:03:21.842064 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 572/1121] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:03:21 2022] DELETE /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:03:21.871503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:21.875682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:21.911582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:21.912104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:21.918102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:21.923577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:21.924411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:21.925066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:22.358736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:22.373031 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdf3b572-710a-4716-b163-6cb5a9248a81 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1312 microversion: 2.1 time: 1.310087 Oct 04 11:03:22.373935 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 550/1122] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:21 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1312 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:22.384069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:22.384789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:22.406561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:22.407063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:22.407497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:22.408220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:22.408683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:22.409108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:22.508502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:22.530306 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61b5970b-85d6-4052-91e1-766f40a7b287 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1527 microversion: 2.1 time: 0.674074 Oct 04 11:03:22.531006 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 573/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:21 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1527 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:22.552040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dcb06961-54b1-4789-b728-7264fd1d2c18 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d448b9d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:22.594305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:22.626859 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b02ca3a5-ec5a-4b58-82d1-658a4084c30d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.250602 Oct 04 11:03:22.631784 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 551/1124] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:22 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:22.684483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dcb06961-54b1-4789-b728-7264fd1d2c18 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.152318 Oct 04 11:03:22.685272 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 574/1125] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:22 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:22.843976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b7597b56-4735-4351-8edc-fa67a29c0b30 req-e47d81e2-8ed7-4303-a5de-7c43d891c2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:22.886778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b7597b56-4735-4351-8edc-fa67a29c0b30 req-e47d81e2-8ed7-4303-a5de-7c43d891c2d8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:22.887281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b7597b56-4735-4351-8edc-fa67a29c0b30 req-e47d81e2-8ed7-4303-a5de-7c43d891c2d8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:22.887719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b7597b56-4735-4351-8edc-fa67a29c0b30 req-e47d81e2-8ed7-4303-a5de-7c43d891c2d8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:22.932706 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b7597b56-4735-4351-8edc-fa67a29c0b30 req-e47d81e2-8ed7-4303-a5de-7c43d891c2d8 service nova] Creating event network-changed:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h2-791135-8 Oct 04 11:03:22.955431 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b7597b56-4735-4351-8edc-fa67a29c0b30 req-e47d81e2-8ed7-4303-a5de-7c43d891c2d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114945 Oct 04 11:03:22.956432 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 552/1126] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:23.400983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:23.408407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:23.415877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:23.416681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:23.417305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:23.418322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:23.418967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:23.422838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:23.564399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:23.565691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:23.591478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:23.592614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:23.593268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:23.594227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:23.594885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:23.595766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:23.952827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:23.967212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ed4e473-1c07-4fc3-8876-e75a96b11c34 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1312 microversion: 2.1 time: 0.568193 Oct 04 11:03:23.970228 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 575/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:23 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1312 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:23.978338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:23.987284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:24.006073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:24.006571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:24.007008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:24.013083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:24.015036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:24.015665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:24.193724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:24.242521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2952ab43-6f4b-46d4-8666-a5f356f4edae tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.271010 Oct 04 11:03:24.244439 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 576/1128] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:23 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:24.249038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a719e0c-16a5-4ebd-9b48-700107bfb2f9 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44f9280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:24.301171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae296c06e8e490db21812b28044533c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2070b5bd76a54fa6b3cbc9c9bee8500d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:24.312871 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31c31b41-e5b5-43b8-9491-d3ce6b88b067 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 200 len: 1527 microversion: 2.1 time: 0.753281 Oct 04 11:03:24.316503 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 553/1129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:23 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 1527 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:24.322138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a719e0c-16a5-4ebd-9b48-700107bfb2f9 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.076054 Oct 04 11:03:24.330399 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 577/1130] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:24 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:24.991094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:24.991665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:25.003814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:25.004317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:25.009496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:25.013332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:25.015194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:25.015635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:25.031314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2e604743-41fe-4fd9-8e2b-7c83c21dadb3 req-70df8c6a-08aa-402f-a64d-e5576bb7bf7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6824acb-eefa-4bca-b75a-60b5c8fec272", "name": "network-vif-deleted", "tag": "4c27a722-231b-4dad-ba63-380265db5958"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:25.046255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:25.053717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2e604743-41fe-4fd9-8e2b-7c83c21dadb3 req-70df8c6a-08aa-402f-a64d-e5576bb7bf7f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:25.058432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:25.059258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2e604743-41fe-4fd9-8e2b-7c83c21dadb3 req-70df8c6a-08aa-402f-a64d-e5576bb7bf7f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:25.060893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2e604743-41fe-4fd9-8e2b-7c83c21dadb3 req-70df8c6a-08aa-402f-a64d-e5576bb7bf7f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:25.085073 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2e604743-41fe-4fd9-8e2b-7c83c21dadb3 req-70df8c6a-08aa-402f-a64d-e5576bb7bf7f service nova] Creating event network-vif-deleted:4c27a722-231b-4dad-ba63-380265db5958 for instance d6824acb-eefa-4bca-b75a-60b5c8fec272 on n-h1-791135-8 Oct 04 11:03:25.093743 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2e604743-41fe-4fd9-8e2b-7c83c21dadb3 req-70df8c6a-08aa-402f-a64d-e5576bb7bf7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066082 Oct 04 11:03:25.095057 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 578/1131] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:25.272706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:25.274107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:25.291998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:25.292892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:25.293593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:25.294631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:25.295317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:25.298373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:25.570766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:25.612080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:25.698228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:25.724420 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81720873-eef7-43bc-ace8-9462b6392f7a tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.455904 Oct 04 11:03:25.725382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 579/1132] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:25 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:25.741794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:25.742748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: d6824acb-eefa-4bca-b75a-60b5c8fec272] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:25.753312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:25.765523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:25.770849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:25.772229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:25.772717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:25.773158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:25.799514 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Instance d6824acb-eefa-4bca-b75a-60b5c8fec272 could not be found. Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 HTTP/1.1 Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:25.799852 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance d6824acb-eefa-4bca-b75a-60b5c8fec272 could not be found. Oct 04 11:03:25.801386 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'd6824acb-eefa-4bca-b75a-60b5c8fec272'} Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6824acb-eefa-4bca-b75a-60b5c8fec272 could not be found. Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:25.802268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6824acb-eefa-4bca-b75a-60b5c8fec272 could not be found. Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6824acb-eefa-4bca-b75a-60b5c8fec272 could not be found. Oct 04 11:03:25.803574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.804745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Instance d6824acb-eefa-4bca-b75a-60b5c8fec272 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:25.804745 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d3505ef-3cba-4deb-b67e-1f9bb162eed8 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272" status: 404 len: 111 microversion: 2.1 time: 0.074727 Oct 04 11:03:25.806485 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 580/1133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:25 2022] GET /compute/v2.1/servers/d6824acb-eefa-4bca-b75a-60b5c8fec272 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:25.811486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b6ed2d8-d42f-4336-9225-3397f0e4cd74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d46d98b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:25.882723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:25.894631 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b6ed2d8-d42f-4336-9225-3397f0e4cd74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.086033 Oct 04 11:03:25.904760 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 581/1134] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:25 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:25.904760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b9459a6-0a72-4a1c-8305-ac3a8b7bf71b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '.version_select at 0x7f71d450e1f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:25.908208 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4fb3a685-0d8a-4aa2-bd93-5fa741ee6b26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1312 microversion: 2.1 time: 0.920914 Oct 04 11:03:25.912206 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 554/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:24 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1312 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:25.924029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:25.969439 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5b9459a6-0a72-4a1c-8305-ac3a8b7bf71b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Image not found. Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b9459a6-0a72-4a1c-8305-ac3a8b7bf71b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/e8c45dfa-af5a-4a7f-8541-dbccec946d39 HTTP/1.1 Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:25.971458 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'e8c45dfa-af5a-4a7f-8541-dbccec946d39'} Oct 04 11:03:25.973112 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e8c45dfa-af5a-4a7f-8541-dbccec946d39 to delete Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:25.974140 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8c45dfa-af5a-4a7f-8541-dbccec946d39 could not be found. Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:25.975635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b9459a6-0a72-4a1c-8305-ac3a8b7bf71b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:25.977148 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b9459a6-0a72-4a1c-8305-ac3a8b7bf71b tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/images/e8c45dfa-af5a-4a7f-8541-dbccec946d39" status: 404 len: 62 microversion: 2.1 time: 0.079260 Oct 04 11:03:25.981550 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 582/1136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:25 2022] DELETE /compute/v2.1/images/e8c45dfa-af5a-4a7f-8541-dbccec946d39 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:03:25.985979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:25.986480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:25.996045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:25.996602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:25.996838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:25.997574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:26.004307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:26.005008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:26.030453 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd HTTP/1.1 Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:26.032749 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.034102 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'cc83d7b6-ee89-4d05-a410-0522214854fd'} Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:26.034851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.036132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.040571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:26.041698 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6594ed01-f3ce-4438-aed5-4b0e3314e3db tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 404 len: 111 microversion: 2.1 time: 0.059513 Oct 04 11:03:26.042941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 555/1137] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:03:25 2022] DELETE /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:26.055180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:26.056938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: cc83d7b6-ee89-4d05-a410-0522214854fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:26.062996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:26.063439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:26.063917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:26.064681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:26.065313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:26.065947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:26.082574 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd HTTP/1.1 Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:26.084390 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.086059 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'cc83d7b6-ee89-4d05-a410-0522214854fd'} Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:26.086978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. Oct 04 11:03:26.088709 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:26.090752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Instance cc83d7b6-ee89-4d05-a410-0522214854fd could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:26.092421 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d01c91c2-5d3e-4250-b0a7-3fc48738d410 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd" status: 404 len: 111 microversion: 2.1 time: 0.043779 Oct 04 11:03:26.096492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 583/1138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:26 2022] GET /compute/v2.1/servers/cc83d7b6-ee89-4d05-a410-0522214854fd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:26.103579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-985ab7a3-2324-4aca-9888-120387de85d5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '.version_select at 0x7f71d4860670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:26.137942 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-985ab7a3-2324-4aca-9888-120387de85d5 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152735420" status: 202 len: 0 microversion: 2.1 time: 0.040204 Oct 04 11:03:26.139019 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 556/1139] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:03:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152735420 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:03:26.753073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:26.753783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:26.764674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:26.793054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:26.799596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:26.806367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:26.807698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:26.808800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:26.915737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5cda349b-d520-407b-9c2a-66ea978a34b1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4c4d9d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:27.020936 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5cda349b-d520-407b-9c2a-66ea978a34b1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.112764 Oct 04 11:03:27.032964 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 557/1140] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:26 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:27.038194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:27.039123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:27.047957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:27.048714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:27.049376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:27.050284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:27.050939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:27.051570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:27.265121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:27.317310 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ce6c307-fb61-4727-b233-8ac50caea2e4 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.568505 Oct 04 11:03:27.320248 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 584/1141] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:26 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:27.456700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6bdc2e90-039c-46be-9e28-9ae550823cb1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '.version_select at 0x7f71d440e940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:27.485661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6bdc2e90-039c-46be-9e28-9ae550823cb1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Image not found. Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6bdc2e90-039c-46be-9e28-9ae550823cb1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/76239643-a501-4899-a5df-c267559c1cfc HTTP/1.1 Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:27.488455 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '76239643-a501-4899-a5df-c267559c1cfc'} Oct 04 11:03:27.490317 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 76239643-a501-4899-a5df-c267559c1cfc to delete Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:27.491161 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 76239643-a501-4899-a5df-c267559c1cfc could not be found. Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:27.492322 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:03:27.496510 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.501138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6bdc2e90-039c-46be-9e28-9ae550823cb1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:27.503505 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6bdc2e90-039c-46be-9e28-9ae550823cb1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/images/76239643-a501-4899-a5df-c267559c1cfc" status: 404 len: 62 microversion: 2.1 time: 0.049876 Oct 04 11:03:27.505063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 585/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:27 2022] DELETE /compute/v2.1/images/76239643-a501-4899-a5df-c267559c1cfc => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:03:27.523771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:27.524662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:27.537859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:27.538349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:27.538780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:27.545829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:27.546788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:27.547416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:27.590663 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 HTTP/1.1 Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:27.592495 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.594226 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2'} Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:27.595591 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.597727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.600080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:27.600435 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5acd2158-4e12-42cc-83c9-67dd50c652a1 tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 404 len: 111 microversion: 2.1 time: 0.089270 Oct 04 11:03:27.606650 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 586/1143] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:03:27 2022] DELETE /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:27.612264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:27.621616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] [instance: 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:27.633270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:27.636442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:27.639341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:27.640440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:27.641572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:27.642890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:27.664114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:27.677219 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b125c5a-4b3c-4cf8-8c71-9b3988742133 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1312 microversion: 2.1 time: 0.642697 Oct 04 11:03:27.685252 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 558/1144] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:27 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1312 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:27.690549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] HTTP exception thrown: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Request method failure captured: Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 HTTP/1.1 Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKrIxVWaM2Vps24nxtTFSZsNRk5qd_Cj9KJCtWiPJnW0_6W7kHknHap3cdi7jRn71ouXZKK1JV6k2ccgI2A3qK6WdWymotHeEB89MHWQsBCNHztjBxdXPIHBSI0PugeUH3R8O1o6no18VNedMKKL9kThz0lvzAFrojduMJaHRvMy5U Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:27.692342 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2070b5bd76a54fa6b3cbc9c9bee8500d"}]}] Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2070b5bd76a54fa6b3cbc9c9bee8500d Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135 Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3ae296c06e8e490db21812b28044533c Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1810192135-project Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.693783 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2'} Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:27.694640 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. Oct 04 11:03:27.695846 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:27.709303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] Returning 404 to user: Instance 4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:27.715053 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4ce286d-2072-4385-86f5-1815c40be7ac tempest-ImagesOneServerNegativeTestJSON-1810192135 tempest-ImagesOneServerNegativeTestJSON-1810192135-project] 10.222.0.23 "GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2" status: 404 len: 111 microversion: 2.1 time: 0.106561 Oct 04 11:03:27.715634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 587/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:27 2022] GET /compute/v2.1/servers/4b3f4b15-29ad-4cc6-9ba3-50fa0fff1cd2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:28.040835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-298f8efd-f84c-4820-9d9a-782686c28e6a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4860700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:28.128367 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-298f8efd-f84c-4820-9d9a-782686c28e6a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.091548 Oct 04 11:03:28.131159 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 559/1146] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:28 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:28.349427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:28.351017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:28.366514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:28.369652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:28.370478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:28.373978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:28.374790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:28.376265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:28.579909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:28.622383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8867bc5-4e60-4539-ae13-3b9ce559b69d tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.278821 Oct 04 11:03:28.623629 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 588/1147] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:28 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:28.717987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:28.718890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:28.727050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:28.731790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:28.732446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:28.733343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:28.734559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:28.735165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:29.144203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49f3b38f-d454-4a6d-85d6-1fd64d6dd8fd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d464d1f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:29.233323 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49f3b38f-d454-4a6d-85d6-1fd64d6dd8fd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.092665 Oct 04 11:03:29.245643 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 589/1148] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:29 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:29.501280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:29.524772 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afee009c-1132-4ee6-bf4a-c243719823a6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1312 microversion: 2.1 time: 0.818001 Oct 04 11:03:29.525298 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 560/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:28 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1312 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:29.661495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:29.662167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:29.683897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:29.684401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:29.684848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:29.685624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:29.689107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:29.689638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:29.749178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:30.248933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-065c4210-0e04-47c5-997e-7f180907a17b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4860dc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:30.330465 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-065c4210-0e04-47c5-997e-7f180907a17b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.085472 Oct 04 11:03:30.338925 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 561/1150] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:30 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:30.520755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:30.554364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:30.567225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:30.570335 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d812c00b-5f6f-40b3-a4a2-668aeb9b6318 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.914772 Oct 04 11:03:30.585651 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 590/1151] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:29 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:30.597555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:30.597555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:30.597975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:30.598830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:30.599339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:30.599764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:30.823008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b1823175-d462-41e6-ad74-92ae10065e7b req-86f5d3b9-6806-4e36-8fc3-215456b484da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:30.851451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1823175-d462-41e6-ad74-92ae10065e7b req-86f5d3b9-6806-4e36-8fc3-215456b484da service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:30.851928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1823175-d462-41e6-ad74-92ae10065e7b req-86f5d3b9-6806-4e36-8fc3-215456b484da service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:30.857284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1823175-d462-41e6-ad74-92ae10065e7b req-86f5d3b9-6806-4e36-8fc3-215456b484da service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:30.876317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b1823175-d462-41e6-ad74-92ae10065e7b req-86f5d3b9-6806-4e36-8fc3-215456b484da service nova] Creating event network-vif-plugged:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h2-791135-8 Oct 04 11:03:30.884577 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b1823175-d462-41e6-ad74-92ae10065e7b req-86f5d3b9-6806-4e36-8fc3-215456b484da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064565 Oct 04 11:03:30.888026 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 591/1152] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:31.082174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:31.092077 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-063a0a26-0190-437d-96fb-606cba1db6b3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1312 microversion: 2.1 time: 0.547714 Oct 04 11:03:31.102616 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 562/1153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:30 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:31.345711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-529392e9-5488-47f8-9183-0d9bcb867eb8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d43c1b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:31.406581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-529392e9-5488-47f8-9183-0d9bcb867eb8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.065180 Oct 04 11:03:31.407765 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 592/1154] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:31 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:31.478130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b3c6e64-7d22-4f0e-8ad6-54c9fa0b2360"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:31.482234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:31.488670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:31.489578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:31.490300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:31.491008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:31.491642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:31.492390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:31.606183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:31.607111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:31.616855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:31.617624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:31.624021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:31.624994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:31.625767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:31.629748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:31.833219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:31.864838 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-651f063d-4baa-4978-ada4-11197c48aef3 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.262961 Oct 04 11:03:31.865978 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 593/1155] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:31 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:32.127251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:32.128360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:32.141602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:32.142660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:32.143908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:32.147373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:32.150796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:32.151545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:32.620149 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39cbe280-597a-4043-8588-9cfd27dc6880 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "POST /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.144340 Oct 04 11:03:32.623911 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 563/1156] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:03:31 2022] POST /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 194 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:32.647809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-154a98a1-04c6-4cb8-833f-81a9bc0b3cf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4860ca0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:32.753066 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-154a98a1-04c6-4cb8-833f-81a9bc0b3cf4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.126087 Oct 04 11:03:32.754335 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 564/1157] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:32 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:32.862106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:32.876750 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5878a57-bf1f-4cab-a97d-ff561f72f8df tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1312 microversion: 2.1 time: 0.753914 Oct 04 11:03:32.878242 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 594/1158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:32 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1312 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:32.894058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:32.895067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:32.908479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:32.911450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:32.918317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:32.919492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:32.920977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:32.924031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:33.065767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:33.103775 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f731cae2-56ad-4a67-b878-83836f662fb7 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.213315 Oct 04 11:03:33.142498 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 565/1159] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:32 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:33.770063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bca14030-3be9-44c4-b8d5-3c90c7429b3c tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d45021f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:33.866536 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bca14030-3be9-44c4-b8d5-3c90c7429b3c tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.101465 Oct 04 11:03:33.868770 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 595/1160] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:33 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:33.903944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:33.904558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:33.925251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:33.925764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:33.928320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:33.933749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:33.936350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:33.937884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:34.139263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:34.140024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:34.156269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:34.156785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:34.160577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:34.162558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:34.167475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:34.169366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:34.382477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:34.431623 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b338e07-b5a0-405b-b4ac-6b6901a705aa tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.296526 Oct 04 11:03:34.434317 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 596/1161] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:34 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:34.558934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:34.570504 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8e256ce-0b57-490c-9909-48f0f930ba26 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1460 microversion: 2.1 time: 0.670279 Oct 04 11:03:34.575626 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 566/1162] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:33 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1460 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:34.599587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:34.600272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:34.620052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:34.620562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:34.621063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:34.621749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:34.622205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:34.622639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:34.884759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa7db8bb-1ee1-4278-a6d9-8dfba52a14d6 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d478e550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:34.965113 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a73f1608-0951-4688-9c8f-c43eab3889be tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1611 microversion: 2.1 time: 0.369202 Oct 04 11:03:34.965809 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 597/1163] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:34 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1611 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:34.995162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:34.999308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:35.015371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:35.016263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:35.016894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:35.017796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:35.018473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:35.019141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:35.072537 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa7db8bb-1ee1-4278-a6d9-8dfba52a14d6 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1452 microversion: 2.1 time: 0.192901 Oct 04 11:03:35.080622 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 567/1164] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:34 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1452 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:03:35.096845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1ce456bc797345d6acbcfceb1ef83111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137a10241e0143bfba9a11313f0ee12d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:35.113537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] flavor_id is None. Assuming migration. {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 11:03:35.114351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:03:35.355603 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49036ddf-4b2e-4af1-8f36-5589a01878ec tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a/action" status: 202 len: 0 microversion: 2.1 time: 0.367194 Oct 04 11:03:35.356521 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 598/1165] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:03:34 2022] POST /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:03:35.365498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:35.366470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:35.395018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:35.396805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:35.399411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:35.401603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:35.402966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:35.404417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:35.462555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:35.463492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:35.489960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:35.491151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:35.495231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:35.502194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:35.504343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:35.505962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:36.045752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:36.145750 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-23920237-e471-4627-9195-82369a0adf6e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.688151 Oct 04 11:03:36.149625 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 599/1166] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:35 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:36.172709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c0a1858-fd35-4e25-81bd-c6d986263d37 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d450d040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:36.186397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:36.194363 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9401851-abe6-4846-b59d-4eddeaece130 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1469 microversion: 2.1 time: 0.833420 Oct 04 11:03:36.194954 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 568/1167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:35 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1469 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:37.182378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:37.184597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:37.221008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:37.221652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:37.236611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:37.243353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:37.245607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:37.248199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:37.518413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:37.572605 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23079d8c-0406-4843-998e-db81439ff81e tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.397584 Oct 04 11:03:37.573606 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 569/1168] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:37 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:37.617471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:37.622798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:37.642702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:37.644415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:37.650934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:37.653269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:37.661991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:37.663693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:38.263775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:38.277498 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a22d08c2-11eb-495e-8962-f28e061496e4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1469 microversion: 2.1 time: 0.671756 Oct 04 11:03:38.278167 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 570/1169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:37 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1469 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:38.614648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:38.615385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:38.629333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:38.630877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:38.633291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:38.634518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:38.636539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:38.639253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:38.695531 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c0a1858-fd35-4e25-81bd-c6d986263d37 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1461 microversion: 2.1 time: 2.542542 Oct 04 11:03:38.696247 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 600/1170] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:36 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1461 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:38.716707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11e8b7ac-fec3-4336-9855-07a2259b4f71 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44213a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:38.826093 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11e8b7ac-fec3-4336-9855-07a2259b4f71 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 200 len: 1461 microversion: 2.1 time: 0.115462 Oct 04 11:03:38.827224 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 601/1171] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:38 2022] GET /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 1461 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:38.843153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:38.845147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:38.871622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:38.875566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:38.876982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:38.878063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:38.878933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:38.882543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:38.883359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:38.958401 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57a7a144-0901-4e4b-b412-732fde71dded tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.348178 Oct 04 11:03:38.959592 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 571/1172] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:38 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:39.241649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:39.257261 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-39d0dbbc-7b36-4a6a-8d85-afa2f5792e5e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425" status: 200 len: 1480 microversion: 2.1 time: 0.420518 Oct 04 11:03:39.258789 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 602/1173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:38 2022] GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 => generated 1480 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:39.306373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:39.308156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:39.327459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:39.328892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:39.329593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:39.331764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:39.332941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:39.334868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:39.650323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:39.664118 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-41716c81-e186-446c-966e-caae71e2aa5b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1469 microversion: 2.1 time: 0.367288 Oct 04 11:03:39.683268 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 572/1174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:39 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1469 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:39.991289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:39.993144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:40.023041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:40.027643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:40.029107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:40.030278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:40.031129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:40.032602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:40.205004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:40.263535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e981f2f5-bb8d-43ef-8ccf-7cd2acb5f004 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.276410 Oct 04 11:03:40.267628 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 603/1175] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:39 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:40.292271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:40.292889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:40.305636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:40.306141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:40.306578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:40.307289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:40.311121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:40.312074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:40.634113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:40.651752 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-542f0085-ac15-43e7-8fbb-733d4568acbc tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425" status: 200 len: 1467 microversion: 2.1 time: 0.368122 Oct 04 11:03:40.652083 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 573/1176] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:40 2022] GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 => generated 1467 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:40.677928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-96015484"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:40.687501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:40.688126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:40.689196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:40.695243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:40.695817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:40.696763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:40.707425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:40.708369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:40.708821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:40.711939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:40.722133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:40.723312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:40.730863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:40.733726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:40.734999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:41.234867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:41.248692 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e130fc2d-72f9-4523-be51-6f715504b26d tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1469 microversion: 2.1 time: 0.563258 Oct 04 11:03:41.249703 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 574/1177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:40 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1469 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:41.295857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:41.296928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:41.321806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63388ed1-3908-4410-a584-2db12709c297 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "POST /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a/action" status: 202 len: 0 microversion: 2.1 time: 0.644870 Oct 04 11:03:41.325675 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 604/1178] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:03:40 2022] POST /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:03:41.340408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:41.342942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:41.343626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:41.345300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:41.347057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:41.348731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:41.355872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72b5e53f-ced0-45fc-8962-a347a53fe803 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d43dca60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:41.435481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:41.446809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72b5e53f-ced0-45fc-8962-a347a53fe803 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.114444 Oct 04 11:03:41.455993 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 605/1179] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:41 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:41.534411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:41.591362 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9586dc41-eafd-4a7f-be65-b33df2e1e7fc tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.298825 Oct 04 11:03:41.594903 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 575/1180] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:41 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:42.279787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:42.281285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:42.299315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:42.301267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:42.302219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:42.306189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:42.306898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:42.307606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:42.472937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eed941bf-03bd-4816-afe3-9dd30a55d141 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d47a9790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:42.555395 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eed941bf-03bd-4816-afe3-9dd30a55d141 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.090495 Oct 04 11:03:42.556978 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 576/1181] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:42 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:42.634615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:42.635548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:42.637342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:42.643933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:42.644721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:42.645389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:42.646331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:42.646980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:42.648153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:42.649738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31f78d83-10fa-4d58-a799-5ece07b56205 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.376573 Oct 04 11:03:42.654081 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 606/1182] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:42 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:42.758646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:42.779691 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f835bc6-0031-4bf1-ac9b-6bf349669d8b tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1929 microversion: 2.75 time: 0.157379 Oct 04 11:03:42.780541 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 577/1183] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:42 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:43.347477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1711406-055a-4650-af99-97d660cec903 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Calling method '.version_select at 0x7f71d440eee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:43.363609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1711406-055a-4650-af99-97d660cec903 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.364175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1711406-055a-4650-af99-97d660cec903 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.364885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1711406-055a-4650-af99-97d660cec903 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.365875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1711406-055a-4650-af99-97d660cec903 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.366497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1711406-055a-4650-af99-97d660cec903 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.367284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1711406-055a-4650-af99-97d660cec903 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.394775 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1711406-055a-4650-af99-97d660cec903 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.439991 Oct 04 11:03:43.396255 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 607/1184] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 11:03:42 2022] GET /compute/v2.1/limits => generated 511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:43.522884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b39f0867-68c5-47af-9aa8-8d1a9158edb0 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-536721136", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:43.603031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Calling method '.version_select at 0x7f71d4860a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:43.607470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.608019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.608522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.621602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-b39f0867-68c5-47af-9aa8-8d1a9158edb0 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:03:43.634610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.635336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.635983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.672866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.673670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.674274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.686241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.687025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.687939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.721171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:43.723382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.724141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.724897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.734112 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15e8fb77-7d54-4883-9350-df34f7ecd290 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2467 microversion: 2.53 time: 0.320940 Oct 04 11:03:43.734997 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 578/1185] 10.222.0.23 () {60 vars in 1243 bytes} [Tue Oct 4 11:03:43 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2467 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:43.740760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1e36965-f7bb-49c6-ace1-32f6597d0b02 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4d6a1f0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:43.803953 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1e36965-f7bb-49c6-ace1-32f6597d0b02 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.065921 Oct 04 11:03:43.803953 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 579/1186] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:43 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:43.808322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:43.808934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:43.826964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.831822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.832499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.833481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:43.834106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:43.834739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:43.949209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b39f0867-68c5-47af-9aa8-8d1a9158edb0 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Getting quotas for project 756bccee52ff470d900f5377c94e4ee5. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:03:43.954117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b39f0867-68c5-47af-9aa8-8d1a9158edb0 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Getting quotas for user 2d6fd1b34dba4d1f8d5be3f7e9fa4c0e and project 756bccee52ff470d900f5377c94e4ee5. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:03:43.974952 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b39f0867-68c5-47af-9aa8-8d1a9158edb0 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b39f0867-68c5-47af-9aa8-8d1a9158edb0 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Request method failure captured: Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 1751 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBMOkaWyl7bqxS6ZXnTLgJmZ_-n7ZUxTwXdTX80blUx11AiMpdGBfJtu3ludhF7eVOYg9FrMNji7PU-BlVIpZ2XszxlLGIDAYAzmnOyRuzum1IMUvJ2tcAVko3mQeDapgv-e_1iA63c7O3RnyENsBezmw3I0XOJZ8e562XWIAM_cNkw Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 756bccee52ff470d900f5377c94e4ee5 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1075834772 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_756bccee52ff470d900f5377c94e4ee5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/756bccee52ff470d900f5377c94e4ee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/756bccee52ff470d900f5377c94e4ee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/756bccee52ff470d900f5377c94e4ee5"}]}] Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1075834772 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 756bccee52ff470d900f5377c94e4ee5 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1075834772 Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2d6fd1b34dba4d1f8d5be3f7e9fa4c0e Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-536721136", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:43.977794 n-d-791135-8 devstack@n-api.service[122409]: exception: Maximum number of metadata items exceeds 128 Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-536721136', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:03:43.980457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 11:03:43.983775 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:43.985878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b39f0867-68c5-47af-9aa8-8d1a9158edb0 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:43.988105 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b39f0867-68c5-47af-9aa8-8d1a9158edb0 tempest-AbsoluteLimitsNegativeTestJSON-1075834772 tempest-AbsoluteLimitsNegativeTestJSON-1075834772-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.469187 Oct 04 11:03:43.993141 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 608/1187] 10.222.0.23 () {60 vars in 1148 bytes} [Tue Oct 4 11:03:43 2022] POST /compute/v2.1/servers => generated 87 bytes in 475 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 04 11:03:44.000894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Calling method '.version_select at 0x7f71d43b1a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:44.009134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.010368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.011243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.029372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.030113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.030715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.034795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:44.074540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:44.084023 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c128bfb4-4e2a-4025-b023-6556defc6b31 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.279283 Oct 04 11:03:44.101687 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 580/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:43 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:44.106343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:44.106965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:44.114587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.115089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.117461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.122021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.126657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.127356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.128905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.129602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.130218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.139414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.139973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.140414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.200250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.201981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.202455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.216718 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22ceb626-8b89-4d9c-af31-8fbba97f7c8b tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1160 microversion: 2.53 time: 0.218838 Oct 04 11:03:44.219308 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 609/1189] 10.222.0.23 () {60 vars in 1222 bytes} [Tue Oct 4 11:03:43 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1160 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:44.246389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb2c90a1-a6ab-47d4-b605-bdb4e8c11279 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Calling method '.version_select at 0x7f71d44f9040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:44.250422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb2c90a1-a6ab-47d4-b605-bdb4e8c11279 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.251117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb2c90a1-a6ab-47d4-b605-bdb4e8c11279 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.251841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb2c90a1-a6ab-47d4-b605-bdb4e8c11279 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.257451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:44.272462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb2c90a1-a6ab-47d4-b605-bdb4e8c11279 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.272956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb2c90a1-a6ab-47d4-b605-bdb4e8c11279 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.273515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb2c90a1-a6ab-47d4-b605-bdb4e8c11279 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.280713 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb2c90a1-a6ab-47d4-b605-bdb4e8c11279 tempest-HypervisorAdminV253TestBase-342434120 tempest-HypervisorAdminV253TestBase-342434120-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/d85a362f-acce-4a7f-b884-9b78989b5ab1" status: 200 len: 791 microversion: 2.53 time: 0.048246 Oct 04 11:03:44.281319 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 610/1190] 10.222.0.23 () {60 vars in 1298 bytes} [Tue Oct 4 11:03:44 2022] GET /compute/v2.1/os-hypervisors/d85a362f-acce-4a7f-b884-9b78989b5ab1 => generated 791 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:03:44.300895 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79187f42-5ef0-41d2-9559-7d188e7cf503 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1935 microversion: 2.75 time: 0.201676 Oct 04 11:03:44.302107 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 581/1191] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:44 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1935 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:44.364431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-987e1a72-a105-44cb-b5c3-e5a693922706 req-43e6d381-0f43-4700-9367-6e729730a112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b04194-7767-4636-9ed0-3869ff18e425", "name": "network-vif-unplugged", "status": "completed", "tag": "c9b6f444-374d-48a3-a78e-32dff234e6dd"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:44.382245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-987e1a72-a105-44cb-b5c3-e5a693922706 req-43e6d381-0f43-4700-9367-6e729730a112 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:44.385971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-987e1a72-a105-44cb-b5c3-e5a693922706 req-43e6d381-0f43-4700-9367-6e729730a112 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:44.386718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-987e1a72-a105-44cb-b5c3-e5a693922706 req-43e6d381-0f43-4700-9367-6e729730a112 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:44.410795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-987e1a72-a105-44cb-b5c3-e5a693922706 req-43e6d381-0f43-4700-9367-6e729730a112 service nova] Creating event network-vif-unplugged:c9b6f444-374d-48a3-a78e-32dff234e6dd for instance 59b04194-7767-4636-9ed0-3869ff18e425 on n-h1-791135-8 Oct 04 11:03:44.417006 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-987e1a72-a105-44cb-b5c3-e5a693922706 req-43e6d381-0f43-4700-9367-6e729730a112 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056578 Oct 04 11:03:44.417830 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 611/1192] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:44.818678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e642267-c263-4e5a-bd7b-12515ed425da tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d49273a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:44.886400 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e642267-c263-4e5a-bd7b-12515ed425da tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.073025 Oct 04 11:03:44.887968 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 582/1193] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:44 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:45.112813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:45.113883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:45.124263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:45.124748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:45.125387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:45.126278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:45.126977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:45.128045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:45.301124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:45.310607 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fea3cfc1-d824-42ca-a9e8-ef67dd9d7b7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.203842 Oct 04 11:03:45.311751 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 612/1194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:45 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:45.332735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:45.333364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:45.341018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:45.344502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:45.346621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:45.349140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:45.351357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:45.353130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:45.484065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:45.502641 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0af284a-b12b-4329-bf8e-f6159feaebd6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1935 microversion: 2.75 time: 0.173842 Oct 04 11:03:45.504005 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 583/1195] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:45 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1935 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:45.905248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea8c0056-d587-493d-9ba5-baf351d31f06 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4414e50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:46.338519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:46.351103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:46.375042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:46.375793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:46.376608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:46.377605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:46.379193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:46.380122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:46.718640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:46.731253 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4d9cc2c-8fae-4e4a-9834-1f972f50c26c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.397877 Oct 04 11:03:46.736802 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 584/1196] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:46 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:46.752607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:46.756330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:46.783641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:46.784550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:46.786541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:46.790290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:46.791959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:46.792632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:46.970316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:47.020560 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3cd1fe13-8716-404e-91e8-45d88b7724f6 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1935 microversion: 2.75 time: 0.282353 Oct 04 11:03:47.042494 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 585/1197] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:46 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1935 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:47.762601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:47.763154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:47.785772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:47.791276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:47.794973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:47.798335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:47.799759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:47.801392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:48.236903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:48.245790 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70d9883d-1674-4ff6-baa4-3b7ff585c321 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.489766 Oct 04 11:03:48.251978 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 586/1198] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:47 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:48.260542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:48.261455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:48.268340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:48.269010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:48.269628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:48.270792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:48.271397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:48.271983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:48.482223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:48.525337 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efb4bb82-e145-4a7f-8de0-546e434abadd tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1935 microversion: 2.75 time: 0.271275 Oct 04 11:03:48.530121 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 587/1199] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:48 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1935 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:48.807831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6dea26c3-0bdc-4fa6-97a6-69faeb38d97f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Calling method '.version_select at 0x7f71d4c4db80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:48.809643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6dea26c3-0bdc-4fa6-97a6-69faeb38d97f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '48f086e797bd4be0b33e7fe03f34d4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fe9ca1b7784cf0847e1b011d2c3bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6dea26c3-0bdc-4fa6-97a6-69faeb38d97f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Request method failure captured: Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMTHXuiRg3C6yL1h6w9qca4OTFz37dEPbDQSJz0oib9gAfgeyWrjPzixKG_6gCj4qRzhZT5xw0oH4ziT3uRAOhrohsZoB5mki-1CP6GrxxZPsAwO45X0_ucnsM-gT0mkUPdEmBZU2Pu_BDe9Eg8SU529CIMeiOqkW7yQwjRmd-aNe8 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}] Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 48f086e797bd4be0b33e7fe03f34d4ac Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: action_args: {} Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 11:03:48.816612 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 11:03:48.821289 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:48.824627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6dea26c3-0bdc-4fa6-97a6-69faeb38d97f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:48.827433 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6dea26c3-0bdc-4fa6-97a6-69faeb38d97f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.294937 Oct 04 11:03:48.828282 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 588/1200] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Oct 4 11:03:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:48.846591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c44f97e2-dee5-4f95-89d9-f4d835ac040d tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Calling method '.version_select at 0x7f71d47a0280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:48.852549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c44f97e2-dee5-4f95-89d9-f4d835ac040d tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '48f086e797bd4be0b33e7fe03f34d4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fe9ca1b7784cf0847e1b011d2c3bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c44f97e2-dee5-4f95-89d9-f4d835ac040d tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Request method failure captured: Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMTHXuiRg3C6yL1h6w9qca4OTFz37dEPbDQSJz0oib9gAfgeyWrjPzixKG_6gCj4qRzhZT5xw0oH4ziT3uRAOhrohsZoB5mki-1CP6GrxxZPsAwO45X0_ucnsM-gT0mkUPdEmBZU2Pu_BDe9Eg8SU529CIMeiOqkW7yQwjRmd-aNe8 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}] Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 48f086e797bd4be0b33e7fe03f34d4ac Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: action_args: {} Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 11:03:48.863381 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 11:03:48.870698 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:48.875779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c44f97e2-dee5-4f95-89d9-f4d835ac040d tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:48.879884 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c44f97e2-dee5-4f95-89d9-f4d835ac040d tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.040860 Oct 04 11:03:48.881804 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 589/1201] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:03:48 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:48.920555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c743bd21-f27d-437c-976b-2a9f4198df7c req-b73508ce-5a80-4275-8a4f-23f6b0913353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e63ee3-3a6c-446a-b69b-eb8e79ad477a", "name": "network-vif-plugged", "status": "completed", "tag": "6aeb5add-c4a0-4408-aa02-652effd838a2"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:48.949211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c743bd21-f27d-437c-976b-2a9f4198df7c req-b73508ce-5a80-4275-8a4f-23f6b0913353 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:48.950879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c743bd21-f27d-437c-976b-2a9f4198df7c req-b73508ce-5a80-4275-8a4f-23f6b0913353 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:48.951567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c743bd21-f27d-437c-976b-2a9f4198df7c req-b73508ce-5a80-4275-8a4f-23f6b0913353 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:48.983955 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c743bd21-f27d-437c-976b-2a9f4198df7c req-b73508ce-5a80-4275-8a4f-23f6b0913353 service nova] Creating event network-vif-plugged:6aeb5add-c4a0-4408-aa02-652effd838a2 for instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a on n-h1-791135-8 Oct 04 11:03:49.019924 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c743bd21-f27d-437c-976b-2a9f4198df7c req-b73508ce-5a80-4275-8a4f-23f6b0913353 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124218 Oct 04 11:03:49.021267 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 590/1202] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:49.028969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-741afcc2-58b4-446c-ac5b-a9819d82ca7f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Calling method '.version_select at 0x7f71d4ba60d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:49.032605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-741afcc2-58b4-446c-ac5b-a9819d82ca7f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '48f086e797bd4be0b33e7fe03f34d4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fe9ca1b7784cf0847e1b011d2c3bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-741afcc2-58b4-446c-ac5b-a9819d82ca7f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Request method failure captured: Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMTHXuiRg3C6yL1h6w9qca4OTFz37dEPbDQSJz0oib9gAfgeyWrjPzixKG_6gCj4qRzhZT5xw0oH4ziT3uRAOhrohsZoB5mki-1CP6GrxxZPsAwO45X0_ucnsM-gT0mkUPdEmBZU2Pu_BDe9Eg8SU529CIMeiOqkW7yQwjRmd-aNe8 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}] Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 48f086e797bd4be0b33e7fe03f34d4ac Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: action_args: {} Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.035158 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.042327 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:49.042327 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:49.042327 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:03:49.042327 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:03:49.042327 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 11:03:49.042327 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.052628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-741afcc2-58b4-446c-ac5b-a9819d82ca7f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:49.057959 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-741afcc2-58b4-446c-ac5b-a9819d82ca7f tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.032690 Oct 04 11:03:49.059169 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 591/1203] 10.222.0.23 () {58 vars in 1179 bytes} [Tue Oct 4 11:03:49 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:49.167376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Calling method '.version_select at 0x7f71d4860ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:49.170083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:49.171031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:49.172558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:49.201822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:49.202672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:49.204111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:49.229593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:49.230922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:49.232917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:49.264547 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-085eab0c-9bac-4b4a-9c98-ba1e7c01e9a5 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.198602 Oct 04 11:03:49.265334 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 592/1204] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:03:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:49.282629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e250ad72-130a-4f36-b22f-fcff1a319e31 tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Calling method '.version_select at 0x7f71d473e5e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:49.288016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e250ad72-130a-4f36-b22f-fcff1a319e31 tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '48f086e797bd4be0b33e7fe03f34d4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fe9ca1b7784cf0847e1b011d2c3bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e250ad72-130a-4f36-b22f-fcff1a319e31 tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Request method failure captured: Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMTHXuiRg3C6yL1h6w9qca4OTFz37dEPbDQSJz0oib9gAfgeyWrjPzixKG_6gCj4qRzhZT5xw0oH4ziT3uRAOhrohsZoB5mki-1CP6GrxxZPsAwO45X0_ucnsM-gT0mkUPdEmBZU2Pu_BDe9Eg8SU529CIMeiOqkW7yQwjRmd-aNe8 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}] Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 48f086e797bd4be0b33e7fe03f34d4ac Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '1'} Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.291468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.296409 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:49.296409 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:49.296409 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:03:49.296409 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:03:49.296409 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 11:03:49.296409 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.300479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e250ad72-130a-4f36-b22f-fcff1a319e31 tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:49.302351 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e250ad72-130a-4f36-b22f-fcff1a319e31 tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.029164 Oct 04 11:03:49.304442 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 593/1205] 10.222.0.23 () {58 vars in 1173 bytes} [Tue Oct 4 11:03:49 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:49.313510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:49.314963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:49.323041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:49.323872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:49.324632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:49.325618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:49.326245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:49.326841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:49.628973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:49.648057 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32d0c950-e546-4b6c-849d-3d1eca2e4ae6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.334507 Oct 04 11:03:49.672446 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 594/1206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:49 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:49.684147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b75e91f-c711-47a3-9926-8152c30026dc tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Calling method '.version_select at 0x7f71d4c4d430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:49.687505 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0b75e91f-c711-47a3-9926-8152c30026dc tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] HTTP exception thrown: Hypervisor with ID 'f60df659-0157-439d-8713-697d550ee886' could not be found. Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b75e91f-c711-47a3-9926-8152c30026dc tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Request method failure captured: Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/f60df659-0157-439d-8713-697d550ee886/uptime HTTP/1.1 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMUTL_zQuDyl8BctKOJuhnqtHMWgz9mIxmHEE1hBhJIL7Q3N9NyxFCvEBLNVOFbLo-KzkUf5ZVkdj7v0R_JvtlaSrkJYsh68qRMnEsNPMx2TILX0bmOxeHSHfy-Jt-Fef_u4xAoYwyT7eD9t0zFh5UH2f14ERKWIGHnO7uU2hSlf88 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 29883946ae1d48edaa558fe3c4acfe53 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-718232007 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29883946ae1d48edaa558fe3c4acfe53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29883946ae1d48edaa558fe3c4acfe53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29883946ae1d48edaa558fe3c4acfe53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29883946ae1d48edaa558fe3c4acfe53"}]}] Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-718232007 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 29883946ae1d48edaa558fe3c4acfe53 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-718232007 Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 0fc6d86eb2bf476ba768d481ebbc6afd Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: exception: Hypervisor with ID 'f60df659-0157-439d-8713-697d550ee886' could not be found. Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'f60df659-0157-439d-8713-697d550ee886'} Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f60df659-0157-439d-8713-697d550ee886' Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:49.734545 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f60df659-0157-439d-8713-697d550ee886' could not be found. Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f60df659-0157-439d-8713-697d550ee886' could not be found. Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b75e91f-c711-47a3-9926-8152c30026dc tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Returning 404 to user: Hypervisor with ID 'f60df659-0157-439d-8713-697d550ee886' could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b75e91f-c711-47a3-9926-8152c30026dc tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/f60df659-0157-439d-8713-697d550ee886/uptime" status: 404 len: 123 microversion: 2.1 time: 0.062272 Oct 04 11:03:49.739934 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 595/1207] 10.222.0.23 () {58 vars in 1278 bytes} [Tue Oct 4 11:03:49 2022] GET /compute/v2.1/os-hypervisors/f60df659-0157-439d-8713-697d550ee886/uptime => generated 123 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:49.753858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:49.754553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:49.767687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:49.768095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:49.768635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:49.769388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:49.769842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:49.770270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:49.967594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] Lazy-loading 'services' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:50.007502 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be9d4a73-0f41-46c9-b0f6-7b59b60d2f11 tempest-ServersAdmin275Test-1379980579 tempest-ServersAdmin275Test-1379980579-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1920 microversion: 2.75 time: 0.269646 Oct 04 11:03:50.010108 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 596/1208] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:49 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1920 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:50.021851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Calling method '.version_select at 0x7f71d4dce160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:50.026335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.030003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.030713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:50.038919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:50.061493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.066053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.066789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:50.093043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.093901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.094529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:50.112880 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0545c11-0904-4ad9-b160-2341aaa79234 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.101512 Oct 04 11:03:50.127639 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 597/1209] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:03:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:50.134675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:50.135428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:50.143087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.145085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.146254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:50.150822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.151400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.151842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:50.221215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:03:50.392387 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d27643f-809b-4d7f-8c47-79ef44776cfd tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 204 len: 0 microversion: 2.75 time: 0.262447 Oct 04 11:03:50.393585 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 598/1210] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:03:50 2022] DELETE /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:03:50.402322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d137244c-ea70-4490-9b9c-f3501daa10db tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Calling method '.version_select at 0x7f71d4df5b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:50.404528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d137244c-ea70-4490-9b9c-f3501daa10db tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '48f086e797bd4be0b33e7fe03f34d4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fe9ca1b7784cf0847e1b011d2c3bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d137244c-ea70-4490-9b9c-f3501daa10db tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Request method failure captured: Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMTHXuiRg3C6yL1h6w9qca4OTFz37dEPbDQSJz0oib9gAfgeyWrjPzixKG_6gCj4qRzhZT5xw0oH4ziT3uRAOhrohsZoB5mki-1CP6GrxxZPsAwO45X0_ucnsM-gT0mkUPdEmBZU2Pu_BDe9Eg8SU529CIMeiOqkW7yQwjRmd-aNe8 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30fe9ca1b7784cf0847e1b011d2c3bd8"}]}] Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 30fe9ca1b7784cf0847e1b011d2c3bd8 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003 Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 48f086e797bd4be0b33e7fe03f34d4ac Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1243297003-project Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '1'} Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 11:03:50.406531 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d137244c-ea70-4490-9b9c-f3501daa10db tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d137244c-ea70-4490-9b9c-f3501daa10db tempest-HypervisorAdminNegativeTestJSON-1243297003 tempest-HypervisorAdminNegativeTestJSON-1243297003-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.012943 Oct 04 11:03:50.410758 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 599/1211] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:03:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:50.414882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:50.418757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:50.426993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.427647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.428160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:50.428961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.431313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.433320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:50.600515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:50.619084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:50.623015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:50.630089 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-897dfb9a-700e-4779-99a9-3a3130d78db7 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1444 microversion: 2.75 time: 0.220157 Oct 04 11:03:50.631621 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 600/1212] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:50 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:50.636398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0766449d-a726-4a85-b6b4-ba173c1cf774 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Calling method '.version_select at 0x7f71d473e160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:50.641522 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0766449d-a726-4a85-b6b4-ba173c1cf774 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] HTTP exception thrown: Hypervisor with ID '20ed1828-bf46-44cf-b880-e85f56eafecf' could not be found. Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0766449d-a726-4a85-b6b4-ba173c1cf774 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Request method failure captured: Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/20ed1828-bf46-44cf-b880-e85f56eafecf HTTP/1.1 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMUTL_zQuDyl8BctKOJuhnqtHMWgz9mIxmHEE1hBhJIL7Q3N9NyxFCvEBLNVOFbLo-KzkUf5ZVkdj7v0R_JvtlaSrkJYsh68qRMnEsNPMx2TILX0bmOxeHSHfy-Jt-Fef_u4xAoYwyT7eD9t0zFh5UH2f14ERKWIGHnO7uU2hSlf88 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 29883946ae1d48edaa558fe3c4acfe53 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-718232007 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29883946ae1d48edaa558fe3c4acfe53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29883946ae1d48edaa558fe3c4acfe53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29883946ae1d48edaa558fe3c4acfe53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29883946ae1d48edaa558fe3c4acfe53"}]}] Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-718232007 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 29883946ae1d48edaa558fe3c4acfe53 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-718232007 Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 0fc6d86eb2bf476ba768d481ebbc6afd Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: exception: Hypervisor with ID '20ed1828-bf46-44cf-b880-e85f56eafecf' could not be found. Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '20ed1828-bf46-44cf-b880-e85f56eafecf'} Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '20ed1828-bf46-44cf-b880-e85f56eafecf' Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:50.643604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '20ed1828-bf46-44cf-b880-e85f56eafecf' could not be found. Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '20ed1828-bf46-44cf-b880-e85f56eafecf' could not be found. Oct 04 11:03:50.647757 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:50.652935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0766449d-a726-4a85-b6b4-ba173c1cf774 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] Returning 404 to user: Hypervisor with ID '20ed1828-bf46-44cf-b880-e85f56eafecf' could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:50.654119 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0766449d-a726-4a85-b6b4-ba173c1cf774 tempest-HypervisorAdminNegativeTestJSON-718232007 tempest-HypervisorAdminNegativeTestJSON-718232007-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/20ed1828-bf46-44cf-b880-e85f56eafecf" status: 404 len: 123 microversion: 2.1 time: 0.021287 Oct 04 11:03:50.659705 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 601/1213] 10.222.0.23 () {58 vars in 1257 bytes} [Tue Oct 4 11:03:50 2022] GET /compute/v2.1/os-hypervisors/20ed1828-bf46-44cf-b880-e85f56eafecf => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:50.674311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:50.675309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:50.683617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.684430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.685120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:50.686095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:50.686983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:50.687648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:51.099038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:51.112203 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4762f8d0-df03-47e6-8f80-b66693b39629 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.444103 Oct 04 11:03:51.115792 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 602/1214] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:50 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:51.666658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:51.667640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:51.677961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:51.678812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:51.679472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:51.682095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:51.682876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:51.683636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:51.857574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:51.874757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:51.885556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:51.902390 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40baf64b-71d4-46a1-8932-ef36faf76754 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1444 microversion: 2.75 time: 0.242190 Oct 04 11:03:51.903942 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 603/1215] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:51 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1444 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:52.154058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:52.154931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:52.176377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:52.178390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:52.180963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:52.188617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:52.191079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:52.193473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:53.208688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:53.218512 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6a420cb-1973-43d2-aad4-5a9cdbc97e4f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 1.077073 Oct 04 11:03:53.238176 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 604/1216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:52 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:53.250543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:53.258763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:53.274646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:53.275559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:53.276249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:53.277192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:53.277888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:53.278541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:53.381401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:53.390299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:53.414555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:53.419358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:53.435748 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4558636d-7176-40d0-bcae-abb5504af120 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1444 microversion: 2.75 time: 0.195897 Oct 04 11:03:53.447078 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 605/1217] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:53 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1444 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:03:53.970998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:54.254239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:54.254791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:54.267278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:54.267766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:54.270407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:54.272998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:54.275183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:54.276214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:54.382440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea8c0056-d587-493d-9ba5-baf351d31f06 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 8.478714 Oct 04 11:03:54.394992 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 613/1218] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:45 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 8497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:54.467774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:54.468960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:54.479393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:54.482405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:54.483665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:54.488547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:54.489013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:54.493554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:54.612980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:54.621276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:54.621958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:54.622705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lazy-loading 'fault' on Instance uuid 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:54.944577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:54.960785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:54.965159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5910087ffa4c435295406ea7b18c42eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32aad4d3c7647bdb0b055d46b6d5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:54.995155 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ad4d2e5-453d-4abc-951e-f85dd803b69e tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 200 len: 1449 microversion: 2.75 time: 0.527348 Oct 04 11:03:55.013496 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 614/1219] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:54 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 1449 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:03:55.224634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:55.239189 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c1adb98-b6e7-4058-b003-37d5cb54b9f2 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.992954 Oct 04 11:03:55.239702 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 606/1220] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:54 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:55.402312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c71afbb-22b3-45e9-b0a8-878296674aad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d47b0d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:55.449678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "41eb44b7-91f8-46b3-a02b-91353c346c6a"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:55.452584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:55.456450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:03:55.482051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:55.486286 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c71afbb-22b3-45e9-b0a8-878296674aad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.087672 Oct 04 11:03:55.486571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:55.487447 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 607/1221] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:55 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:55.488156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:55.489491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:55.491643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:55.492257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:55.998624 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] HTTP exception thrown: Volume 41eb44b7-91f8-46b3-a02b-91353c346c6a could not be found. Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Request method failure captured: Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments/4b3c6e64-7d22-4f0e-8ad6-54c9fa0b2360 HTTP/1.1 Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 74 Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKHeYmth_sOKhBq5CgRT8-j07RwLm2A1B43QPU6mLkQXREH3-SXNpgOQrqshb6y0I5Etot1BHfrgrHZgaHBxHgbuviJ4ge7200sJuMLtP-sRqquLQFDqjIuzIH-A06ykFKV2arJHGaxEQUDTMdC9dUUfBS0gyXFl1AuuzAxWtE30v0 Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 960bece624a1477eacc3a6fbc5b03a9e Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesAdminNegativeTest-1755074212 Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_960bece624a1477eacc3a6fbc5b03a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/960bece624a1477eacc3a6fbc5b03a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/960bece624a1477eacc3a6fbc5b03a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/960bece624a1477eacc3a6fbc5b03a9e"}]}] Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesAdminNegativeTest-1755074212 Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 960bece624a1477eacc3a6fbc5b03a9e Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1755074212 Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesAdminNegativeTest-1755074212-project-admin Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 515ffc067bd444e298f353c9589ae2eb Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesAdminNegativeTest-1755074212-project-admin Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: {"volumeAttachment": {"volumeId": "41eb44b7-91f8-46b3-a02b-91353c346c6a"}} Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: exception: Volume 41eb44b7-91f8-46b3-a02b-91353c346c6a could not be found. Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '133e0337-b85f-489a-9545-7582c99ba173', 'id': '4b3c6e64-7d22-4f0e-8ad6-54c9fa0b2360', 'body': {'volumeAttachment': {'volumeId': '41eb44b7-91f8-46b3-a02b-91353c346c6a'}}} Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41eb44b7-91f8-46b3-a02b-91353c346c6a could not be found. (HTTP 404) (Request-ID: req-169be1cb-8696-43e9-b8f7-a8d3fa64a8ae) Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:03:56.029574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41eb44b7-91f8-46b3-a02b-91353c346c6a could not be found. Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 41eb44b7-91f8-46b3-a02b-91353c346c6a could not be found. Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41eb44b7-91f8-46b3-a02b-91353c346c6a could not be found. Oct 04 11:03:56.036057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.043972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:56.043972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] [instance: 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:56.046096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Returning 400 to user: Volume 41eb44b7-91f8-46b3-a02b-91353c346c6a could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:56.047347 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-abc20793-4a66-4ac4-902c-a090652826e8 tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments/4b3c6e64-7d22-4f0e-8ad6-54c9fa0b2360" status: 400 len: 107 microversion: 2.1 time: 1.028073 Oct 04 11:03:56.048485 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 615/1222] 10.222.0.23 () {60 vars in 1433 bytes} [Tue Oct 4 11:03:55 2022] PUT /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments/4b3c6e64-7d22-4f0e-8ad6-54c9fa0b2360 => generated 107 bytes in 1034 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:03:56.048613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:56.049034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:56.049569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:56.050314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:56.050775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:56.051206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:56.084914 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] HTTP exception thrown: Instance 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 could not be found. Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Request method failure captured: Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 HTTP/1.1 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBK8kBISdnWR_Hm-4LKR1v70nSY4O-zg_PvsN6V3Dr52TYZqjiJR8tSm3EWr9bOjDoPgVuiNxdHTqqLEU6TBvnnhITqq-FLjeQTgNmbk5wFUdZegThvPtgd0tNzm_7ucVC-jaSSva-ZK_wz11ZQggRkdkqfpnFglATvomy-mLI6_hFo Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: b32aad4d3c7647bdb0b055d46b6d5f21 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdmin275Test-190211989 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b32aad4d3c7647bdb0b055d46b6d5f21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b32aad4d3c7647bdb0b055d46b6d5f21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b32aad4d3c7647bdb0b055d46b6d5f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b32aad4d3c7647bdb0b055d46b6d5f21"}]}] Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdmin275Test-190211989 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: b32aad4d3c7647bdb0b055d46b6d5f21 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdmin275Test-190211989 Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersAdmin275Test-190211989-project Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 5910087ffa4c435295406ea7b18c42eb Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdmin275Test-190211989-project Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 could not be found. Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2'} Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 could not be found. Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 could not be found. Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:56.088215 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.092690 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:56.092690 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:56.092690 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:56.092690 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:56.092690 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:56.092690 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 could not be found. Oct 04 11:03:56.092690 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:56.102131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] Returning 404 to user: Instance 5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:56.103241 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40084812-5f2e-4a4d-a6e6-bc4a45b03a35 tempest-ServersAdmin275Test-190211989 tempest-ServersAdmin275Test-190211989-project] 10.222.0.23 "GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2" status: 404 len: 111 microversion: 2.75 time: 0.068661 Oct 04 11:03:56.106326 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 608/1223] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:03:56 2022] GET /compute/v2.1/servers/5c3ba13e-dd08-46c5-ae6b-88a4f0f92db2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 11:03:56.182030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:56.182578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:56.203463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:56.203821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:56.204460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:56.205338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:56.205984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:56.206569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:56.266816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:56.267644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:56.282327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:56.283331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:56.284547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:56.286678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:56.289156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:56.296061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:56.503662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lazy-loading 'services' on Instance uuid 133e0337-b85f-489a-9545-7582c99ba173 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:03:56.721418 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9397632-b154-40ef-9737-40bb16d4ee1d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "DELETE /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments/4b3c6e64-7d22-4f0e-8ad6-54c9fa0b2360" status: 202 len: 0 microversion: 2.1 time: 0.544027 Oct 04 11:03:56.728008 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 616/1224] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:03:56 2022] DELETE /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments/4b3c6e64-7d22-4f0e-8ad6-54c9fa0b2360 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:03:56.733656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fda97d4-aed3-481f-9d67-c02462a0d50b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d43c1ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:56.870671 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8fda97d4-aed3-481f-9d67-c02462a0d50b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.140945 Oct 04 11:03:56.874106 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 617/1225] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:56 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:56.888604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:56.898954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:56.918443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:56.918974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:56.919426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:56.933714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:56.934652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:56.935299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:56.944137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:56.963256 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82642955-cef3-4433-bf83-f9154232b462 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.701804 Oct 04 11:03:56.982598 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 609/1226] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:56 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:57.007224 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b408fdaa-3011-4e78-8633-584f191af83c tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131995 Oct 04 11:03:57.011965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 618/1227] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:03:56 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:57.521383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Calling method '.version_select at 0x7f71d478e160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:57.523720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:57.525184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:57.525801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:57.568639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:57.570943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:57.572702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:57.604080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:57.605280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:57.606006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:57.609892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-303bf4d8-954e-4ae8-90dc-8ec6b93e6e82 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Calling method '.version_select at 0x7f71d437d430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:57.614243 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f78bf781-d2d1-47bb-b01b-9ef01cfd6d40 tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.474671 Oct 04 11:03:57.615452 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 610/1228] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:03:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:57.668271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-303bf4d8-954e-4ae8-90dc-8ec6b93e6e82 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:03:57.668899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-303bf4d8-954e-4ae8-90dc-8ec6b93e6e82 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Neutron security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:03:57.669457 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-303bf4d8-954e-4ae8-90dc-8ec6b93e6e82 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] HTTP exception thrown: Security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 does not exist Oct 04 11:03:57.669457 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-d708229a-eb57-421b-8551-fecdbcae0d0d'] Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-303bf4d8-954e-4ae8-90dc-8ec6b93e6e82 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Request method failure captured: Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/abe55b6e-faf2-4aff-ba72-4738a9ab82d0 HTTP/1.1 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBMdT-_qE5fJ7Z2DtwKZbCEMiv2VefHyGvGkw3R5-vs4VyN5_OIxZvZuK7wkkIFCIhFu8KjVC7GG99tGi_dVZcAxPRfe7GR8j4B4HMC3e-OetYXUazzR3JWhmGx1aCRLouQ7s5_uPIUUUCOvKx0o1Ej867BGZrhNWRUFZAC__VMJsVM Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7015f7696c184b77af623d34e2dd0033 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7015f7696c184b77af623d34e2dd0033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7015f7696c184b77af623d34e2dd0033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7015f7696c184b77af623d34e2dd0033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7015f7696c184b77af623d34e2dd0033"}]}] Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7015f7696c184b77af623d34e2dd0033 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsNegativeTestJSON-1970998227-project Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e0d7bd8956b54da0b90a7f85b949d0dd Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227-project Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 does not exist Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-d708229a-eb57-421b-8551-fecdbcae0d0d'] Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'abe55b6e-faf2-4aff-ba72-4738a9ab82d0'} Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:03:57.686955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 does not exist Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d708229a-eb57-421b-8551-fecdbcae0d0d'] Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 does not exist Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d708229a-eb57-421b-8551-fecdbcae0d0d'] Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 does not exist Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d708229a-eb57-421b-8551-fecdbcae0d0d'] Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 does not exist Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d708229a-eb57-421b-8551-fecdbcae0d0d'] Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-303bf4d8-954e-4ae8-90dc-8ec6b93e6e82 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Returning 404 to user: Security group abe55b6e-faf2-4aff-ba72-4738a9ab82d0 does not exist Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-d708229a-eb57-421b-8551-fecdbcae0d0d'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-303bf4d8-954e-4ae8-90dc-8ec6b93e6e82 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/abe55b6e-faf2-4aff-ba72-4738a9ab82d0" status: 404 len: 194 microversion: 2.1 time: 0.337778 Oct 04 11:03:57.691684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 619/1229] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:03:57 2022] DELETE /compute/v2.1/os-security-groups/abe55b6e-faf2-4aff-ba72-4738a9ab82d0 => generated 194 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:03:57.701172 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9be201fe-4fd3-4b9c-b117-56798a59bd92 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004647 Oct 04 11:03:57.701980 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 620/1230] 10.222.0.23 () {58 vars in 1164 bytes} [Tue Oct 4 11:03:57 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 11:03:57.714268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd17ce08-c157-4fc8-801c-d03d9cac7811 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Calling method '.version_select at 0x7f71d43c1b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:57.930256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85a9fe74-3f56-4712-807b-b0ba23aca399 tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] Calling method '.version_select at 0x7f71d47b0940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:57.933610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-85a9fe74-3f56-4712-807b-b0ba23aca399 tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '990a3ec75c554ee4a010b7e082c0134a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04db46446ae940209b8ef97227e79194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85a9fe74-3f56-4712-807b-b0ba23aca399 tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] Request method failure captured: Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/n-h1-791135-8/search HTTP/1.1 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMb8aBWZ_xGVS__AdiNURHtcRPwYvzFePj7-yqST0XRyFmjKiVerZEaugJMf1JzOLOQSqsCnGn9qBQhc-WPwtiEktzCbop3n-b0uVc7zW2SaViAXRcWPymcy2Fvf1yxQhcAiUk3uKidkEcGo1a2OCQexaHv4vZ1S1uyUhUVv3fqVAs Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 04db46446ae940209b8ef97227e79194 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-498034318 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_04db46446ae940209b8ef97227e79194"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04db46446ae940209b8ef97227e79194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04db46446ae940209b8ef97227e79194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/04db46446ae940209b8ef97227e79194"}]}] Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-498034318 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 04db46446ae940209b8ef97227e79194 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-498034318 Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-498034318-project Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 990a3ec75c554ee4a010b7e082c0134a Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-498034318-project Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'n-h1-791135-8'} Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:57.939664 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.945155 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:57.945155 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:57.945155 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:57.945155 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:03:57.945155 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:03:57.945155 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 11:03:57.945155 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:57.951052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85a9fe74-3f56-4712-807b-b0ba23aca399 tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:57.958578 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85a9fe74-3f56-4712-807b-b0ba23aca399 tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h1-791135-8/search" status: 403 len: 117 microversion: 2.1 time: 0.333614 Oct 04 11:03:57.966372 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 611/1231] 10.222.0.23 () {58 vars in 1209 bytes} [Tue Oct 4 11:03:57 2022] GET /compute/v2.1/os-hypervisors/n-h1-791135-8/search => generated 117 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:57.975011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf2a7642-bd27-4f39-995c-6fa4b46cc144 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4744040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.032740 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd17ce08-c157-4fc8-801c-d03d9cac7811 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.324236 Oct 04 11:03:58.033699 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 621/1232] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 11:03:57 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:03:58.038597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-875c49d5-43e4-4fdc-8bb6-fb98086492ee tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Calling method '.version_select at 0x7f71d440eee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.040978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875c49d5-43e4-4fdc-8bb6-fb98086492ee tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.042282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875c49d5-43e4-4fdc-8bb6-fb98086492ee tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.043730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875c49d5-43e4-4fdc-8bb6-fb98086492ee tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.053857 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-875c49d5-43e4-4fdc-8bb6-fb98086492ee tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-875c49d5-43e4-4fdc-8bb6-fb98086492ee tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Request method failure captured: Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBMdXEcz-zukzkRcqhXQjiqaWtvYld1tA3RzscSh58pfgDlSaDaLDREzLEBwCouHCktUPrLGW6fiX9Mv7wsceffkPXwQyN6GiXc9ArZNPKOfX2faWpPaLoKkiJj2noW0QpqfQDZRVfb4VKSSzip_yyyghttRk7KOQ9_gm3BcBnCI6iM Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 889162d174e24d6494c837542a749378 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1640099459 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_889162d174e24d6494c837542a749378"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/889162d174e24d6494c837542a749378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/889162d174e24d6494c837542a749378"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/889162d174e24d6494c837542a749378"}]}] Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1640099459 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 889162d174e24d6494c837542a749378 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1640099459 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f3b543462f1b493a968763215fc133e1 Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 11:03:58.056136 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.061070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-875c49d5-43e4-4fdc-8bb6-fb98086492ee tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:58.061070 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-875c49d5-43e4-4fdc-8bb6-fb98086492ee tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.022690 Oct 04 11:03:58.064805 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 622/1233] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:03:58 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:58.068215 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf2a7642-bd27-4f39-995c-6fa4b46cc144 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.100346 Oct 04 11:03:58.070923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.071544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:58.073848 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 612/1234] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:57 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:58.079883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.080600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.081298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.082550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.083284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.084009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.093179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.096847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:58.126787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.133597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.134303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.137718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.140652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.142972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.235788 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63a8b274-e5a2-4101-a23f-75f793cf4e33 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159438 Oct 04 11:03:58.245055 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 613/1235] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:03:58 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:58.254225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e5c616c-7877-48a6-b4c3-c17a3273bc0c tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Calling method '.version_select at 0x7f71d4860a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.590837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-7e5c616c-7877-48a6-b4c3-c17a3273bc0c tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:03:58.592478 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7e5c616c-7877-48a6-b4c3-c17a3273bc0c tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 11:03:58.592478 n-d-791135-8 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-15b1106a-1018-476d-93d8-5425f66291c1'] Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e5c616c-7877-48a6-b4c3-c17a3273bc0c tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Request method failure captured: Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-security-groups/2d69528f-0e1e-42a0-b3b1-c09faf90ab6e HTTP/1.1 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMdT-_qE5fJ7Z2DtwKZbCEMiv2VefHyGvGkw3R5-vs4VyN5_OIxZvZuK7wkkIFCIhFu8KjVC7GG99tGi_dVZcAxPRfe7GR8j4B4HMC3e-OetYXUazzR3JWhmGx1aCRLouQ7s5_uPIUUUCOvKx0o1Ej867BGZrhNWRUFZAC__VMJsVM Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 7015f7696c184b77af623d34e2dd0033 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7015f7696c184b77af623d34e2dd0033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7015f7696c184b77af623d34e2dd0033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7015f7696c184b77af623d34e2dd0033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7015f7696c184b77af623d34e2dd0033"}]}] Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 7015f7696c184b77af623d34e2dd0033 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupsNegativeTestJSON-1970998227-project Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e0d7bd8956b54da0b90a7f85b949d0dd Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227-project Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: exception: Insufficient rights for removing default security group. Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-15b1106a-1018-476d-93d8-5425f66291c1'] Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '2d69528f-0e1e-42a0-b3b1-c09faf90ab6e'} Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:03:58.597923 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15b1106a-1018-476d-93d8-5425f66291c1'] Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15b1106a-1018-476d-93d8-5425f66291c1'] Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15b1106a-1018-476d-93d8-5425f66291c1'] Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15b1106a-1018-476d-93d8-5425f66291c1'] Oct 04 11:03:58.602015 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.612768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e5c616c-7877-48a6-b4c3-c17a3273bc0c tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 11:03:58.612768 n-d-791135-8 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-15b1106a-1018-476d-93d8-5425f66291c1'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:58.614157 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e5c616c-7877-48a6-b4c3-c17a3273bc0c tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/2d69528f-0e1e-42a0-b3b1-c09faf90ab6e" status: 400 len: 182 microversion: 2.1 time: 0.367784 Oct 04 11:03:58.616184 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 614/1236] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:03:58 2022] DELETE /compute/v2.1/os-security-groups/2d69528f-0e1e-42a0-b3b1-c09faf90ab6e => generated 182 bytes in 370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:03:58.626143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Calling method '.version_select at 0x7f71d4600790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.634175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.635286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.636673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.650457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:58.666173 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e04ea857-0e61-47d8-8f43-fda6dd0b6cc3 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.600203 Oct 04 11:03:58.667672 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 623/1237] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:58 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:58.674767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.675472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.676068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.680461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7cf40c08-77fa-4797-872c-810eaf2feace tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Calling method '.version_select at 0x7f71d435a310>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.707971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.708725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.709321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.718816 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7512549e-3996-40f3-8583-e71f777cb24f tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.098873 Oct 04 11:03:58.719713 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 615/1238] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:03:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:58.733716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7403c211-dfab-4eec-9d9e-5906b3649b1e tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] Calling method '.version_select at 0x7f71d47b0940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.736421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7403c211-dfab-4eec-9d9e-5906b3649b1e tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '990a3ec75c554ee4a010b7e082c0134a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04db46446ae940209b8ef97227e79194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7403c211-dfab-4eec-9d9e-5906b3649b1e tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] Request method failure captured: Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMb8aBWZ_xGVS__AdiNURHtcRPwYvzFePj7-yqST0XRyFmjKiVerZEaugJMf1JzOLOQSqsCnGn9qBQhc-WPwtiEktzCbop3n-b0uVc7zW2SaViAXRcWPymcy2Fvf1yxQhcAiUk3uKidkEcGo1a2OCQexaHv4vZ1S1uyUhUVv3fqVAs Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 04db46446ae940209b8ef97227e79194 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-498034318 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_04db46446ae940209b8ef97227e79194"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04db46446ae940209b8ef97227e79194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/04db46446ae940209b8ef97227e79194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/04db46446ae940209b8ef97227e79194"}]}] Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-498034318 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 04db46446ae940209b8ef97227e79194 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-498034318 Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-498034318-project Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 990a3ec75c554ee4a010b7e082c0134a Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-498034318-project Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '1'} Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.738576 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.743414 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.743414 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.743414 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.743414 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:03:58.743414 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:03:58.743414 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 11:03:58.743414 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.744884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7403c211-dfab-4eec-9d9e-5906b3649b1e tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:58.746519 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7403c211-dfab-4eec-9d9e-5906b3649b1e tempest-HypervisorAdminNegativeUnderV252Test-498034318 tempest-HypervisorAdminNegativeUnderV252Test-498034318-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018383 Oct 04 11:03:58.747574 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 616/1239] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 11:03:58 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:03:58.758912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2abaa17f-fa5e-4310-ac9e-8a6727e4a1aa tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Calling method '.version_select at 0x7f71d4600d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:58.761095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abaa17f-fa5e-4310-ac9e-8a6727e4a1aa tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:58.761923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abaa17f-fa5e-4310-ac9e-8a6727e4a1aa tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:58.762563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abaa17f-fa5e-4310-ac9e-8a6727e4a1aa tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:58.776276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-7cf40c08-77fa-4797-872c-810eaf2feace tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:03:58.777061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-7cf40c08-77fa-4797-872c-810eaf2feace tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Neutron security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:03:58.777845 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7cf40c08-77fa-4797-872c-810eaf2feace tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] HTTP exception thrown: Security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 does not exist Oct 04 11:03:58.777845 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-e9ac55af-5a7f-4708-8665-53d0b953e2e8'] Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7cf40c08-77fa-4797-872c-810eaf2feace tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Request method failure captured: Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-security-groups/76fad77f-0d30-4dcb-be98-dde6cebbfcb7 HTTP/1.1 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBMdT-_qE5fJ7Z2DtwKZbCEMiv2VefHyGvGkw3R5-vs4VyN5_OIxZvZuK7wkkIFCIhFu8KjVC7GG99tGi_dVZcAxPRfe7GR8j4B4HMC3e-OetYXUazzR3JWhmGx1aCRLouQ7s5_uPIUUUCOvKx0o1Ej867BGZrhNWRUFZAC__VMJsVM Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7015f7696c184b77af623d34e2dd0033 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7015f7696c184b77af623d34e2dd0033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7015f7696c184b77af623d34e2dd0033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7015f7696c184b77af623d34e2dd0033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7015f7696c184b77af623d34e2dd0033"}]}] Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7015f7696c184b77af623d34e2dd0033 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsNegativeTestJSON-1970998227-project Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e0d7bd8956b54da0b90a7f85b949d0dd Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227-project Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 does not exist Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-e9ac55af-5a7f-4708-8665-53d0b953e2e8'] Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '76fad77f-0d30-4dcb-be98-dde6cebbfcb7'} Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:03:58.780571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 does not exist Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9ac55af-5a7f-4708-8665-53d0b953e2e8'] Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 does not exist Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9ac55af-5a7f-4708-8665-53d0b953e2e8'] Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 does not exist Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9ac55af-5a7f-4708-8665-53d0b953e2e8'] Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 does not exist Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9ac55af-5a7f-4708-8665-53d0b953e2e8'] Oct 04 11:03:58.785253 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.788156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7cf40c08-77fa-4797-872c-810eaf2feace tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Returning 404 to user: Security group 76fad77f-0d30-4dcb-be98-dde6cebbfcb7 does not exist Oct 04 11:03:58.788156 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-e9ac55af-5a7f-4708-8665-53d0b953e2e8'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:58.789681 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7cf40c08-77fa-4797-872c-810eaf2feace tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/76fad77f-0d30-4dcb-be98-dde6cebbfcb7" status: 404 len: 194 microversion: 2.1 time: 0.120368 Oct 04 11:03:58.790236 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2abaa17f-fa5e-4310-ac9e-8a6727e4a1aa tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] HTTP exception thrown: No hypervisor matching '06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105' could be found. Oct 04 11:03:58.790761 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 624/1240] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:03:58 2022] GET /compute/v2.1/os-security-groups/76fad77f-0d30-4dcb-be98-dde6cebbfcb7 => generated 194 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2abaa17f-fa5e-4310-ac9e-8a6727e4a1aa tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Request method failure captured: Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-hypervisors/06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105/servers HTTP/1.1 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMdXEcz-zukzkRcqhXQjiqaWtvYld1tA3RzscSh58pfgDlSaDaLDREzLEBwCouHCktUPrLGW6fiX9Mv7wsceffkPXwQyN6GiXc9ArZNPKOfX2faWpPaLoKkiJj2noW0QpqfQDZRVfb4VKSSzip_yyyghttRk7KOQ9_gm3BcBnCI6iM Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 889162d174e24d6494c837542a749378 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1640099459 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_889162d174e24d6494c837542a749378"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/889162d174e24d6494c837542a749378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/889162d174e24d6494c837542a749378"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/889162d174e24d6494c837542a749378"}]}] Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1640099459 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 889162d174e24d6494c837542a749378 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1640099459 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: f3b543462f1b493a968763215fc133e1 Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: exception: No hypervisor matching '06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105' could be found. Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105'} Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105' could be found. Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105' could be found. Oct 04 11:03:58.792990 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.799506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2abaa17f-fa5e-4310-ac9e-8a6727e4a1aa tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] Returning 404 to user: No hypervisor matching '06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105' could be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:58.800409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0549730a-8efe-4a3f-a230-41c8dde193c1 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Action: 'update', calling method: .version_select at 0x7f71d435fc10>, body: {"security_group": {"name": "tempest-sg-1798341221", "description": "tempest-description-178514203"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:03:58.807417 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2abaa17f-fa5e-4310-ac9e-8a6727e4a1aa tempest-HypervisorAdminNegativeUnderV252Test-1640099459 tempest-HypervisorAdminNegativeUnderV252Test-1640099459-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105/servers" status: 404 len: 123 microversion: 2.1 time: 0.046382 Oct 04 11:03:58.810191 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 617/1241] 10.222.0.23 () {58 vars in 1281 bytes} [Tue Oct 4 11:03:58 2022] GET /compute/v2.1/os-hypervisors/06f4b3bc-a6ec-4ad1-b7d1-3a38b418b105/servers => generated 123 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:58.854958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-0549730a-8efe-4a3f-a230-41c8dde193c1 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:03:58.855558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-0549730a-8efe-4a3f-a230-41c8dde193c1 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Neutron security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:03:58.857003 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0549730a-8efe-4a3f-a230-41c8dde193c1 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] HTTP exception thrown: Security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 does not exist Oct 04 11:03:58.857003 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-c58eaf2d-7e2b-4b4c-8ed0-c3878178a5c6'] Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0549730a-8efe-4a3f-a230-41c8dde193c1 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Request method failure captured: Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/os-security-groups/df5d8d6b-c451-460a-b4b6-541f42ab48e2 HTTP/1.1 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 101 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBMdT-_qE5fJ7Z2DtwKZbCEMiv2VefHyGvGkw3R5-vs4VyN5_OIxZvZuK7wkkIFCIhFu8KjVC7GG99tGi_dVZcAxPRfe7GR8j4B4HMC3e-OetYXUazzR3JWhmGx1aCRLouQ7s5_uPIUUUCOvKx0o1Ej867BGZrhNWRUFZAC__VMJsVM Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7015f7696c184b77af623d34e2dd0033 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7015f7696c184b77af623d34e2dd0033"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7015f7696c184b77af623d34e2dd0033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7015f7696c184b77af623d34e2dd0033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7015f7696c184b77af623d34e2dd0033"}]}] Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7015f7696c184b77af623d34e2dd0033 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227 Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsNegativeTestJSON-1970998227-project Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e0d7bd8956b54da0b90a7f85b949d0dd Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1970998227-project Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: {"security_group": {"name": "tempest-sg-1798341221", "description": "tempest-description-178514203"}} Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 does not exist Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-c58eaf2d-7e2b-4b4c-8ed0-c3878178a5c6'] Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'df5d8d6b-c451-460a-b4b6-541f42ab48e2', 'body': {'security_group': {'name': 'tempest-sg-1798341221', 'description': 'tempest-description-178514203'}}} Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:03:58.859538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 does not exist Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c58eaf2d-7e2b-4b4c-8ed0-c3878178a5c6'] Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 does not exist Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c58eaf2d-7e2b-4b4c-8ed0-c3878178a5c6'] Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 does not exist Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c58eaf2d-7e2b-4b4c-8ed0-c3878178a5c6'] Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 does not exist Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c58eaf2d-7e2b-4b4c-8ed0-c3878178a5c6'] Oct 04 11:03:58.864272 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:03:58.868812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0549730a-8efe-4a3f-a230-41c8dde193c1 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] Returning 404 to user: Security group df5d8d6b-c451-460a-b4b6-541f42ab48e2 does not exist Oct 04 11:03:58.868812 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-c58eaf2d-7e2b-4b4c-8ed0-c3878178a5c6'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:03:58.870204 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0549730a-8efe-4a3f-a230-41c8dde193c1 tempest-SecurityGroupsNegativeTestJSON-1970998227 tempest-SecurityGroupsNegativeTestJSON-1970998227-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/df5d8d6b-c451-460a-b4b6-541f42ab48e2" status: 404 len: 194 microversion: 2.1 time: 0.074095 Oct 04 11:03:58.887475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 625/1242] 10.222.0.23 () {60 vars in 1290 bytes} [Tue Oct 4 11:03:58 2022] PUT /compute/v2.1/os-security-groups/df5d8d6b-c451-460a-b4b6-541f42ab48e2 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:03:59.091207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2114548a-5448-4f69-95fd-058fb1299147 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d47faee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:59.174772 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2114548a-5448-4f69-95fd-058fb1299147 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.087599 Oct 04 11:03:59.190795 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 618/1243] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:03:59 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:03:59.258876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:59.262318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:59.276760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:59.277568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:59.280807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:59.282216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:59.282927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:59.285280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:59.372711 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-faa7f955-d77f-4544-b874-3642d43f9ff6 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120003 Oct 04 11:03:59.374192 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 626/1244] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:03:59 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:03:59.697251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:03:59.698182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:03:59.719129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:59.719641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:59.728303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:03:59.729237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:03:59.734412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:03:59.734871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:00.197829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b329524f-69da-445d-baaa-32b87830978a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d435fa60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:00.327420 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b329524f-69da-445d-baaa-32b87830978a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.134891 Oct 04 11:04:00.328013 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 627/1245] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:00 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:00.386015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:00.388969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:00.408424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:00.409135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:00.415291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:00.420921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:00.422543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:00.424140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:00.469488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:00.480900 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7ef4d0e2-d809-4167-9cff-bf142de9f5ee tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.790597 Oct 04 11:04:00.485901 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 619/1246] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:03:59 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:00.539867 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99c949b3-59d9-44c8-b56d-34f6545126ae tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154390 Oct 04 11:04:00.543467 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 628/1247] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:04:00 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:04:01.344192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-20904c45-a5d0-4b3e-ad98-bbbb8fe45b77 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d47fa940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:01.427585 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-20904c45-a5d0-4b3e-ad98-bbbb8fe45b77 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.088423 Oct 04 11:04:01.428187 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 620/1248] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:01 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:01.513897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:01.515245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:01.532230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:01.533157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:01.535746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:01.536829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:01.537664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:01.540427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:01.561404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:01.564294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:01.594602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:01.595112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:01.595558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:01.600788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:01.601717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:01.602360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:01.703378 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2542a1a5-c201-49b5-9a57-af9cd7d9c7e2 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148197 Oct 04 11:04:01.704977 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 621/1249] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:04:01 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:02.095925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:02.150026 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-54a09a2b-066a-415a-a656-c568a88c2497 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.636316 Oct 04 11:04:02.163046 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 629/1250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:01 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:02.446384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c33c5104-db9e-4221-a31b-84399425a64b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d47b0820>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:02.542423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:02.543167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:02.578466 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c33c5104-db9e-4221-a31b-84399425a64b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.138749 Oct 04 11:04:02.588042 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 622/1251] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:02 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:02.594328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:02.594863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:02.598333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:02.603667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:02.607151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:02.608617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:02.717705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:02.720218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:02.753778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:02.757184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:02.758713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:02.759786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:02.761066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:02.762631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:02.833409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:02.955938 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c37e099-d51b-4b5d-82b1-cf1496ea5cfa tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242923 Oct 04 11:04:02.957590 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 623/1252] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:04:02 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:03.082780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 5813e7a4-1b03-438c-bf70-c2b544030ce4 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:04:03.144822 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1e813f4-fbbe-4328-8adf-37de081a89f4 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 2345 microversion: 2.25 time: 0.599325 Oct 04 11:04:03.155124 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 630/1253] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:02 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 2345 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:04:03.176083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d8fc1f47-69f6-4c7a-94ea-66e0f3175bbe tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:03.180402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8fc1f47-69f6-4c7a-94ea-66e0f3175bbe tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:03.181657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:03.181785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8fc1f47-69f6-4c7a-94ea-66e0f3175bbe tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:03.182659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8fc1f47-69f6-4c7a-94ea-66e0f3175bbe tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:03.182841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:03.190143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8fc1f47-69f6-4c7a-94ea-66e0f3175bbe tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:03.194025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8fc1f47-69f6-4c7a-94ea-66e0f3175bbe tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:03.194599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8fc1f47-69f6-4c7a-94ea-66e0f3175bbe tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:03.205087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:03.208613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:03.211569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:03.213062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:03.217267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:03.218018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:03.318673 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d8fc1f47-69f6-4c7a-94ea-66e0f3175bbe tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.146949 Oct 04 11:04:03.327498 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 624/1254] 10.222.0.23 () {60 vars in 1217 bytes} [Tue Oct 4 11:04:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:04:03.644800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:03.660229 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3445c6d4-c8bf-4390-bc40-1649ecdba4af tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.479393 Oct 04 11:04:03.661183 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 631/1255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:03 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:04:03.674046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb862035-8e8f-48ca-b009-300d6a51bcc0 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d440ef70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:03.775852 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb862035-8e8f-48ca-b009-300d6a51bcc0 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.113199 Oct 04 11:04:03.776940 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 632/1256] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:03 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:03.968413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:03.971021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:04.003062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:04.005796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:04.006736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:04.009446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:04.012367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:04.014216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:04.196020 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2730474-62a8-4d89-ae7d-ef0a65b7983f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231681 Oct 04 11:04:04.207331 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 633/1257] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:04:03 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:04:04.329828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1646345007", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:04.519693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:04:04.688083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:04.689403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:04.708131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:04.708640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:04.709084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:04.709856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:04.716653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:04.717129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:04.823919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:05.228948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:04:05.229911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:04:05.230829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:04:05.232748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:04:05.233498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:04:05.256870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:05.257780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:05.260012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:05.261072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:05.263981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:05.264783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:05.315086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Getting quotas for project 8e8dfb2a0b8d4faa8e810e56fc749d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:04:05.328773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Getting quotas for user 671786f1a7c74682a66520aeb60a5f50 and project 8e8dfb2a0b8d4faa8e810e56fc749d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:04:05.360302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:05.364104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:04:05.372783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:04:05.400019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:05.410371 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b2db5ca-5887-4369-bf83-63599aa9eece tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1474 microversion: 2.1 time: 0.726132 Oct 04 11:04:05.411954 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 634/1258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:04 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1474 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:05.419067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-917b602d-f79e-40d6-b233-94344b7b7a02 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d435ab80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:05.503778 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-917b602d-f79e-40d6-b233-94344b7b7a02 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.089849 Oct 04 11:04:05.505252 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 635/1259] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:05 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:05.551931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:05.559553 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48eff20d-fb77-48f3-a0dc-e11ba868f9dd tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051334 Oct 04 11:04:05.561588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:05.568323 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 625/1260] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:04:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:04:05.622765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:05.623270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:05.623709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:05.624411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:05.624863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:05.625285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:05.729289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d08b588a-765e-4096-9a3c-3b8bbe6881ab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215192 Oct 04 11:04:05.730856 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 636/1261] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:04:05 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:05.933177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-534790803", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:06.059542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:04:06.440119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:06.440753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:06.451789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:06.452295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:06.458394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:06.459943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:06.461815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:06.462455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:06.976347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:04:06.978335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:04:06.979792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:04:06.981320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:04:06.982096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:04:07.013516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:07.014627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:07.015923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:07.017659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:07.018919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:07.021732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:07.044370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:07.062898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6967a91-c69b-4c4d-812a-9f9a3e98e880 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1473 microversion: 2.1 time: 0.630647 Oct 04 11:04:07.065239 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 637/1262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:06 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1473 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:04:07.080828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7621d5eb-03b0-4502-bad4-6f5e386dc1a3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d42eba60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:07.082908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Getting quotas for project 8e8dfb2a0b8d4faa8e810e56fc749d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:04:07.094923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Getting quotas for user 671786f1a7c74682a66520aeb60a5f50 and project 8e8dfb2a0b8d4faa8e810e56fc749d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:04:07.119653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:04:07.123267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:04:07.203840 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7621d5eb-03b0-4502-bad4-6f5e386dc1a3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.135370 Oct 04 11:04:07.207798 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 638/1263] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:07 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:07.224561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:07.233071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:07.251024 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85197188-b04f-412e-98fe-5fae33ed27df tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.332165 Oct 04 11:04:07.253619 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 626/1264] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:04:07.258532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:07.260452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:07.262621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:07.265421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:07.268355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:07.269901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:07.274137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df907df4-5db1-4577-a9a2-79ef69ee9df1", "device": "/dev/xvdb"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:07.286864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:07.329191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:07.331681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:07.335129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:07.343827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:07.347309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:07.347789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:07.460294 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f10c6e4f-0e52-4e94-8b94-a1bfbe6614e3 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247333 Oct 04 11:04:07.471194 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 639/1265] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:04:07 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:07.510549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1050786f-a1e4-43de-ad59-b29de42f7e1e req-30c2b435-2011-4776-b91a-9105c5485ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:07.587950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1050786f-a1e4-43de-ad59-b29de42f7e1e req-30c2b435-2011-4776-b91a-9105c5485ce4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:07.589335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1050786f-a1e4-43de-ad59-b29de42f7e1e req-30c2b435-2011-4776-b91a-9105c5485ce4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:07.591743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1050786f-a1e4-43de-ad59-b29de42f7e1e req-30c2b435-2011-4776-b91a-9105c5485ce4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:07.657046 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1050786f-a1e4-43de-ad59-b29de42f7e1e req-30c2b435-2011-4776-b91a-9105c5485ce4 service nova] Creating event network-vif-unplugged:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h1-791135-8 Oct 04 11:04:07.693827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-1050786f-a1e4-43de-ad59-b29de42f7e1e req-30c2b435-2011-4776-b91a-9105c5485ce4 service nova] Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:04:07.760262 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1050786f-a1e4-43de-ad59-b29de42f7e1e req-30c2b435-2011-4776-b91a-9105c5485ce4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.283695 Oct 04 11:04:07.764510 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 640/1266] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:07.784595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-456529f4-b4b4-4c75-afcf-540d08251ee6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:07.786849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-456529f4-b4b4-4c75-afcf-540d08251ee6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:07.901205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-456529f4-b4b4-4c75-afcf-540d08251ee6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:07.918564 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-456529f4-b4b4-4c75-afcf-540d08251ee6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1213 microversion: 2.1 time: 0.149164 Oct 04 11:04:07.922630 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 641/1267] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:07 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:08.243142 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6dd61a0-eb38-4f0e-ae3f-7a7f8e768b31 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "POST /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.986169 Oct 04 11:04:08.243769 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 627/1268] 10.222.0.23 () {62 vars in 1364 bytes} [Tue Oct 4 11:04:07 2022] POST /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments => generated 194 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:04:08.276604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:08.277315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:08.301815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9985861-9ec6-4833-a630-0a5e8830ca26 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:08.303959 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b9985861-9ec6-4833-a630-0a5e8830ca26 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9985861-9ec6-4833-a630-0a5e8830ca26 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431-project-admin] Request method failure captured: Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBMnpVxm44E0RqyHyycyKSMNdry7lFzA-n23324OSGo_AVUh6xx282ldKLFk7kvbCkPbo3dWoTknAxXkinKycNK3v08KMB7ZPWKf3IUjaahmAyF8SYzDkUGoiZOECS34f1sT3gW9nhU_YaPGL6osRrJZ56OS0M7XWcEc-QzaOGlxqjw Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fa8d942390f046d49fa149ce4246eac2 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa8d942390f046d49fa149ce4246eac2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa8d942390f046d49fa149ce4246eac2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa8d942390f046d49fa149ce4246eac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa8d942390f046d49fa149ce4246eac2"}]}] Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fa8d942390f046d49fa149ce4246eac2 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431-project-admin Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e6339661dbee4f49980d58e2bd5354e6 Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431-project-admin Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid timestamp for date invalid_time Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'invalid_time'} Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:04:08.334365 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:04:08.348038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 11:04:08.348038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:08.348038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9985861-9ec6-4833-a630-0a5e8830ca26 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:04:08.348038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9985861-9ec6-4833-a630-0a5e8830ca26 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431 tempest-InstanceUsageAuditLogNegativeTestJSON-1062303431-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.411508 Oct 04 11:04:08.348038 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 642/1269] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Oct 4 11:04:07 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 418 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:04:08.352545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:08.353049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:08.353527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:08.353769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abd9577a-12a0-4903-a511-0bab6e22c2e8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4421d30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:08.366077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:08.366588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:08.367564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:08.470375 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-abd9577a-12a0-4903-a511-0bab6e22c2e8 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.128273 Oct 04 11:04:08.471266 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 643/1270] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:08 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:08.896969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-811b423c-5342-43aa-80a2-15ff00e8d608 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:08.899646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-811b423c-5342-43aa-80a2-15ff00e8d608 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ae33cc32ae0646ef9ec44135c99377af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ec41b339b94a368d6a465746c1e5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-811b423c-5342-43aa-80a2-15ff00e8d608 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] Request method failure captured: Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBMlCtsm7Nx51g14LpWr6K27EUAnTQ_1OJZU6cABlhUZQn3c66azR391aTp9YZ2ib7MlO06CwgqKSDf8zVswdNOQBw98g4pG2aX43Hain-T5aa9kHKE3PPEbnodUYELOCLdTnoC1ygppsrKeHOh5HXv0AbgReuawgWN9gWuasMjDcW8 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a7ec41b339b94a368d6a465746c1e5a1 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a7ec41b339b94a368d6a465746c1e5a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7ec41b339b94a368d6a465746c1e5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7ec41b339b94a368d6a465746c1e5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a7ec41b339b94a368d6a465746c1e5a1"}]}] Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a7ec41b339b94a368d6a465746c1e5a1 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: ae33cc32ae0646ef9ec44135c99377af Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: action_args: {} Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:08.901971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:08.907996 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:08.907996 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:08.907996 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:04:08.907996 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:04:08.907996 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 11:04:08.907996 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:08.913218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-811b423c-5342-43aa-80a2-15ff00e8d608 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:04:08.920530 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-811b423c-5342-43aa-80a2-15ff00e8d608 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.445110 Oct 04 11:04:08.926403 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 644/1271] 10.222.0.23 () {58 vars in 1185 bytes} [Tue Oct 4 11:04:08 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 454 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:04:08.948704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:08.960255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:08.982719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:08.987432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:08.988588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:08.995938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:08.998045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:09.000132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:09.104138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b134728-432d-4343-b8cc-6e5a6eadc3a9 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.175621 Oct 04 11:04:09.122790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 645/1272] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:04:08 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:04:09.141699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-372e17f4-5412-4b8a-a91f-24a6cf087abd tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:09.148948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-372e17f4-5412-4b8a-a91f-24a6cf087abd tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ae33cc32ae0646ef9ec44135c99377af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ec41b339b94a368d6a465746c1e5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-372e17f4-5412-4b8a-a91f-24a6cf087abd tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] Request method failure captured: Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2011:04:08 HTTP/1.1 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBMlCtsm7Nx51g14LpWr6K27EUAnTQ_1OJZU6cABlhUZQn3c66azR391aTp9YZ2ib7MlO06CwgqKSDf8zVswdNOQBw98g4pG2aX43Hain-T5aa9kHKE3PPEbnodUYELOCLdTnoC1ygppsrKeHOh5HXv0AbgReuawgWN9gWuasMjDcW8 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a7ec41b339b94a368d6a465746c1e5a1 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a7ec41b339b94a368d6a465746c1e5a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7ec41b339b94a368d6a465746c1e5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a7ec41b339b94a368d6a465746c1e5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a7ec41b339b94a368d6a465746c1e5a1"}]}] Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a7ec41b339b94a368d6a465746c1e5a1 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: ae33cc32ae0646ef9ec44135c99377af Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2022-10-04 11:04:08'} Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:09.156566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:09.160681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:09.160681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:09.160681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 11:04:09.160681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 11:04:09.160681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 11:04:09.160681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:09.169489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-372e17f4-5412-4b8a-a91f-24a6cf087abd tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:04:09.172089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-372e17f4-5412-4b8a-a91f-24a6cf087abd tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213 tempest-InstanceUsageAuditLogNegativeTestJSON-1536096213-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 11:04:08" status: 403 len: 128 microversion: 2.1 time: 0.044202 Oct 04 11:04:09.173305 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 646/1273] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:04:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2011%3A04%3A08 => generated 128 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:04:09.198683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:09.202615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:09.227733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:09.229151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:09.230357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:09.236025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:09.238218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:09.242231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:09.850550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:09.883056 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-706a6d95-71bb-4cfa-a156-624cbf8da34d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1217 microversion: 2.1 time: 0.697525 Oct 04 11:04:09.888330 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 647/1274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:09 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1217 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:09.915673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4a41bcc-cd01-4a04-91b3-b211f8c036db tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d428db80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:10.044757 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4a41bcc-cd01-4a04-91b3-b211f8c036db tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.155049 Oct 04 11:04:10.052786 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 648/1275] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:09 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:10.087028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-284338606", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "df4e3d84-1220-484c-bf4d-3342da9c048d"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:10.301630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] validate_networks() for [('df4e3d84-1220-484c-bf4d-3342da9c048d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:04:10.436447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:10.454456 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e34f6df-8423-4090-8e17-224ac4e457ad tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1473 microversion: 2.1 time: 2.191584 Oct 04 11:04:10.455090 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 628/1276] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:08 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1473 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:10.482642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bfcc5ab7-d3fe-4eac-9c0e-ba6d12564903 req-c1adc0a1-65dd-463a-a3f0-3371890604e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:10.499773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bfcc5ab7-d3fe-4eac-9c0e-ba6d12564903 req-c1adc0a1-65dd-463a-a3f0-3371890604e4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:10.500265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bfcc5ab7-d3fe-4eac-9c0e-ba6d12564903 req-c1adc0a1-65dd-463a-a3f0-3371890604e4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:10.500702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bfcc5ab7-d3fe-4eac-9c0e-ba6d12564903 req-c1adc0a1-65dd-463a-a3f0-3371890604e4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:10.554935 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bfcc5ab7-d3fe-4eac-9c0e-ba6d12564903 req-c1adc0a1-65dd-463a-a3f0-3371890604e4 service nova] Creating event network-changed:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h1-791135-8 Oct 04 11:04:10.586632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-bfcc5ab7-d3fe-4eac-9c0e-ba6d12564903 req-c1adc0a1-65dd-463a-a3f0-3371890604e4 service nova] Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:04:10.628419 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bfcc5ab7-d3fe-4eac-9c0e-ba6d12564903 req-c1adc0a1-65dd-463a-a3f0-3371890604e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158634 Oct 04 11:04:10.630605 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 629/1277] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:10.911633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:10.912755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:10.926871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:10.928987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:10.930244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:10.933956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:10.936398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:10.937054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:11.305002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:11.317995 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80376668-1634-49ed-9f58-ca61772216a5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1283 microversion: 2.1 time: 0.413572 Oct 04 11:04:11.321093 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 630/1278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:10 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1283 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:04:11.340252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee3e2d4e-b411-4174-8731-f8881df62196 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d46005e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:11.471606 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee3e2d4e-b411-4174-8731-f8881df62196 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.148273 Oct 04 11:04:11.472375 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 631/1279] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:11 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:11.488839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:11.491495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:11.506837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:11.507512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:11.508134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:11.510191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:11.512813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:11.513496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:12.068523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:12.080946 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e38be3c8-4905-48f2-b60e-fe7a5383a9d4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1471 microversion: 2.1 time: 0.597919 Oct 04 11:04:12.085144 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 632/1280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:11 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1471 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:12.193305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:04:12.195560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:04:12.196298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:04:12.197089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:04:12.197833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:04:12.249025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:12.253684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:12.255526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:12.263897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:12.277311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:12.281295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:12.344371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:12.345298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:12.364894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:12.369451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:12.370828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:12.372082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:12.376685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:12.379763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:12.381583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Getting quotas for project 86a0fc1de1644db0a9a7e77241e2c04f. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:04:12.401115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Getting quotas for user 67875c6ae98c4184b8519b21977e23da and project 86a0fc1de1644db0a9a7e77241e2c04f. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:04:12.447460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:04:12.452651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:04:12.612422 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3aa1a91-0336-4570-8551-7c1b3894276e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.558392 Oct 04 11:04:12.619960 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 649/1281] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:04:12.636412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2bad7cec-343e-4fae-bdb7-87d7fa54ac56 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d429ddc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:13.173153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:13.183452 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0336b22-9e25-45a1-b485-3dfbbb947a94 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1271 microversion: 2.1 time: 0.845046 Oct 04 11:04:13.184029 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 633/1282] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:12 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1271 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:13.216016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bba68227-84c7-4551-ab02-797b91577aab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:13.216573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bba68227-84c7-4551-ab02-797b91577aab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:13.364689 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2bad7cec-343e-4fae-bdb7-87d7fa54ac56 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.743099 Oct 04 11:04:13.367104 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 650/1283] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:12 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:13.395897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:13.396948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:13.413134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:13.416368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:13.423604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:13.424793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:13.425533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:13.426260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:13.485544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bba68227-84c7-4551-ab02-797b91577aab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:13.494268 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bba68227-84c7-4551-ab02-797b91577aab tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1217 microversion: 2.1 time: 0.301426 Oct 04 11:04:13.499784 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 634/1284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:13 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1217 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:14.211958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:14.214675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:14.229480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:14.230680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:14.232448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:14.234795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:14.237115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:14.237823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:14.391317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:14.407964 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b88b6ced-5a56-434d-84c0-b3f419ec5931 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1468 microversion: 2.1 time: 1.037716 Oct 04 11:04:14.412648 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 651/1285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:13 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1468 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:14.433301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c5cfc9b-780a-4687-8368-bfbdab6d9ab1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d440eee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:14.537190 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c5cfc9b-780a-4687-8368-bfbdab6d9ab1 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.120076 Oct 04 11:04:14.545610 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 652/1286] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:14 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:14.559989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:14.575327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:14.593950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:14.594746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:14.595457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:14.598375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:14.599793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:14.602933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:14.933758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:14.948818 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-219f9cd6-a8bc-423a-be3d-08d961be2798 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1271 microversion: 2.1 time: 0.742337 Oct 04 11:04:14.968764 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 635/1287] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:14 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1271 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:14.977183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:14.978647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:14.989122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:14.989982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:14.991918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:14.995449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:14.997171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:14.999220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:15.218859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-404262b6-ce36-43e6-b47f-c0c363569c7f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "POST /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a/action" status: 202 len: 0 microversion: 2.1 time: 0.673126 Oct 04 11:04:15.226129 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 653/1288] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:04:14 2022] POST /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:04:15.231669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:15.232376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:15.252755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:15.256774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:15.257297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:15.258115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:15.258581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:15.259016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:15.303435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:15.313154 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac55739f-002d-4dd5-a470-cfa2daf788e1 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1269 microversion: 2.1 time: 0.342719 Oct 04 11:04:15.313782 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 636/1289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:14 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1269 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:15.551858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07c6393f-a7c9-4634-a2db-b3956284e55c tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4617a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:15.694259 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-07c6393f-a7c9-4634-a2db-b3956284e55c tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.145905 Oct 04 11:04:15.695439 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 637/1290] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:15 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:15.980232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:15.980855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:15.997075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:16.000367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:16.005017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:16.005885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:16.006367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:16.006811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:16.331112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:16.341692 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f68601e3-8f21-4a69-973e-cdacce356b9a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1271 microversion: 2.1 time: 0.365778 Oct 04 11:04:16.363519 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 638/1291] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:15 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1271 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:16.373694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:16.374309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:16.387086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:16.398353 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1024c92a-c363-42ad-b527-2f2b37a9d895 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 1.170251 Oct 04 11:04:16.404089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:16.420037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:16.420037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:16.420037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:16.420037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:16.420037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:16.421207 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 654/1292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:15 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:16.530435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:16.542558 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c9b30fa-6d8f-4e31-9586-35cc3981b836 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1287 microversion: 2.1 time: 0.177841 Oct 04 11:04:16.544646 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 639/1293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:16 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:16.709284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-739441c3-878d-4def-844f-72559bca1b83 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d42ebb80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:16.792204 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-739441c3-878d-4def-844f-72559bca1b83 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1451 microversion: 2.1 time: 0.086637 Oct 04 11:04:16.801943 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 655/1294] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:16 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1451 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:17.378239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:17.378899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:17.392100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:17.399318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:17.399815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:17.400255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:17.400973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:17.411970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:17.412433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:17.431599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:17.432223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:17.460556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:17.461758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:17.462872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:17.465818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:17.466485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:17.467126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:18.351288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:18.386616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4634d248-8086-4a4a-aa35-4e35fb4c18f6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.962726 Oct 04 11:04:18.391176 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 656/1295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:17 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:04:18.411491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:18.412118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:18.427258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:18.431153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:18.431908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:18.434871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:18.435381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:18.435828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:18.474897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:18.488416 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b08b9b7-0e60-461c-b1cb-99f7fc441bbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 1.115778 Oct 04 11:04:18.503565 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 640/1296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:17 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:18.516654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d43b32de-83c0-478b-b6ee-543e793027ad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d488e0d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:18.588480 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d43b32de-83c0-478b-b6ee-543e793027ad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1460 microversion: 2.1 time: 0.082766 Oct 04 11:04:18.590073 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 641/1297] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:18 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1460 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:18.605195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-dd512a37-154d-4109-ac20-7004e986434f req-cd42d66d-73e9-495f-9998-267f005e706e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d278191-0937-47b3-bb59-4c40c4a98bda", "tag": "db7d8832-93a3-4fdd-a30e-8d691ca33259"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:18.635342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dd512a37-154d-4109-ac20-7004e986434f req-cd42d66d-73e9-495f-9998-267f005e706e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:18.636906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dd512a37-154d-4109-ac20-7004e986434f req-cd42d66d-73e9-495f-9998-267f005e706e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:18.638901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dd512a37-154d-4109-ac20-7004e986434f req-cd42d66d-73e9-495f-9998-267f005e706e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:18.658116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:18.669906 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e989e453-73d9-45f2-9038-7e7a4b206630 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1275 microversion: 2.1 time: 0.277601 Oct 04 11:04:18.677793 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 657/1298] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:18 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:18.684794 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-dd512a37-154d-4109-ac20-7004e986434f req-cd42d66d-73e9-495f-9998-267f005e706e service nova] Creating event network-changed:db7d8832-93a3-4fdd-a30e-8d691ca33259 for instance 9d278191-0937-47b3-bb59-4c40c4a98bda on n-h1-791135-8 Oct 04 11:04:18.693007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95b5929d-6732-4142-ae27-d4c5ed43335e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d429d790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:18.694613 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-dd512a37-154d-4109-ac20-7004e986434f req-cd42d66d-73e9-495f-9998-267f005e706e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103210 Oct 04 11:04:18.697258 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 642/1299] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:18.790287 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95b5929d-6732-4142-ae27-d4c5ed43335e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 200 len: 1460 microversion: 2.1 time: 0.110189 Oct 04 11:04:18.791300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 658/1300] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:18 2022] GET /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 1460 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:18.805392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:18.806104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:18.820424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:18.820912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:18.821340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:18.822070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:18.822520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:18.822940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:18.860895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bd8bc907-9a8b-46ab-b505-fecc31753216 req-cb485506-7826-4e41-95de-5839c6ec3fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:18.886837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bd8bc907-9a8b-46ab-b505-fecc31753216 req-cb485506-7826-4e41-95de-5839c6ec3fb9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:18.888449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bd8bc907-9a8b-46ab-b505-fecc31753216 req-cb485506-7826-4e41-95de-5839c6ec3fb9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:18.892485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bd8bc907-9a8b-46ab-b505-fecc31753216 req-cb485506-7826-4e41-95de-5839c6ec3fb9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:18.936237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bd8bc907-9a8b-46ab-b505-fecc31753216 req-cb485506-7826-4e41-95de-5839c6ec3fb9 service nova] Creating event network-vif-plugged:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h1-791135-8 Oct 04 11:04:18.950982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-bd8bc907-9a8b-46ab-b505-fecc31753216 req-cb485506-7826-4e41-95de-5839c6ec3fb9 service nova] Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:04:18.974596 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bd8bc907-9a8b-46ab-b505-fecc31753216 req-cb485506-7826-4e41-95de-5839c6ec3fb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118285 Oct 04 11:04:18.977012 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 659/1301] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:19.416454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:19.417605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:19.448897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:19.450308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:19.451878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:19.461161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:19.461895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:19.463882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:19.786775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:19.795609 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-686fcb27-7a82-49f5-94b5-bb279b990789 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1468 microversion: 2.1 time: 0.994634 Oct 04 11:04:19.802616 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 643/1302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:18 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1468 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:19.814135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:19.815179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:19.831929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:19.832556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:19.833611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:19.834417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:19.835058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:19.835566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:20.270759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:20.279629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:20.286008 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-524402d6-5345-4141-aa3c-9b9de7a49dd6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.482180 Oct 04 11:04:20.286596 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 644/1303] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:19 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:20.290049 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-33bd8012-9c77-4e4b-a63e-63168905909b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.879050 Oct 04 11:04:20.290947 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 660/1304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:19 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:04:20.301086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:20.301735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:20.307878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-949204933"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:20.311406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:20.312699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:20.313196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:20.313689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:20.314348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:20.314793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:20.315213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:20.322349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:20.323100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:20.323676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:20.324931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:20.325569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:20.326159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:20.570885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:20.614256 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-534b7076-493d-4364-80b3-598a2515a051 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "POST /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425/action" status: 202 len: 0 microversion: 2.1 time: 0.321760 Oct 04 11:04:20.615652 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 661/1305] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:04:20 2022] POST /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:04:20.627690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-48e2a11c-5899-4783-a38d-a29f2ac97c26 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d43b1940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:20.684142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-48e2a11c-5899-4783-a38d-a29f2ac97c26 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.062174 Oct 04 11:04:20.685195 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 662/1306] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:20 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:20.925066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:20.932486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:20.950066 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4eba7ab-42f7-4df0-9b4d-26331c4a6fd7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.662281 Oct 04 11:04:20.952308 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 645/1307] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:20 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:21.308035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:21.309120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:21.316412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:21.317208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:21.324711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:21.327100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:21.327801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:21.328624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:21.329301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:21.330325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:21.331626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:21.332954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:21.333436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:21.336100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:21.336566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:21.338679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:21.949852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:21.958604 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ce3a405-bdc9-4976-8e6b-e4e42572a359 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.646419 Oct 04 11:04:21.973732 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 646/1308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:21 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:04:21.979617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-31135e60-ba7c-4eba-942e-8beeeffe57d5 req-ccf9c902-02b8-4347-b6a6-307821283df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a138f63e-bcb7-4a95-baa5-08da1f47aad6", "tag": "0f9193e2-f9f9-4947-bc48-2ebefb080a4d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:21.992659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-31135e60-ba7c-4eba-942e-8beeeffe57d5 req-ccf9c902-02b8-4347-b6a6-307821283df1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:21.993559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-31135e60-ba7c-4eba-942e-8beeeffe57d5 req-ccf9c902-02b8-4347-b6a6-307821283df1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:21.994143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-31135e60-ba7c-4eba-942e-8beeeffe57d5 req-ccf9c902-02b8-4347-b6a6-307821283df1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:22.006579 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-31135e60-ba7c-4eba-942e-8beeeffe57d5 req-ccf9c902-02b8-4347-b6a6-307821283df1 service nova] Creating event network-changed:0f9193e2-f9f9-4947-bc48-2ebefb080a4d for instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 on n-h2-791135-8 Oct 04 11:04:22.012602 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-31135e60-ba7c-4eba-942e-8beeeffe57d5 req-ccf9c902-02b8-4347-b6a6-307821283df1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037260 Oct 04 11:04:22.013577 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 647/1309] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:22.019028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9bff1eff-2f62-4345-80f0-0210d99a7900 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4617670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:22.027627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:22.036648 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28f0a77a-6aee-470b-86f4-402536123f11 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.732366 Oct 04 11:04:22.054712 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 663/1310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:21 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:22.059912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:22.060912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:22.069451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:22.070998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:22.071697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:22.072565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:22.073176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:22.073930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:22.083525 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9bff1eff-2f62-4345-80f0-0210d99a7900 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.068518 Oct 04 11:04:22.084112 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 648/1311] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:22 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:22.325885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:22.361121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:22.389767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc42e47e-89bf-4fe8-a5c6-b848d37ee739 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.333311 Oct 04 11:04:22.404197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 664/1312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:22 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:22.986891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:22.987633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:23.014661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:23.015632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:23.017322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:23.018948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:23.021699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:23.024592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:23.059643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:23.060242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:23.062138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:23.074075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:23.074571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:23.075011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:23.075725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:23.076185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:23.101985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:23.490356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:23.956245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:23.967448 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2951d6d2-ac0c-498b-8466-91e889eb6d52 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.984792 Oct 04 11:04:23.982048 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 649/1313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:22 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:23.999625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e47d7011-58f8-4d26-95eb-118eb2bd4961 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4617160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:24.009789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:24.020972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2b95642-0b24-4336-972a-174e41d67ea1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.965064 Oct 04 11:04:24.022939 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 665/1314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:23 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:04:24.030143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-77ecaf72-6223-4f51-863e-18babce463c0 req-aca50c08-3e8e-4574-a6d2-0448439c7771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e63ee3-3a6c-446a-b69b-eb8e79ad477a", "name": "network-vif-unplugged", "status": "completed", "tag": "6aeb5add-c4a0-4408-aa02-652effd838a2"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:24.104737 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e47d7011-58f8-4d26-95eb-118eb2bd4961 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.120064 Oct 04 11:04:24.106486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77ecaf72-6223-4f51-863e-18babce463c0 req-aca50c08-3e8e-4574-a6d2-0448439c7771 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:24.110006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77ecaf72-6223-4f51-863e-18babce463c0 req-aca50c08-3e8e-4574-a6d2-0448439c7771 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:24.110802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77ecaf72-6223-4f51-863e-18babce463c0 req-aca50c08-3e8e-4574-a6d2-0448439c7771 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:24.111671 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 650/1315] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:23 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:24.136092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:24.136755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:24.161074 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-77ecaf72-6223-4f51-863e-18babce463c0 req-aca50c08-3e8e-4574-a6d2-0448439c7771 service nova] Creating event network-vif-unplugged:6aeb5add-c4a0-4408-aa02-652effd838a2 for instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a on n-h1-791135-8 Oct 04 11:04:24.162940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:24.165202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:24.165670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:24.167509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:24.169756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:24.170685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-77ecaf72-6223-4f51-863e-18babce463c0 req-aca50c08-3e8e-4574-a6d2-0448439c7771 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143454 Oct 04 11:04:24.171302 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 666/1316] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:24.171602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:24.759094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:24.773961 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c239ade4-9a80-4805-89ab-a68a86d9cdca tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.648550 Oct 04 11:04:24.785519 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 651/1317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:24 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:24.987603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0da822f4-bd13-4162-8d16-9066c7e24908 req-f1ed8076-842a-44d8-ae1e-fc5bbf314b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6383b671-7d1d-408f-80d9-3c9ade2a609d", "tag": "4faf4872-4fad-42e9-b6fa-a0110144308a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:25.006086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:25.006524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:25.009648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0da822f4-bd13-4162-8d16-9066c7e24908 req-f1ed8076-842a-44d8-ae1e-fc5bbf314b2d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:25.010481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0da822f4-bd13-4162-8d16-9066c7e24908 req-f1ed8076-842a-44d8-ae1e-fc5bbf314b2d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:25.014127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0da822f4-bd13-4162-8d16-9066c7e24908 req-f1ed8076-842a-44d8-ae1e-fc5bbf314b2d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:25.021329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:25.026588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:25.028285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:25.031755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:25.032778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:25.032926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:25.034113 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0da822f4-bd13-4162-8d16-9066c7e24908 req-f1ed8076-842a-44d8-ae1e-fc5bbf314b2d service nova] Creating event network-changed:4faf4872-4fad-42e9-b6fa-a0110144308a for instance 6383b671-7d1d-408f-80d9-3c9ade2a609d on n-h1-791135-8 Oct 04 11:04:25.042503 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0da822f4-bd13-4162-8d16-9066c7e24908 req-f1ed8076-842a-44d8-ae1e-fc5bbf314b2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.481579 Oct 04 11:04:25.044214 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 667/1318] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:25.059688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:25.060551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:25.070791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:25.071407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:25.072014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:25.073210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:25.073808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:25.074358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:25.916698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:25.936048 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-287b0018-b055-40c4-9891-b6a69a919ae5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.933707 Oct 04 11:04:25.936705 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 652/1319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:24 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:25.951762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-249ab84e-71e9-44ad-be74-7e2f1e07e6af tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4c4d430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:26.013970 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-249ab84e-71e9-44ad-be74-7e2f1e07e6af tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.076045 Oct 04 11:04:26.014606 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 653/1320] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:25 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:26.025223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:26.025877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:26.033418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:26.035418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:26.035873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:26.036581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:26.037034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:26.039852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:26.359890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:26.378690 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c0599dc-9be6-4e17-a31d-a69af631323e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 1.326240 Oct 04 11:04:26.380063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 668/1321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:25 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:26.408322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:26.426082 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a500d4d9-c274-42fb-a319-bb44bcf93723 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.404353 Oct 04 11:04:26.426996 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 654/1322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:26 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:26.439333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e2a19ce4-2f1e-4b0e-8167-5f1ffb9356d5 req-a724aa9d-d4e1-4b36-8ff6-d35e85405ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:26.486699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e2a19ce4-2f1e-4b0e-8167-5f1ffb9356d5 req-a724aa9d-d4e1-4b36-8ff6-d35e85405ebd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:26.490213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e2a19ce4-2f1e-4b0e-8167-5f1ffb9356d5 req-a724aa9d-d4e1-4b36-8ff6-d35e85405ebd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:26.491009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e2a19ce4-2f1e-4b0e-8167-5f1ffb9356d5 req-a724aa9d-d4e1-4b36-8ff6-d35e85405ebd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:26.533333 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e2a19ce4-2f1e-4b0e-8167-5f1ffb9356d5 req-a724aa9d-d4e1-4b36-8ff6-d35e85405ebd service nova] Creating event network-vif-unplugged:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h2-791135-8 Oct 04 11:04:26.577013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-e2a19ce4-2f1e-4b0e-8167-5f1ffb9356d5 req-a724aa9d-d4e1-4b36-8ff6-d35e85405ebd service nova] Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:04:26.614176 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e2a19ce4-2f1e-4b0e-8167-5f1ffb9356d5 req-a724aa9d-d4e1-4b36-8ff6-d35e85405ebd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182616 Oct 04 11:04:26.615450 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 655/1323] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:26.666725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1258021225", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": "none"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:26.692358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:26.766921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:04:26.767535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:04:26.768182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:04:26.768769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:04:26.769401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:04:26.777729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:26.778741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:26.782374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:26.782862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:26.783299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:26.784035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:26.784488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:26.785125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:26.787054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:26.787556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:26.788036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:26.788758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:26.789220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:26.789694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:26.808478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Getting quotas for project e637210d112043fbab064bc4e65ea917. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:04:26.813581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Getting quotas for user 968e4ed3b1ef447b9a1f3621a371fbd6 and project e637210d112043fbab064bc4e65ea917. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:04:26.846120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:04:26.849024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:04:26.921540 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5cb3c535-0ea8-4cef-b1a3-e89a07bcf394 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.526505 Oct 04 11:04:26.922949 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 669/1324] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:04:26.947064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4dd398b3-a7cd-4aae-bde1-82ccf6632036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:26.948743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4dd398b3-a7cd-4aae-bde1-82ccf6632036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:27.248788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4dd398b3-a7cd-4aae-bde1-82ccf6632036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:27.272587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4dd398b3-a7cd-4aae-bde1-82ccf6632036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:27.274193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4dd398b3-a7cd-4aae-bde1-82ccf6632036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:27.289310 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4dd398b3-a7cd-4aae-bde1-82ccf6632036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1454 microversion: 2.91 time: 0.355269 Oct 04 11:04:27.292837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 670/1325] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:26 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1454 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:27.304116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:27.308040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:27.322570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:27.325868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:27.326636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:27.330332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:27.331092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:27.332996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:28.142766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 5813e7a4-1b03-438c-bf70-c2b544030ce4 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:04:28.196880 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8f950e8-1446-4b54-b740-168000173250 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 2423 microversion: 2.25 time: 1.420516 Oct 04 11:04:28.198162 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 656/1326] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:26 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 2423 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:04:28.210717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-762e3d04-d5e5-4655-a693-c604f78a1c68 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d47a0940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:28.307227 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-762e3d04-d5e5-4655-a693-c604f78a1c68 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.107521 Oct 04 11:04:28.307826 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 657/1327] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:28 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:28.326449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:28.327114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:28.355204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:28.355795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:28.356245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:28.356966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:28.357460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:28.357969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:28.386344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:28.401437 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ba06c13-1af5-4fee-af8c-7dd41f87c3e6 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 1.107138 Oct 04 11:04:28.404071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 671/1328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:27 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:28.415547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:28.416591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:28.432373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:28.434509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:28.436847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:28.437797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:28.440819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:28.441573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:29.097988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:29.112140 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6d0bee9-4d5c-4bbf-9964-f71742ea364c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.802353 Oct 04 11:04:29.114969 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 658/1329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:28 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:29.131459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-791135-8", "block_migration": "auto"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:29.135908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:29.156996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:29.161605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:29.164473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:29.165476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:29.167119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:29.169493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:29.279380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:29.291399 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-04a5c26c-988a-40df-865a-ffffa589c089 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.884703 Oct 04 11:04:29.294885 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 672/1330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:28 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:29.311985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:29.312949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:29.331161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:29.334350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:29.335069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:29.335981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:29.336605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:29.338893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:29.459135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'flavor' on Instance uuid 5813e7a4-1b03-438c-bf70-c2b544030ce4 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:04:29.562766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Going to try to live migrate instance to n-h1-791135-8 {{(pid=122408) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:04:29.572339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:29.583641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:29.587469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:29.606817 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fb9a2e3-6eec-4638-826a-178a7cd60ec1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1524 microversion: 2.91 time: 0.304670 Oct 04 11:04:29.607764 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 673/1331] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:29 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1524 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:29.613854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-490af30d-a19d-44ea-b34a-c4a107d5a5f5 req-ddea9f7f-309c-4199-a663-124a4d8f4053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:29.636310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-490af30d-a19d-44ea-b34a-c4a107d5a5f5 req-ddea9f7f-309c-4199-a663-124a4d8f4053 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:29.637799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-490af30d-a19d-44ea-b34a-c4a107d5a5f5 req-ddea9f7f-309c-4199-a663-124a4d8f4053 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:29.639920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-490af30d-a19d-44ea-b34a-c4a107d5a5f5 req-ddea9f7f-309c-4199-a663-124a4d8f4053 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:29.669303 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-490af30d-a19d-44ea-b34a-c4a107d5a5f5 req-ddea9f7f-309c-4199-a663-124a4d8f4053 service nova] Creating event network-changed:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h2-791135-8 Oct 04 11:04:29.687020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-490af30d-a19d-44ea-b34a-c4a107d5a5f5 req-ddea9f7f-309c-4199-a663-124a4d8f4053 service nova] Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:04:29.724113 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-490af30d-a19d-44ea-b34a-c4a107d5a5f5 req-ddea9f7f-309c-4199-a663-124a4d8f4053 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112446 Oct 04 11:04:29.726704 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 674/1332] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:29.755832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b77cf0db-562f-484e-a44c-4af9a1ac0776 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d42ebca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:29.854936 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b77cf0db-562f-484e-a44c-4af9a1ac0776 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.125959 Oct 04 11:04:29.855834 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 675/1333] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:29 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:29.863584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:29.863584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:29.869942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:29.870644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:29.871980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:29.872909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:29.873503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:29.874768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:30.617008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:30.650728 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4e7bb04-6299-46f2-a0ad-f8d336845822 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.789848 Oct 04 11:04:30.666847 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 676/1334] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:29 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:30.684675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-02ee6c55-e8a9-4da1-8ac0-d64712a43777 req-35a28890-d8a2-4d12-a400-d6191ec03d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d278191-0937-47b3-bb59-4c40c4a98bda", "name": "network-vif-plugged", "status": "completed", "tag": "db7d8832-93a3-4fdd-a30e-8d691ca33259"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:30.703155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02ee6c55-e8a9-4da1-8ac0-d64712a43777 req-35a28890-d8a2-4d12-a400-d6191ec03d67 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:30.705461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02ee6c55-e8a9-4da1-8ac0-d64712a43777 req-35a28890-d8a2-4d12-a400-d6191ec03d67 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:30.706400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02ee6c55-e8a9-4da1-8ac0-d64712a43777 req-35a28890-d8a2-4d12-a400-d6191ec03d67 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:30.731711 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-02ee6c55-e8a9-4da1-8ac0-d64712a43777 req-35a28890-d8a2-4d12-a400-d6191ec03d67 service nova] Creating event network-vif-plugged:db7d8832-93a3-4fdd-a30e-8d691ca33259 for instance 9d278191-0937-47b3-bb59-4c40c4a98bda on n-h1-791135-8 Oct 04 11:04:30.751403 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-02ee6c55-e8a9-4da1-8ac0-d64712a43777 req-35a28890-d8a2-4d12-a400-d6191ec03d67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079330 Oct 04 11:04:30.752571 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 677/1335] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:30.760367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:30.761447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:30.775197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:30.776748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:30.777900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:30.801644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:30.802942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:30.805785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:31.176702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:31.185847 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-946655f5-243a-4f63-aa84-116e601fd3a1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.431443 Oct 04 11:04:31.194348 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 678/1336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:30 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:31.199512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:31.210313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:31.228181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:31.240997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:31.242261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:31.243190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:31.243836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:31.244473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:31.641940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:31.651961 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5071b3c1-ce4d-4da5-a87d-6824ca9ff47d tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.456235 Oct 04 11:04:31.657010 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 679/1337] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:31 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:31.661961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:31.667438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:31.691332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:31.692125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:31.692758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:31.693703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:31.694436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:31.695045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:31.839605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:31.851311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:31.853810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:31.859691 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c89f139f-0a79-4bdb-a937-dce699508b0e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1512 microversion: 2.91 time: 0.201398 Oct 04 11:04:31.861555 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 680/1338] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:31 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:31.867344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4610f708-5af5-4aa7-b640-f3ddd7e65a36 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d43c1af0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:31.961910 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4610f708-5af5-4aa7-b640-f3ddd7e65a36 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.099221 Oct 04 11:04:31.962810 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 681/1339] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:31 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:31.968293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:31.969130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:31.978738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:31.980077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:31.980700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:31.981751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:31.982367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:31.984357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:32.415978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:32.438616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d19d365a-2a14-41ba-9e23-4210fc1f49d8 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.471014 Oct 04 11:04:32.457210 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 682/1340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:31 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:32.479619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-030fbc53-3d59-41bf-9fe3-dfff56e6aabb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Action: 'create', calling method: .version_select at 0x7f71d435fa60>, body: {"keypair": {"name": "tempest-keypair-1618137327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8U/heuNTRWVy+YUGr18Xbhy02P+Dc0taMHWrJow8sepzjebvYIXnvYp0VdpsQfohcQXYvSTFWyrPMwg+HrOuk8DsE+wbIsDZR43tMR0QCLSKqQbY07zviqpDMUbHNT4Q=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:32.552393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-030fbc53-3d59-41bf-9fe3-dfff56e6aabb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Getting quotas for project 01c5a71c4dee44e4a726208c616433a6. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:04:32.560691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-030fbc53-3d59-41bf-9fe3-dfff56e6aabb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Getting quotas for user cb7fadf5ab3b465d9fcf0e04aa3ebe84 and project 01c5a71c4dee44e4a726208c616433a6. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:04:32.642475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-030fbc53-3d59-41bf-9fe3-dfff56e6aabb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.183170 Oct 04 11:04:32.646905 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 683/1341] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:04:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:04:32.654188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:32.654808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:32.674785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:32.675296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:32.675698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:32.687326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:32.691733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:32.692203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:33.385988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:33.407026 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e234801-2f47-41fc-bbfb-f913c1588a9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.758372 Oct 04 11:04:33.409902 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 684/1342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:32 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:33.417051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:33.418259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:33.427444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:33.430854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:33.432072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:33.434669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:33.436077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:33.438152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:34.176474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:34.188105 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-589095c4-229e-477a-ba03-a9cd91bfa271 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.776722 Oct 04 11:04:34.190285 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 685/1343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:33 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:34.213039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:34.215834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:34.241548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:34.243730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:34.245022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:34.247659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:34.249001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:34.250121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:34.268156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:34.414710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:34.430146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:34.431518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:34.449239 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d3a4812-3dc2-43a1-a48c-45771673c27c tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/action" status: 202 len: 0 microversion: 2.25 time: 5.332169 Oct 04 11:04:34.450266 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 659/1344] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:04:29 2022] POST /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/action => generated 0 bytes in 5334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:04:34.454763 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fca45c88-f7cb-43ef-9c8e-fe6d1655d293 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1512 microversion: 2.91 time: 0.262872 Oct 04 11:04:34.457900 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 686/1345] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:34 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:34.469302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6a5637f3-f0b1-4088-a602-0ca1f4bd5918 req-f415341a-60dc-4f7b-911e-520a280ef7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b04194-7767-4636-9ed0-3869ff18e425", "name": "network-vif-plugged", "status": "completed", "tag": "c9b6f444-374d-48a3-a78e-32dff234e6dd"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:34.470699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdca37ef-742a-4259-bda0-97716c3c155b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d473e9d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:34.497457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6a5637f3-f0b1-4088-a602-0ca1f4bd5918 req-f415341a-60dc-4f7b-911e-520a280ef7c2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:34.499237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6a5637f3-f0b1-4088-a602-0ca1f4bd5918 req-f415341a-60dc-4f7b-911e-520a280ef7c2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:34.499816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6a5637f3-f0b1-4088-a602-0ca1f4bd5918 req-f415341a-60dc-4f7b-911e-520a280ef7c2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:34.529474 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6a5637f3-f0b1-4088-a602-0ca1f4bd5918 req-f415341a-60dc-4f7b-911e-520a280ef7c2 service nova] Creating event network-vif-plugged:c9b6f444-374d-48a3-a78e-32dff234e6dd for instance 59b04194-7767-4636-9ed0-3869ff18e425 on n-h1-791135-8 Oct 04 11:04:34.542114 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdca37ef-742a-4259-bda0-97716c3c155b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.087022 Oct 04 11:04:34.542931 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 660/1346] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:34 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:34.544157 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6a5637f3-f0b1-4088-a602-0ca1f4bd5918 req-f415341a-60dc-4f7b-911e-520a280ef7c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084144 Oct 04 11:04:34.549334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:34.551215 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 687/1347] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:34.568181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:34.588021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:34.588589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:34.589551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:34.590436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:34.591382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:34.592970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:34.684377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec69b8e5-09e2-423a-ae27-8875cab536f6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Action: 'create', calling method: .version_select at 0x7f71d42871f0>, body: {"keypair": {"name": "tempest-keypair-1360255257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRXaQmLD/mwErA0uEuFHuluqBOtKpXwAdOvyjFNd3AQSQicqA0sLUv3DVDD8CWHxH55NjFHvZtvpC8QHdwiMx0YRHcR2RXManE7wXuFDkzd9nKt6fFRcocd4riMA32+jg=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:34.712148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ec69b8e5-09e2-423a-ae27-8875cab536f6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Getting quotas for project b968e6eb837f4be2b40439b79a0b7509. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:04:34.717108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ec69b8e5-09e2-423a-ae27-8875cab536f6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Getting quotas for user c21554eac00f49a88859835db6a7581e and project b968e6eb837f4be2b40439b79a0b7509. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:04:34.763231 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec69b8e5-09e2-423a-ae27-8875cab536f6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210275 Oct 04 11:04:34.766452 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 688/1348] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:04:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:34.778503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:34.779435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:34.787232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:34.788396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:34.795232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:34.803181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:34.804433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:34.805425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:35.473168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:35.487987 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d3b4cd93-d628-4e2d-8491-4d6073c6ed93 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.943454 Oct 04 11:04:35.489949 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 661/1349] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:34 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:35.496872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:35.497732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:35.506568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:35.507280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:35.507949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:35.508870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:35.509555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:35.510204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:35.576634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:35.589339 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0dc577c-6a7a-4f71-9a2a-e174112374cc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.820741 Oct 04 11:04:35.590284 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 689/1350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:34 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:35.614835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:35.615458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:35.635959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:35.637323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:35.638244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:35.639244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:35.639916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:35.640546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:36.115223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:36.131551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:36.136709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:36.139480 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f7cf66a-428c-4ba4-8af3-2231d14bc42c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.647033 Oct 04 11:04:36.140246 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 662/1351] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:35 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:36.146308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:36.148707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:36.154885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:36.159457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:36.166011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:36.169822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:36.171083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:36.172540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:36.173192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:36.176063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:36.184849 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73cebb24-9caf-43f4-8aef-798c92a8d981 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.591280 Oct 04 11:04:36.188471 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 690/1352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:35 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:36.193608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc2b6351-5cf7-4999-bae5-fdf34fc354bd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d437b040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:36.303579 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc2b6351-5cf7-4999-bae5-fdf34fc354bd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.111917 Oct 04 11:04:36.306711 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 691/1353] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:36 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:36.328427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:36.341024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:36.355004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:36.384438 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e5a39c77-7a99-4dd3-97b4-0060e5789056 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1512 microversion: 2.91 time: 0.241448 Oct 04 11:04:36.385252 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 663/1354] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:36 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:36.525889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:36.528400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:36.549226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:36.550272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:36.552101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:36.553103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:36.554447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:36.557134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:36.577631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3aa51b42-524f-49f7-b257-03f655ced185 req-40be15d5-2c12-44ba-912e-5fa7efca8938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a138f63e-bcb7-4a95-baa5-08da1f47aad6", "name": "network-vif-plugged", "status": "completed", "tag": "0f9193e2-f9f9-4947-bc48-2ebefb080a4d"}, {"server_uuid": "6383b671-7d1d-408f-80d9-3c9ade2a609d", "name": "network-vif-plugged", "status": "completed", "tag": "4faf4872-4fad-42e9-b6fa-a0110144308a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:36.603036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3aa51b42-524f-49f7-b257-03f655ced185 req-40be15d5-2c12-44ba-912e-5fa7efca8938 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:36.603527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3aa51b42-524f-49f7-b257-03f655ced185 req-40be15d5-2c12-44ba-912e-5fa7efca8938 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:36.607339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3aa51b42-524f-49f7-b257-03f655ced185 req-40be15d5-2c12-44ba-912e-5fa7efca8938 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:36.646267 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3aa51b42-524f-49f7-b257-03f655ced185 req-40be15d5-2c12-44ba-912e-5fa7efca8938 service nova] Creating event network-vif-plugged:0f9193e2-f9f9-4947-bc48-2ebefb080a4d for instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 on n-h2-791135-8 Oct 04 11:04:36.648217 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3aa51b42-524f-49f7-b257-03f655ced185 req-40be15d5-2c12-44ba-912e-5fa7efca8938 service nova] Creating event network-vif-plugged:4faf4872-4fad-42e9-b6fa-a0110144308a for instance 6383b671-7d1d-408f-80d9-3c9ade2a609d on n-h1-791135-8 Oct 04 11:04:36.665686 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3aa51b42-524f-49f7-b257-03f655ced185 req-40be15d5-2c12-44ba-912e-5fa7efca8938 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092447 Oct 04 11:04:36.671043 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 664/1355] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:04:36.685146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:36.687560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:36.702896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:36.704101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:36.704980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:36.707422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:36.708115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:36.710451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:36.796240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:36.880707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:36.900089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c5f5313-846b-4d48-81a0-428c6fbb2ef7 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1467 microversion: 2.1 time: 0.384108 Oct 04 11:04:36.901913 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 692/1356] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:36 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:36.930394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-410790080", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "be7b29d0-5b24-4485-baf3-c6484472e59b"}, {"port": "c3fdccff-9fdc-4892-b028-ab3882d9278a", "tag": "port-1"}, {"port": "e9423bf4-7a84-4511-a3b6-3c607d86bde1", "tag": "port-2"}, {"uuid": "a791c107-2cc6-4b26-b058-6fcb30d1e984", "tag": "net-1"}, {"uuid": "a791c107-2cc6-4b26-b058-6fcb30d1e984"}, {"uuid": "0285a0ed-4774-49c6-a194-6082b94b215f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0285a0ed-4774-49c6-a194-6082b94b215f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "45a97701-4e7c-4dd1-83f0-bb83a3d96694", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "48dd84d0-71ff-4932-9b91-781579ef72d8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f92b6a57-4f7e-47f7-8e17-94734daabe16", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--348597742"}], "key_name": "tempest-keypair-1618137327", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:37.296685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] validate_networks() for [('be7b29d0-5b24-4485-baf3-c6484472e59b', None, None, None, None, None), (None, None, 'c3fdccff-9fdc-4892-b028-ab3882d9278a', None, None, None), (None, None, 'e9423bf4-7a84-4511-a3b6-3c607d86bde1', None, None, None), ('a791c107-2cc6-4b26-b058-6fcb30d1e984', None, None, None, None, None), ('a791c107-2cc6-4b26-b058-6fcb30d1e984', None, None, None, None, None), ('0285a0ed-4774-49c6-a194-6082b94b215f', '10.2.2.100', None, None, None, None), ('0285a0ed-4774-49c6-a194-6082b94b215f', '10.2.2.200', None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:04:37.330130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:37.338877 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d89d9a52-3c62-4a1c-9fef-4af971667059 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.665134 Oct 04 11:04:37.357011 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 665/1357] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:36 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:37.368357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:37.369284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:37.383819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:37.384504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:37.385077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:37.388351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:37.389138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:37.389759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:37.960612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:37.963237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:37.975152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:37.976888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:37.978434 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ca35c1b-5bdf-4358-827a-59e10c88748c tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.620121 Oct 04 11:04:37.979175 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 666/1358] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:37 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:37.987969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:37.989858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:38.013082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:38.013743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:38.015784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:38.017469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:38.018717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:38.019198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:38.267457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:38.281711 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32917e46-747b-4039-adf7-c97d49f04e5f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1317 microversion: 2.1 time: 0.297110 Oct 04 11:04:38.282873 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 667/1359] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:37 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:38.288523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e39b7f83-ae5e-4052-983f-ba09d476f941 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4599700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:38.343885 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e39b7f83-ae5e-4052-983f-ba09d476f941 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1452 microversion: 2.1 time: 0.059695 Oct 04 11:04:38.345171 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 668/1360] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:38 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:38.351850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:38.352709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:38.361637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:38.362618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:38.363435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:38.364451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:38.365326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:38.366461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:38.478271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:38.489591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:38.491457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:38.509024 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2f0ef74-ab3d-42f0-90ce-21678f986717 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1533 microversion: 2.91 time: 0.162541 Oct 04 11:04:38.509862 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 669/1361] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:38 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1533 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:38.535421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:38.536050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:38.567122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:38.567882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:38.568568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:38.570643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:38.571324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:38.572040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:38.963491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:38.978210 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33110100-e403-45bc-9fdf-7225a31ae416 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1460 microversion: 2.1 time: 0.464258 Oct 04 11:04:38.982209 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 670/1362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:38 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1460 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:39.003790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:39.007138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:39.033132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:39.033132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:39.033675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:39.034286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:39.034738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:39.045297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:39.496663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:39.512333 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8dc35b40-7be2-4699-8161-908890f9a70d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1313 microversion: 2.1 time: 0.524779 Oct 04 11:04:39.515907 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 671/1363] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:38 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:39.684927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:39.685904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:39.702090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:39.702841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:39.706429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:39.707706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:39.713613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:39.715861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:40.014768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lazy-loading 'services' on Instance uuid d547029e-7d82-43c1-b62b-e86b323bfcbe {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:04:40.077311 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-00ed4975-27c5-48ff-baad-d102707ff67d tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1938 microversion: 2.91 time: 0.560251 Oct 04 11:04:40.103302 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 672/1364] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:39 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1938 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:40.124673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:40.125682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:40.154187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:40.157179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:40.159349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:40.165194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:40.166080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:40.170997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:40.705843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:40.719313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:40.724353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:40.726479 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-901c6e67-e0b5-4251-a2d5-659df27cedbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.622166 Oct 04 11:04:40.749946 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 673/1365] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:40 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:40.757646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:40.769947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:40.779743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:40.782427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:40.783150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:40.784303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:40.791136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:40.791903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:41.157910 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0003f65c-9550-431a-a079-f82850c3782e tempest-MigrationsAdminTest-1922827443 tempest-MigrationsAdminTest-1922827443-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1611 microversion: 2.1 time: 0.406031 Oct 04 11:04:41.173377 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 674/1366] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:40 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1611 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:41.173377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:41.173377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:41.195342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:41.196824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:41.202082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:41.209018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:41.212555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:41.213948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:41.760816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:41.773121 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9662f0c5-dc57-46b1-9b45-bfacce08cc4a tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1508 microversion: 2.1 time: 0.605315 Oct 04 11:04:41.789416 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 675/1367] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:41 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1508 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:41.793584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f8a04ac-86e7-42b8-855d-4ac0a18fc72d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4600670>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:43.143571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:04:43.144103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:04:43.144470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:04:43.144886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:04:43.145302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:04:43.167902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:43.168406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:43.175230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:43.181184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:43.181895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:43.182514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:43.239973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Getting quotas for project 01c5a71c4dee44e4a726208c616433a6. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:04:43.254962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Getting quotas for user cb7fadf5ab3b465d9fcf0e04aa3ebe84 and project 01c5a71c4dee44e4a726208c616433a6. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:04:43.571279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:04:43.575388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='45a97701-4e7c-4dd1-83f0-bb83a3d96694',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='48dd84d0-71ff-4932-9b91-781579ef72d8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f92b6a57-4f7e-47f7-8e17-94734daabe16',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:04:44.231036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:44.267615 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64a9f80b-43ff-4640-854c-0521c554f179 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.362636 Oct 04 11:04:44.275977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 693/1368] 10.222.0.23 () {62 vars in 1189 bytes} [Tue Oct 4 11:04:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 7373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:04:44.395463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-984e19b5-0228-40e5-9efc-61db8718246e req-432d2468-a5ba-44cb-9839-af356003f356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:44.427248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-984e19b5-0228-40e5-9efc-61db8718246e req-432d2468-a5ba-44cb-9839-af356003f356 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:44.428068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-984e19b5-0228-40e5-9efc-61db8718246e req-432d2468-a5ba-44cb-9839-af356003f356 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:44.429726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-984e19b5-0228-40e5-9efc-61db8718246e req-432d2468-a5ba-44cb-9839-af356003f356 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:44.466181 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-984e19b5-0228-40e5-9efc-61db8718246e req-432d2468-a5ba-44cb-9839-af356003f356 service nova] Creating event network-vif-plugged:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h2-791135-8 Oct 04 11:04:44.472778 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-984e19b5-0228-40e5-9efc-61db8718246e req-432d2468-a5ba-44cb-9839-af356003f356 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195226 Oct 04 11:04:44.476704 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 694/1369] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:44.486975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:44.487696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:44.496400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:44.497178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:44.498105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:44.499001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:44.499614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:44.500191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:44.599121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lazy-loading 'services' on Instance uuid d547029e-7d82-43c1-b62b-e86b323bfcbe {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:04:44.621180 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99d899f3-a71e-4f3b-8e11-8fe757999238 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1938 microversion: 2.91 time: 0.143054 Oct 04 11:04:44.634039 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 695/1370] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:44 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1938 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:44.655518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:44.656150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:44.665167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:44.666421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:44.667072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:44.668926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:44.670584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:44.671462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:44.976559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:44.988986 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfc2f0e1-e7c4-4f95-bbe3-a603cf24f3f6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1463 microversion: 2.1 time: 0.353786 Oct 04 11:04:45.004996 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 696/1371] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:44 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1463 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:45.185759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:45.186292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:45.202895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:45.204823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:45.205280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:45.208278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:45.208866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:45.209500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:45.271668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:04:45.426954 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1264352-6c99-475c-8692-7552e0d3f9cd tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 204 len: 0 microversion: 2.1 time: 0.415944 Oct 04 11:04:45.427877 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 697/1372] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:04:45 2022] DELETE /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:04:45.438245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:45.439276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:45.447389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:45.448113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:45.450281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:45.451240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:45.452292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:45.453182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:45.650901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:45.661507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:45.663289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:45.664673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d542e51-dba2-4121-aa54-21369a118112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.234691 Oct 04 11:04:45.665980 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 698/1373] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:45 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:45.685137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:45.686118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:45.695517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:45.696015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:45.698111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:45.698859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:45.699337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:45.713332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.024547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:46.038107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:46.039509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:46.040681 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3082f089-a235-4484-8626-eb39ab2d39cb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1519 microversion: 2.42 time: 0.373264 Oct 04 11:04:46.041254 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 699/1374] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:45 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1519 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:46.046154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34cc0b9e-1064-405d-97af-680b76ccad72 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:46.050492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cc0b9e-1064-405d-97af-680b76ccad72 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.051394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cc0b9e-1064-405d-97af-680b76ccad72 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.051394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cc0b9e-1064-405d-97af-680b76ccad72 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.052267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cc0b9e-1064-405d-97af-680b76ccad72 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.054013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cc0b9e-1064-405d-97af-680b76ccad72 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.054013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cc0b9e-1064-405d-97af-680b76ccad72 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.086108 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34cc0b9e-1064-405d-97af-680b76ccad72 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.043746 Oct 04 11:04:46.087043 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 700/1375] 10.222.0.23 () {60 vars in 1217 bytes} [Tue Oct 4 11:04:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:04:46.091677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9896a063-23d1-4565-80c0-48b0320b1984"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:46.094335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:46.101464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.101971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.102416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.103141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.103604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.104038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.186878 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] HTTP exception thrown: Volume 3b88ed7c-1527-4790-b000-ed216423d83f could not be found. Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Request method failure captured: Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d/os-volume_attachments/3b88ed7c-1527-4790-b000-ed216423d83f HTTP/1.1 Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 74 Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBKHeYmth_sOKhBq5CgRT8-j07RwLm2A1B43QPU6mLkQXREH3-SXNpgOQrqshb6y0I5Etot1BHfrgrHZgaHBxHgbuviJ4ge7200sJuMLtP-sRqquLQFDqjIuzIH-A06ykFKV2arJHGaxEQUDTMdC9dUUfBS0gyXFl1AuuzAxWtE30v0 Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 960bece624a1477eacc3a6fbc5b03a9e Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesAdminNegativeTest-1755074212 Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_960bece624a1477eacc3a6fbc5b03a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/960bece624a1477eacc3a6fbc5b03a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/960bece624a1477eacc3a6fbc5b03a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/960bece624a1477eacc3a6fbc5b03a9e"}]}] Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesAdminNegativeTest-1755074212 Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 960bece624a1477eacc3a6fbc5b03a9e Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1755074212 Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesAdminNegativeTest-1755074212-project-admin Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 515ffc067bd444e298f353c9589ae2eb Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesAdminNegativeTest-1755074212-project-admin Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: {"volumeAttachment": {"volumeId": "9896a063-23d1-4565-80c0-48b0320b1984"}} Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: exception: Volume 3b88ed7c-1527-4790-b000-ed216423d83f could not be found. Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '6383b671-7d1d-408f-80d9-3c9ade2a609d', 'id': '3b88ed7c-1527-4790-b000-ed216423d83f', 'body': {'volumeAttachment': {'volumeId': '9896a063-23d1-4565-80c0-48b0320b1984'}}} Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b88ed7c-1527-4790-b000-ed216423d83f could not be found. (HTTP 404) (Request-ID: req-1fac081f-1157-4371-b440-b8dd701ae4ae) Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:04:46.189039 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b88ed7c-1527-4790-b000-ed216423d83f could not be found. Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b88ed7c-1527-4790-b000-ed216423d83f could not be found. Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b88ed7c-1527-4790-b000-ed216423d83f could not be found. Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] Returning 404 to user: Volume 3b88ed7c-1527-4790-b000-ed216423d83f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7edc0286-148e-44d8-bc30-99b1fd6d4b4b tempest-VolumesAdminNegativeTest-1755074212 tempest-VolumesAdminNegativeTest-1755074212-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d/os-volume_attachments/3b88ed7c-1527-4790-b000-ed216423d83f" status: 404 len: 109 microversion: 2.1 time: 0.102819 Oct 04 11:04:46.194479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 701/1376] 10.222.0.23 () {60 vars in 1433 bytes} [Tue Oct 4 11:04:46 2022] PUT /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d/os-volume_attachments/3b88ed7c-1527-4790-b000-ed216423d83f => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:04:46.200953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:46.201603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:46.209038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.209905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.210633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.213390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.213390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.213390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.414236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:46.442495 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-921d987e-4fa0-421c-b325-0e1b2d531822 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1463 microversion: 2.1 time: 0.249846 Oct 04 11:04:46.456057 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 702/1377] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:46 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1463 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:46.476910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:46.478732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:46.525148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.525986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.527923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.528732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.529208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.529672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.859366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:46.870598 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bac20aeb-17fb-48e2-9b4e-d82d1e574824 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 200 len: 1466 microversion: 2.1 time: 0.412833 Oct 04 11:04:46.881609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 703/1378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:46 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 1466 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:46.881609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:46.881609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:46.889449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.889449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.889761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.891060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:46.891849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:46.892393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:46.939593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lazy-loading 'flavor' on Instance uuid d547029e-7d82-43c1-b62b-e86b323bfcbe {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:04:47.079909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:50.501108 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f8a04ac-86e7-42b8-855d-4ac0a18fc72d tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1461 microversion: 2.1 time: 8.717994 Oct 04 11:04:50.503055 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 676/1379] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:41 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1461 bytes in 8726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:50.538686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:50.551369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:50.569331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:50.569869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:50.570304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:50.571046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:50.573904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:50.575442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:50.661942 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45d5b4b1-4efe-401d-afcd-94920ec41726 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "POST /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe/action" status: 202 len: 0 microversion: 2.91 time: 3.789025 Oct 04 11:04:50.665461 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 704/1380] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:04:46 2022] POST /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe/action => generated 0 bytes in 3791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:04:50.687679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1351217238", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9d278191-0937-47b3-bb59-4c40c4a98bda"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:50.821627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:04:50.901130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:50.912050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:50.923269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:50.924511 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1337d66-1299-4c73-96b0-ce6cb32edd20 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.400791 Oct 04 11:04:50.925070 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 677/1381] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:50 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:50.933757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:50.934361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:50.961841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:50.962334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:50.962760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:50.963469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:50.978437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:50.978951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.478401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:04:51.478999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:04:51.479488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:04:51.479967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:04:51.480442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:04:51.495940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.496997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.502986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.512807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.514299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.519974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.530379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:51.546407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:51.548380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:51.551122 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3194dc3d-0d2b-4177-9ad1-759d9ecc67cc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1706 microversion: 2.42 time: 0.624209 Oct 04 11:04:51.557847 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 678/1382] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:50 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1706 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:51.568942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:51.569966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 79cd3988-e24b-40e3-b8f3-f78e280b031a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:51.592176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.593113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.593833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.596625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.597421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.598123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.608879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Getting quotas for project 8e8dfb2a0b8d4faa8e810e56fc749d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:04:51.615282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Getting quotas for user 671786f1a7c74682a66520aeb60a5f50 and project 8e8dfb2a0b8d4faa8e810e56fc749d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:04:51.616157 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] HTTP exception thrown: Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a could not be found. Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Request method failure captured: Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a HTTP/1.1 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIeVq9R6G4-SI2rCSoyQb-x-B4-ydSbu8hhpwOjkyydw-suqAxEOB-dP9gEGvCAlEnD3hD58XmzvKxH5INJc5AYFjtZ64heLytpaPiu1deykkJHwvyQuwzGayRLo3gMqWNScPqdpFDNACTRXNfHxCi_EQSP0fIjxJub8ns7R1Tcxzg Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 64b6b184def140dba0ea1ac0a56a98e1 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-MigrationsAdminTest-435332656 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64b6b184def140dba0ea1ac0a56a98e1"}]}] Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-MigrationsAdminTest-435332656 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 64b6b184def140dba0ea1ac0a56a98e1 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-MigrationsAdminTest-435332656 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-MigrationsAdminTest-435332656-project Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: b024d221d4784e2399fd7676706cbc04 Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-MigrationsAdminTest-435332656-project Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a could not be found. Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '79cd3988-e24b-40e3-b8f3-f78e280b031a'} Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a could not be found. Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a could not be found. Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:51.618387 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:51.622851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:51.622851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:51.622851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:51.622851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:04:51.622851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:04:51.622851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a could not be found. Oct 04 11:04:51.622851 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:51.628872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Returning 404 to user: Instance 79cd3988-e24b-40e3-b8f3-f78e280b031a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:04:51.630199 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6606003e-66b3-43df-b3a4-ad208787162b tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a" status: 404 len: 111 microversion: 2.1 time: 0.070817 Oct 04 11:04:51.635094 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 679/1383] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:51 2022] GET /compute/v2.1/servers/79cd3988-e24b-40e3-b8f3-f78e280b031a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:04:51.640576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0954c3a8-4b88-41b8-829c-846de95d5d67 req-45697b1d-f798-4de0-9e00-841439d2b701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cd3988-e24b-40e3-b8f3-f78e280b031a", "name": "network-vif-deleted", "tag": "fc6a2457-4aa3-4215-ab51-699951039864"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:51.653417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0954c3a8-4b88-41b8-829c-846de95d5d67 req-45697b1d-f798-4de0-9e00-841439d2b701 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.654314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0954c3a8-4b88-41b8-829c-846de95d5d67 req-45697b1d-f798-4de0-9e00-841439d2b701 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.654992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0954c3a8-4b88-41b8-829c-846de95d5d67 req-45697b1d-f798-4de0-9e00-841439d2b701 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.656052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:04:51.663794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:04:51.671367 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0954c3a8-4b88-41b8-829c-846de95d5d67 req-45697b1d-f798-4de0-9e00-841439d2b701 service nova] Creating event network-vif-deleted:fc6a2457-4aa3-4215-ab51-699951039864 for instance 79cd3988-e24b-40e3-b8f3-f78e280b031a on n-h2-791135-8 Oct 04 11:04:51.690989 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0954c3a8-4b88-41b8-829c-846de95d5d67 req-45697b1d-f798-4de0-9e00-841439d2b701 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054090 Oct 04 11:04:51.691982 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 680/1384] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:51.698662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6dae43a-6e04-4779-b4e4-2d855ee33621 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4600790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:51.769245 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6dae43a-6e04-4779-b4e4-2d855ee33621 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 200 len: 1461 microversion: 2.1 time: 0.075742 Oct 04 11:04:51.771155 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 681/1385] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:51 2022] GET /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 1461 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:51.779831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:51.779831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:51.785818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.786457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.786908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.799658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.800258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.800708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.814448 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e92a437-1dca-4da2-a740-6d7f6cc383e2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138847 Oct 04 11:04:51.818034 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 705/1386] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:04:51.831327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:51.831810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:51.850318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.851066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.851710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.852605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:51.854056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:51.856189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:51.907030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:04:51.965249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:51.978269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:51.982456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:51.997831 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-969a1eee-a0fe-4d55-b45d-d61baef2ca1c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.225421 Oct 04 11:04:52.000167 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 682/1387] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:51 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:52.005338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:52.009033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:52.015853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:52.016607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:52.017338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:52.018304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:52.019045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:52.019691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:52.050451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:04:52.152906 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5f6be05-06b1-4808-8ec4-98d04a1ad99f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 204 len: 0 microversion: 2.1 time: 0.332402 Oct 04 11:04:52.166660 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 706/1388] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:04:51 2022] DELETE /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:04:52.188565 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc4a1fb2-3f04-41ef-9f42-e834da74afca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 204 len: 0 microversion: 2.1 time: 0.186713 Oct 04 11:04:52.188928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:52.189155 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 683/1389] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:04:52 2022] DELETE /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:04:52.189668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:52.197509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4117cca6-4bee-4dbe-9869-245a968a36f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:52.198215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4117cca6-4bee-4dbe-9869-245a968a36f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:52.212838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:52.213334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:52.213796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:52.214511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:52.226514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:52.227313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:52.337943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4117cca6-4bee-4dbe-9869-245a968a36f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:52.348862 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4117cca6-4bee-4dbe-9869-245a968a36f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1214 microversion: 2.1 time: 0.155448 Oct 04 11:04:52.362394 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 684/1390] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:52 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:52.376942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:52.386422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:52.398097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:52.398592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:52.399021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:52.401569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:52.402027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:52.402458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.018036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.038841 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb1861c1-d169-41f9-9598-0c8bf0f2a5f3 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425" status: 200 len: 1467 microversion: 2.1 time: 0.866657 Oct 04 11:04:53.058671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 707/1391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:52 2022] GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 => generated 1467 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:53.073329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:53.073983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:53.087897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.088541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.088992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.089746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.090210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.090737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.177107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.185939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.187375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.188543 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efaa5e44-2629-47a4-8350-543508076ccd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.824904 Oct 04 11:04:53.189113 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 685/1392] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:52 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:53.199770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:53.200578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:53.207416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.208096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.208861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.210414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.211044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.211471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.401658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.411160 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b9ccc4e-88b0-41e7-b0dc-cd8a44bcd11f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1514 microversion: 2.1 time: 0.351111 Oct 04 11:04:53.430105 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 708/1393] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:53 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:53.440544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:53.445813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:53.459185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.460053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.460668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.462155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.466373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.467200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.474682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.480177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:53.489639 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60c710f0-e3a7-4a40-8d46-da7f813d9ce4 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1534 microversion: 2.1 time: 0.294105 Oct 04 11:04:53.491162 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 686/1394] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:53 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1534 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:53.498930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:53.500254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:53.513915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.514664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.515539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.516682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.517304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.518141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.641397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.653059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.655933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.673790 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05db1551-4f29-4d5c-bdd6-702072d9a070 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.177503 Oct 04 11:04:53.693918 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 687/1395] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:53 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:53.711007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1262c38-1390-4c24-b483-1fb4668ee6b4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4618e50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:53.717712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.741980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.743514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.745056 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf3db422-ddb4-4716-908d-2278578eca8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1752 microversion: 2.42 time: 0.312715 Oct 04 11:04:53.745793 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 709/1396] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:53 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1752 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:53.754417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:53.755492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:53.764429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.765488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.766101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.768026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:53.768678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:53.769117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:53.883031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:53.894000 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1262c38-1390-4c24-b483-1fb4668ee6b4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-10-04T11%3A02%3A45Z" status: 200 len: 2372 microversion: 2.1 time: 0.198452 Oct 04 11:04:53.897425 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 688/1397] 10.222.0.23 () {58 vars in 1199 bytes} [Tue Oct 4 11:04:53 2022] GET /compute/v2.1/images?changes-since=2022-10-04T11%3A02%3A45Z => generated 2372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:53.898309 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-560e2acf-9683-44c3-b513-85ca6a40f5b1 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1218 microversion: 2.1 time: 0.147887 Oct 04 11:04:53.899484 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 710/1398] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:53 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:53.910318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3746e505-67fc-4b34-a747-93ba97f8f9f0 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4600790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.007563 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3746e505-67fc-4b34-a747-93ba97f8f9f0 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1466012383" status: 200 len: 485 microversion: 2.1 time: 0.101462 Oct 04 11:04:54.008156 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 689/1399] 10.222.0.23 () {58 vars in 1231 bytes} [Tue Oct 4 11:04:53 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1466012383 => generated 485 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:54.020873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4ae88dd-52af-4536-b087-0886462b58fd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d450d820>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.151449 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4ae88dd-52af-4536-b087-0886462b58fd tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images?server=59b04194-7767-4636-9ed0-3869ff18e425" status: 200 len: 956 microversion: 2.1 time: 0.134242 Oct 04 11:04:54.154960 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 711/1400] 10.222.0.23 () {58 vars in 1209 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/images?server=59b04194-7767-4636-9ed0-3869ff18e425 => generated 956 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:54.166790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7dbe360-33e0-4ecd-b102-ea11f7e6d7be tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4562b80>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.217538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.218361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:54.239825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:54.241125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:54.241840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:54.243476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:54.244127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:54.244742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:54.258079 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7dbe360-33e0-4ecd-b102-ea11f7e6d7be tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fc9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 483 microversion: 2.1 time: 0.094283 Oct 04 11:04:54.267036 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 690/1401] 10.222.0.23 () {58 vars in 1317 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fc9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 483 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:04:54.279209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5dfdbe9-c9bd-447a-91a0-17fcb9e235a4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4600a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.355546 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5dfdbe9-c9bd-447a-91a0-17fcb9e235a4 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fc9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 483 microversion: 2.1 time: 0.087237 Oct 04 11:04:54.367020 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 691/1402] 10.222.0.23 () {58 vars in 1303 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fc9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 483 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:54.375725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df174808-eec8-4b4a-81f4-59f19e831fb2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4600430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.483699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:54.494265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:54.495956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:54.497377 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd4f0fca-ab67-46e8-8cc7-0c2347b291dd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.283700 Oct 04 11:04:54.498502 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 712/1403] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:54.504270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.505158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:54.513172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:54.513940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:54.514564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:54.515465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:54.516078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:54.517497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:54.566338 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df174808-eec8-4b4a-81f4-59f19e831fb2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.197448 Oct 04 11:04:54.577261 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 692/1404] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:54.582780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.583856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:54.590425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:54.590919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:54.591351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:54.592065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:54.592518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:54.592940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:54.842993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:54.864770 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-274fad26-a628-4c30-8099-fac863e9a147 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1514 microversion: 2.1 time: 0.364854 Oct 04 11:04:54.866679 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 713/1405] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1514 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:54.885042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6033704c-b9c6-4afd-86fd-63361ab25922 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d42840d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.900228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:54.909073 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5036b4f9-709a-4a1c-a451-2f84cd652060 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1534 microversion: 2.1 time: 0.330543 Oct 04 11:04:54.925955 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 693/1406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1534 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:54.937537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:54.938428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:54.944719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:54.945491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:54.946099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:54.946976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:54.947596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:54.948225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.041719 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6033704c-b9c6-4afd-86fd-63361ab25922 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1427 microversion: 2.1 time: 0.173620 Oct 04 11:04:55.042935 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 714/1407] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/images?type=snapshot => generated 1427 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:55.063982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.083057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.086030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:55.087835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.090636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.104314 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-456cc6e2-f07b-43ad-929e-97562b6f2474 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.176921 Oct 04 11:04:55.115655 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 694/1408] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:54 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:55.116111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.116111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.116111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.116111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.116111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.116111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.118404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.118913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:55.137204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.137933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.138983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.139387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.140068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.142472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.420380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.431494 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7d7de22-9be7-4e03-b930-33014e135a1d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1266 microversion: 2.1 time: 0.325471 Oct 04 11:04:55.433391 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 695/1409] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:55.441620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b2d7d18-237f-4792-beaf-5b705122b263 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d45093a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.542762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.554610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.556554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.557980 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76acb938-d768-431d-886f-be19f4ff8b95 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1844 microversion: 2.42 time: 0.513937 Oct 04 11:04:55.562610 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 715/1410] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1844 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:55.587342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e8fd0669-171b-451a-9f76-f659b7d98aa0 req-9a4a97b7-77ad-4768-b8fe-c2091542f1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b04194-7767-4636-9ed0-3869ff18e425", "name": "network-vif-unplugged", "status": "completed", "tag": "c9b6f444-374d-48a3-a78e-32dff234e6dd"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:55.607149 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b2d7d18-237f-4792-beaf-5b705122b263 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.172478 Oct 04 11:04:55.608208 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 696/1411] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:55.613689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.614678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:55.620810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8fd0669-171b-451a-9f76-f659b7d98aa0 req-9a4a97b7-77ad-4768-b8fe-c2091542f1bb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.621305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8fd0669-171b-451a-9f76-f659b7d98aa0 req-9a4a97b7-77ad-4768-b8fe-c2091542f1bb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.621760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8fd0669-171b-451a-9f76-f659b7d98aa0 req-9a4a97b7-77ad-4768-b8fe-c2091542f1bb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.623454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.624190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.625022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.625996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.626677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.627340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.637105 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e8fd0669-171b-451a-9f76-f659b7d98aa0 req-9a4a97b7-77ad-4768-b8fe-c2091542f1bb service nova] Creating event network-vif-unplugged:c9b6f444-374d-48a3-a78e-32dff234e6dd for instance 59b04194-7767-4636-9ed0-3869ff18e425 on n-h1-791135-8 Oct 04 11:04:55.642510 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e8fd0669-171b-451a-9f76-f659b7d98aa0 req-9a4a97b7-77ad-4768-b8fe-c2091542f1bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078313 Oct 04 11:04:55.643430 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 716/1412] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:55.649958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18fb7fbe-1d77-47f0-a31d-b9374ce7e121 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d450d0d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.761049 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18fb7fbe-1d77-47f0-a31d-b9374ce7e121 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T11%3A02%3A42Z" status: 200 len: 6325 microversion: 2.1 time: 0.116098 Oct 04 11:04:55.762397 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 717/1413] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T11%3A02%3A42Z => generated 6325 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:55.781692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f4d3069-4276-4251-bf59-25f26eeb05ed tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4284310>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.788135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.797972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.800034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:55.801435 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3cd45c9-2344-4db2-bc37-d7aa329ccd98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.191941 Oct 04 11:04:55.802170 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 697/1414] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:55.838796 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f4d3069-4276-4251-bf59-25f26eeb05ed tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1466012383" status: 200 len: 665 microversion: 2.1 time: 0.061481 Oct 04 11:04:55.839938 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 718/1415] 10.222.0.23 () {58 vars in 1252 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1466012383 => generated 665 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:55.856776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba803831-6d47-4e11-bcc3-291f70afc28b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4600550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.892336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.893492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:55.907787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.910033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.910475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.916050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:55.917425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:55.917883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:55.953282 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba803831-6d47-4e11-bcc3-291f70afc28b tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fc9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1463 microversion: 2.1 time: 0.100793 Oct 04 11:04:55.964072 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 698/1416] 10.222.0.23 () {58 vars in 1338 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Fc9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1463 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:55.970561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:55.971423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:56.001625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.002948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.006233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.008337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.010187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.010637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.246764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:56.257234 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-adf2883e-3560-46f8-bde9-b722d2778062 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1514 microversion: 2.1 time: 0.371451 Oct 04 11:04:56.276895 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 719/1417] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:04:56.283580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc348f69-5a72-4490-907c-2ac8aa8b2d7f tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d435faf0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:56.320325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:56.338330 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c82e7e3c-24e7-4aba-b42a-76298cb3c109 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1534 microversion: 2.1 time: 0.372612 Oct 04 11:04:56.345753 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 699/1418] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:55 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1534 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:56.358005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:56.358914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:56.366938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.367649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.368269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.369158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.369796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.370385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.381805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc348f69-5a72-4490-907c-2ac8aa8b2d7f tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fc9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1463 microversion: 2.1 time: 0.103068 Oct 04 11:04:56.397544 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 720/1419] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Oct 4 11:04:56 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Fc9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1463 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:56.407616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-684ae9b5-58be-4646-93c5-562108da6b88 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44e3d30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:56.445504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:56.466258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:56.467717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:56.473079 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ed7b32a-1e8b-497e-809d-f52a8841f962 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.125999 Oct 04 11:04:56.486769 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 700/1420] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:56 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:56.493676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:56.494458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:56.503914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.504596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.505250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.506893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.507557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.508186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.645144 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-684ae9b5-58be-4646-93c5-562108da6b88 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.245456 Oct 04 11:04:56.651621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 721/1421] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Oct 4 11:04:56 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:56.665997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:56.666641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:56.672135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:56.688498 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f13519c-4186-4555-89cd-c7be7a096aac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1266 microversion: 2.1 time: 0.200114 Oct 04 11:04:56.692040 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 701/1422] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:56 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:56.696907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1027bc6-7e8e-439a-9a74-f67279903db2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44c94c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:56.721860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.722604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.724395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.726013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.727749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.729033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.839527 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b1027bc6-7e8e-439a-9a74-f67279903db2 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4367 microversion: 2.1 time: 0.146177 Oct 04 11:04:56.844320 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 702/1423] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Oct 4 11:04:56 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:56.858578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:56.860400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:56.893308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.894243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.895428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:56.896780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:56.897896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:56.899304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:57.297110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:57.315572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:57.318156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:57.326001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46b32761-46dd-4faa-8371-e19ef50fb647 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1844 microversion: 2.42 time: 0.673233 Oct 04 11:04:57.326595 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 722/1424] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:56 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1844 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:57.367905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29011d4d-fd12-458f-ba93-9dffa4500f0c tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d435fd30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:57.411419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:57.432412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:57.437770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:57.485505 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b8c30f38-2928-4c99-82d0-4a9da9a83599 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.639599 Oct 04 11:04:57.488974 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29011d4d-fd12-458f-ba93-9dffa4500f0c tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/c5abc5b2-fab0-47a3-992d-153996b39244" status: 200 len: 784 microversion: 2.1 time: 0.135555 Oct 04 11:04:57.517048 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 703/1425] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:56 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:57.520877 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 723/1426] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:04:57 2022] GET /compute/v2.1/images/c5abc5b2-fab0-47a3-992d-153996b39244 => generated 784 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:57.530460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:57.531782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:57.540719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:57.541512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:57.542147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:57.543339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:57.544046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:57.545007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:57.552402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:57.558087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:57.586793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:57.587345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:57.587834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:57.588561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:57.589023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:57.589485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:57.705174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:57.723900 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef1eb8b7-a66b-4285-974e-6fab2807f054 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 200 len: 1302 microversion: 2.1 time: 0.204278 Oct 04 11:04:57.725813 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 704/1427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:57 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 1302 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:57.744463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b53a166d-694e-4ab4-bc2e-6a5cdf49a4f9 req-d4f9f8b5-33f5-48f0-9c61-82a8617a858c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6383b671-7d1d-408f-80d9-3c9ade2a609d", "name": "network-vif-deleted", "tag": "4faf4872-4fad-42e9-b6fa-a0110144308a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:57.772224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b53a166d-694e-4ab4-bc2e-6a5cdf49a4f9 req-d4f9f8b5-33f5-48f0-9c61-82a8617a858c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:57.773460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b53a166d-694e-4ab4-bc2e-6a5cdf49a4f9 req-d4f9f8b5-33f5-48f0-9c61-82a8617a858c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:57.776127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b53a166d-694e-4ab4-bc2e-6a5cdf49a4f9 req-d4f9f8b5-33f5-48f0-9c61-82a8617a858c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:57.807584 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b53a166d-694e-4ab4-bc2e-6a5cdf49a4f9 req-d4f9f8b5-33f5-48f0-9c61-82a8617a858c service nova] Creating event network-vif-deleted:4faf4872-4fad-42e9-b6fa-a0110144308a for instance 6383b671-7d1d-408f-80d9-3c9ade2a609d on n-h1-791135-8 Oct 04 11:04:57.823120 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b53a166d-694e-4ab4-bc2e-6a5cdf49a4f9 req-d4f9f8b5-33f5-48f0-9c61-82a8617a858c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095229 Oct 04 11:04:57.825493 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 705/1428] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:57.843969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:57.844909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:57.865978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:57.866633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:57.867476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:57.871365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:57.872745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:57.873544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:58.010000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:58.020279 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3fee4d79-365c-4b7b-bee6-808d858f5234 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1492 microversion: 2.1 time: 0.484045 Oct 04 11:04:58.033404 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 724/1429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:57 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1492 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:58.033404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ace7a9db-3e30-4cad-9db2-88fd9da16dad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d437b160>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:58.051265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:58.078877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:58.081612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:58.100488 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ee189a8-0049-4695-8c41-64703d9c550b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.272704 Oct 04 11:04:58.105502 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 706/1430] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:57 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:58.172026 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ace7a9db-3e30-4cad-9db2-88fd9da16dad tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.143632 Oct 04 11:04:58.179915 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 725/1431] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 11:04:58 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:58.200210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:58.200862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:58.216854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:58.218301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:58.219561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:58.221115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:58.222384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:58.223625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:58.230417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e4b6717a-28d3-4ab3-80b6-e9bc7ea950c9 req-bfe3cc26-8507-488a-875f-b6fd84c8b456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5813e7a4-1b03-438c-bf70-c2b544030ce4", "name": "network-vif-unplugged", "status": "completed", "tag": "b429cae8-ebcb-4a50-988d-0ebd70deba67"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:04:58.264861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e4b6717a-28d3-4ab3-80b6-e9bc7ea950c9 req-bfe3cc26-8507-488a-875f-b6fd84c8b456 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:58.266046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e4b6717a-28d3-4ab3-80b6-e9bc7ea950c9 req-bfe3cc26-8507-488a-875f-b6fd84c8b456 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:58.269740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e4b6717a-28d3-4ab3-80b6-e9bc7ea950c9 req-bfe3cc26-8507-488a-875f-b6fd84c8b456 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:58.306272 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e4b6717a-28d3-4ab3-80b6-e9bc7ea950c9 req-bfe3cc26-8507-488a-875f-b6fd84c8b456 service nova] Creating event network-vif-unplugged:b429cae8-ebcb-4a50-988d-0ebd70deba67 for instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 on n-h2-791135-8 Oct 04 11:04:58.322181 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e4b6717a-28d3-4ab3-80b6-e9bc7ea950c9 req-bfe3cc26-8507-488a-875f-b6fd84c8b456 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.214996 Oct 04 11:04:58.323976 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 707/1432] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:04:58.329336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eeabea3d-b3ed-417d-896a-d4bc63019e83 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4618d30>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:58.373872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:58.389011 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eee527f9-0c04-4cca-941e-9f2c866cead4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1272 microversion: 2.1 time: 0.206960 Oct 04 11:04:58.391784 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 726/1433] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:58 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:58.402700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:58.403521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:58.409872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:58.410578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:58.411196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:58.412315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:58.413098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:58.414034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:58.762880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:58.781054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:58.784523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:58.786502 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f194dc76-b7b7-487c-b805-745880d2de55 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1844 microversion: 2.42 time: 0.391863 Oct 04 11:04:58.796320 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 727/1434] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:58 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1844 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:58.817916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:58.817916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:58.848789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:58.849304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:58.850331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:58.851063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:58.856973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:58.857564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:58.869477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:04:59.292441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:59.305173 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eeabea3d-b3ed-417d-896a-d4bc63019e83 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "DELETE /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf" status: 204 len: 0 microversion: 2.1 time: 0.979744 Oct 04 11:04:59.306706 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 708/1435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:58 2022] DELETE /compute/v2.1/images/b0c65033-dfa5-4b20-b373-3e73ce8457bf => generated 0 bytes in 982 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:04:59.313327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:59.314233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 6383b671-7d1d-408f-80d9-3c9ade2a609d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:59.321335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:59.322812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:59.324015 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1cf8a19c-64ba-4113-a599-a03f0a9d9b58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.526721 Oct 04 11:04:59.330427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.330912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.335041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 728/1436] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:58 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:59.335617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:59.336631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.341622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:59.344069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.344936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:59.354879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:59.377425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.379878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.382031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:59.383203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.383916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.384893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:59.385769 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] HTTP exception thrown: Instance 6383b671-7d1d-408f-80d9-3c9ade2a609d could not be found. Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Request method failure captured: Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d HTTP/1.1 Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJ3JoAXifOOSGeJHAEIwdFqSsAUQsTyH_gFYOtFMBnEozsEaYwFcL0b9DfrtIjO30wjutnoY8cqb2Lxxj2PCXoEaHu8KaTj5pUlxTEv_UW868waiVQEiZ93cQzrC7YqY_ZSDawvwY7eMYh5jViQ2sSs2UbVRr2-G9VS0omwtTOQBRw Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 86a0fc1de1644db0a9a7e77241e2c04f Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesAdminNegativeTest-1344492479 Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86a0fc1de1644db0a9a7e77241e2c04f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86a0fc1de1644db0a9a7e77241e2c04f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86a0fc1de1644db0a9a7e77241e2c04f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86a0fc1de1644db0a9a7e77241e2c04f"}]}] Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesAdminNegativeTest-1344492479 Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 86a0fc1de1644db0a9a7e77241e2c04f Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1344492479 Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-VolumesAdminNegativeTest-1344492479-project Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 67875c6ae98c4184b8519b21977e23da Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesAdminNegativeTest-1344492479-project Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 6383b671-7d1d-408f-80d9-3c9ade2a609d could not be found. Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '6383b671-7d1d-408f-80d9-3c9ade2a609d'} Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6383b671-7d1d-408f-80d9-3c9ade2a609d could not be found. Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6383b671-7d1d-408f-80d9-3c9ade2a609d could not be found. Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:04:59.389829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6383b671-7d1d-408f-80d9-3c9ade2a609d could not be found. Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Returning 404 to user: Instance 6383b671-7d1d-408f-80d9-3c9ade2a609d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ccdf1bd1-9087-417a-a150-2ef0e412982f tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d" status: 404 len: 111 microversion: 2.1 time: 0.083346 Oct 04 11:04:59.397827 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 709/1437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:59 2022] GET /compute/v2.1/servers/6383b671-7d1d-408f-80d9-3c9ade2a609d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:04:59.407527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:59.408150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:59.423110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.423904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.424541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:59.425488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.426252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.428577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:59.455707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.456627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.457295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:59.458017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lazy-loading 'fault' on Instance uuid 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:04:59.629793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:59.630442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:59.683577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:59.685061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:04:59.686201 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-27d3f6aa-c11b-4a20-8fac-c9981062e4d9 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 200 len: 1368 microversion: 2.1 time: 0.348284 Oct 04 11:04:59.690475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 729/1438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:59 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:04:59.715585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61e0c661-5c64-46d5-9881-374e131a5954 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d435fd30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:59.725160 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-92c0fbfd-accd-496f-a619-97c52d973ed7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.319772 Oct 04 11:04:59.725936 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 710/1439] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:04:59 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:04:59.747481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:04:59.748308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:04:59.766944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.768167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.769531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:04:59.771402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:04:59.773437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:04:59.774067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:00.153473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:00.167948 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53a0350e-276c-4694-93b2-e050dcb875b7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1314 microversion: 2.1 time: 0.440918 Oct 04 11:05:00.168550 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 711/1440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:59 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:00.182276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:00.182903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:00.184904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:00.195546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:00.196051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:00.196491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:00.197207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:00.197693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:00.198116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:00.547447 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61e0c661-5c64-46d5-9881-374e131a5954 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "DELETE /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977" status: 204 len: 0 microversion: 2.1 time: 0.854315 Oct 04 11:05:00.549798 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 730/1441] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:04:59 2022] DELETE /compute/v2.1/images/012e5adf-41a1-443e-baeb-85f5c9459977 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:00.561492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7f6883c5-6ca1-421d-9d4d-f0fe723379e9 req-0a7df253-e7f0-4ed5-bfd0-038fc09be959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f9a42b-34ef-40c9-b53f-5f0b6c27d74d", "name": "network-vif-deleted", "tag": "e4684748-4942-4af4-a1f5-40bd0456b612"}, {"name": "network-changed", "server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "tag": "3b9ced07-b4bf-4318-8dc4-527be99dccbd"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:00.592267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:00.595903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7f6883c5-6ca1-421d-9d4d-f0fe723379e9 req-0a7df253-e7f0-4ed5-bfd0-038fc09be959 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:00.598406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7f6883c5-6ca1-421d-9d4d-f0fe723379e9 req-0a7df253-e7f0-4ed5-bfd0-038fc09be959 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:00.599129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7f6883c5-6ca1-421d-9d4d-f0fe723379e9 req-0a7df253-e7f0-4ed5-bfd0-038fc09be959 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:00.611031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:00.612488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:00.613706 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5400c9da-bd21-4afa-a55d-a38ab65a8da1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1865 microversion: 2.42 time: 0.444197 Oct 04 11:05:00.629862 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 712/1442] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:00 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1865 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:00.635773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7f6883c5-6ca1-421d-9d4d-f0fe723379e9 req-0a7df253-e7f0-4ed5-bfd0-038fc09be959 service nova] Creating event network-vif-deleted:e4684748-4942-4af4-a1f5-40bd0456b612 for instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d on n-h1-791135-8 Oct 04 11:05:00.637417 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7f6883c5-6ca1-421d-9d4d-f0fe723379e9 req-0a7df253-e7f0-4ed5-bfd0-038fc09be959 service nova] Creating event network-changed:3b9ced07-b4bf-4318-8dc4-527be99dccbd for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:05:00.638407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b977111b-d80f-4b36-a1a6-89803c481dc2 req-2d05f8bf-e82a-457c-bcb3-a902b485b6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5813e7a4-1b03-438c-bf70-c2b544030ce4", "tag": "b429cae8-ebcb-4a50-988d-0ebd70deba67"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:00.653749 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7f6883c5-6ca1-421d-9d4d-f0fe723379e9 req-0a7df253-e7f0-4ed5-bfd0-038fc09be959 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.101887 Oct 04 11:05:00.655113 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 731/1443] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:00.661162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:00.661819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:00.668972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:00.669704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:00.670145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:00.670857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:00.671322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:00.671748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:00.683517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b977111b-d80f-4b36-a1a6-89803c481dc2 req-2d05f8bf-e82a-457c-bcb3-a902b485b6aa service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:00.685626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b977111b-d80f-4b36-a1a6-89803c481dc2 req-2d05f8bf-e82a-457c-bcb3-a902b485b6aa service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:00.686163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b977111b-d80f-4b36-a1a6-89803c481dc2 req-2d05f8bf-e82a-457c-bcb3-a902b485b6aa service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:00.712280 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b977111b-d80f-4b36-a1a6-89803c481dc2 req-2d05f8bf-e82a-457c-bcb3-a902b485b6aa service nova] Creating event network-changed:b429cae8-ebcb-4a50-988d-0ebd70deba67 for instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 on n-h2-791135-8 Oct 04 11:05:00.724027 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b977111b-d80f-4b36-a1a6-89803c481dc2 req-2d05f8bf-e82a-457c-bcb3-a902b485b6aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092752 Oct 04 11:05:00.726047 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 713/1444] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:00.733394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f0ad8e4-6aa3-4060-a6dd-f2dc4adf1ba7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d44f63a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:00.934941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:00.951373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:00.953722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:00.955156 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c913b867-ea16-4144-a1a6-17a5003b1c45 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.298747 Oct 04 11:05:00.956658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 732/1445] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:00 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:00.987133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:00.989796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:01.018440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.018885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.019334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.023013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.023499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.023946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.062302 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] HTTP exception thrown: Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d could not be found. Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Request method failure captured: Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d HTTP/1.1 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBIeVq9R6G4-SI2rCSoyQb-x-B4-ydSbu8hhpwOjkyydw-suqAxEOB-dP9gEGvCAlEnD3hD58XmzvKxH5INJc5AYFjtZ64heLytpaPiu1deykkJHwvyQuwzGayRLo3gMqWNScPqdpFDNACTRXNfHxCi_EQSP0fIjxJub8ns7R1Tcxzg Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 64b6b184def140dba0ea1ac0a56a98e1 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64b6b184def140dba0ea1ac0a56a98e1"}]}] Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 64b6b184def140dba0ea1ac0a56a98e1 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MigrationsAdminTest-435332656-project Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: b024d221d4784e2399fd7676706cbc04 Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MigrationsAdminTest-435332656-project Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d could not be found. Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '63f9a42b-34ef-40c9-b53f-5f0b6c27d74d'} Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d could not be found. Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d could not be found. Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:01.066349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d could not be found. Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Returning 404 to user: Instance 63f9a42b-34ef-40c9-b53f-5f0b6c27d74d could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f37e039a-9df6-4826-aea1-8a3dc8f0d203 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d" status: 404 len: 111 microversion: 2.1 time: 0.097675 Oct 04 11:05:01.072585 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 733/1446] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:00 2022] GET /compute/v2.1/servers/63f9a42b-34ef-40c9-b53f-5f0b6c27d74d => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:05:01.092973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:01.095245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:01.106041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.106713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.108875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.108875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.108875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.109398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.263165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:01.278177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:01.297244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:01.330536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:01.342694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa408964-6eff-49c3-9260-7c75d2f0189f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.266945 Oct 04 11:05:01.371865 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 734/1447] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:01 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:01.388194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53d7519a-a78b-4f72-9a50-3e0052493b28 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '.version_select at 0x7f71d450d280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:01.451770 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53d7519a-a78b-4f72-9a50-3e0052493b28 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-536118098" status: 202 len: 0 microversion: 2.1 time: 0.077497 Oct 04 11:05:01.457961 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 735/1448] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:05:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-536118098 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:01.479355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:01.481302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:01.499393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.499896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.501535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.503500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.503884 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f0ad8e4-6aa3-4060-a6dd-f2dc4adf1ba7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "DELETE /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda" status: 204 len: 0 microversion: 2.1 time: 0.775789 Oct 04 11:05:01.504034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.504433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.504771 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 714/1449] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:00 2022] DELETE /compute/v2.1/images/ac226838-3070-4b95-a19a-921b02ac3fda => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:01.513182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:01.514901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:01.535631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.541937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.543488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.556909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:01.565249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.569497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.570503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.644329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=28 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:01.646591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:05:01.682570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:01.901124 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7dcf15aa-536c-4460-b338-1a8dc017da01 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 204 len: 0 microversion: 2.1 time: 0.391214 Oct 04 11:05:01.907136 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 715/1450] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:05:01 2022] DELETE /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:01.926529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:01.929895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:01.945868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.948219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.949864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.954034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:01.955120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:01.955680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:01.985141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:02.009561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45723f76-fe07-4054-862b-b1cc9acc7b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1314 microversion: 2.1 time: 0.547617 Oct 04 11:05:02.013696 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 736/1451] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:01 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:02.032375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:02.038264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:02.070123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:02.071331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:02.071799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:02.072554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:02.074611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:02.075083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:02.342138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:02.687523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:02.696759 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5664eaae-8c27-4d44-b0e5-1f640d80fe87 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1474 microversion: 2.1 time: 0.681656 Oct 04 11:05:02.697323 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 737/1452] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:02 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1474 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:02.710595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:02.713738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:02.726781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:02.727278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:02.731684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:02.736295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:02.743585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:02.750036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:02.751460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:02.752115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:02.758363 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:02.759802 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0faed53d-b5ab-44ca-b882-c1d7d68c5f49 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1865 microversion: 2.42 time: 0.848225 Oct 04 11:05:02.760623 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 716/1453] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:01 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1865 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:02.801792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:02.802425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:02.823316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:02.823827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:02.824269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:02.824989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:02.825483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:02.825922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:03.084803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:03.093309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:03.094835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:03.100184 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9c45833-f980-46db-906b-b8327b1f5689 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.320083 Oct 04 11:05:03.124300 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 717/1454] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:02 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:03.129455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bd257b68-a693-413c-83de-02f3daad45d1 req-fccf6d33-ac64-46e7-85a0-eb3d9ee1baa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "tag": "c3fdccff-9fdc-4892-b028-ab3882d9278a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:03.159015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd257b68-a693-413c-83de-02f3daad45d1 req-fccf6d33-ac64-46e7-85a0-eb3d9ee1baa8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:03.159504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd257b68-a693-413c-83de-02f3daad45d1 req-fccf6d33-ac64-46e7-85a0-eb3d9ee1baa8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:03.159940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd257b68-a693-413c-83de-02f3daad45d1 req-fccf6d33-ac64-46e7-85a0-eb3d9ee1baa8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:03.191164 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bd257b68-a693-413c-83de-02f3daad45d1 req-fccf6d33-ac64-46e7-85a0-eb3d9ee1baa8 service nova] Creating event network-changed:c3fdccff-9fdc-4892-b028-ab3882d9278a for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:05:03.196655 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bd257b68-a693-413c-83de-02f3daad45d1 req-fccf6d33-ac64-46e7-85a0-eb3d9ee1baa8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070990 Oct 04 11:05:03.197250 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 718/1455] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:03.202498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:03.203206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:03.222563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:03.223069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:03.223501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:03.224218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:03.224860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:03.225293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:03.346016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:03.363044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:03.364867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:03.369815 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b52dea79-f289-40ed-919e-6e9fac18476b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.668730 Oct 04 11:05:03.370677 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 738/1456] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:02 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:03.638626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:03.647035 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9654c03f-4641-4651-8d83-e6ad0871caeb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1314 microversion: 2.1 time: 0.448471 Oct 04 11:05:03.647619 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 719/1457] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:03 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:03.721806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:03.722498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:03.731230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:03.731733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:03.732179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:03.732899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:03.733391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:03.733849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:03.792288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:03.792897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:03.809299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:03.809831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:03.810271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:03.810983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:03.811435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:03.815523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:04.926660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:04.936734 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-004670d4-356b-4b04-b439-67a2e1475313 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1474 microversion: 2.1 time: 1.219081 Oct 04 11:05:04.938146 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 739/1458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:03 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1474 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:04.944777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:04.945986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:04.955723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:04.957016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:04.957759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:04.960017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:04.962363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:04.963102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:05.125810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.128076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.157982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.166361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.167425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.172318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.175159 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06216b29-4839-459d-8820-cfe1a7b427d0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1886 microversion: 2.42 time: 1.386739 Oct 04 11:05:05.176929 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 720/1459] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:03 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1886 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:05:05.183049 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f6a5bc2-8647-49dc-a0a8-068308ed614a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.242525 Oct 04 11:05:05.225503 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 740/1460] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:04 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:05.229913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:05.233882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:05.234501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:05.238039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:05.244871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:05.245331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:05.245809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:05.246506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:05.246943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:05.247369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:05.260832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:05.261333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:05.261799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:05.262521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:05.262978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:05.263418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:05.889428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.906599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.908565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:05.910753 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90f78cdb-189a-4302-a4a9-cbe09a49a641 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.732306 Oct 04 11:05:05.916067 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 721/1461] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:05 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:05.924995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:05.925716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:05.936479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:05.941257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:05.941989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:05.942934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:05.947674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:05.948303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.012847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.013552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:05:06.025208 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e09ed577-2673-4649-8554-045e926dca80 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1314 microversion: 2.1 time: 0.797265 Oct 04 11:05:06.027914 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 741/1462] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:05 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:06.055372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:06.057688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:06.074853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.075638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.076260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.077177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.080581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.081262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.155063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:05:06.165307 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-565900c3-644c-4b1c-87fc-65ccd4998d67 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 204 len: 0 microversion: 2.1 time: 0.247338 Oct 04 11:05:06.166563 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 722/1463] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:05:05 2022] DELETE /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:06.180372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b07a2f52-1a66-429d-adb1-50401b109892 req-2ae90dbb-bacc-41e9-9a07-1b5711a5bda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e948af-4417-4d7e-b6f3-bd626a4b78af", "tag": "e3300dae-21c8-4d18-ac53-b687cdfa275e"}, {"name": "network-changed", "server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "tag": "e9423bf4-7a84-4511-a3b6-3c607d86bde1"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:06.207293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b07a2f52-1a66-429d-adb1-50401b109892 req-2ae90dbb-bacc-41e9-9a07-1b5711a5bda7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.208062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b07a2f52-1a66-429d-adb1-50401b109892 req-2ae90dbb-bacc-41e9-9a07-1b5711a5bda7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.208717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b07a2f52-1a66-429d-adb1-50401b109892 req-2ae90dbb-bacc-41e9-9a07-1b5711a5bda7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.239418 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b07a2f52-1a66-429d-adb1-50401b109892 req-2ae90dbb-bacc-41e9-9a07-1b5711a5bda7 service nova] Creating event network-changed:e3300dae-21c8-4d18-ac53-b687cdfa275e for instance f4e948af-4417-4d7e-b6f3-bd626a4b78af on n-h1-791135-8 Oct 04 11:05:06.240472 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b07a2f52-1a66-429d-adb1-50401b109892 req-2ae90dbb-bacc-41e9-9a07-1b5711a5bda7 service nova] Creating event network-changed:e9423bf4-7a84-4511-a3b6-3c607d86bde1 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:05:06.269840 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b07a2f52-1a66-429d-adb1-50401b109892 req-2ae90dbb-bacc-41e9-9a07-1b5711a5bda7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.095604 Oct 04 11:05:06.276894 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 723/1464] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:06.282111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:06.291371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:06.313154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.314656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.315257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.316148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.316763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.322728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.379706 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ccbf7bc-2c95-4d15-93aa-0fc48046cd17 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "DELETE /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 204 len: 0 microversion: 2.1 time: 0.339919 Oct 04 11:05:06.383393 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 742/1465] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:05:06 2022] DELETE /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:06.402606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:06.403530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:06.411529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.412677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.413471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.414242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.414755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.415188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.420933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.421450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.422077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.422542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lazy-loading 'fault' on Instance uuid c9e63ee3-3a6c-446a-b69b-eb8e79ad477a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:05:06.533752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.545468 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-752a0ac4-3259-4d00-9434-76cc4ecf0e45 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1308 microversion: 2.1 time: 0.267241 Oct 04 11:05:06.549498 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 724/1466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:06 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:06.558246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:06.565899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:06.576853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.578708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.579347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.580267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.581279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.581919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.695332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.703347 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a2418ad-741e-4efa-86fd-e5443fbed1d0 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1467 microversion: 2.1 time: 0.318702 Oct 04 11:05:06.704209 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 743/1467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:06 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1467 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:06.709511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:06.710111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:06.716327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.716816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.717244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.717956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.718410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.718832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.808114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.818220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.820446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.827918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae5eef3a-be3b-4e27-a9e8-be55cc22a696 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.122711 Oct 04 11:05:06.829331 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 744/1468] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:06 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:06.835159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:06.836279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:06.843460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.844277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.844944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.846140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.850784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.853835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.855201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.860792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.862435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:06.864380 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eea5bbe2-5e94-44e4-997e-a931dd91c802 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1886 microversion: 2.42 time: 0.312630 Oct 04 11:05:06.880060 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 725/1469] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:06 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1886 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:06.941716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:06.942824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:06.951186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.951684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.952123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.952844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:06.953527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:06.954116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:06.999999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:07.009680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-374bd6e7-11ca-445f-98bb-abefa87f9940 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1684 microversion: 2.1 time: 0.178724 Oct 04 11:05:07.022288 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 745/1470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:06 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1684 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:07.056826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:07.057485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:07.064483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.065086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.066039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.066699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.067236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.074579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.110873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:07.339218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:07.351457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:07.353182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:07.362114 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-deb80d71-a6a1-4499-99da-fb73a40491ef tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.426412 Oct 04 11:05:07.363255 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 726/1471] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:06 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:07.548365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:07.571157 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-55bd59bc-c184-4f9b-a80d-dda9d2ac26bc tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1314 microversion: 2.1 time: 0.518219 Oct 04 11:05:07.572033 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 746/1472] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:07 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:07.574513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:07.575137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:07.589540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.590427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.591172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.592101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.592997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.593962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.630384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.631516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.632210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.632955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lazy-loading 'fault' on Instance uuid c9e63ee3-3a6c-446a-b69b-eb8e79ad477a {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:05:07.707774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:07.715779 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb94d9d0-79b1-4ec4-ac98-25ac74ec0a7a tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 200 len: 1308 microversion: 2.1 time: 0.145083 Oct 04 11:05:07.722753 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 727/1473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:07 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:05:07.734962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:07.735573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:07.742552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.743033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.743465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.744153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.744604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.745021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.856603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:07.857127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:07.891149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.892575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.895021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.897463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:07.899691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:07.901022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:07.969915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:07.978924 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d1aa6b3-00a4-41ef-84a1-e717eeb3357a tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1467 microversion: 2.1 time: 0.247983 Oct 04 11:05:07.982657 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 747/1474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:07 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1467 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:08.007753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:08.014857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:08.029228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.030517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.031597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.032594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.033269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.034158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.103725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.120034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.121709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.128212 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd7b6ef4-246e-4e8c-a3f9-9bdf730d855e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.275759 Oct 04 11:05:08.129062 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 728/1475] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:07 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:05:08.140356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:08.148100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:08.157786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.160688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.165827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.166921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.167470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.168066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.566876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.588293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.590746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.592462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.593824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57ff8483-38b8-4974-b457-e33fdc99631d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1886 microversion: 2.42 time: 0.590554 Oct 04 11:05:08.594725 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 748/1476] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:08 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1886 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:08.600855 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c6ad445-c6a0-48b1-99c6-8048d8745404 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1684 microversion: 2.1 time: 0.470170 Oct 04 11:05:08.601760 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 729/1477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:08 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1684 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:08.601998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-379c6122-1cd2-40d0-a432-01f523f06b14 req-1202e56e-5a44-4f27-abf5-0e654c11446e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e63ee3-3a6c-446a-b69b-eb8e79ad477a", "name": "network-vif-deleted", "tag": "6aeb5add-c4a0-4408-aa02-652effd838a2"}, {"name": "network-changed", "server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "tag": "5414b7fc-31df-462b-b968-1450587a3ef8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:08.607423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:08.608268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:08.620000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-379c6122-1cd2-40d0-a432-01f523f06b14 req-1202e56e-5a44-4f27-abf5-0e654c11446e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.620488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-379c6122-1cd2-40d0-a432-01f523f06b14 req-1202e56e-5a44-4f27-abf5-0e654c11446e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.621018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.621307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-379c6122-1cd2-40d0-a432-01f523f06b14 req-1202e56e-5a44-4f27-abf5-0e654c11446e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.622189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.623417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.624704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.625975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.627418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.634735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:08.639742 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-379c6122-1cd2-40d0-a432-01f523f06b14 req-1202e56e-5a44-4f27-abf5-0e654c11446e service nova] Creating event network-vif-deleted:6aeb5add-c4a0-4408-aa02-652effd838a2 for instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a on n-h1-791135-8 Oct 04 11:05:08.640419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-379c6122-1cd2-40d0-a432-01f523f06b14 req-1202e56e-5a44-4f27-abf5-0e654c11446e service nova] Creating event network-changed:5414b7fc-31df-462b-b968-1450587a3ef8 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:05:08.650731 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-379c6122-1cd2-40d0-a432-01f523f06b14 req-1202e56e-5a44-4f27-abf5-0e654c11446e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054284 Oct 04 11:05:08.656558 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 749/1478] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:08.663448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:08.664683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:08.676380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.677036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.678093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.678886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.679363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.679803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.903636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.914576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.920924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.922533 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da76d53b-ed50-49fc-9305-d7564ecbabe7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.318973 Oct 04 11:05:08.923985 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 730/1479] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:08 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:08.931855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:08.932758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: c9e63ee3-3a6c-446a-b69b-eb8e79ad477a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:08.940480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.942047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.942853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.944320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:08.944958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:08.945719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:08.956516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:08.966533 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] HTTP exception thrown: Instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a could not be found. Oct 04 11:05:08.968053 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa0f3745-eb70-42bd-b26d-586d5c372529 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1314 microversion: 2.1 time: 0.309657 Oct 04 11:05:08.980247 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 750/1480] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:08 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Request method failure captured: Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a HTTP/1.1 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBLRWzgLBHiovUTFAWOZKFq4gyQfccgaDxJp1gQ5mfePe0qtYFtBDjf0k3daDPIthi-o1yRK8jrv4aNO-hXAxF6qv6hMFLRNn1ETndTvQHBDntrsUHpdWBJdQg9OScEUjwGymB4iobM-KE5hVE5ehaztHJPuOl_xI35pOkcomV-BwPI Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 8436fc8200e24cfba225f7509d1e8362 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ListImageFiltersTestJSON-823019566 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8436fc8200e24cfba225f7509d1e8362"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8436fc8200e24cfba225f7509d1e8362"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8436fc8200e24cfba225f7509d1e8362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8436fc8200e24cfba225f7509d1e8362"}]}] Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ListImageFiltersTestJSON-823019566 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 8436fc8200e24cfba225f7509d1e8362 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-823019566 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ListImageFiltersTestJSON-823019566-project Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 29d1012a243d4941897d32e0b2856e63 Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ListImageFiltersTestJSON-823019566-project Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a could not be found. Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'c9e63ee3-3a6c-446a-b69b-eb8e79ad477a'} Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a could not be found. Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a could not be found. Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:08.980635 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a could not be found. Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Returning 404 to user: Instance c9e63ee3-3a6c-446a-b69b-eb8e79ad477a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b5d4189-1105-4cb6-972f-37d167e7851e tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a" status: 404 len: 111 microversion: 2.1 time: 0.046621 Oct 04 11:05:08.991743 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 731/1481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:08 2022] GET /compute/v2.1/servers/c9e63ee3-3a6c-446a-b69b-eb8e79ad477a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:05:09.009916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:09.010979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:09.011141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:09.011884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:09.023796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.026332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.027295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.028133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.028956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.029085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.029701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.030139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.037830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.038386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.038770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.039211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.134385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:05:09.305937 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-08daec44-6c1b-40b8-81ba-01a678e3f506 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425" status: 204 len: 0 microversion: 2.1 time: 0.325622 Oct 04 11:05:09.306869 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 751/1482] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:05:08 2022] DELETE /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:09.313227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:09.313967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:09.329169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.329609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.330045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.330750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.336526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.337056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.379333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:09.389002 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32f56a42-ebce-470c-9b9f-2c9cca9d0eca tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1467 microversion: 2.1 time: 0.382251 Oct 04 11:05:09.395821 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 732/1483] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:09 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1467 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:09.406371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:09.407343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:09.422513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.425469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.426179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.427213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.431179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.432119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.540817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:09.557332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:09.563022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:09.579548 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bec224ee-67a9-4ea0-afe3-54b65f7e9ff4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.271386 Oct 04 11:05:09.587271 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 752/1484] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:09 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:09.622707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:09.623315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:09.632430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.632922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.633393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:09.634078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:09.634531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:09.634951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:10.354220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:10.366947 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75606932-b9a7-4d21-bac9-d2452d4b9b41 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425" status: 200 len: 1473 microversion: 2.1 time: 0.969662 Oct 04 11:05:10.367534 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 733/1485] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:09 2022] GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 => generated 1473 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:10.391684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:10.392715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:10.403882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:10.404663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:10.405856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:10.412509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:10.413290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:10.414007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:11.077666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:11.094267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:11.097131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:11.099782 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1f314cdc-ad82-4a3c-b1b8-3e312399555a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1886 microversion: 2.42 time: 1.481372 Oct 04 11:05:11.113376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 753/1486] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:09 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1886 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:05:11.113376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:11.113376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:11.118141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:11.118950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:11.119742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:11.120629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:11.121371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:11.123059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:11.480475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:11.494471 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6f23fb03-ae14-43a2-bac4-65cd8c1a6019 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1684 microversion: 2.1 time: 1.109582 Oct 04 11:05:11.495977 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 734/1487] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:10 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1684 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:11.504365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:11.505571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:11.514470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:11.515492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:11.516171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:11.517291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:11.517982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:11.518748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:11.855438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:11.864372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:11.866176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:11.867560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0e77bdc-d8e1-4de5-8e19-e098153a9112 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.765349 Oct 04 11:05:11.868290 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 754/1488] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:11 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:11.891478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:11.892365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:11.899201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:11.899939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:11.900561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:11.901464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:11.902137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:11.902749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:12.337287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:12.344955 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9dd9a908-d45c-4706-8cd7-9658483fa7f8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1314 microversion: 2.1 time: 0.847509 Oct 04 11:05:12.345565 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 735/1489] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:11 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:12.362342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:12.363245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:12.373310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:12.374119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:12.376268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:12.377260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:12.386091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:12.386858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:12.602359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:12.611791 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a774bcfd-873e-49a4-968c-4a720e1ca01e tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 200 len: 1467 microversion: 2.1 time: 0.729033 Oct 04 11:05:12.617522 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 755/1490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:11 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 1467 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:12.622985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1295111874", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3ba8760c-e561-4b30-bf58-6372199f0cd6"}], "security_groups": [{"name": "tempest-securitygroup--2030058664"}], "key_name": "tempest-keypair-1360255257", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "06526206-eb10-4880-8d01-c7aa5337f6ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:12.704320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:12.732627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:12.735267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:12.744495 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-122218af-8d9c-4cda-8c3d-ba2a06f31238 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1560 microversion: 2.91 time: 0.385904 Oct 04 11:05:12.745991 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 736/1491] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:12 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1560 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:12.754892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3657896f-9c5b-4dd3-84a5-f67474cc6d47 req-3f00b548-2f08-4416-bc8e-31c53c692144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "tag": "b88d59fb-34d8-4876-b140-ab257f0d6a64"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:12.774196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3657896f-9c5b-4dd3-84a5-f67474cc6d47 req-3f00b548-2f08-4416-bc8e-31c53c692144 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:12.776174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3657896f-9c5b-4dd3-84a5-f67474cc6d47 req-3f00b548-2f08-4416-bc8e-31c53c692144 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:12.776840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3657896f-9c5b-4dd3-84a5-f67474cc6d47 req-3f00b548-2f08-4416-bc8e-31c53c692144 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:12.801192 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3657896f-9c5b-4dd3-84a5-f67474cc6d47 req-3f00b548-2f08-4416-bc8e-31c53c692144 service nova] Creating event network-changed:b88d59fb-34d8-4876-b140-ab257f0d6a64 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:05:12.819442 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3657896f-9c5b-4dd3-84a5-f67474cc6d47 req-3f00b548-2f08-4416-bc8e-31c53c692144 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065360 Oct 04 11:05:12.829758 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 737/1492] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:12.835342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a261c496-1c84-44fd-bef7-03542e3b382a req-a1ac787b-4a1e-45bf-8253-9c94f8ab634c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e948af-4417-4d7e-b6f3-bd626a4b78af", "name": "network-vif-plugged", "status": "completed", "tag": "e3300dae-21c8-4d18-ac53-b687cdfa275e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:12.858418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a261c496-1c84-44fd-bef7-03542e3b382a req-a1ac787b-4a1e-45bf-8253-9c94f8ab634c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:12.858841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a261c496-1c84-44fd-bef7-03542e3b382a req-a1ac787b-4a1e-45bf-8253-9c94f8ab634c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:12.859274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a261c496-1c84-44fd-bef7-03542e3b382a req-a1ac787b-4a1e-45bf-8253-9c94f8ab634c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:12.898289 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a261c496-1c84-44fd-bef7-03542e3b382a req-a1ac787b-4a1e-45bf-8253-9c94f8ab634c service nova] Creating event network-vif-plugged:e3300dae-21c8-4d18-ac53-b687cdfa275e for instance f4e948af-4417-4d7e-b6f3-bd626a4b78af on n-h1-791135-8 Oct 04 11:05:12.917343 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a261c496-1c84-44fd-bef7-03542e3b382a req-a1ac787b-4a1e-45bf-8253-9c94f8ab634c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085865 Oct 04 11:05:12.918567 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 738/1493] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:12.935150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:12.939865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:12.953530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:12.954162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:12.954695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:12.955612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:12.956189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:12.962000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:13.294430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] validate_networks() for [('3ba8760c-e561-4b30-bf58-6372199f0cd6', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:05:13.584794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d1012a243d4941897d32e0b2856e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8436fc8200e24cfba225f7509d1e8362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:13.592938 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-927ac7e5-2aae-4f04-98d9-a2f42fd34d74 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425" status: 200 len: 1473 microversion: 2.1 time: 0.672867 Oct 04 11:05:13.606208 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 739/1494] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:12 2022] GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 => generated 1473 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:13.616140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:13.616826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:13.623302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:13.623856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:13.624309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:13.625057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:13.625545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:13.626228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:14.285769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:14.311340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:14.312788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:14.317812 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bacd1861-44e5-4ff9-b889-0dff8d90554e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1886 microversion: 2.42 time: 0.710207 Oct 04 11:05:14.318497 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 740/1495] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:13 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1886 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:14.333209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-951c2991-0706-4576-811d-6575d44ceb39 req-655239ca-8170-4ec6-811e-3ee2e189870b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6ad7b9-05e4-41a3-bbd7-af165b007a63", "name": "network-vif-deleted", "tag": "0b6cbe01-a672-4ba7-babc-6e79a199d6da"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:14.355111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-951c2991-0706-4576-811d-6575d44ceb39 req-655239ca-8170-4ec6-811e-3ee2e189870b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:14.355840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-951c2991-0706-4576-811d-6575d44ceb39 req-655239ca-8170-4ec6-811e-3ee2e189870b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:14.356490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-951c2991-0706-4576-811d-6575d44ceb39 req-655239ca-8170-4ec6-811e-3ee2e189870b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:14.403627 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-951c2991-0706-4576-811d-6575d44ceb39 req-655239ca-8170-4ec6-811e-3ee2e189870b service nova] Creating event network-vif-deleted:0b6cbe01-a672-4ba7-babc-6e79a199d6da for instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 on n-h2-791135-8 Oct 04 11:05:14.418446 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-951c2991-0706-4576-811d-6575d44ceb39 req-655239ca-8170-4ec6-811e-3ee2e189870b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098464 Oct 04 11:05:14.421485 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 741/1496] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:14.427453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:14.428376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:14.435063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:14.435803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:14.436457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:14.437342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:14.438005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:14.438596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:14.642161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:14.653075 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7214f275-4204-4fd8-be2f-3160785f475e tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1616 microversion: 2.1 time: 0.230216 Oct 04 11:05:14.666562 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 742/1497] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:14 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1616 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:14.674882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:14.675681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:14.696946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:14.697183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:14.697666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:14.698740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:14.699205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:14.700154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.086056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Getting quotas for project b968e6eb837f4be2b40439b79a0b7509. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:05:15.094056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Getting quotas for user c21554eac00f49a88859835db6a7581e and project b968e6eb837f4be2b40439b79a0b7509. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:05:15.099734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:15.118142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:15.120583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:15.123169 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef7dd9fb-0a09-49ce-93f5-0bbfc98fb4f6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1815 microversion: 2.25 time: 0.455152 Oct 04 11:05:15.123766 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 743/1498] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:14 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1815 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:15.126758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:05:15.127257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:05:15.128077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:05:15.128824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:05:15.129242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:05:15.148367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.148954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.149455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.150245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.150718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.151202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.159805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:15.162731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:15.172520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Getting quotas for project b968e6eb837f4be2b40439b79a0b7509. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:05:15.175667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.179035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.179249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Getting quotas for user c21554eac00f49a88859835db6a7581e and project b968e6eb837f4be2b40439b79a0b7509. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:05:15.188841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.190180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.191726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.192420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.323148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:05:15.325392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06526206-eb10-4880-8d01-c7aa5337f6ef',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:05:15.554498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:15.570322 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f31db3e-b8f7-4576-b089-7ef9c53155c7 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1464 microversion: 2.1 time: 0.425601 Oct 04 11:05:15.572121 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 744/1499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:15 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1464 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:15.584356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:15.585311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: 1f6ad7b9-05e4-41a3-bbd7-af165b007a63] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:15.598566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4337e334-65fd-420f-abec-e9019f1becb7 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.979753 Oct 04 11:05:15.599771 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 756/1500] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:05:12 2022] POST /compute/v2.1/servers => generated 407 bytes in 2982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:05:15.604951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.606058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.608821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.609837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.611554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:15.612162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:15.612719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.613407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.623772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.631162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.631746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.633264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.633799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.634232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.649824 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] HTTP exception thrown: Instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 could not be found. Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Request method failure captured: Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 HTTP/1.1 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIeVq9R6G4-SI2rCSoyQb-x-B4-ydSbu8hhpwOjkyydw-suqAxEOB-dP9gEGvCAlEnD3hD58XmzvKxH5INJc5AYFjtZ64heLytpaPiu1deykkJHwvyQuwzGayRLo3gMqWNScPqdpFDNACTRXNfHxCi_EQSP0fIjxJub8ns7R1Tcxzg Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 64b6b184def140dba0ea1ac0a56a98e1 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64b6b184def140dba0ea1ac0a56a98e1"}]}] Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 64b6b184def140dba0ea1ac0a56a98e1 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-MigrationsAdminTest-435332656-project Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: b024d221d4784e2399fd7676706cbc04 Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-MigrationsAdminTest-435332656-project Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 could not be found. Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '1f6ad7b9-05e4-41a3-bbd7-af165b007a63'} Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 could not be found. Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 could not be found. Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:15.653636 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.659221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:15.659221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:15.659221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:15.659221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:15.659221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:15.659221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 could not be found. Oct 04 11:05:15.659221 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.660993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Returning 404 to user: Instance 1f6ad7b9-05e4-41a3-bbd7-af165b007a63 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:15.664002 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f6c05e9-4979-43b1-9e75-e88f2e637a1c tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63" status: 404 len: 111 microversion: 2.1 time: 0.090664 Oct 04 11:05:15.665772 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 745/1501] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:15 2022] GET /compute/v2.1/servers/1f6ad7b9-05e4-41a3-bbd7-af165b007a63 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:05:15.681916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:15.682928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] [instance: 59b04194-7767-4636-9ed0-3869ff18e425] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:15.691769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.692636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.695141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.696121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.696810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.701233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.727568 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] HTTP exception thrown: Instance 59b04194-7767-4636-9ed0-3869ff18e425 could not be found. Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Request method failure captured: Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 HTTP/1.1 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBLRWzgLBHiovUTFAWOZKFq4gyQfccgaDxJp1gQ5mfePe0qtYFtBDjf0k3daDPIthi-o1yRK8jrv4aNO-hXAxF6qv6hMFLRNn1ETndTvQHBDntrsUHpdWBJdQg9OScEUjwGymB4iobM-KE5hVE5ehaztHJPuOl_xI35pOkcomV-BwPI Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 8436fc8200e24cfba225f7509d1e8362 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ListImageFiltersTestJSON-823019566 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8436fc8200e24cfba225f7509d1e8362"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8436fc8200e24cfba225f7509d1e8362"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8436fc8200e24cfba225f7509d1e8362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8436fc8200e24cfba225f7509d1e8362"}]}] Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ListImageFiltersTestJSON-823019566 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 8436fc8200e24cfba225f7509d1e8362 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-823019566 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ListImageFiltersTestJSON-823019566-project Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 29d1012a243d4941897d32e0b2856e63 Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ListImageFiltersTestJSON-823019566-project Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 59b04194-7767-4636-9ed0-3869ff18e425 could not be found. Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '59b04194-7767-4636-9ed0-3869ff18e425'} Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b04194-7767-4636-9ed0-3869ff18e425 could not be found. Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b04194-7767-4636-9ed0-3869ff18e425 could not be found. Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:15.742558 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.749787 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:15.749787 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:15.749787 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:15.749787 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:15.749787 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:15.749787 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b04194-7767-4636-9ed0-3869ff18e425 could not be found. Oct 04 11:05:15.749787 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:15.751124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Returning 404 to user: Instance 59b04194-7767-4636-9ed0-3869ff18e425 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:15.752152 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30961841-f798-42f6-ad88-29b22394eaae tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425" status: 404 len: 111 microversion: 2.1 time: 0.080905 Oct 04 11:05:15.754219 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 746/1502] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:15 2022] GET /compute/v2.1/servers/59b04194-7767-4636-9ed0-3869ff18e425 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:05:15.760324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7e129454-9053-4ac8-8a96-ce584358e719 req-191c88e7-a4ed-413a-83e2-52da4ff3f732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "tag": "e7349ae7-773f-4e2b-ab5a-79cbcf7c41eb"}, {"name": "network-changed", "server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "tag": "b3a2f117-dbc4-4c90-9ddf-05e06c43e6b6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:15.785688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7e129454-9053-4ac8-8a96-ce584358e719 req-191c88e7-a4ed-413a-83e2-52da4ff3f732 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.790544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7e129454-9053-4ac8-8a96-ce584358e719 req-191c88e7-a4ed-413a-83e2-52da4ff3f732 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.791344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7e129454-9053-4ac8-8a96-ce584358e719 req-191c88e7-a4ed-413a-83e2-52da4ff3f732 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.812018 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7e129454-9053-4ac8-8a96-ce584358e719 req-191c88e7-a4ed-413a-83e2-52da4ff3f732 service nova] Creating event network-changed:e7349ae7-773f-4e2b-ab5a-79cbcf7c41eb for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:05:15.825925 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7e129454-9053-4ac8-8a96-ce584358e719 req-191c88e7-a4ed-413a-83e2-52da4ff3f732 service nova] Creating event network-changed:b3a2f117-dbc4-4c90-9ddf-05e06c43e6b6 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:05:15.831582 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7e129454-9053-4ac8-8a96-ce584358e719 req-191c88e7-a4ed-413a-83e2-52da4ff3f732 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075286 Oct 04 11:05:15.832679 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 747/1503] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:15.840881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:15.843750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:15.844762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:15.853277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:15.858771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.859264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.859700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.860411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:15.860543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:15.860865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:15.861296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:15.872837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc28af49-9c5b-4255-a6c6-c68e863d6fe6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1560 microversion: 2.91 time: 0.272004 Oct 04 11:05:15.885958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 757/1504] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:15 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1560 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:16.053785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:16.069884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Searching by: {'deleted': False, 'project_id': 'f2972365a29d4815802e73f3cb1344e9'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:05:16.089442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.090969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.091702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:16.093045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.098343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.099172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:16.263066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72cb5d34-55dc-4224-9a9c-007a923e37ef tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.375034 Oct 04 11:05:16.264308 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 758/1505] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:05:15 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:05:16.296323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25a35d31-4b70-48b1-ab8e-62087a67d6b8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:16.297072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25a35d31-4b70-48b1-ab8e-62087a67d6b8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:16.306602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:16.464847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25a35d31-4b70-48b1-ab8e-62087a67d6b8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:16.473032 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25a35d31-4b70-48b1-ab8e-62087a67d6b8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1122 microversion: 2.1 time: 0.207469 Oct 04 11:05:16.475184 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 759/1506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:16 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1122 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:16.487246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:16.488128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:16.504648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.506142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.506803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:16.509718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.510445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.512190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:16.591672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:05:16.623837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:16.637120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:16.643197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:16.644720 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9a9e2c2-419d-4608-965e-be28209b3cce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1886 microversion: 2.42 time: 0.810146 Oct 04 11:05:16.645888 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 748/1507] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:15 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1886 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:16.667646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:16.669098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:16.676451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.678914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.679661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:16.680699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.681945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.682564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:16.732082 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-da1ea0b7-77ac-4ffe-85ad-dda9e1f87cbe tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 204 len: 0 microversion: 2.1 time: 0.253849 Oct 04 11:05:16.735810 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 760/1508] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:05:16 2022] DELETE /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:16.738713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.739414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.740604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:16.741217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lazy-loading 'fault' on Instance uuid 133e0337-b85f-489a-9545-7582c99ba173 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:05:16.743298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfe30d4e-b4ff-4e3e-b864-74beec367897 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4502e50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:16.796670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67875c6ae98c4184b8519b21977e23da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a0fc1de1644db0a9a7e77241e2c04f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:16.808496 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d98cfc7b-fbfd-48f9-873a-cb538d44a357 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 200 len: 1332 microversion: 2.1 time: 0.160888 Oct 04 11:05:16.821391 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 749/1509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:16 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 1332 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:16.821391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:16.821391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:16.828910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.829711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.830375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:16.831448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:16.832157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:16.833220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.106742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:17.118555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:17.120451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:17.121690 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ae4d703-6641-48f5-a103-7bb3f050d4d2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1805 microversion: 2.25 time: 0.310785 Oct 04 11:05:17.137820 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 750/1510] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:16 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1805 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:17.146719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:17.153101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Searching by: {'deleted': False} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:05:17.156593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:17.159965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.160455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.160884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.162415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.163057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.163700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.175375 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfe30d4e-b4ff-4e3e-b864-74beec367897 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "DELETE /compute/v2.1/images/4b3bbafa-aa8f-4a4f-867a-e6b779240569" status: 204 len: 0 microversion: 2.1 time: 0.440865 Oct 04 11:05:17.176023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 761/1511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:16 2022] DELETE /compute/v2.1/images/4b3bbafa-aa8f-4a4f-867a-e6b779240569 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:17.181935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-fd4afe6e-3057-4799-a1b7-b6932a442378 req-39eb53eb-df15-45db-a20f-bbbdd889ce4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b04194-7767-4636-9ed0-3869ff18e425", "name": "network-vif-deleted", "tag": "c9b6f444-374d-48a3-a78e-32dff234e6dd"}, {"server_uuid": "133e0337-b85f-489a-9545-7582c99ba173", "name": "network-vif-deleted", "tag": "30a28d0b-9016-4e57-9f4a-46a137d05c43"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:17.193755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fd4afe6e-3057-4799-a1b7-b6932a442378 req-39eb53eb-df15-45db-a20f-bbbdd889ce4d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.194308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fd4afe6e-3057-4799-a1b7-b6932a442378 req-39eb53eb-df15-45db-a20f-bbbdd889ce4d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.194811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fd4afe6e-3057-4799-a1b7-b6932a442378 req-39eb53eb-df15-45db-a20f-bbbdd889ce4d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.206812 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-fd4afe6e-3057-4799-a1b7-b6932a442378 req-39eb53eb-df15-45db-a20f-bbbdd889ce4d service nova] Creating event network-vif-deleted:c9b6f444-374d-48a3-a78e-32dff234e6dd for instance 59b04194-7767-4636-9ed0-3869ff18e425 on n-h1-791135-8 Oct 04 11:05:17.207426 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-fd4afe6e-3057-4799-a1b7-b6932a442378 req-39eb53eb-df15-45db-a20f-bbbdd889ce4d service nova] Creating event network-vif-deleted:30a28d0b-9016-4e57-9f4a-46a137d05c43 for instance 133e0337-b85f-489a-9545-7582c99ba173 on n-h2-791135-8 Oct 04 11:05:17.216451 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-fd4afe6e-3057-4799-a1b7-b6932a442378 req-39eb53eb-df15-45db-a20f-bbbdd889ce4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038907 Oct 04 11:05:17.220844 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 762/1512] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:17.226947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:17.227939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:17.235027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.235843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.236481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.237428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.238089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.238730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.251848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:17.293034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:05:17.485588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:17.494566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.495114 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7a5f76e-35ea-4bf9-a184-65e1d431dee5 tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1468 microversion: 2.1 time: 0.272956 Oct 04 11:05:17.495583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.495733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 763/1513] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:17 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1468 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:17.497938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.509383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:17.511510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:17.527107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.527609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.528044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.528746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.530706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.533739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.539425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:17.685977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:17.702930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:17.705705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:17.716154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a58cbd3a-5fd2-4188-a376-bca6daa4288b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.218903 Oct 04 11:05:17.733504 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 764/1514] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:17 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:17.741465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b725d1a5-0305-495f-8d46-778b49242527 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '.version_select at 0x7f71d44e3160>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:17.748222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b725d1a5-0305-495f-8d46-778b49242527 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:17.748960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b725d1a5-0305-495f-8d46-778b49242527 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:17.749723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b725d1a5-0305-495f-8d46-778b49242527 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:17.761171 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b725d1a5-0305-495f-8d46-778b49242527 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.025858 Oct 04 11:05:17.761804 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 765/1515] 10.222.0.23 () {60 vars in 1184 bytes} [Tue Oct 4 11:05:17 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:17.767315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfd2ee94-c9c6-495f-a02d-b198f3492975 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d457a040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:18.199909 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a7bfe40-7d37-469e-98ef-2ecc311bcd5c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16252 microversion: 2.1 time: 1.060807 Oct 04 11:05:18.201337 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 751/1516] 10.222.0.23 () {58 vars in 1171 bytes} [Tue Oct 4 11:05:17 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16252 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:18.216970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:18.223962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:18.232116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.232989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.233832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.234792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.235567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.236390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.277767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfd2ee94-c9c6-495f-a02d-b198f3492975 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "DELETE /compute/v2.1/images/84a67a42-7ec5-47e4-8ba1-4e171439a354" status: 204 len: 0 microversion: 2.1 time: 0.514292 Oct 04 11:05:18.281981 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 766/1517] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:17 2022] DELETE /compute/v2.1/images/84a67a42-7ec5-47e4-8ba1-4e171439a354 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:18.287776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:18.288250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:18.296362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.297201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.310593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.313122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.314871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.316994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.477620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:18.487582 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-851d16ac-b3d5-402d-a5a2-525d83835fed tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1220 microversion: 2.1 time: 0.284659 Oct 04 11:05:18.505574 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 752/1518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:18 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1220 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:18.510465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:18.511069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:18.521578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.523233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.524165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.526570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.527929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.528534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.634166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:18.651520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:18.657554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:18.659266 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd5e192e-4e0c-4a02-ac21-5f43ca40cb64 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1886 microversion: 2.42 time: 0.376138 Oct 04 11:05:18.662017 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 767/1519] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:18 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1886 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:18.676748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:18.678177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] [instance: 133e0337-b85f-489a-9545-7582c99ba173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:18.704413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.706634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.707257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.710190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.710851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.711486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.735775 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] HTTP exception thrown: Instance 133e0337-b85f-489a-9545-7582c99ba173 could not be found. Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Request method failure captured: Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 HTTP/1.1 Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJ3JoAXifOOSGeJHAEIwdFqSsAUQsTyH_gFYOtFMBnEozsEaYwFcL0b9DfrtIjO30wjutnoY8cqb2Lxxj2PCXoEaHu8KaTj5pUlxTEv_UW868waiVQEiZ93cQzrC7YqY_ZSDawvwY7eMYh5jViQ2sSs2UbVRr2-G9VS0omwtTOQBRw Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 86a0fc1de1644db0a9a7e77241e2c04f Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesAdminNegativeTest-1344492479 Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86a0fc1de1644db0a9a7e77241e2c04f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86a0fc1de1644db0a9a7e77241e2c04f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86a0fc1de1644db0a9a7e77241e2c04f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86a0fc1de1644db0a9a7e77241e2c04f"}]}] Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesAdminNegativeTest-1344492479 Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 86a0fc1de1644db0a9a7e77241e2c04f Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1344492479 Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesAdminNegativeTest-1344492479-project Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 67875c6ae98c4184b8519b21977e23da Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesAdminNegativeTest-1344492479-project Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 133e0337-b85f-489a-9545-7582c99ba173 could not be found. Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '133e0337-b85f-489a-9545-7582c99ba173'} Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133e0337-b85f-489a-9545-7582c99ba173 could not be found. Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133e0337-b85f-489a-9545-7582c99ba173 could not be found. Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:18.744244 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:18.750375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:18.750375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:18.750375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:18.750375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:18.750375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:18.750375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133e0337-b85f-489a-9545-7582c99ba173 could not be found. Oct 04 11:05:18.750375 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:18.754164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Returning 404 to user: Instance 133e0337-b85f-489a-9545-7582c99ba173 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:18.758047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d14e32d0-11a1-493e-9f04-21f1138dbca7 tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173" status: 404 len: 111 microversion: 2.1 time: 0.093383 Oct 04 11:05:18.765939 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 768/1520] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:18 2022] GET /compute/v2.1/servers/133e0337-b85f-489a-9545-7582c99ba173 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:05:18.775976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:18.785988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Searching by: {'deleted': False, 'project_id': 'f2972365a29d4815802e73f3cb1344e9'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:05:18.809053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 5813e7a4-1b03-438c-bf70-c2b544030ce4 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:05:18.818026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.821977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.822822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.825501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.832929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.834372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.847697 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1052d047-0a7c-412f-aa07-baa8ad58c472 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 2423 microversion: 2.25 time: 0.336419 Oct 04 11:05:18.866419 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 753/1521] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:18 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 2423 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:18.875263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ac73d26-966e-4330-9ad5-70ae8c5a8bd7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] Calling method '.version_select at 0x7f71d4430430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:18.927965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6c1becf5-5e01-46fd-ae0a-085734dd48ec tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=8e8dfb2a0b8d4faa8e810e56fc749d2d" status: 200 len: 15 microversion: 2.1 time: 0.159610 Oct 04 11:05:18.930878 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 769/1522] 10.222.0.23 () {58 vars in 1231 bytes} [Tue Oct 4 11:05:18 2022] GET /compute/v2.1/servers/detail?tenant_id=8e8dfb2a0b8d4faa8e810e56fc749d2d => generated 15 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:05:18.935900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:18.936783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:18.946778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.947557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.948179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:18.949732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:18.950376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:18.951732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:19.127561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b024d221d4784e2399fd7676706cbc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b6b184def140dba0ea1ac0a56a98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:19.138701 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b63be4b-1047-488f-8a2f-2b07d231571f tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 200 len: 1426 microversion: 2.1 time: 0.205385 Oct 04 11:05:19.143790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 770/1523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:18 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 1426 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:19.149867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:19.152962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:19.169734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:19.171657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:19.172264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:19.174974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:19.175534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:19.177079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:19.337731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:19.351067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:19.352908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:19.367780 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84c90a6a-bcb6-4085-afb1-76ca4800929e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.222808 Oct 04 11:05:19.372331 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 771/1524] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:19 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:19.378658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9eaf149-1fcb-4a44-9b82-6ccf98569bdd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] Calling method '.version_select at 0x7f71d457ae50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:19.418544 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9eaf149-1fcb-4a44-9b82-6ccf98569bdd tempest-VolumesAdminNegativeTest-1344492479 tempest-VolumesAdminNegativeTest-1344492479-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721102254" status: 202 len: 0 microversion: 2.1 time: 0.045074 Oct 04 11:05:19.419545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 772/1525] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721102254 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:19.435457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:19.436393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:19.450487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:19.450984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:19.451419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:19.452132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:19.452590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:19.453018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:19.481601 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ac73d26-966e-4330-9ad5-70ae8c5a8bd7 tempest-ListImageFiltersTestJSON-823019566 tempest-ListImageFiltersTestJSON-823019566-project] 10.222.0.23 "DELETE /compute/v2.1/images/8d8badee-f820-47bf-a601-db37d72e6c9f" status: 204 len: 0 microversion: 2.1 time: 0.613528 Oct 04 11:05:19.482392 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 754/1526] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:18 2022] DELETE /compute/v2.1/images/8d8badee-f820-47bf-a601-db37d72e6c9f => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:19.491292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:19.507453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Searching by: {'tenant_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'deleted': False} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:05:19.522345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:19.523170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:19.523917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:19.525250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:19.525998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:19.527946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:19.854352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:05:19.856449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 5813e7a4-1b03-438c-bf70-c2b544030ce4 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:05:19.894757 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ff7fb06-9134-4f94-bb2d-cae3c8847cb3 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 2423 microversion: 2.25 time: 0.473602 Oct 04 11:05:19.896507 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 773/1527] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:19 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 2423 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:19.913579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1b7796cf-1791-4180-8451-319244a1a97a req-c5b9c788-c42f-43a3-8ea5-58c9a13fcb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f801b4d9-89bd-4232-9031-fbb661178744", "name": "network-vif-deleted", "tag": "ad4bec16-719d-4826-bf8e-6aefb10f7672"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:19.946614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1b7796cf-1791-4180-8451-319244a1a97a req-c5b9c788-c42f-43a3-8ea5-58c9a13fcb30 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:19.947104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1b7796cf-1791-4180-8451-319244a1a97a req-c5b9c788-c42f-43a3-8ea5-58c9a13fcb30 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:19.947537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1b7796cf-1791-4180-8451-319244a1a97a req-c5b9c788-c42f-43a3-8ea5-58c9a13fcb30 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:19.982483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1b7796cf-1791-4180-8451-319244a1a97a req-c5b9c788-c42f-43a3-8ea5-58c9a13fcb30 service nova] Creating event network-vif-deleted:ad4bec16-719d-4826-bf8e-6aefb10f7672 for instance f801b4d9-89bd-4232-9031-fbb661178744 on n-h1-791135-8 Oct 04 11:05:19.989235 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1b7796cf-1791-4180-8451-319244a1a97a req-c5b9c788-c42f-43a3-8ea5-58c9a13fcb30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091095 Oct 04 11:05:19.994031 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 774/1528] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:20.001001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:20.008520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:20.028731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:20.031146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:20.031599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:20.034519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:20.035199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:20.035797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:20.120842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:20.131606 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-62c35937-8dd5-4b82-ab59-a68a68859c35 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1238 microversion: 2.1 time: 0.136282 Oct 04 11:05:20.137151 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 775/1529] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:19 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1238 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:20.143518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:20.160763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:20.178521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:20.179480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:20.180342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:20.182815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:20.183509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:20.184498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:20.475975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:20.476852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:20.477564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:20.956721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:20.978172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:20.983224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:20.989908 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca9f89ed-d44e-4185-b879-894d874b8ea7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.845848 Oct 04 11:05:20.992727 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 776/1530] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:20 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:21.020047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:21.023720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:21.039796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.040827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.040962 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1af6c45b-19da-4f47-9ccc-313dc31f26c1 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8e8dfb2a0b8d4faa8e810e56fc749d2d" status: 200 len: 4826 microversion: 2.1 time: 1.555921 Oct 04 11:05:21.049441 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 755/1531] 10.222.0.23 () {58 vars in 1257 bytes} [Tue Oct 4 11:05:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8e8dfb2a0b8d4faa8e810e56fc749d2d => generated 4826 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:21.054016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:21.054851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] [instance: f801b4d9-89bd-4232-9031-fbb661178744] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:21.066425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.067197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.068260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.068410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.068703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.083990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.090390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.093529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.097639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.102570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.146408 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] HTTP exception thrown: Instance f801b4d9-89bd-4232-9031-fbb661178744 could not be found. Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Request method failure captured: Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 HTTP/1.1 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBIeVq9R6G4-SI2rCSoyQb-x-B4-ydSbu8hhpwOjkyydw-suqAxEOB-dP9gEGvCAlEnD3hD58XmzvKxH5INJc5AYFjtZ64heLytpaPiu1deykkJHwvyQuwzGayRLo3gMqWNScPqdpFDNACTRXNfHxCi_EQSP0fIjxJub8ns7R1Tcxzg Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 64b6b184def140dba0ea1ac0a56a98e1 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/64b6b184def140dba0ea1ac0a56a98e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/64b6b184def140dba0ea1ac0a56a98e1"}]}] Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 64b6b184def140dba0ea1ac0a56a98e1 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-MigrationsAdminTest-435332656 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-MigrationsAdminTest-435332656-project Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: b024d221d4784e2399fd7676706cbc04 Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-MigrationsAdminTest-435332656-project Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance f801b4d9-89bd-4232-9031-fbb661178744 could not be found. Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'f801b4d9-89bd-4232-9031-fbb661178744'} Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f801b4d9-89bd-4232-9031-fbb661178744 could not be found. Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f801b4d9-89bd-4232-9031-fbb661178744 could not be found. Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:21.155605 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f801b4d9-89bd-4232-9031-fbb661178744 could not be found. Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] Returning 404 to user: Instance f801b4d9-89bd-4232-9031-fbb661178744 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:21.164603 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee9565bb-6e7b-433c-97f0-0a44bd67eaff tempest-MigrationsAdminTest-435332656 tempest-MigrationsAdminTest-435332656-project] 10.222.0.23 "GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744" status: 404 len: 111 microversion: 2.1 time: 0.112685 Oct 04 11:05:21.175944 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 756/1532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:21 2022] GET /compute/v2.1/servers/f801b4d9-89bd-4232-9031-fbb661178744 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:05:21.190712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:21.191319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:21.227794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.228603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.229507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.230902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.231575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.232244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.301321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lazy-loading 'services' on Instance uuid 5813e7a4-1b03-438c-bf70-c2b544030ce4 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:05:21.460086 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-778c1db4-f369-4970-b164-166233286cf1 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments/df907df4-5db1-4577-a9a2-79ef69ee9df1" status: 202 len: 0 microversion: 2.25 time: 0.465753 Oct 04 11:05:21.460896 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 777/1533] 10.222.0.23 () {60 vars in 1457 bytes} [Tue Oct 4 11:05:20 2022] DELETE /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments/df907df4-5db1-4577-a9a2-79ef69ee9df1 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:05:21.481401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:21.504927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:21.517934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Searching by: {'tenant_id': 'f2972365a29d4815802e73f3cb1344e9', 'deleted': False} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:05:21.525765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:21.529863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.531594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.538423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.539444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.540092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.542951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.553917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:21.577623 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39267d97-c499-4b59-b3d8-42a107cf4057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.400439 Oct 04 11:05:21.593277 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 757/1534] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:21 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:21.598953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:21.615579 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a97f0d8-f7fd-45ed-acdd-b99be298adaa tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f2972365a29d4815802e73f3cb1344e9" status: 200 len: 15 microversion: 2.1 time: 0.153206 Oct 04 11:05:21.616439 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 778/1535] 10.222.0.23 () {58 vars in 1257 bytes} [Tue Oct 4 11:05:21 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f2972365a29d4815802e73f3cb1344e9 => generated 15 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:05:21.629599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:21.647780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:21.649700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.654055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:21.654619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.655330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.659208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.662171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.663059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.667888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.668382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.668818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.677331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.678033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.678434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.775973 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a301e90-c3c5-4aee-9ab0-851487f002b6 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141658 Oct 04 11:05:21.776858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 779/1536] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:05:21 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:21.781829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b973192a-386f-4646-82e7-0cc5ae6d093e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:21.806807 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b973192a-386f-4646-82e7-0cc5ae6d093e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.028614 Oct 04 11:05:21.821548 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 780/1537] 10.222.0.23 () {58 vars in 1189 bytes} [Tue Oct 4 11:05:21 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:05:21.834825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:21.844657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:21.863638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.869292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.875045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:21.876571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:21.878132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:21.879508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:22.158418 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9457964-cd0c-4a04-b2aa-09d51b4ea386 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action" status: 202 len: 0 microversion: 2.1 time: 0.329129 Oct 04 11:05:22.159385 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 781/1538] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:05:21 2022] POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:22.165334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:22.170417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:22.197376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:22.197712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:22.198156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:22.198880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:22.199340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:22.199774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:22.792341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:22.811145 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a780a0cc-e6a5-47b2-9a82-aaf8dc1bc6ad tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1306 microversion: 2.1 time: 1.216142 Oct 04 11:05:22.822416 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 758/1539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:21 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1306 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:22.836523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:22.857488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:22.858544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:05:22.877252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:22.878042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:22.878931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:22.881090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:22.881860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:22.883930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:23.094522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:05:23.289933 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93073d0f-5d1f-4c5b-9eb9-bafb2f3fece4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.463188 Oct 04 11:05:23.305509 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 759/1540] 10.222.0.23 () {58 vars in 1150 bytes} [Tue Oct 4 11:05:22 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:23.322203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:23.329711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:23.346817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:23.349435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:23.354191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:23.355680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:23.356769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:23.357215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:24.167220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:24.179527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:24.182771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:24.184180 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2fdcc1ed-0ed4-4f39-b529-dc5d444a3d90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 2.023832 Oct 04 11:05:24.187524 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 782/1541] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:22 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:24.202180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:24.206889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:24.227014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:24.231972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:24.232672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:24.236258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:24.236929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:24.237609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:24.316179 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81cef167-68a6-4404-81e6-768acd538567 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122804 Oct 04 11:05:24.323481 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 783/1542] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:05:24 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:24.334816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:24.340089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:24.353292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:24.358011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:24.358480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:24.359222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:24.359688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:24.360148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:24.388909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:24.395993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:24.416100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:24.426348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:24.444466 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-48267975-1f71-471f-a45a-66c8b3235e10 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 1.137411 Oct 04 11:05:24.444824 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 760/1543] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:23 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:24.488768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:24.492043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:24.527644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:24.529828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:24.534451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:24.535554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:24.536948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:24.537710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:24.540478 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2c2cc3e-0648-4b41-862d-6bd93aa033d0 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action" status: 202 len: 0 microversion: 2.1 time: 0.215705 Oct 04 11:05:24.541599 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 784/1544] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:05:24 2022] POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:24.549377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:24.549931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:24.567153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:24.567693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:24.568132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:24.568847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:24.569302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:24.569758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:25.895349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:25.909927 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ec7866dd-2f43-4d39-ab47-574ca887e34e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1306 microversion: 2.1 time: 1.437840 Oct 04 11:05:25.912810 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 761/1545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:24 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1306 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:25.926651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:25.928722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:25.943359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:25.943868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:25.944310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:25.948746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:25.949252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:25.949909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:26.397812 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff9e9d1d-a927-4a30-b6eb-579ceb0a371a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1614 microversion: 2.1 time: 1.852383 Oct 04 11:05:26.405687 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 785/1546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:24 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1614 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:26.422914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:26.437439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:26.479951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:26.492366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:26.494491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:26.495078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:26.498107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:26.502549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:26.503141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:26.632213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f6e6e0e0-86f8-4df3-ab9f-2b7bbfbc30d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.223423 Oct 04 11:05:26.642233 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 786/1547] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:05:26 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:26.657450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:26.658463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:26.682933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:26.683443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:26.684157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:26.685108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:26.685807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:26.686420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:26.897578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:26.910562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:26.918309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:26.934128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd3d4b3a-b6c5-4817-b5b3-f38606cff4b6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.289975 Oct 04 11:05:26.953276 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 787/1548] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:26 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:26.990379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:26.991003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:26.999975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:27.000468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:27.000911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:27.001651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:27.002106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:27.002540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.022364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:28.042392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:28.044318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:28.046181 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e15f378-a887-4fe2-bdbb-0695f6c18d7d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 2.131577 Oct 04 11:05:28.047152 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 762/1549] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:25 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:28.059241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:28.062459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:28.075448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:28.076159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:28.076841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.078010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:28.078635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:28.079227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.479022 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3046a0ec-c041-4224-9f2e-f0d6b6371f0c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1614 microversion: 2.1 time: 1.526220 Oct 04 11:05:28.482174 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 788/1550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:26 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1614 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:28.634290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:28.643804 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b892fdeb-4d90-46e0-80aa-98c02b7ff012 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1306 microversion: 2.1 time: 0.595011 Oct 04 11:05:28.648396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 763/1551] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:28 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1306 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:28.659297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:28.666101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:28.686902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:28.687514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:28.688515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.690681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:28.695535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:28.696343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.767723 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d98b1d2-7d50-4757-aa36-48576bf94f9a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117934 Oct 04 11:05:28.771616 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 764/1552] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:05:28 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:28.783894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1159d860-9ecf-4dcf-bca5-103b32a21ee4 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Action: 'update', calling method: .version_select at 0x7f71d457aee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:28.790634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:28.793923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:28.802452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:28.803053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:28.803484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.804391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:28.805003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:28.805660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.901331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1159d860-9ecf-4dcf-bca5-103b32a21ee4 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:28.905416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1159d860-9ecf-4dcf-bca5-103b32a21ee4 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:28.906211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1159d860-9ecf-4dcf-bca5-103b32a21ee4 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.907267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1159d860-9ecf-4dcf-bca5-103b32a21ee4 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:28.909673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1159d860-9ecf-4dcf-bca5-103b32a21ee4 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:28.911194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1159d860-9ecf-4dcf-bca5-103b32a21ee4 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:28.976657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:28.992993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:28.998365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:29.017549 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d7162ba-d290-4dac-989a-01ee1cbc2da3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.240559 Oct 04 11:05:29.030318 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 765/1553] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:28 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:29.046044 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1159d860-9ecf-4dcf-bca5-103b32a21ee4 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/c96f2231aa8e47bbaf921a5387ff76ca" status: 200 len: 148 microversion: 2.57 time: 0.558736 Oct 04 11:05:29.048586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:29.049444 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 789/1554] 10.222.0.23 () {62 vars in 1303 bytes} [Tue Oct 4 11:05:28 2022] PUT /compute/v2.1/os-quota-sets/c96f2231aa8e47bbaf921a5387ff76ca => generated 148 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:29.057783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Searching by: {'host': 'n-h1-791135-8', 'deleted': False} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:05:29.066473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f63733b8-c43d-49ca-9561-33d505e47832 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Calling method '.version_select at 0x7f71d42eb3a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:29.068690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.070389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.071924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.077158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.080528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.080866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.266983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63733b8-c43d-49ca-9561-33d505e47832 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.269205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63733b8-c43d-49ca-9561-33d505e47832 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.271100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63733b8-c43d-49ca-9561-33d505e47832 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.275776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63733b8-c43d-49ca-9561-33d505e47832 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.277974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63733b8-c43d-49ca-9561-33d505e47832 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.279335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63733b8-c43d-49ca-9561-33d505e47832 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.368223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f63733b8-c43d-49ca-9561-33d505e47832 tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c96f2231aa8e47bbaf921a5387ff76ca/detail" status: 200 len: 463 microversion: 2.57 time: 0.311779 Oct 04 11:05:29.369178 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 790/1555] 10.222.0.23 () {60 vars in 1304 bytes} [Tue Oct 4 11:05:29 2022] GET /compute/v2.1/os-quota-sets/c96f2231aa8e47bbaf921a5387ff76ca/detail => generated 463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:29.384560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:29.385185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:29.408895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:05:29.410050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.410549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.416773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.418967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.419632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.425843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.638680 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f40898c0-b620-4fd9-b97b-8729d0be0188 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=n-h1-791135-8&all_tenants=1" status: 200 len: 1667 microversion: 2.1 time: 0.587911 Oct 04 11:05:29.647534 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 766/1556] 10.222.0.23 () {58 vars in 1190 bytes} [Tue Oct 4 11:05:29 2022] GET /compute/v2.1/servers?host=n-h1-791135-8&all_tenants=1 => generated 1667 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:29.652809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ccd03d1c-b4ce-4bef-b5a9-b334bcfbb0ba req-28ac40af-482d-4e69-a714-e4913be3af98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628b765d-b4cf-4a47-b151-9414fc1934a0", "tag": "197d9c40-744c-4f59-9b1b-41cad82ecf0d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:29.663068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ccd03d1c-b4ce-4bef-b5a9-b334bcfbb0ba req-28ac40af-482d-4e69-a714-e4913be3af98 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.663558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ccd03d1c-b4ce-4bef-b5a9-b334bcfbb0ba req-28ac40af-482d-4e69-a714-e4913be3af98 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.664370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ccd03d1c-b4ce-4bef-b5a9-b334bcfbb0ba req-28ac40af-482d-4e69-a714-e4913be3af98 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.670681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:29.682970 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ccd03d1c-b4ce-4bef-b5a9-b334bcfbb0ba req-28ac40af-482d-4e69-a714-e4913be3af98 service nova] Creating event network-changed:197d9c40-744c-4f59-9b1b-41cad82ecf0d for instance 628b765d-b4cf-4a47-b151-9414fc1934a0 on n-h1-791135-8 Oct 04 11:05:29.689439 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ccd03d1c-b4ce-4bef-b5a9-b334bcfbb0ba req-28ac40af-482d-4e69-a714-e4913be3af98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040618 Oct 04 11:05:29.690438 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 767/1557] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:29.699615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:29.703984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:05:29.710437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.710914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.711383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.712105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.712548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.712962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.740761 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-502f7284-e91a-41ca-b66e-65c982be9665 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.047444 Oct 04 11:05:29.751012 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 768/1558] 10.222.0.23 () {58 vars in 1196 bytes} [Tue Oct 4 11:05:29 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:05:29.756346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:29.757085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:29.763998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.764536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.764968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:29.765733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:29.766181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:29.766600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.443665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:30.456407 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-898444fc-db2f-4ba2-8bf3-283266b8f9a3 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1306 microversion: 2.1 time: 0.704140 Oct 04 11:05:30.458503 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 769/1559] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:29 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1306 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:30.475382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:30.485255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:30.491241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Action: 'update', calling method: .version_select at 0x7f71d44803a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:30.501423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:30.503054 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81f43bc7-8575-4780-87df-17e00e9cce16 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.132529 Oct 04 11:05:30.503923 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 791/1560] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:29 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:30.532968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:30.544133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:30.575033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:30.590698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.597009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.602028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.603607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.605283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.607227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.687441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.687441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.691450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.691450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.691720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.698240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.742784 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a56f25de-557d-49e0-b505-686c3c7f58de tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action" status: 202 len: 0 microversion: 2.1 time: 0.215507 Oct 04 11:05:30.748003 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 792/1561] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:05:30 2022] POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:30.756114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:30.759768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:30.784490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.786358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.788108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.791851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.792510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.795120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.827472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.834246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.836112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.837114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.839206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.839836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.884069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-797e362f-a97c-4252-bbd9-dede893f5180 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133273 Oct 04 11:05:30.891227 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 793/1562] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:05:30 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:30.904725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:30.907389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:30.924769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.925903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.926535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:30.931170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:30.931973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:30.934145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:31.084796 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93671bfc-d1f5-48ac-84df-f93b1752437c tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/c96f2231aa8e47bbaf921a5387ff76ca?user_id=5eea6f6bbd9244a8bb73b7449d7c57ab" status: 200 len: 148 microversion: 2.57 time: 0.594412 Oct 04 11:05:31.089472 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 770/1563] 10.222.0.23 () {62 vars in 1384 bytes} [Tue Oct 4 11:05:30 2022] PUT /compute/v2.1/os-quota-sets/c96f2231aa8e47bbaf921a5387ff76ca?user_id=5eea6f6bbd9244a8bb73b7449d7c57ab => generated 148 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:31.107452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:31.112125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:31.126605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:31.127849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:31.129123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:31.134462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:31.135259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:31.136453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:31.300384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:05:31.302409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:05:31.304475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:05:31.305662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:05:31.306097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:05:31.417444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:31.439989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:31.451069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:31.468483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:31.472655 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-62d4cd0a-e418-4a0c-b3f3-2559aea36718 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.578732 Oct 04 11:05:31.474371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 794/1564] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:30 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:31.482964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:31.488810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2323f18d-1963-49ae-b24e-355d966ca64b tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] Calling method '.version_select at 0x7f71d45cf1f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:31.502485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:31.502995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:31.504957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:31.505222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:31.505679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:31.603942 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b7286ed-735d-4360-8ae3-f83a6dfebf9c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action" status: 202 len: 1067 microversion: 2.1 time: 0.512718 Oct 04 11:05:31.606835 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 771/1565] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:05:31 2022] POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action => generated 1067 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 11:05:31.619013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:31.619702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:31.631488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:31.651812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:31.652319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:31.654095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:31.656494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:31.658348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:31.658802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:31.669153 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2323f18d-1963-49ae-b24e-355d966ca64b tempest-QuotasAdminTestV257-1650655411 tempest-QuotasAdminTestV257-1650655411-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/c96f2231aa8e47bbaf921a5387ff76ca?user_id=5eea6f6bbd9244a8bb73b7449d7c57ab" status: 200 len: 190 microversion: 2.57 time: 0.188842 Oct 04 11:05:31.674067 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 795/1566] 10.222.0.23 () {60 vars in 1364 bytes} [Tue Oct 4 11:05:31 2022] GET /compute/v2.1/os-quota-sets/c96f2231aa8e47bbaf921a5387ff76ca?user_id=5eea6f6bbd9244a8bb73b7449d7c57ab => generated 190 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:31.693185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:31.695514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:31.722526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:31.723102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:31.724177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:31.729637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:31.730660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:31.733789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:32.392370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:32.406928 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe9bae55-0d49-409d-a079-800e8cf331ca tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1306 microversion: 2.1 time: 0.797417 Oct 04 11:05:32.408289 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 772/1567] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:31 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1306 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:32.425855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:32.427810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:32.454001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:32.454447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:32.460090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:32.463626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:32.465679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:32.466705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:32.975177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:32.988695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:33.002045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:33.003285 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c6c5e681-96c8-4947-8878-80e261230665 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.327807 Oct 04 11:05:33.004125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 796/1568] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:31 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:33.020136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:33.027346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:33.045904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:33.046405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:33.046862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:33.049084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:33.049846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:33.050859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:33.167376 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-642da881-66b3-4754-9550-1a362aba25bc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.160643 Oct 04 11:05:33.173007 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 797/1569] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:05:33 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:05:33.180104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:33.181996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:33.195975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:33.196667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:33.197288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:33.198222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:33.199039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:33.199637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:33.841069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:33.861912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:33.869128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:33.882541 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecaaebf2-505b-4c7c-86fb-4ad42e03670c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.708199 Oct 04 11:05:33.883797 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 798/1570] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:33 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:33.896134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:33.897056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:33.908099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:33.908799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:33.909441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:33.911179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:33.912778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:33.913485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:33.917914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:33.929273 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2e22c3a-ee40-4536-a4b2-f5852a59bec6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1471 microversion: 2.1 time: 1.518636 Oct 04 11:05:33.954677 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 773/1571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:32 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1471 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:34.243043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-742a6b5b-09b7-49e9-8ecf-b69cc7d803d0 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d44a7f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-80413765", "description": "tempest-description-474531385"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:34.666781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:34.683276 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a0941f89-a5a1-496c-849c-e7cba66d30e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1306 microversion: 2.1 time: 0.798055 Oct 04 11:05:34.690970 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 799/1572] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:33 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1306 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:34.706055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:34.709186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:34.721732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:34.730053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:34.730655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:34.731541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:34.732092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:34.732628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:34.774407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:35.235588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:35.247434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:35.272612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:35.276742 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-282c29ef-caa1-43a8-83d9-5aa3aa57dd90 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.578392 Oct 04 11:05:35.287483 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 800/1573] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:34 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:35.292808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:35.299505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:35.305468 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-742a6b5b-09b7-49e9-8ecf-b69cc7d803d0 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.349329 Oct 04 11:05:35.307086 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 774/1574] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:05:33 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:35.319217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:35.320636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:35.320785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:35.321559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:35.322085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:35.324322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:35.324855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:35.325370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:35.356151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:35.357985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:35.359553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:35.361905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:35.362659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:35.364994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:35.408835 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09f81849-63b9-47cb-9e0f-1558a3afc296 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.120001 Oct 04 11:05:35.411829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 801/1575] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:05:35 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:35.436585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:35.437558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:35.448216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:35.450432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:35.453912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:35.455440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:35.456748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:35.460753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:35.706978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:35.720706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:35.729962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:35.749983 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89694a80-5e41-43f8-b2bb-186998f934f1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.441367 Oct 04 11:05:35.752718 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 775/1576] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:35 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:35.758512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46b98267-ad58-4441-923e-44323873c927 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d45995e0>, body: {"security_group_rule": {"parent_group_id": "6130459d-ef3c-414a-86d9-948abd909129", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:36.065650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:36.078390 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96afb016-9438-40c1-9aaa-9ee06b4c29d9 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1471 microversion: 2.1 time: 0.664524 Oct 04 11:05:36.079168 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 802/1577] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:35 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1471 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:36.086704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:36.090796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:36.109088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:36.110327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:36.112568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:36.113857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:36.116650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:36.117502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:37.044359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:37.061230 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3d6762d0-cb61-4551-a018-b9a81b835265 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1306 microversion: 2.1 time: 0.977181 Oct 04 11:05:37.062033 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 803/1578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:36 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1306 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:37.084382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:37.085421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:37.114935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:37.116176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:37.117239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:37.124607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:37.132656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:37.133397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:37.239594 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46b98267-ad58-4441-923e-44323873c927 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.485144 Oct 04 11:05:37.241674 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 776/1579] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:05:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:37.251075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:37.251977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:37.269814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:37.273936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:37.274390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:37.279866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:37.280366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:37.281168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:37.611079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:37.630178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:37.632661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:37.640345 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b721b0b-89ca-4e3f-80bb-7471100a77f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.397469 Oct 04 11:05:37.654947 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 777/1580] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:37 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:37.672990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:37.673909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:37.684888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:37.686541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:37.687153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:37.688042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:37.689274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:37.689928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:38.306142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:38.313944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:38.322186 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e557ef7-3936-483a-aa00-0a268174df7b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1471 microversion: 2.1 time: 0.665709 Oct 04 11:05:38.326134 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 778/1581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:37 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1471 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:38.332145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:38.350585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:38.351926 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a8f6150-b812-4615-8100-4ac247bacab0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.277947 Oct 04 11:05:38.352515 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 804/1582] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:37 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:38.357298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:38.370920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e454102e-2eab-4834-91b4-2150cde7b81f tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d45990d0>, body: {"security_group_rule": {"parent_group_id": "6130459d-ef3c-414a-86d9-948abd909129", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:38.371850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:38.397674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:38.399583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:38.400892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:38.403642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:38.405138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:38.409380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:38.685595 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e454102e-2eab-4834-91b4-2150cde7b81f tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] HTTP exception thrown: This rule already exists in group 6130459d-ef3c-414a-86d9-948abd909129 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e454102e-2eab-4834-91b4-2150cde7b81f tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Request method failure captured: Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 138 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBN97eAVpit6z3BZKyLF88o3Xj2UdLzho6vagS_KfS884RT2Qae-f3rawqdKtdNWupjq9E-fCCbkPx5gtFw5vIKWcwvZ4UDB4_nIysXC8cIRiE_oNauOILhVKMfyc5xiqiNEg-OTCm-2JZy94wBxHxvg7oTsQrPmUq4-zugFJxwQhAc Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88bc9e0f7a3649e3afbd65778a69430b"}]}] Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 8d1fd3ed4358402990dcbb0a2355e771 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: {"security_group_rule": {"parent_group_id": "6130459d-ef3c-414a-86d9-948abd909129", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: exception: This rule already exists in group 6130459d-ef3c-414a-86d9-948abd909129 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6130459d-ef3c-414a-86d9-948abd909129', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 6130459d-ef3c-414a-86d9-948abd909129 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 6130459d-ef3c-414a-86d9-948abd909129 Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:38.687494 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:38.692676 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:38.692676 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:38.692676 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 6130459d-ef3c-414a-86d9-948abd909129 Oct 04 11:05:38.692676 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:38.702481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e454102e-2eab-4834-91b4-2150cde7b81f tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Returning 400 to user: This rule already exists in group 6130459d-ef3c-414a-86d9-948abd909129 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:38.704350 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e454102e-2eab-4834-91b4-2150cde7b81f tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.376009 Oct 04 11:05:38.705575 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 779/1583] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:05:38 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:05:38.712390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:38.718514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:38.752004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:38.760698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:38.761622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:38.762663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:38.763783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:38.764444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:39.207515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:39.219279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:39.229330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:39.244752 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-067eabeb-74f0-411f-adc5-dcabf20a1a86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.537831 Oct 04 11:05:39.246268 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 780/1584] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:38 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:39.251154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ffa06a5e-c9aa-47f3-9f03-64db504afe3c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Calling method '.version_select at 0x7f71d44c9a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:39.321428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:39.342156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:39.374536 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7347cc46-f4c8-4e57-9c5a-d9d9fd69ac61 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 1.020755 Oct 04 11:05:39.382151 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 805/1585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:38 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:39.396979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:39.405128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:39.431261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:39.432194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:39.434671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:39.435933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:39.439892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:39.440571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:40.286178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:40.301796 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca82e1f0-265f-461c-824f-986738ed0a8e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1471 microversion: 2.1 time: 0.915187 Oct 04 11:05:40.312662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 806/1586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:39 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1471 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:40.343422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:40.345089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:40.366354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:40.369650 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ffa06a5e-c9aa-47f3-9f03-64db504afe3c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/fba8c2f4-f8b1-47c8-b187-df7941be24f4" status: 202 len: 0 microversion: 2.1 time: 1.121801 Oct 04 11:05:40.370479 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 781/1587] 10.222.0.23 () {58 vars in 1287 bytes} [Tue Oct 4 11:05:39 2022] DELETE /compute/v2.1/os-security-group-rules/fba8c2f4-f8b1-47c8-b187-df7941be24f4 => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:40.370918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:40.371873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:40.378180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:40.380272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:40.380951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:40.390179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:40.391574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:40.436920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:40.446390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:40.446390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:40.448498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:40.456541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:40.456909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:40.752125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:40.773004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:40.779929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:40.790730 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2abdb018-05a4-4869-933d-b93d4719f479 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.419091 Oct 04 11:05:40.793224 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 782/1588] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:40 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:40.799235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e847c34-e61f-47d0-bd42-43f716045ea8 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d4618f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-16512053", "description": "tempest-description-289455247"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:40.860054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=15 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:41.063781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:41.406814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:41.433751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:41.444254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:41.449867 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c7853df-881e-4e3d-b55d-eec876ccb3d2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.134966 Oct 04 11:05:41.454870 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 807/1589] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:40 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:41.470465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:41.471392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:41.479484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:41.480279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:41.480920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:41.481891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:41.482529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:41.483535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:41.660515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:42.072101 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e847c34-e61f-47d0-bd42-43f716045ea8 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.277529 Oct 04 11:05:42.083954 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 783/1590] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:05:40 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:42.089007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:42.089652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:42.127447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:42.138202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:42.139415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:42.140362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:42.141008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:42.144445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:42.348105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:42.360445 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9754ada6-9d86-457a-863a-93e81935523d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.902736 Oct 04 11:05:42.364607 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 808/1591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:41 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:42.378010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:42.379207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:42.395920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:42.398010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:42.415053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:42.415921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:42.416410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:42.416851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:42.579378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:42.602830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:42.604963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:42.610808 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-03ddebe1-64b3-47c9-ae4a-bd3f6c96b52a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.244793 Oct 04 11:05:42.612021 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 809/1592] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:42 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:42.628313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:42.631698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-844042cf-fe6a-46bd-9f97-e5d6389332da tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d4615d30>, body: {"security_group_rule": {"parent_group_id": "1d2f0679-675c-48e1-a236-d0e6fd68010f", "ip_protocol": "tcp", "from_port": 124307909, "to_port": 22}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:42.651838 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b5f4f58-b1d3-440d-8415-2ef3537df99e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1471 microversion: 2.1 time: 0.563134 Oct 04 11:05:42.653232 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 784/1593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:42 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1471 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:42.764069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-844042cf-fe6a-46bd-9f97-e5d6389332da tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] HTTP exception thrown: Invalid port range 124307909:22. Former value cannot be greater than the later Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-844042cf-fe6a-46bd-9f97-e5d6389332da tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Request method failure captured: Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 145 Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBN97eAVpit6z3BZKyLF88o3Xj2UdLzho6vagS_KfS884RT2Qae-f3rawqdKtdNWupjq9E-fCCbkPx5gtFw5vIKWcwvZ4UDB4_nIysXC8cIRiE_oNauOILhVKMfyc5xiqiNEg-OTCm-2JZy94wBxHxvg7oTsQrPmUq4-zugFJxwQhAc Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88bc9e0f7a3649e3afbd65778a69430b"}]}] Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8d1fd3ed4358402990dcbb0a2355e771 Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: {"security_group_rule": {"parent_group_id": "1d2f0679-675c-48e1-a236-d0e6fd68010f", "ip_protocol": "tcp", "from_port": 124307909, "to_port": 22}} Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid port range 124307909:22. Former value cannot be greater than the later Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1d2f0679-675c-48e1-a236-d0e6fd68010f', 'ip_protocol': 'tcp', 'from_port': 124307909, 'to_port': 22}}} Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 124307909:22. Former value cannot be greater than the later Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 124307909:22. Former value cannot be greater than the later Oct 04 11:05:42.766106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 124307909:22. Former value cannot be greater than the later Oct 04 11:05:42.771211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:42.772874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-844042cf-fe6a-46bd-9f97-e5d6389332da tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Returning 400 to user: Invalid port range 124307909:22. Former value cannot be greater than the later {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:42.773992 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-844042cf-fe6a-46bd-9f97-e5d6389332da tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.160839 Oct 04 11:05:42.775076 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 810/1594] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:05:42 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:05:42.779853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:42.785218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:42.801946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:42.802993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:42.804881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:42.805989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:42.823307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:42.825660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:42.906291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1133832910", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:42.948812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:43.237905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:43.253332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:43.260225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:43.261728 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f68be563-cf27-4840-9d27-46d5bff83b8b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.485489 Oct 04 11:05:43.262826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 811/1595] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:42 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:43.269055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1aaa6b51-02f6-41c3-8639-bff3c1955ba7 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d4615040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1145505697", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:43.288737 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1aaa6b51-02f6-41c3-8639-bff3c1955ba7 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] HTTP exception thrown: Security group id should be uuid Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1aaa6b51-02f6-41c3-8639-bff3c1955ba7 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Request method failure captured: Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 131 Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBN97eAVpit6z3BZKyLF88o3Xj2UdLzho6vagS_KfS884RT2Qae-f3rawqdKtdNWupjq9E-fCCbkPx5gtFw5vIKWcwvZ4UDB4_nIysXC8cIRiE_oNauOILhVKMfyc5xiqiNEg-OTCm-2JZy94wBxHxvg7oTsQrPmUq4-zugFJxwQhAc Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88bc9e0f7a3649e3afbd65778a69430b"}]}] Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8d1fd3ed4358402990dcbb0a2355e771 Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1145505697", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group id should be uuid Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1145505697', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:43.290277 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:43.296035 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 11:05:43.296035 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:43.296035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1aaa6b51-02f6-41c3-8639-bff3c1955ba7 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Returning 400 to user: Security group id should be uuid {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:43.296035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1aaa6b51-02f6-41c3-8639-bff3c1955ba7 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027711 Oct 04 11:05:43.296035 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 812/1596] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:05:43 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:05:43.303283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98c279f3-2d49-4101-aed7-448299f76a11 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d4629af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2107373566", "description": "tempest-description-464097762"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:44.013150 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98c279f3-2d49-4101-aed7-448299f76a11 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.714120 Oct 04 11:05:44.015137 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 813/1597] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:05:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:44.020258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:44.021327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:44.051108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:44.052027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:44.064575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:44.065614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:44.066349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:44.068921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:44.300764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:44.319800 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f19a435-5e2b-44b1-9514-18459bd3fa88 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.298653 Oct 04 11:05:44.321228 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 814/1598] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:44 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:44.330079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:44.338734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:44.359755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:44.360533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:44.361216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:44.365153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:44.365807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:44.366954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:44.513372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:44.526667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:44.531158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:44.549055 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ccbcbffb-bf46-4a47-8b34-9993585ad29a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.226422 Oct 04 11:05:44.566739 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 815/1599] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:44 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:44.578745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:44.579756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:44.588570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:44.589483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:44.590162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:44.591685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:44.592417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:44.593103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:44.845296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:44.855628 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-209fda2c-e80e-4287-a231-6f5c1a04ab90 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1471 microversion: 2.1 time: 0.286065 Oct 04 11:05:44.856828 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 816/1600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:44 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:44.861873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-876f1a0a-2f1d-4f10-a0da-517348b482f4 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d46be3a0>, body: {"security_group_rule": {"parent_group_id": "5ca7465d-b871-4d31-bef9-95b543cb2ceb", "ip_protocol": "tempest-999-87048355", "from_port": 22, "to_port": 22}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:44.923961 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-876f1a0a-2f1d-4f10-a0da-517348b482f4 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] HTTP exception thrown: Invalid IP protocol tempest-999-87048355. Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-876f1a0a-2f1d-4f10-a0da-517348b482f4 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Request method failure captured: Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 155 Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBN97eAVpit6z3BZKyLF88o3Xj2UdLzho6vagS_KfS884RT2Qae-f3rawqdKtdNWupjq9E-fCCbkPx5gtFw5vIKWcwvZ4UDB4_nIysXC8cIRiE_oNauOILhVKMfyc5xiqiNEg-OTCm-2JZy94wBxHxvg7oTsQrPmUq4-zugFJxwQhAc Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88bc9e0f7a3649e3afbd65778a69430b"}]}] Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8d1fd3ed4358402990dcbb0a2355e771 Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: {"security_group_rule": {"parent_group_id": "5ca7465d-b871-4d31-bef9-95b543cb2ceb", "ip_protocol": "tempest-999-87048355", "from_port": 22, "to_port": 22}} Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid IP protocol tempest-999-87048355. Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5ca7465d-b871-4d31-bef9-95b543cb2ceb', 'ip_protocol': 'tempest-999-87048355', 'from_port': 22, 'to_port': 22}}} Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-87048355. Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-87048355. Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:44.926481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:44.931802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:44.931802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:44.931802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:44.931802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:44.931802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:44.931802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:44.931802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-87048355. Oct 04 11:05:44.931802 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:44.933600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-876f1a0a-2f1d-4f10-a0da-517348b482f4 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Returning 400 to user: Invalid IP protocol tempest-999-87048355. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:44.934788 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-876f1a0a-2f1d-4f10-a0da-517348b482f4 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.076698 Oct 04 11:05:44.935871 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 817/1601] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:05:44 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:05:44.946570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:44.947535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:44.955581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:44.956322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:44.956996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:44.957998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:44.958634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:44.959239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:45.273787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:45.288618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:45.290195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:45.294307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-df7810d0-5bc0-4d1a-8333-eb478af3bbce tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.357220 Oct 04 11:05:45.294909 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 818/1602] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:44 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:45.306602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b9d1f7a-9dc4-4ab2-948b-b0d067cb7ccb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d4a18700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1477336201", "description": "tempest-description-1812026411"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:45.550933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b9d1f7a-9dc4-4ab2-948b-b0d067cb7ccb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.254930 Oct 04 11:05:45.562131 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 819/1603] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:05:45 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:45.570415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:45.571030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:45.587232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:45.587728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:45.588163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:45.588864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:45.590114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:45.590549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:45.699891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:05:45.888670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:45.919805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11c5f0c4-58be-4ab4-ad55-dd96ce97ee39 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.353870 Oct 04 11:05:45.922050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 820/1604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:45 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:45.931871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e2e340ed-8b95-467d-8c9d-f9c8ad61e8af tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d4615550>, body: {"security_group_rule": {"parent_group_id": "3505d8bf-926a-4c4a-8b8e-559406945b75", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:46.071751 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e2e340ed-8b95-467d-8c9d-f9c8ad61e8af tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e2e340ed-8b95-467d-8c9d-f9c8ad61e8af tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Request method failure captured: Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 138 Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBN97eAVpit6z3BZKyLF88o3Xj2UdLzho6vagS_KfS884RT2Qae-f3rawqdKtdNWupjq9E-fCCbkPx5gtFw5vIKWcwvZ4UDB4_nIysXC8cIRiE_oNauOILhVKMfyc5xiqiNEg-OTCm-2JZy94wBxHxvg7oTsQrPmUq4-zugFJxwQhAc Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88bc9e0f7a3649e3afbd65778a69430b"}]}] Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8d1fd3ed4358402990dcbb0a2355e771 Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: {"security_group_rule": {"parent_group_id": "3505d8bf-926a-4c4a-8b8e-559406945b75", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3505d8bf-926a-4c4a-8b8e-559406945b75', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 11:05:46.073864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 11:05:46.082700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:46.088744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e2e340ed-8b95-467d-8c9d-f9c8ad61e8af tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:46.090524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e2e340ed-8b95-467d-8c9d-f9c8ad61e8af tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.167252 Oct 04 11:05:46.091663 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 821/1605] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:05:45 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:05:46.097561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:46.099135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:46.109788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:46.110721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:46.111344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:46.112258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:46.113102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:46.114549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:46.131996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:05:46.132422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:05:46.132900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:05:46.133310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:05:46.135548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:05:46.148990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:46.149225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:46.149749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:46.150492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:46.150948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:46.151618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:46.178007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:05:46.182868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:05:46.203492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:05:46.208042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:05:46.227739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:46.243133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:46.246605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:46.261903 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b2cb260-2415-4633-b103-7a7362c22f1e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.168781 Oct 04 11:05:46.262801 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 822/1606] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:46 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:46.272091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:46.272756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:46.283232 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3360021-12a6-4506-bd96-ab3aaf611d2a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.627258 Oct 04 11:05:46.283424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:46.283856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:46.284269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:46.284986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:46.285617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:46.285925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:46.289971 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 785/1607] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:05:46.302726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4da6d38e-c6cb-4bc8-9b6f-572fa1b4d109 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d4618670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-499600563", "description": "tempest-description-978460198"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:46.305128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:46.604746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:46.623997 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f5e4259-56c9-4f0a-9f51-0f83854269b4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1477 microversion: 2.1 time: 0.353918 Oct 04 11:05:46.625659 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 823/1608] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:46 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1477 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:46.631787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c53288d5-758e-4f5d-9a78-c0496d1b2fb1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:46.636139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c53288d5-758e-4f5d-9a78-c0496d1b2fb1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:46.803406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c53288d5-758e-4f5d-9a78-c0496d1b2fb1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:46.810439 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c53288d5-758e-4f5d-9a78-c0496d1b2fb1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1217 microversion: 2.1 time: 0.183516 Oct 04 11:05:46.811525 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 824/1609] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:46 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:46.816339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:46.817806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:46.824958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:46.825714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:46.826318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:46.827208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:46.827869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:46.828474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:46.900277 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4da6d38e-c6cb-4bc8-9b6f-572fa1b4d109 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.602495 Oct 04 11:05:46.901291 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 786/1610] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:05:46 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:46.915228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7536162e-1540-47cb-9ef0-dba38ce41a36 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d470a670>, body: {"security_group_rule": {"parent_group_id": "43f6de18-90cb-4313-ad7f-6f3bcbedd036", "ip_protocol": "tcp", "from_port": 22, "to_port": 2045411336}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:47.221383 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7536162e-1540-47cb-9ef0-dba38ce41a36 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] HTTP exception thrown: Invalid port range 22:2045411336. Valid TCP ports should be between 1-65535 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7536162e-1540-47cb-9ef0-dba38ce41a36 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Request method failure captured: Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 146 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBN97eAVpit6z3BZKyLF88o3Xj2UdLzho6vagS_KfS884RT2Qae-f3rawqdKtdNWupjq9E-fCCbkPx5gtFw5vIKWcwvZ4UDB4_nIysXC8cIRiE_oNauOILhVKMfyc5xiqiNEg-OTCm-2JZy94wBxHxvg7oTsQrPmUq4-zugFJxwQhAc Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88bc9e0f7a3649e3afbd65778a69430b"}]}] Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 8d1fd3ed4358402990dcbb0a2355e771 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: {"security_group_rule": {"parent_group_id": "43f6de18-90cb-4313-ad7f-6f3bcbedd036", "ip_protocol": "tcp", "from_port": 22, "to_port": 2045411336}} Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid port range 22:2045411336. Valid TCP ports should be between 1-65535 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'security_group_rule': {'parent_group_id': '43f6de18-90cb-4313-ad7f-6f3bcbedd036', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2045411336}}} Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2045411336. Valid TCP ports should be between 1-65535 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2045411336. Valid TCP ports should be between 1-65535 Oct 04 11:05:47.227553 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2045411336. Valid TCP ports should be between 1-65535 Oct 04 11:05:47.233668 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.241108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7536162e-1540-47cb-9ef0-dba38ce41a36 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Returning 400 to user: Invalid port range 22:2045411336. Valid TCP ports should be between 1-65535 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:47.243893 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7536162e-1540-47cb-9ef0-dba38ce41a36 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.332057 Oct 04 11:05:47.253862 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 787/1611] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:05:46 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 344 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 11:05:47.274913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:47.282698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:47.289580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:47.294997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:47.295855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:47.296854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:47.298115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:47.299545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:47.361664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:47.385922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:47.388194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:47.393154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf95cc63-42d1-4806-b357-446b472b8011 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.576772 Oct 04 11:05:47.410235 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 825/1612] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:46 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:47.416149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51d10fb0-f7cb-4077-aac2-98ebe9886cbb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Action: 'create', calling method: .version_select at 0x7f71d46d9430>, body: {"security_group_rule": {"parent_group_id": "b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:47.533122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-51d10fb0-f7cb-4077-aac2-98ebe9886cbb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:05:47.534004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-51d10fb0-f7cb-4077-aac2-98ebe9886cbb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Neutron security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:05:47.534682 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-51d10fb0-f7cb-4077-aac2-98ebe9886cbb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] HTTP exception thrown: Security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 does not exist Oct 04 11:05:47.534682 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4337557f-322b-4ad4-b470-a635a36dfbe3'] Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51d10fb0-f7cb-4077-aac2-98ebe9886cbb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Request method failure captured: Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 138 Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBN97eAVpit6z3BZKyLF88o3Xj2UdLzho6vagS_KfS884RT2Qae-f3rawqdKtdNWupjq9E-fCCbkPx5gtFw5vIKWcwvZ4UDB4_nIysXC8cIRiE_oNauOILhVKMfyc5xiqiNEg-OTCm-2JZy94wBxHxvg7oTsQrPmUq4-zugFJxwQhAc Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88bc9e0f7a3649e3afbd65778a69430b"}]}] Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8d1fd3ed4358402990dcbb0a2355e771 Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: {"security_group_rule": {"parent_group_id": "b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 does not exist Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4337557f-322b-4ad4-b470-a635a36dfbe3'] Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:05:47.538316 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 does not exist Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4337557f-322b-4ad4-b470-a635a36dfbe3'] Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 does not exist Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4337557f-322b-4ad4-b470-a635a36dfbe3'] Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 does not exist Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4337557f-322b-4ad4-b470-a635a36dfbe3'] Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 does not exist Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4337557f-322b-4ad4-b470-a635a36dfbe3'] Oct 04 11:05:47.544372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.557929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51d10fb0-f7cb-4077-aac2-98ebe9886cbb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Returning 404 to user: Security group b73dce57-e9a2-4e37-bccb-bbc5bcbc7f16 does not exist Oct 04 11:05:47.557929 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4337557f-322b-4ad4-b470-a635a36dfbe3'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:47.559458 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51d10fb0-f7cb-4077-aac2-98ebe9886cbb tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.147899 Oct 04 11:05:47.560846 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 826/1613] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:05:47 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:05:47.567710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:47.568764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:47.578486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:47.580428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:47.581071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:47.582154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:47.583390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:47.584002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:47.637730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:47.658948 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1988d85b-0463-43dc-8861-f8ed2904cae8 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.399314 Oct 04 11:05:47.659951 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 788/1614] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:47 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:47.666271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33b9525f-a28d-408c-bc7d-fe628093c23c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Calling method '.version_select at 0x7f71d4617700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:47.701576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:47.713433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:47.714903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:47.720210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b55f7cff-999b-4455-bf71-fb1e87fdfb65 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1537 microversion: 2.91 time: 0.157813 Oct 04 11:05:47.720790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 827/1615] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:47 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1537 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:47.726829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:47.727985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:47.735351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:47.736124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:47.736808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:47.738055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:47.738802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:47.739455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:47.747038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-33b9525f-a28d-408c-bc7d-fe628093c23c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 does not exist", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:05:47.747721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.security_group_api [None req-33b9525f-a28d-408c-bc7d-fe628093c23c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Neutron security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 not found {{(pid=122408) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 11:05:47.748251 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-33b9525f-a28d-408c-bc7d-fe628093c23c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] HTTP exception thrown: Security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 does not exist Oct 04 11:05:47.748251 n-d-791135-8 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-50a4dcda-6b59-4982-9082-19aceb1c6973'] Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33b9525f-a28d-408c-bc7d-fe628093c23c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Request method failure captured: Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-security-group-rules/c41b2481-0897-4581-9acb-9eb8223d9dd1 HTTP/1.1 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBN97eAVpit6z3BZKyLF88o3Xj2UdLzho6vagS_KfS884RT2Qae-f3rawqdKtdNWupjq9E-fCCbkPx5gtFw5vIKWcwvZ4UDB4_nIysXC8cIRiE_oNauOILhVKMfyc5xiqiNEg-OTCm-2JZy94wBxHxvg7oTsQrPmUq4-zugFJxwQhAc Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88bc9e0f7a3649e3afbd65778a69430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88bc9e0f7a3649e3afbd65778a69430b"}]}] Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 88bc9e0f7a3649e3afbd65778a69430b Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 8d1fd3ed4358402990dcbb0a2355e771 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: exception: Security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 does not exist Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-50a4dcda-6b59-4982-9082-19aceb1c6973'] Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'c41b2481-0897-4581-9acb-9eb8223d9dd1'} Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:05:47.750286 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 does not exist Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50a4dcda-6b59-4982-9082-19aceb1c6973'] Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 does not exist Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50a4dcda-6b59-4982-9082-19aceb1c6973'] Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 does not exist Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50a4dcda-6b59-4982-9082-19aceb1c6973'] Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 does not exist Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50a4dcda-6b59-4982-9082-19aceb1c6973'] Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33b9525f-a28d-408c-bc7d-fe628093c23c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Returning 404 to user: Security group rule c41b2481-0897-4581-9acb-9eb8223d9dd1 does not exist Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: Neutron server returns request_ids: ['req-50a4dcda-6b59-4982-9082-19aceb1c6973'] {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33b9525f-a28d-408c-bc7d-fe628093c23c tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/c41b2481-0897-4581-9acb-9eb8223d9dd1" status: 404 len: 199 microversion: 2.1 time: 0.090227 Oct 04 11:05:47.759052 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 789/1616] 10.222.0.23 () {58 vars in 1287 bytes} [Tue Oct 4 11:05:47 2022] DELETE /compute/v2.1/os-security-group-rules/c41b2481-0897-4581-9acb-9eb8223d9dd1 => generated 199 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:05:47.764340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be68417c-6752-43d2-a99a-0bea76bf8c56 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Calling method '.version_select at 0x7f71d4555280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:48.088187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:48.097453 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82e70463-6196-4a1c-bbf8-01e89effbb5a tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1477 microversion: 2.1 time: 0.375278 Oct 04 11:05:48.110228 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 828/1617] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:47 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1477 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:48.122237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:48.123133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:48.130776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:48.131559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:48.132184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:48.133337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:48.133985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:48.134885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:48.237492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:48.247031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0bb5ddb-fe4c-44bd-b0f0-5851309de3c4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1269 microversion: 2.1 time: 0.131343 Oct 04 11:05:48.249970 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 829/1618] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:48 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:48.274888 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be68417c-6752-43d2-a99a-0bea76bf8c56 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/43f6de18-90cb-4313-ad7f-6f3bcbedd036" status: 202 len: 0 microversion: 2.1 time: 0.515124 Oct 04 11:05:48.275482 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 790/1619] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:05:47 2022] DELETE /compute/v2.1/os-security-groups/43f6de18-90cb-4313-ad7f-6f3bcbedd036 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:48.286552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3af9a854-f483-4067-b6fa-eac4859e3ac9 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Calling method '.version_select at 0x7f71d465aca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:48.428335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:48.430198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:48.443324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:48.448132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:48.448132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:48.452189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:48.452682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:48.453112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:48.667280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3af9a854-f483-4067-b6fa-eac4859e3ac9 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3505d8bf-926a-4c4a-8b8e-559406945b75" status: 202 len: 0 microversion: 2.1 time: 0.387361 Oct 04 11:05:48.667862 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 830/1620] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:05:48 2022] DELETE /compute/v2.1/os-security-groups/3505d8bf-926a-4c4a-8b8e-559406945b75 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:48.677226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e3939b2-169a-4d4e-95ca-c91cd0f0fd7b tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Calling method '.version_select at 0x7f71d4629700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:48.964820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:48.993064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:48.997743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:49.001154 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14fd1121-cf4a-43b6-8a48-afba8533510a tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.579849 Oct 04 11:05:49.002211 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 791/1621] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:48 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:49.023131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:49.023941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:49.039243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:49.040248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:49.041094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:49.042090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:49.042779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:49.044846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:49.099698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e3939b2-169a-4d4e-95ca-c91cd0f0fd7b tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/5ca7465d-b871-4d31-bef9-95b543cb2ceb" status: 202 len: 0 microversion: 2.1 time: 0.427331 Oct 04 11:05:49.101091 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 831/1622] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:05:48 2022] DELETE /compute/v2.1/os-security-groups/5ca7465d-b871-4d31-bef9-95b543cb2ceb => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:49.148007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:49.148640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:49.163662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:49.164174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:49.164622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:49.165389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:49.165844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:49.166283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:49.279996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:49.288728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:49.301514 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc48906f-4486-4fef-97bf-0b7aff120e01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.294350 Oct 04 11:05:49.304329 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 792/1623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:49 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:49.325535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fa10145-3fc8-4c5d-94be-2aeaf60913b5 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Calling method '.version_select at 0x7f71d44f6a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:49.361106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:49.380545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:49.385788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:49.405443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6779577-2130-4139-ab3a-2f936310797f tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1537 microversion: 2.91 time: 0.301886 Oct 04 11:05:49.407136 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 832/1624] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:49 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1537 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:49.420172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:49.423561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:49.436846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:49.437884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:49.438576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:49.439410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:49.440045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:49.440584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.204503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:50.215906 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-04355a24-5f1e-4a39-8926-fc9205c5c8d2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1477 microversion: 2.1 time: 0.807438 Oct 04 11:05:50.220114 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 833/1625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:49 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1477 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:50.225427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:50.226269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:50.232489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.233214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.233941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.234829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.235457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.236033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.330520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:50.346477 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5facb471-8cd4-4f87-8a7a-b7d832d422c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1275 microversion: 2.1 time: 0.124989 Oct 04 11:05:50.348166 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 834/1626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:50 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:50.355632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8b145fc7-3714-48b1-9247-5a2fca5d5d01 req-e519f8ef-ba8d-4a02-9b4f-c1dfc2b1325d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d278191-0937-47b3-bb59-4c40c4a98bda", "name": "network-vif-unplugged", "status": "completed", "tag": "db7d8832-93a3-4fdd-a30e-8d691ca33259"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:50.361755 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fa10145-3fc8-4c5d-94be-2aeaf60913b5 tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1d2f0679-675c-48e1-a236-d0e6fd68010f" status: 202 len: 0 microversion: 2.1 time: 1.056178 Oct 04 11:05:50.362365 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 793/1627] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:05:49 2022] DELETE /compute/v2.1/os-security-groups/1d2f0679-675c-48e1-a236-d0e6fd68010f => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:50.368553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:50.369478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:50.387825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.388334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.388854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.389627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8b145fc7-3714-48b1-9247-5a2fca5d5d01 req-e519f8ef-ba8d-4a02-9b4f-c1dfc2b1325d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.390643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.391084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.391508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.395222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8b145fc7-3714-48b1-9247-5a2fca5d5d01 req-e519f8ef-ba8d-4a02-9b4f-c1dfc2b1325d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.395222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8b145fc7-3714-48b1-9247-5a2fca5d5d01 req-e519f8ef-ba8d-4a02-9b4f-c1dfc2b1325d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.415588 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8b145fc7-3714-48b1-9247-5a2fca5d5d01 req-e519f8ef-ba8d-4a02-9b4f-c1dfc2b1325d service nova] Creating event network-vif-unplugged:db7d8832-93a3-4fdd-a30e-8d691ca33259 for instance 9d278191-0937-47b3-bb59-4c40c4a98bda on n-h1-791135-8 Oct 04 11:05:50.422573 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8b145fc7-3714-48b1-9247-5a2fca5d5d01 req-e519f8ef-ba8d-4a02-9b4f-c1dfc2b1325d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072608 Oct 04 11:05:50.423944 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 835/1628] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:50.443520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:50.444797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:50.452289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.453202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.453960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.455050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.455749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.456801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.793399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:50.806959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:50.809092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:50.810305 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2da88fab-79a6-41cd-a648-a75789141b0b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.447000 Oct 04 11:05:50.829796 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 794/1629] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:50 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:50.843127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4a99024-c088-421e-8f74-36dbfae1342f tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] Calling method '.version_select at 0x7f71d4480040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:50.883334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:50.899518 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e29d14ae-8548-4a6e-aa04-b844458173ef tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.474078 Oct 04 11:05:50.919951 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 836/1630] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:50 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:50.933716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:50.934630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:50.946394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.947456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.949140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:50.950600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:50.951382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:50.952011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.085862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:51.095710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:51.098383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:51.108617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0a4c825-2456-4e39-9507-49320eb2b7d7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1480 microversion: 2.91 time: 0.182967 Oct 04 11:05:51.109968 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 837/1631] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:50 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1480 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:51.138589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:51.141662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:51.148879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.149943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.150485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.151313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.152026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.152551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.233650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-791135-8". {{(pid=122409) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 11:05:51.340312 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13b5378b-6c5d-42ee-b121-4c6ef5b026f7 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe/action" status: 202 len: 0 microversion: 2.91 time: 0.205196 Oct 04 11:05:51.347311 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 838/1632] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:05:51 2022] POST /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:05:51.359612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:51.361920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:51.378205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.382269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.382923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.383907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.384642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.385374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.613402 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4a99024-c088-421e-8f74-36dbfae1342f tempest-SecurityGroupRulesNegativeTestJSON-2088107918 tempest-SecurityGroupRulesNegativeTestJSON-2088107918-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6130459d-ef3c-414a-86d9-948abd909129" status: 202 len: 0 microversion: 2.1 time: 0.778913 Oct 04 11:05:51.615532 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 795/1633] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:05:50 2022] DELETE /compute/v2.1/os-security-groups/6130459d-ef3c-414a-86d9-948abd909129 => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:05:51.626717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:51.628011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:51.644489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.648461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.650788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.652467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.653617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.654552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.685137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:51.697069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c1d0341-b4b8-4cdc-ae86-099af4ecb949 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1477 microversion: 2.1 time: 0.344854 Oct 04 11:05:51.717455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 839/1634] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:51 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1477 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:51.727512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:51.730980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:51.746974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.751577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.753070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.755195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.757303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.761822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.824835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:51.860785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:51.867557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:51.881767 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-077dc586-5f00-4718-8be3-81bc1a357e8a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1488 microversion: 2.91 time: 0.264584 Oct 04 11:05:51.906173 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 796/1635] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:51 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1488 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:51.918840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:51.924002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:51.938453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.940734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.942591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:51.943559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:51.945811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:51.947871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:52.686055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:52.701546 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02b38f81-2984-468d-85a5-d43dbf15100c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.982704 Oct 04 11:05:52.705792 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 840/1636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:51 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:52.721981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:52.723029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:52.815762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:52.828354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:52.836766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:52.857671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:52.858508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:52.859193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:52.860082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:53.038791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:53.055361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:53.057940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:53.064423 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca122cb7-0b9f-4dae-9ae2-3411c4bf6037 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.156017 Oct 04 11:05:53.066246 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 797/1637] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:51 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:53.075364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3164b181-ea64-44f9-b74b-6b5bf05697fe req-845f4595-fe16-417e-a695-4459192a5389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d278191-0937-47b3-bb59-4c40c4a98bda", "name": "network-vif-plugged", "status": "completed", "tag": "db7d8832-93a3-4fdd-a30e-8d691ca33259"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:53.102512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3164b181-ea64-44f9-b74b-6b5bf05697fe req-845f4595-fe16-417e-a695-4459192a5389 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:53.104681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3164b181-ea64-44f9-b74b-6b5bf05697fe req-845f4595-fe16-417e-a695-4459192a5389 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:53.107019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3164b181-ea64-44f9-b74b-6b5bf05697fe req-845f4595-fe16-417e-a695-4459192a5389 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:53.158653 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3164b181-ea64-44f9-b74b-6b5bf05697fe req-845f4595-fe16-417e-a695-4459192a5389 service nova] Creating event network-vif-plugged:db7d8832-93a3-4fdd-a30e-8d691ca33259 for instance 9d278191-0937-47b3-bb59-4c40c4a98bda on n-h1-791135-8 Oct 04 11:05:53.166633 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3164b181-ea64-44f9-b74b-6b5bf05697fe req-845f4595-fe16-417e-a695-4459192a5389 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098147 Oct 04 11:05:53.168305 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 798/1638] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:53.171152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:53.174033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:53.174924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:53.181711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:53.182588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:53.183204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:53.184088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:53.184901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:53.185547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:53.190670 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dee43acd-4e16-413b-abf7-3a76835a021e tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.483515 Oct 04 11:05:53.197516 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 841/1639] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:52 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:53.223852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:53.236694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:53.266882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:53.267616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:53.268353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:53.269370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:53.270403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:53.272091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:53.574974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:53.590098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:53.591665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:53.610000 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a30fdc06-70b1-4196-9c6f-22dabdf848f2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.410516 Oct 04 11:05:53.622481 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 842/1640] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:53 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:53.646529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:53.655333 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01b7bc1a-73ec-4cd5-9c44-1956bfcb454b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1477 microversion: 2.1 time: 0.485633 Oct 04 11:05:53.656759 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 799/1641] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:53 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:53.739650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:53.740363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:53.759329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:53.760503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:53.761022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:53.766583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:53.767174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:53.767682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:53.780244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:54.095381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:54.097289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:54.098951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:54.107625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:54.108490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:54.109110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:54.109868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:54.110179 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5dc8806e-1fbe-462d-8ca3-a603462d3786 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.381933 Oct 04 11:05:54.111083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:54.111770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:54.112015 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 843/1642] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:53 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:54.226951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:54.228213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:54.241671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:54.243397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:54.244101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:54.245899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:54.246608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:54.247444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:54.525808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:54.546562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:54.548101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:54.549456 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d66e5ed-8412-4872-b1ab-c8d35fdd0aa1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.456808 Oct 04 11:05:54.550222 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 800/1643] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:54 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:54.584832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:54.593803 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d576c8bf-9712-44ee-a6ae-5586a11e7e08 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.373973 Oct 04 11:05:54.593803 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 844/1644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:54 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:54.651228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:54.652135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:54.663375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:54.663880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:54.664321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:54.665042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:54.665534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:54.670294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:54.683135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:54.683862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:54.709894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:54.710570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:54.711116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:54.711714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:54.712211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:54.712639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:54.963692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:54.975398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:54.983827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:55.001555 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa3362c2-3220-4ab0-805d-1481461c51b1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.353429 Oct 04 11:05:55.004104 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 801/1645] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:54 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:55.145745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:55.149132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:55.173503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:55.174009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:55.175380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:55.192490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:55.199089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:55.199726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:55.201745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:55.226810 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfc4a188-f753-4d92-a4ce-6c1fbd614fbe tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1477 microversion: 2.1 time: 0.548222 Oct 04 11:05:55.231178 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 845/1646] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:54 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1477 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:55.258351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1799777c-3ce7-45cc-9230-9b9fee932c0f req-c2b41b5e-a673-4d34-b38b-684f719722af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1976caef-e757-4301-a92b-66d06d09fc3b", "tag": "dd891def-01c0-4d99-9aee-31340fccf0a0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:55.313067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1799777c-3ce7-45cc-9230-9b9fee932c0f req-c2b41b5e-a673-4d34-b38b-684f719722af service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:55.314002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1799777c-3ce7-45cc-9230-9b9fee932c0f req-c2b41b5e-a673-4d34-b38b-684f719722af service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:55.317942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1799777c-3ce7-45cc-9230-9b9fee932c0f req-c2b41b5e-a673-4d34-b38b-684f719722af service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:55.392966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1799777c-3ce7-45cc-9230-9b9fee932c0f req-c2b41b5e-a673-4d34-b38b-684f719722af service nova] Creating event network-changed:dd891def-01c0-4d99-9aee-31340fccf0a0 for instance 1976caef-e757-4301-a92b-66d06d09fc3b on n-h2-791135-8 Oct 04 11:05:55.415587 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1799777c-3ce7-45cc-9230-9b9fee932c0f req-c2b41b5e-a673-4d34-b38b-684f719722af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183014 Oct 04 11:05:55.417436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 846/1647] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:55.448117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d9e97e20-a13b-40e5-8dbb-94923eb4a8a5 req-95d89df8-5662-4de4-a7f6-630f815ee758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628b765d-b4cf-4a47-b151-9414fc1934a0", "name": "network-vif-plugged", "status": "completed", "tag": "197d9c40-744c-4f59-9b1b-41cad82ecf0d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:55.508504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d9e97e20-a13b-40e5-8dbb-94923eb4a8a5 req-95d89df8-5662-4de4-a7f6-630f815ee758 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:55.508504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d9e97e20-a13b-40e5-8dbb-94923eb4a8a5 req-95d89df8-5662-4de4-a7f6-630f815ee758 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:55.508504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d9e97e20-a13b-40e5-8dbb-94923eb4a8a5 req-95d89df8-5662-4de4-a7f6-630f815ee758 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:55.575141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d9e97e20-a13b-40e5-8dbb-94923eb4a8a5 req-95d89df8-5662-4de4-a7f6-630f815ee758 service nova] Creating event network-vif-plugged:197d9c40-744c-4f59-9b1b-41cad82ecf0d for instance 628b765d-b4cf-4a47-b151-9414fc1934a0 on n-h1-791135-8 Oct 04 11:05:55.610804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d9e97e20-a13b-40e5-8dbb-94923eb4a8a5 req-95d89df8-5662-4de4-a7f6-630f815ee758 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191637 Oct 04 11:05:55.613871 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 847/1648] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:55.659390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:55.665574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:55.695661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:55.698704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:55.701170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:55.702223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:55.709694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:55.710559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:56.105496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:56.115893 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f90aadd7-75b5-446f-b926-c6a93471b149 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.979650 Oct 04 11:05:56.117053 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 802/1649] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:55 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:56.137829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:56.138501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:56.153629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:56.154251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:56.154608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:56.155359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:56.155821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:56.156245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:56.173801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:56.199690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:56.810773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:05:56.930190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:56.939927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:56.950308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:56.951830 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f4bd59c-93b4-414c-9073-e3e96b3e8812 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.327306 Oct 04 11:05:56.952589 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 848/1650] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:55 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:56.966361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:56.974243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:57.001070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.001601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.003027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:57.006021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.007880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.010104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.013131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.019905 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7616dcf-e68f-45a6-86f4-07026c15d1e6 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1294 microversion: 2.1 time: 0.890331 Oct 04 11:05:57.020875 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 803/1651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:56 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1294 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:57.037561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:57.038656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:57.058106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.062054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.062755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.063672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.073904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.076084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.409489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:57.425197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:57.436424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:57.455069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5d16f3a-1cbc-4a5b-8f69-0ec692d86602 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.492458 Oct 04 11:05:57.461115 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 849/1652] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:56 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:57.479482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:57.481883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:57.507527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.508040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.510491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.528657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.531418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.533123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.805404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:57.823996 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4eef198d-b517-4d70-a761-3ff32790e6e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1463 microversion: 2.1 time: 0.798237 Oct 04 11:05:57.827086 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 804/1653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:57 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1463 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:57.833454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-335b0f4e-11e7-4986-b1bb-9d90fc0e4fa0 req-9e1d2713-f317-4e8c-95f0-e317a284c75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-plugged", "status": "completed", "tag": "e7349ae7-773f-4e2b-ab5a-79cbcf7c41eb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:57.882515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-335b0f4e-11e7-4986-b1bb-9d90fc0e4fa0 req-9e1d2713-f317-4e8c-95f0-e317a284c75d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.883001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-335b0f4e-11e7-4986-b1bb-9d90fc0e4fa0 req-9e1d2713-f317-4e8c-95f0-e317a284c75d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.906977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-335b0f4e-11e7-4986-b1bb-9d90fc0e4fa0 req-9e1d2713-f317-4e8c-95f0-e317a284c75d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.952887 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-335b0f4e-11e7-4986-b1bb-9d90fc0e4fa0 req-9e1d2713-f317-4e8c-95f0-e317a284c75d service nova] Creating event network-vif-plugged:e7349ae7-773f-4e2b-ab5a-79cbcf7c41eb for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:05:57.963171 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-335b0f4e-11e7-4986-b1bb-9d90fc0e4fa0 req-9e1d2713-f317-4e8c-95f0-e317a284c75d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134945 Oct 04 11:05:57.964343 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 805/1654] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:05:57.966320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:57.971623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:57.975515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:57.978604 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a2c11ab-e2ee-4f80-a43f-f5b485faea21 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.515931 Oct 04 11:05:57.982863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.983653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.984320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.985258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:57.985980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:57.986633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:57.991694 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 850/1655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:57 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:58.008127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:58.009538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:58.020746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.021789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.023343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.030523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.031243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.032415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.433769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:58.447827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:58.450892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:58.452419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e24b449a-2dbf-4670-baba-f0761620d397 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 0.459323 Oct 04 11:05:58.459660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:58.474438 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6e0bf1e-d4c0-454a-b017-013bfffe9957 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1463 microversion: 2.1 time: 0.504080 Oct 04 11:05:58.475400 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 806/1656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:57 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1463 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:58.478933 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 851/1657] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:57 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:58.486224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:58.490192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:58.500235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:58.501330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:58.505485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.506000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.506633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.509619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.510159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.510642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.510790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.511472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.512160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.513109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.513802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.514439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.677503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:58.697786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:58.703533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:58.718926 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3232100-1122-4109-9fc7-e1be7e71fe56 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.232058 Oct 04 11:05:58.720878 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 852/1658] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:05:58 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:05:58.727328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:05:58.730736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:58.737236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.738231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.738942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.739944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.740690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.741392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.854040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:05:58.854941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:05:58.856324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:05:58.856771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:05:58.857251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:05:58.877499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:05:58.889423 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8001ee0-1044-4c8a-9f33-820eaea8638f tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1485 microversion: 2.1 time: 0.411888 Oct 04 11:05:58.894744 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 807/1659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:58 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1485 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:05:58.918214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:58.919066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:58.937111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.939419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.944363 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.945439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:58.946088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:58.946691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:58.987262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:59.003887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:59.004841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:59.005283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:59.006134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:59.006622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:59.007055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:59.061591 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2146be35-8e5d-4312-a774-e9c839708348 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action" status: 202 len: 1067 microversion: 2.1 time: 0.339185 Oct 04 11:05:59.062250 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 853/1660] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:05:58 2022] POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action => generated 1067 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 11:05:59.075900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:59.076983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:59.084620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:59.085559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:59.086273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:59.087221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:59.087909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:59.088568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:59.154543 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0424afb-56cc-4a96-b747-780420ebc1c1 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.240789 Oct 04 11:05:59.155148 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 808/1661] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:05:58 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0/os-interface => generated 285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:05:59.160693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:05:59.161585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:05:59.185122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:59.187169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:59.188531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:05:59.192049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:05:59.200232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:05:59.200910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:00.138490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:00.148288 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1bf571cc-96f4-429b-9368-fe8dfc949039 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.991795 Oct 04 11:06:00.155069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:00.181292 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 809/1662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:59 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:00.183804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd3e1176-5787-4fc2-af9b-fbb476ed3dd8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 1.114041 Oct 04 11:06:00.191983 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 854/1663] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:05:59 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:00.197606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:00.198243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:00.203128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:00.203746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:00.217437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:00.217936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:00.218379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:00.219101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:00.219557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:00.219986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:00.230765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:00.231275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:00.231713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:00.232435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:00.232901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:00.233334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:00.439068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:00.468593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:00.470915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:00.478428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00bc9950-9bd6-48a3-bef2-b4f016373cfb tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.285013 Oct 04 11:06:00.506518 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 855/1664] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:00 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:00.513906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-899b6fc1-d0d5-4080-98d5-873d11d3e89e req-727b6666-050a-4b7d-bda2-ef29c35d9aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-plugged", "status": "completed", "tag": "b88d59fb-34d8-4876-b140-ab257f0d6a64"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:00.538040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-899b6fc1-d0d5-4080-98d5-873d11d3e89e req-727b6666-050a-4b7d-bda2-ef29c35d9aca service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:00.538869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-899b6fc1-d0d5-4080-98d5-873d11d3e89e req-727b6666-050a-4b7d-bda2-ef29c35d9aca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:00.542047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-899b6fc1-d0d5-4080-98d5-873d11d3e89e req-727b6666-050a-4b7d-bda2-ef29c35d9aca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:00.590647 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-899b6fc1-d0d5-4080-98d5-873d11d3e89e req-727b6666-050a-4b7d-bda2-ef29c35d9aca service nova] Creating event network-vif-plugged:b88d59fb-34d8-4876-b140-ab257f0d6a64 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:06:00.604780 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-899b6fc1-d0d5-4080-98d5-873d11d3e89e req-727b6666-050a-4b7d-bda2-ef29c35d9aca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091752 Oct 04 11:06:00.607218 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 856/1665] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:01.187688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:01.189378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:01.215110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:01.241542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:01.242004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:01.242959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:01.244222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:01.255078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:01.630329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:01.647415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:01.667517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:01.669193 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-502148bc-fd9e-4403-830a-370004eee643 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.486561 Oct 04 11:06:01.676727 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 810/1666] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:00 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:01.691033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:01.694334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:01.715761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:01.720687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:01.721492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:01.722579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:01.727592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:01.728532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:02.588019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:02.601085 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-606192c7-0dcd-478e-8098-29089d5282be tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 1.416072 Oct 04 11:06:02.620720 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 857/1667] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:01 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:02.632402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:02.635281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:02.654921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:02.655996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:02.656660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:02.657636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:02.658332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:02.659016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:03.002931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:03.018337 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0619e588-43d6-4757-a8ae-3650a837cbc2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 1.328372 Oct 04 11:06:03.038444 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 811/1668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:01 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:03.065322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:03.074420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:03.108802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:03.111664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:03.112404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:03.121219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:03.123373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:03.124579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:03.637843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:03.646948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:03.675565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:03.719685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ebd3535b-8757-4f4f-b423-ec3ac56e2614 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 1.096255 Oct 04 11:06:03.751229 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 858/1669] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:02 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:03.765168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0427cac6-1c59-4a72-9213-28b3634663ba req-cdda752d-ca92-419d-b1c1-c3a4b2c73493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-plugged", "status": "completed", "tag": "e9423bf4-7a84-4511-a3b6-3c607d86bde1"}, {"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-plugged", "status": "completed", "tag": "b3a2f117-dbc4-4c90-9ddf-05e06c43e6b6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:03.815993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0427cac6-1c59-4a72-9213-28b3634663ba req-cdda752d-ca92-419d-b1c1-c3a4b2c73493 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:03.817965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0427cac6-1c59-4a72-9213-28b3634663ba req-cdda752d-ca92-419d-b1c1-c3a4b2c73493 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:03.819522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0427cac6-1c59-4a72-9213-28b3634663ba req-cdda752d-ca92-419d-b1c1-c3a4b2c73493 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:03.848609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0427cac6-1c59-4a72-9213-28b3634663ba req-cdda752d-ca92-419d-b1c1-c3a4b2c73493 service nova] Creating event network-vif-plugged:e9423bf4-7a84-4511-a3b6-3c607d86bde1 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:06:03.867698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0427cac6-1c59-4a72-9213-28b3634663ba req-cdda752d-ca92-419d-b1c1-c3a4b2c73493 service nova] Creating event network-vif-plugged:b3a2f117-dbc4-4c90-9ddf-05e06c43e6b6 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:06:03.875071 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0427cac6-1c59-4a72-9213-28b3634663ba req-cdda752d-ca92-419d-b1c1-c3a4b2c73493 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.122111 Oct 04 11:06:03.878149 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 859/1670] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:03.921322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:03.923092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:03.950088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:03.951730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:03.952357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:03.955674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:03.956360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:03.957674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:04.017504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:05.442209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:05.457310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:05.463853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:05.466180 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-78bbffd5-8e23-42e9-9d63-14480607ef9e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 2.425056 Oct 04 11:06:05.466959 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 812/1671] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:03 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 2427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:05.472027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:05.474745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:05.481106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:05.481867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:05.482932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:05.484104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:05.484891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:05.485525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:05.491001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:05.828502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:05.836599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-528415b2-4ff4-4029-9471-1720cc3d3d95 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 1.953712 Oct 04 11:06:05.845504 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 860/1672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:03 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:05.933167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:05.941994 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d68b6560-ba99-4279-ab50-04606535de8e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.473017 Oct 04 11:06:05.946120 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 813/1673] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:05 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:05.957667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:05.958563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:05.981190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:05.982020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:05.984063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:05.985415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:05.993502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:05.994240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:06.317039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:06.332728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:06.336619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:06.352751 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b46478e8-5362-4419-8ed6-745d84479c7d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.404313 Oct 04 11:06:06.356046 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 814/1674] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:05 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:06.372440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f1918c7f-260f-4163-9d02-1de16201c44f req-e8a4a7e1-49eb-44f2-9e3a-63538a1f18df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-plugged", "status": "completed", "tag": "5414b7fc-31df-462b-b968-1450587a3ef8"}, {"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-plugged", "status": "completed", "tag": "c3fdccff-9fdc-4892-b028-ab3882d9278a"}, {"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-plugged", "status": "completed", "tag": "3b9ced07-b4bf-4318-8dc4-527be99dccbd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:06.402729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f1918c7f-260f-4163-9d02-1de16201c44f req-e8a4a7e1-49eb-44f2-9e3a-63538a1f18df service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:06.403825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f1918c7f-260f-4163-9d02-1de16201c44f req-e8a4a7e1-49eb-44f2-9e3a-63538a1f18df service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:06.407225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f1918c7f-260f-4163-9d02-1de16201c44f req-e8a4a7e1-49eb-44f2-9e3a-63538a1f18df service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:06.460499 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f1918c7f-260f-4163-9d02-1de16201c44f req-e8a4a7e1-49eb-44f2-9e3a-63538a1f18df service nova] Creating event network-vif-plugged:5414b7fc-31df-462b-b968-1450587a3ef8 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:06:06.461862 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f1918c7f-260f-4163-9d02-1de16201c44f req-e8a4a7e1-49eb-44f2-9e3a-63538a1f18df service nova] Creating event network-vif-plugged:c3fdccff-9fdc-4892-b028-ab3882d9278a for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:06:06.464102 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f1918c7f-260f-4163-9d02-1de16201c44f req-e8a4a7e1-49eb-44f2-9e3a-63538a1f18df service nova] Creating event network-vif-plugged:3b9ced07-b4bf-4318-8dc4-527be99dccbd for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:06:06.480756 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f1918c7f-260f-4163-9d02-1de16201c44f req-e8a4a7e1-49eb-44f2-9e3a-63538a1f18df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.119504 Oct 04 11:06:06.484340 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 815/1675] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:06.492765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f705313-fdc1-4c2f-be34-c3659dddf004 tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] Calling method '.version_select at 0x7f71d48a9dc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:06.501495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:06.505762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:06.525039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:06.525965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:06.530266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:06.531320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:06.532717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:06.534582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:06.719008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6f705313-fdc1-4c2f-be34-c3659dddf004 tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.872015 Oct 04 11:06:06.726897 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 861/1676] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 11:06:05 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:06:06.735630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a03e5f4e-4d57-46f2-99f9-5535bf9ddf2b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] Action: 'create', calling method: .version_select at 0x7f71d48d3670>, body: {"pool": "non_exist_pool"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:07.028730 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a03e5f4e-4d57-46f2-99f9-5535bf9ddf2b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] HTTP exception thrown: Floating IP pool not found. Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a03e5f4e-4d57-46f2-99f9-5535bf9ddf2b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] Request method failure captured: Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 26 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBOcm8gWKucl85fELerisRvwDzr6m-YhIghyOzlTEioirKOGRhwjQ083ZcaIa4gAuQopJXxwrxwg9SRZQfLj9tTUhT8l0Poxq3ksYtz2vTs86iiddS46IgvL7PXUBKPQryMdSUfX8uBjGMCYmsMfmYNQ9tuKUYQoXbP3FxBb2-qGYj0 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a625e19fd38f47c3b4523641b967ad7a Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1769894766 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a625e19fd38f47c3b4523641b967ad7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a625e19fd38f47c3b4523641b967ad7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a625e19fd38f47c3b4523641b967ad7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a625e19fd38f47c3b4523641b967ad7a"}]}] Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1769894766 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a625e19fd38f47c3b4523641b967ad7a Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1769894766 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsNegativeTestJSON-1769894766-project Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f294c59ca39849c08e5abb2fa9242424 Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1769894766-project Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: {"pool": "non_exist_pool"} Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: exception: Floating IP pool not found. Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:06:07.031645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:06:07.037028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 11:06:07.037028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:07.039030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a03e5f4e-4d57-46f2-99f9-5535bf9ddf2b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] Returning 404 to user: Floating IP pool not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:06:07.040494 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a03e5f4e-4d57-46f2-99f9-5535bf9ddf2b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.310851 Oct 04 11:06:07.041688 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 862/1677] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:06:06 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:06:07.056338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:07.057482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:07.090374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:07.091247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:07.091947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:07.092985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:07.100114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:07.103790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:08.281919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:08.299162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:08.300901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:08.307410 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-702dadd3-91e3-45f3-b9d5-bab6115cc7ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.813273 Oct 04 11:06:08.320736 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 816/1678] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:06 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:08.332779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:08.333550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:08.343241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:08.345789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:08.346324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:08.347247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:08.349904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:08.352859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:08.364221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:08.385212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1b0e20c-dd62-40f5-9bfa-c9fc6314b69c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 1.341809 Oct 04 11:06:08.387661 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 863/1679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:07 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:08.399130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e3cd8c2-c14f-4640-aa3e-b9b35f4a0d3b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] Calling method '.version_select at 0x7f71d440ef70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:08.509342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-0e3cd8c2-c14f-4640-aa3e-b9b35f4a0d3b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 403c3a8a-5210-4944-a231-8d8168b39282 could not be found", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:06:08.510838 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0e3cd8c2-c14f-4640-aa3e-b9b35f4a0d3b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] HTTP exception thrown: Floating IP not found for ID 403c3a8a-5210-4944-a231-8d8168b39282 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e3cd8c2-c14f-4640-aa3e-b9b35f4a0d3b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] Request method failure captured: Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-floating-ips/403c3a8a-5210-4944-a231-8d8168b39282 HTTP/1.1 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBOcm8gWKucl85fELerisRvwDzr6m-YhIghyOzlTEioirKOGRhwjQ083ZcaIa4gAuQopJXxwrxwg9SRZQfLj9tTUhT8l0Poxq3ksYtz2vTs86iiddS46IgvL7PXUBKPQryMdSUfX8uBjGMCYmsMfmYNQ9tuKUYQoXbP3FxBb2-qGYj0 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a625e19fd38f47c3b4523641b967ad7a Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1769894766 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a625e19fd38f47c3b4523641b967ad7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a625e19fd38f47c3b4523641b967ad7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a625e19fd38f47c3b4523641b967ad7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a625e19fd38f47c3b4523641b967ad7a"}]}] Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1769894766 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a625e19fd38f47c3b4523641b967ad7a Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1769894766 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsNegativeTestJSON-1769894766-project Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f294c59ca39849c08e5abb2fa9242424 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1769894766-project Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: exception: Floating IP not found for ID 403c3a8a-5210-4944-a231-8d8168b39282 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '403c3a8a-5210-4944-a231-8d8168b39282'} Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 403c3a8a-5210-4944-a231-8d8168b39282 could not be found Oct 04 11:06:08.512837 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afe1412a-1371-48af-9ce1-741d23ac1c5d'] Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 403c3a8a-5210-4944-a231-8d8168b39282. Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 403c3a8a-5210-4944-a231-8d8168b39282 Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 403c3a8a-5210-4944-a231-8d8168b39282 Oct 04 11:06:08.518053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:06:08.523289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e3cd8c2-c14f-4640-aa3e-b9b35f4a0d3b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] Returning 404 to user: Floating IP not found for ID 403c3a8a-5210-4944-a231-8d8168b39282 {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:06:08.524358 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e3cd8c2-c14f-4640-aa3e-b9b35f4a0d3b tempest-FloatingIPsNegativeTestJSON-1769894766 tempest-FloatingIPsNegativeTestJSON-1769894766-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/403c3a8a-5210-4944-a231-8d8168b39282" status: 404 len: 111 microversion: 2.1 time: 0.134768 Oct 04 11:06:08.526214 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 864/1680] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:06:08 2022] DELETE /compute/v2.1/os-floating-ips/403c3a8a-5210-4944-a231-8d8168b39282 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:06:08.536696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:08.542607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:08.571591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:08.575590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:08.577965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:08.580855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:08.583163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:08.586055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:08.666974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:08.681697 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49a3da41-71a6-4623-89e4-81aa4e3d8f7f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.359499 Oct 04 11:06:08.684133 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 817/1681] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:08 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:08.814604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:08.831290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:08.836523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:08.855649 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64ca7d19-3f05-49b6-bebe-1ed3ab4abf05 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.325082 Oct 04 11:06:08.856477 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 865/1682] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:08 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:08.870580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:08.871197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:08.885518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:08.886027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:08.886468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:08.887202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:08.887638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:08.888089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:08.992969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8bdeab17-78ad-4420-bb3b-55fb40ec2742 tempest-AZV2TestJSON-1696596987 tempest-AZV2TestJSON-1696596987-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:08.998446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bdeab17-78ad-4420-bb3b-55fb40ec2742 tempest-AZV2TestJSON-1696596987 tempest-AZV2TestJSON-1696596987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:09.000135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bdeab17-78ad-4420-bb3b-55fb40ec2742 tempest-AZV2TestJSON-1696596987 tempest-AZV2TestJSON-1696596987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:09.000605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bdeab17-78ad-4420-bb3b-55fb40ec2742 tempest-AZV2TestJSON-1696596987 tempest-AZV2TestJSON-1696596987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:09.001425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bdeab17-78ad-4420-bb3b-55fb40ec2742 tempest-AZV2TestJSON-1696596987 tempest-AZV2TestJSON-1696596987-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:09.006046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bdeab17-78ad-4420-bb3b-55fb40ec2742 tempest-AZV2TestJSON-1696596987 tempest-AZV2TestJSON-1696596987-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:09.006543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bdeab17-78ad-4420-bb3b-55fb40ec2742 tempest-AZV2TestJSON-1696596987 tempest-AZV2TestJSON-1696596987-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:09.104620 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8bdeab17-78ad-4420-bb3b-55fb40ec2742 tempest-AZV2TestJSON-1696596987 tempest-AZV2TestJSON-1696596987-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.419040 Oct 04 11:06:09.107470 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 818/1683] 10.222.0.23 () {58 vars in 1164 bytes} [Tue Oct 4 11:06:08 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:06:09.149999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d940c446-db7d-409d-aab0-e27842d40678 req-ed2789b5-3ebb-4e7c-a540-0c8be997c31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628b765d-b4cf-4a47-b151-9414fc1934a0", "tag": "197d9c40-744c-4f59-9b1b-41cad82ecf0d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:09.182450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d940c446-db7d-409d-aab0-e27842d40678 req-ed2789b5-3ebb-4e7c-a540-0c8be997c31a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:09.184551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d940c446-db7d-409d-aab0-e27842d40678 req-ed2789b5-3ebb-4e7c-a540-0c8be997c31a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:09.186661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d940c446-db7d-409d-aab0-e27842d40678 req-ed2789b5-3ebb-4e7c-a540-0c8be997c31a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:09.234489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:09.239977 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d940c446-db7d-409d-aab0-e27842d40678 req-ed2789b5-3ebb-4e7c-a540-0c8be997c31a service nova] Creating event network-changed:197d9c40-744c-4f59-9b1b-41cad82ecf0d for instance 628b765d-b4cf-4a47-b151-9414fc1934a0 on n-h1-791135-8 Oct 04 11:06:09.261903 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d940c446-db7d-409d-aab0-e27842d40678 req-ed2789b5-3ebb-4e7c-a540-0c8be997c31a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126426 Oct 04 11:06:09.263270 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 819/1684] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:09.274429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1a235a31-a302-40e2-a2ad-e1306df86222 req-43895963-6d2f-4332-8aa5-9d03934e05df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1976caef-e757-4301-a92b-66d06d09fc3b", "name": "network-vif-plugged", "status": "completed", "tag": "dd891def-01c0-4d99-9aee-31340fccf0a0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:09.286279 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c837c9af-3984-4756-9b3e-aba3c1d9fd40 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1485 microversion: 2.1 time: 0.428844 Oct 04 11:06:09.290652 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 866/1685] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:08 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1485 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:09.312589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a235a31-a302-40e2-a2ad-e1306df86222 req-43895963-6d2f-4332-8aa5-9d03934e05df service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:09.324081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a235a31-a302-40e2-a2ad-e1306df86222 req-43895963-6d2f-4332-8aa5-9d03934e05df service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:09.328581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1a235a31-a302-40e2-a2ad-e1306df86222 req-43895963-6d2f-4332-8aa5-9d03934e05df service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:09.351153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:09.352094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:09.363679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:09.364549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:09.366275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:09.367294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:09.378343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:09.379628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:09.388430 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1a235a31-a302-40e2-a2ad-e1306df86222 req-43895963-6d2f-4332-8aa5-9d03934e05df service nova] Creating event network-vif-plugged:dd891def-01c0-4d99-9aee-31340fccf0a0 for instance 1976caef-e757-4301-a92b-66d06d09fc3b on n-h2-791135-8 Oct 04 11:06:09.394153 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1a235a31-a302-40e2-a2ad-e1306df86222 req-43895963-6d2f-4332-8aa5-9d03934e05df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129262 Oct 04 11:06:09.407436 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 820/1686] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:09.416581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:09.434722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:09.464190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:09.464704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:09.465166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:09.478639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:09.480449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:09.480909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:10.392555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:10.425017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:10.434928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:10.444078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b6555e9-c3e0-4aac-bed4-8364c1602cab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1874 microversion: 2.42 time: 1.100939 Oct 04 11:06:10.444790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 867/1687] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:09 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1874 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:10.474550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:10.475204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:10.515284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:10.515787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:10.516224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:10.526460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:10.528329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:10.529413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:10.535489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:10.546160 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-237b856c-3552-43ec-bec0-048b4465bb45 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 1.133989 Oct 04 11:06:10.548899 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 821/1688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:09 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:10.562153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:10.577198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:10.614092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:10.614601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:10.615037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:10.618434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:10.620110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:10.621832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:11.000552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:11.025292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:11.028347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:11.037896 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c81b46c2-9b66-45c0-a583-55548f0cbe80 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.485474 Oct 04 11:06:11.051273 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 822/1689] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:10 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:11.051658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:11.058571 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17fe8ee1-1286-4dd7-834c-81f0c9d773a1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.612327 Oct 04 11:06:11.060800 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 868/1690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:10 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:11.166914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2132182712", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f0bf75d3-271a-43d6-b516-b6797bcc3a40"}], "block_device_mapping_v2": [{"uuid": "21cbc061-6f30-4761-8ddd-7337b34b3790", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:11.254164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] validate_networks() for [('f0bf75d3-271a-43d6-b516-b6797bcc3a40', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:06:11.479129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:11.480293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:11.490170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:11.491543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:11.492327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:11.495351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:11.497240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:11.510090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:11.914011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:11.924086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:11.927404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:11.929287 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5f7c96a-2abc-4322-a00a-04dbadb96261 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2830 microversion: 2.42 time: 0.455549 Oct 04 11:06:11.950261 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 869/1691] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:11 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2830 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:11.963327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:11.968446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:11.977061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:11.978227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:11.979201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:11.980480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:11.981261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:11.982208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.186619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:12.195781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17a17124-2600-4229-9dbc-9d8fc70cc646 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.243975 Oct 04 11:06:12.206133 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 870/1692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:11 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:12.218858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:12.219556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:12.227319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:12.228074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:12.228702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.229821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:12.230772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:12.231379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.383940 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63c2199e-9534-48e3-b61f-72aa48db1b29 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.176333 Oct 04 11:06:12.386024 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 871/1693] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Oct 4 11:06:12 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5/os-interface => generated 1830 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:12.392244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:12.393229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:12.402804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:12.403485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:12.404096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.405937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:12.406567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:12.408017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.428759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:06:12.429265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:06:12.429882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:06:12.430383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:06:12.430918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:06:12.447662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:12.448629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:12.449305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.451041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:12.451628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:12.452148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.473093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for project 83765ee4f79c49f49b8af1a56a260450. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:12.477898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Getting quotas for user 27f40f692eac4ea39019fe4921b054f7 and project 83765ee4f79c49f49b8af1a56a260450. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:12.501313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:12.517405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:12.520955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:12.534153 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab28e09a-d37e-40e4-9d3f-59d253faf478 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.147040 Oct 04 11:06:12.534752 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 872/1694] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:12 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:12.548033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:12.548649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:12.551021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:06:12.553879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21cbc061-6f30-4761-8ddd-7337b34b3790',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:06:12.566987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:12.570966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:12.571689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.572596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:12.574676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:12.575315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:12.711303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:12.736650 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f3f7780-e8db-4e46-bcc7-60cc96996ba2 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.579856 Oct 04 11:06:12.738574 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 823/1695] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:06:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:06:12.755148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80b663d4-0322-453a-8c63-773ed07ec0bb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:12.756201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80b663d4-0322-453a-8c63-773ed07ec0bb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:12.926547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:12.938590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80b663d4-0322-453a-8c63-773ed07ec0bb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:12.939397 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1c51565-0e1d-48d0-8f46-bdf2f48cf729 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.399659 Oct 04 11:06:12.948965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80b663d4-0322-453a-8c63-773ed07ec0bb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:12.954877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80b663d4-0322-453a-8c63-773ed07ec0bb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:12.955811 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 873/1696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:12 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:12.962935 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80b663d4-0322-453a-8c63-773ed07ec0bb tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1104 microversion: 2.25 time: 0.212372 Oct 04 11:06:12.963485 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 824/1697] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:12 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1104 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:13.225375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:13.227710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:13.242532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:13.243238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:13.243845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:13.245288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:13.246303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:13.246892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:13.561843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:13.566845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:13.571584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:13.597898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cb20cb3e-2b43-4616-bcec-d5cac4a22a06 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.379194 Oct 04 11:06:13.599958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:13.601388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:13.601889 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 874/1698] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:13 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:13.602506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:13.603424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:13.607803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:13.608249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:13.709978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:13.727467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:13.731313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:13.744775 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-987df849-4b4f-4d0a-a69d-e060f72c2b1a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.186488 Oct 04 11:06:13.746148 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 825/1699] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:13 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:13.970029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:13.970946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:13.980749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:13.982806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:13.983435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:13.985602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:13.986255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:13.986857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:13.993758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:13.994533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:14.010236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:14.010937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:14.011521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:14.012367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:14.012922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:14.013575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:14.523608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:14.536984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:14.538572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:14.540832 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05a6be78-851f-47bd-9897-96913c69878d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1233 microversion: 2.25 time: 0.551714 Oct 04 11:06:14.541974 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 826/1700] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:13 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1233 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:14.630374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:14.632421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:14.647340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:14.648677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:14.649389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:14.651658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:14.654366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:14.655057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:14.849526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:14.862916 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d5c76fa-7092-4385-a9c8-20e7484b97f7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.898580 Oct 04 11:06:14.865140 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 875/1701] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:13 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:14.874677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-dc16c77b-4489-4035-b9d9-d9d8f2588b10 req-2bc3706f-856d-469b-8f25-8c885936b193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "tag": "3b9ced07-b4bf-4318-8dc4-527be99dccbd"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:14.898074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dc16c77b-4489-4035-b9d9-d9d8f2588b10 req-2bc3706f-856d-469b-8f25-8c885936b193 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:14.898565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dc16c77b-4489-4035-b9d9-d9d8f2588b10 req-2bc3706f-856d-469b-8f25-8c885936b193 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:14.898996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dc16c77b-4489-4035-b9d9-d9d8f2588b10 req-2bc3706f-856d-469b-8f25-8c885936b193 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:14.938059 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-dc16c77b-4489-4035-b9d9-d9d8f2588b10 req-2bc3706f-856d-469b-8f25-8c885936b193 service nova] Creating event network-changed:3b9ced07-b4bf-4318-8dc4-527be99dccbd for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:06:14.952637 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-dc16c77b-4489-4035-b9d9-d9d8f2588b10 req-2bc3706f-856d-469b-8f25-8c885936b193 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085715 Oct 04 11:06:14.953692 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 876/1702] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:14.961384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:14.962448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:14.970312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:14.971044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:14.971683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:14.972624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:14.973556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:14.974159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:15.257640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:15.280071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:15.281934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:15.294388 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4bd4e046-c0c4-4c91-bb14-e6c499553178 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.339031 Oct 04 11:06:15.314651 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 877/1703] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:14 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:15.430312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:15.442157 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f82c3bb0-2543-460b-bff5-617ca263865e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.821622 Oct 04 11:06:15.442864 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 827/1704] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:14 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:15.571630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:15.572792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:15.581019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:15.581964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:15.582889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:15.585206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:15.586292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:15.632752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:15.896165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:15.900801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:15.917299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:15.917761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:15.921205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:15.922013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:15.922484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:15.922915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:16.142623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:16.157496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:16.164789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:16.167673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6c5fd5ef-1b5c-4148-a37d-b01c311fd24e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1251 microversion: 2.25 time: 0.599376 Oct 04 11:06:16.170517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 878/1705] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:15 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1251 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:16.325864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:16.327042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:16.337053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:16.337685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:16.338128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:16.338841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:16.339299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:16.339726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:16.484355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:16.502905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:16.512695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:16.520263 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eab19be1-bff5-406c-a6ad-6c906216f644 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.198625 Oct 04 11:06:16.521654 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 879/1706] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:16 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:16.528612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:16.529688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:16.541973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:16.542940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:16.544098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:16.545416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:16.553389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:16.567785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:16.611995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:16.626436 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d83887a2-abd4-4501-aadb-cb3410a9263a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1317 microversion: 2.1 time: 0.738594 Oct 04 11:06:16.631953 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 828/1707] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:15 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:17.199731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:17.201229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:17.218259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:17.219872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:17.220680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:17.223424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:17.224225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:17.225609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:17.514779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:17.530867 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-723e747b-21bf-4127-a785-25b990886f63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 1.007693 Oct 04 11:06:17.532013 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 880/1708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:16 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:17.553289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:17.556858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:17.573157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:17.574875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:17.576354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:17.577058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:17.577559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:17.577991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:17.591254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:17.789015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:17.812425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:17.818929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:17.835755 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0a7ff1d3-3f69-4c2a-b88e-1b2f0ba3e7cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.287274 Oct 04 11:06:17.837845 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 881/1709] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:17 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:17.854381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:17.855489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:17.865987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:17.876923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:17.879242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:17.880217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:17.881508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:17.895105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:17.897330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:18.806100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:18.817498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:18.819388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:18.820864 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fab6e118-b3f3-48e1-ab20-0deeea88cb49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1293 microversion: 2.25 time: 1.625283 Oct 04 11:06:18.822084 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 829/1710] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:17 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1293 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:18.828006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:18.829987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:18.844750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:18.845529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:18.846169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:18.847505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:18.848184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:18.848837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:18.905396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:18.914772 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-945c1e8d-7dc4-4220-94e5-93d42e2aaa14 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1467 microversion: 2.1 time: 1.075171 Oct 04 11:06:18.915965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 882/1711] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:17 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1467 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:18.924596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:18.926023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:18.940886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:18.943083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:18.943787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:18.944750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:18.946017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:18.947341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:19.113710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:19.126289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:19.135330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:19.150422 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e998478f-f740-42be-8250-c321853468cf tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.233109 Oct 04 11:06:19.151615 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 883/1712] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:18 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:19.483533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:19.486664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:19.514558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:19.515794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:19.516417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:19.517330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:19.520044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:19.520910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:19.547464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:19.560728 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d6bab56-7af2-41e3-9b14-c5064a839466 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.737425 Oct 04 11:06:19.579023 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 830/1713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:18 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:19.852166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:19.852966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:19.870198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:19.871038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:19.873131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:19.875980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:19.878028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:19.882110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:20.532055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:20.547074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:20.549818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:20.557131 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a91db1ca-29d5-46e1-988f-08ca75df2866 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1293 microversion: 2.25 time: 0.709691 Oct 04 11:06:20.559666 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 831/1714] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:19 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1293 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:20.578789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:20.580964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:20.594565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:20.596791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:20.598748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:20.601288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:20.603010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:20.604011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:20.808573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:20.824748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:20.824748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:20.827313 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c42124d0-20e7-4688-b48a-168ac2ddab66 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1533 microversion: 2.91 time: 0.258927 Oct 04 11:06:20.837744 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 832/1715] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:20 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1533 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:20.843058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:20.843938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:20.864327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:20.865627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:20.866301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:20.867227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:20.867893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:20.868526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:20.966732 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09da4f73-31a3-4030-bec4-87994d41a794 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1618 microversion: 2.1 time: 1.813547 Oct 04 11:06:20.967524 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 884/1716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:19 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1618 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:20.987802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:20.988505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:21.008547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:21.009069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:21.009601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:21.010326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:21.010780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:21.014810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:21.231641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lazy-loading 'services' on Instance uuid d547029e-7d82-43c1-b62b-e86b323bfcbe {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:21.280392 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13bd969e-35ed-434c-958e-d12e435bd849 tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1938 microversion: 2.91 time: 0.310478 Oct 04 11:06:21.283712 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 885/1717] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:20 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1938 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:21.296941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac89fd92-7c28-460b-b6fb-7d9a2ccbf39b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Action: 'create', calling method: .version_select at 0x7f71d48e53a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-622049922", "policies": ["affinity"]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:21.361081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ac89fd92-7c28-460b-b6fb-7d9a2ccbf39b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:21.382623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ac89fd92-7c28-460b-b6fb-7d9a2ccbf39b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:21.383220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:21.397811 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f00c6dc4-46db-4f01-8f17-9eb1363fda15 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.556714 Oct 04 11:06:21.414680 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 833/1718] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:20 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:21.428200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-48047e73-688f-450f-8743-629213ccf99e req-e8fbb049-6886-4d65-b444-23262333c57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314aa825-15be-4c05-88d6-b47c202d4640", "tag": "fb97bf5a-d2d4-4256-9000-0254ba7aa594"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:21.438932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-48047e73-688f-450f-8743-629213ccf99e req-e8fbb049-6886-4d65-b444-23262333c57a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:21.439712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-48047e73-688f-450f-8743-629213ccf99e req-e8fbb049-6886-4d65-b444-23262333c57a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:21.440411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-48047e73-688f-450f-8743-629213ccf99e req-e8fbb049-6886-4d65-b444-23262333c57a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:21.446993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:21.476166 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-48047e73-688f-450f-8743-629213ccf99e req-e8fbb049-6886-4d65-b444-23262333c57a service nova] Creating event network-changed:fb97bf5a-d2d4-4256-9000-0254ba7aa594 for instance 314aa825-15be-4c05-88d6-b47c202d4640 on n-h1-791135-8 Oct 04 11:06:21.506684 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-48047e73-688f-450f-8743-629213ccf99e req-e8fbb049-6886-4d65-b444-23262333c57a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090141 Oct 04 11:06:21.509707 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 834/1719] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:21.523324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:21.527340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:21.529179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ac89fd92-7c28-460b-b6fb-7d9a2ccbf39b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:21.543080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ac89fd92-7c28-460b-b6fb-7d9a2ccbf39b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:21.544106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:21.544785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:21.545975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:21.546908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:21.547565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:21.548250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:21.578022 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac89fd92-7c28-460b-b6fb-7d9a2ccbf39b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.290716 Oct 04 11:06:21.589850 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 886/1720] 10.222.0.23 () {60 vars in 1174 bytes} [Tue Oct 4 11:06:21 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:21.618549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:21.621344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:21.636654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:21.638978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:21.639842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:21.641548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:21.642334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:21.643611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:21.657951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lazy-loading 'flavor' on Instance uuid d547029e-7d82-43c1-b62b-e86b323bfcbe {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:22.133577 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ffbbe39f-16bc-4514-aea4-4c162d6edd2d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "POST /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe/action" status: 202 len: 0 microversion: 2.91 time: 0.617218 Oct 04 11:06:22.136354 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 835/1721] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:06:21 2022] POST /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:06:22.148266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:22.167124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-472840357", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "315e223e-fc8e-4a6f-9f5c-75915503dd52"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:22.172138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:22.184768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:22.186103 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34c089ec-50cf-4c5c-aeab-40c793b8ffb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1293 microversion: 2.25 time: 0.580048 Oct 04 11:06:22.191614 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 887/1722] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:21 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1293 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:22.198083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:22.198682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:22.233451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:22.233996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:22.237177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:22.238508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:22.238992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:22.239431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:22.319569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:06:22.466324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:22.680381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:22.692626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:22.696556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:22.710760 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5327da10-2f96-4533-8ae3-5695157844e0 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.517809 Oct 04 11:06:22.712036 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 888/1723] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:22 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:22.716949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:22.717880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:22.724161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:22.724917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:22.725626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:22.726545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:22.727218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:22.727860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:22.946523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:22.985039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:06:22.985925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:06:22.986768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:06:22.987347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:06:22.988198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:06:23.021296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:23.022098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:23.022772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:23.024475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:23.025706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:23.026468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:23.049022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:23.053784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:23.067605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Going to run 2 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:06:23.073033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:06:23.120199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:23.131326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f7dfdce-b2dd-4db3-9c84-e3b056eaa511 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.417987 Oct 04 11:06:23.132483 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 889/1724] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:22 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:23.155884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122408) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 11:06:23.177990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:23.182627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:23.220286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:23.220897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:23.227355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:23.227922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:23.228374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:23.229373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:23.230018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:23.230647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:23.271536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:23.278981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:23.316172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=95bfd7f2-1c04-4198-8e68-d74b326d8578,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:06:23.411625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:23.418391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:23.473963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:23.476859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:23.479913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:23.548880 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-915db038-b116-47fe-89a0-ecfce81d1b4a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.410288 Oct 04 11:06:23.549915 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 836/1725] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:06:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:06:23.559006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:23.565109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:23.566500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Searching by: {'deleted': False, 'project_id': 'bf100271e41c4475835267bcaf15c0b3'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:06:23.588551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:23.589640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:23.590285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:23.591235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:23.592077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:23.592677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:23.696876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:06:23.813293 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-19d39929-9fa2-4713-b0eb-0b06f317b31e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.258188 Oct 04 11:06:23.823036 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 837/1726] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:06:23 2022] GET /compute/v2.1/servers => generated 1002 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:23.829087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:23.829574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:23.836382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:23.836871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:23.837313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:23.838105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:23.838568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:23.838991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:24.096804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:24.116007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:24.125965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:24.129790 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1d2b890-1872-40dd-953c-15f1d968be32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1281 microversion: 2.25 time: 0.913248 Oct 04 11:06:24.133848 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 890/1727] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:23 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1281 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:24.140758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57fd82ba-e78d-4b12-a649-479003b96176 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:24.141892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57fd82ba-e78d-4b12-a649-479003b96176 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:24.149996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:24.165694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:24.173227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:24.185102 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7a6c0d0-db60-4113-b3be-27c7375995d2 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.360164 Oct 04 11:06:24.193488 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 838/1728] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:23 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:24.193488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:24.193488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:24.209402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:24.209402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:24.209402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:24.209402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:24.209402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:24.210169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:24.315553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57fd82ba-e78d-4b12-a649-479003b96176 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:24.330327 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57fd82ba-e78d-4b12-a649-479003b96176 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1218 microversion: 2.1 time: 0.192384 Oct 04 11:06:24.332535 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 891/1729] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:24 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:24.623259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:24.644965 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-032a4595-891b-44d7-8c79-7dbdb608769f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.455082 Oct 04 11:06:24.667536 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 839/1730] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:24 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:25.165482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:25.166310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:25.183099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:25.185914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:25.187994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:25.188977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:25.189653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:25.192732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:25.219804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:25.221091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:25.233858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:25.235090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:25.237785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:25.238756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:25.240226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:25.246521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:25.581956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:25.595621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:25.615685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:25.647522 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7b8845c-252f-47ea-ae26-34212bdd4640 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.432351 Oct 04 11:06:25.649833 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 840/1731] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:25 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:25.662757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:25.663393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:25.691048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:25.691552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:25.691990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:25.702332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:25.702997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:25.703458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:25.873211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:25.877425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:25.904386 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb2279d8-4582-415f-a015-37b7c354ed3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1214 microversion: 2.1 time: 0.253406 Oct 04 11:06:25.906762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:25.912646 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 841/1732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:25 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:25.914245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:25.915434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0bcce389-3854-4519-9505-3427693ef387 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1281 microversion: 2.25 time: 0.754717 Oct 04 11:06:25.916005 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 892/1733] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:25 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1281 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:25.936808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:25.941539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:25.960323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:25.961156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:25.961446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:25.962153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:25.962690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:25.963513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:25.978522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbcc3020-8a55-417a-a15f-c8bf81edbf5a tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Action: 'create', calling method: .version_select at 0x7f71d4ad0160>, body: {"keypair": {"name": "tempest-keypair-633193538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmMd4htVByiNJ82K99bSuKg1U0Dml8abMnwPbP6157tePDnK+xaNt4ok/TCJnGGYI7g/b1s7vtVHiUeG4qXEQKjge7VuymZqT1gHVOI+gQ284mTKxdoVBbhSxaZSpjxEw=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:25.995372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-bbcc3020-8a55-417a-a15f-c8bf81edbf5a tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Getting quotas for project 8cf84a0f9e4d4832be12ec83a2c5b192. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:25.999934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-bbcc3020-8a55-417a-a15f-c8bf81edbf5a tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Getting quotas for user d04405bf8f724455be376b1428e54061 and project 8cf84a0f9e4d4832be12ec83a2c5b192. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:26.028707 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbcc3020-8a55-417a-a15f-c8bf81edbf5a tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105802 Oct 04 11:06:26.037878 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 893/1734] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:06:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:26.257323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:26.278848 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-154fa76e-a600-472b-aa6d-a6403c1c757f tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.360637 Oct 04 11:06:26.279906 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 842/1735] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:25 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:26.679417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:26.683653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:26.707262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:26.707671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:26.709228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:26.710074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:26.710584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:26.711002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:26.827486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:26.839143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:26.841834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:26.849193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5003cca6-f957-4416-aa9a-d1d12bae234e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.174087 Oct 04 11:06:26.860637 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 894/1736] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:26 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:26.927693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:26.928386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:26.941327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:26.942351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:26.947550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:26.947987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:26.948460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:26.949184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:26.949662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:26.950104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:26.952498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:26.958584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:26.960968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:26.963063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:26.966384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:26.968545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:27.335372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:27.345065 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2e270f6-e17a-4366-af38-65e1fff027fe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1270 microversion: 2.1 time: 0.421319 Oct 04 11:06:27.345768 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 843/1737] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:26 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1270 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:27.365781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:27.366538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:27.382543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:27.383122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:27.383534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:27.384324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:27.384780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:27.385339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:27.949931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:27.964436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:27.969507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:27.970687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6eaccc90-798d-47f9-9718-61c7a7166eb5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1281 microversion: 2.25 time: 1.034234 Oct 04 11:06:27.974974 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 895/1738] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:26 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1281 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:27.984608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:27.988914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:27.999805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:28.001479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:28.002965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:28.004900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:28.007532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:28.010554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:28.261187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:28.277194 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85fab18a-df3c-419b-a333-7b545e85815d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.922173 Oct 04 11:06:28.282931 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 844/1739] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:27 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:28.319720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:28.336500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:28.339232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:28.356904 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f81e030c-2d0b-474d-87f9-423b9aeba613 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.380499 Oct 04 11:06:28.359232 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 896/1740] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:27 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:28.368199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:28.369032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:28.382900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:28.383432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:28.383849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:28.384623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:28.385111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:28.385589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:28.499679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:28.518356 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4dde75f3-6d4d-4b4f-8dcb-04f5393727bc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1276 microversion: 2.1 time: 0.153822 Oct 04 11:06:28.534963 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 845/1741] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:28 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:28.967528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-362a0e57-4978-4d12-b4a7-1970973dde31 req-3da5b8a6-de53-4986-81d3-6129b101f618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95bfd7f2-1c04-4198-8e68-d74b326d8578", "tag": "81990cc3-a4e2-461a-a98a-cf92fd8bbaaf"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:28.979504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-362a0e57-4978-4d12-b4a7-1970973dde31 req-3da5b8a6-de53-4986-81d3-6129b101f618 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:28.980362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-362a0e57-4978-4d12-b4a7-1970973dde31 req-3da5b8a6-de53-4986-81d3-6129b101f618 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:28.981067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-362a0e57-4978-4d12-b4a7-1970973dde31 req-3da5b8a6-de53-4986-81d3-6129b101f618 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:28.999514 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-362a0e57-4978-4d12-b4a7-1970973dde31 req-3da5b8a6-de53-4986-81d3-6129b101f618 service nova] Creating event network-changed:81990cc3-a4e2-461a-a98a-cf92fd8bbaaf for instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 on n-h2-791135-8 Oct 04 11:06:29.003361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:29.004353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:29.008388 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-362a0e57-4978-4d12-b4a7-1970973dde31 req-3da5b8a6-de53-4986-81d3-6129b101f618 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045326 Oct 04 11:06:29.010469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 897/1742] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:29.033164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:29.036933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:29.037478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:29.038275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:29.038745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:29.039151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:29.307696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:29.308325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:29.325867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:29.326864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:29.328184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:29.329167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:29.330405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:29.333545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:29.512061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:29.524512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:29.527443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:29.529684 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab55d612-d55e-4641-9bc8-ba7b0c9fe4fd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1281 microversion: 2.25 time: 0.531597 Oct 04 11:06:29.530889 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 846/1743] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:28 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1281 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:29.537328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:29.538640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:29.576221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:29.576898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:29.577619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:29.585264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:29.586388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:29.587098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:29.752545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:29.765949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:29.768500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:29.780011 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49e7921f-24d6-4765-9347-62e04ddbbed6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.247188 Oct 04 11:06:29.783159 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 847/1744] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:29 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:29.797844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:29.798940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:29.807489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:29.808135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:29.808833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:29.809927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:29.810671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:29.811202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:30.080716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:30.095449 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a79ad1b-7161-4f54-b267-8e0ded456097 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.786722 Oct 04 11:06:30.103389 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 898/1745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:29 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:30.106558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:30.117616 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-194ff71e-dbb8-41f6-8a28-d591210b3274 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1276 microversion: 2.1 time: 0.324824 Oct 04 11:06:30.133426 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 848/1746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:29 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1276 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:30.563978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:30.564704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:30.571445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:30.572438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:30.573091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:30.574222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:30.574710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:30.575206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:30.822677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:30.824142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:30.852816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:30.853809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:30.858040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:30.861801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:30.863115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:30.863560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:31.060531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:31.064605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:31.066965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:31.078786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:31.080321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:31.081801 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0fdd5ec6-0193-4f69-ab0f-fcdcab21fe98 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1281 microversion: 2.25 time: 0.521869 Oct 04 11:06:31.086981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:31.090554 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 899/1747] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:30 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1281 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:31.092424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:31.110403 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-435409a8-85fd-4abc-8d12-12413e7c9ec3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.292496 Oct 04 11:06:31.111939 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 849/1748] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:30 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:31.139951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:31.144070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:31.166854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:31.167796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:31.169633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:31.170815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:31.171772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:31.172496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:31.216899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1196213891", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "fe42e5c1-b0b0-4c86-b1a2-ac753c58d8e1"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:31.324648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] validate_networks() for [('fe42e5c1-b0b0-4c86-b1a2-ac753c58d8e1', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:06:31.533231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:31.542471 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-621448bd-e085-4f37-895a-3798e59afaaa tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1472 microversion: 2.1 time: 0.412110 Oct 04 11:06:31.553384 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 850/1749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:31 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:31.558491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:31.559266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:31.574549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:31.575298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:31.575842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:31.576976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:31.577568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:31.578093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:31.856939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:31.868584 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bde59e94-e6af-417a-804c-584b7a19f6ee tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.323869 Oct 04 11:06:31.875579 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 851/1750] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:31 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:31.885744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1862565302", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "736160b7-45dc-40a5-b210-4deb924c97c8"}], "security_groups": [{"name": "tempest-securitygroup--2141156873"}], "key_name": "tempest-keypair-633193538", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:32.038108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] validate_networks() for [('736160b7-45dc-40a5-b210-4deb924c97c8', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:06:32.062139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:06:32.062608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:06:32.063320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:06:32.064081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:06:32.064663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:06:32.075990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.076905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.077803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.079364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.080175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.080888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.104741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Getting quotas for project ee7bbcbc81f547c0b5982b0f1efc54cc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:32.112869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Getting quotas for user 4dbb699b24b3432e9adc7b6d869e4744 and project ee7bbcbc81f547c0b5982b0f1efc54cc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:32.139889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:06:32.142856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:06:32.224122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-07e29ddd-e04a-4476-bfdb-af985e0cee90 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132236 Oct 04 11:06:32.229413 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 900/1751] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:06:32.235880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:32.236788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:32.248132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.249180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.249850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.254484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.255117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.255572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.499096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:32.502562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:32.523241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:32.525315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:32.539171 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78ae7b36-2816-48bc-a81c-8db14a778aa7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1281 microversion: 2.25 time: 0.312662 Oct 04 11:06:32.542022 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 901/1752] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:32 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1281 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:32.559274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:32.560126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:32.563995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:32.570714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.573075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.575054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.576122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.578270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.578705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.652108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Getting quotas for project 8cf84a0f9e4d4832be12ec83a2c5b192. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:32.658354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Getting quotas for user d04405bf8f724455be376b1428e54061 and project 8cf84a0f9e4d4832be12ec83a2c5b192. Resources: dict_keys(['metadata_items']) {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:32.662080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:32.670510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:32.672055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:32.678752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:06:32.679280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:06:32.679528 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92c98968-1157-4938-88cd-fc359d8eab59 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.135807 Oct 04 11:06:32.679759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:06:32.681158 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 902/1753] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:32 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:32.683513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:06:32.686434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-608173f4-cc3d-4860-b5c5-62767aef4ce1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:32.687267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-608173f4-cc3d-4860-b5c5-62767aef4ce1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:32.693764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:06:32.711018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.712097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.712810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.713794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.714431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.715021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.736362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Getting quotas for project 8cf84a0f9e4d4832be12ec83a2c5b192. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:32.752128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Getting quotas for user d04405bf8f724455be376b1428e54061 and project 8cf84a0f9e4d4832be12ec83a2c5b192. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:32.787520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:06:32.791975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:06:32.907898 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6961ee67-5b6c-4c20-b6cf-3de3dab8e665 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.029197 Oct 04 11:06:32.911884 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 852/1754] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:06:31 2022] POST /compute/v2.1/servers => generated 407 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:06:32.929028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:32.930060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:32.971152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.972293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.973712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:32.976094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:32.980838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:32.982106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:33.276445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-608173f4-cc3d-4860-b5c5-62767aef4ce1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:33.283773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-608173f4-cc3d-4860-b5c5-62767aef4ce1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1208 microversion: 2.1 time: 0.601303 Oct 04 11:06:33.284421 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 903/1755] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:32 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1208 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:33.297071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:33.298168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:33.314171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:33.315032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:33.315913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:33.316981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:33.317749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:33.318463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:33.883751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:33.897550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-122a84c9-3ed3-41c5-b78e-f7c9c228eaeb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.608541 Oct 04 11:06:33.898829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 904/1756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:33 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:33.904007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:33.905010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:33.914594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:33.915442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:33.916121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:33.917052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:33.917755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:33.918423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:33.991359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.017804 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4eafde6-d497-40f3-9249-494c429d2d27 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1478 microversion: 2.1 time: 1.104467 Oct 04 11:06:34.019913 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 853/1757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:32 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1478 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:34.024880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:34.026316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:34.035374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.040811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.041443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:34.042392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.042860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.046857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:34.112656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.121191 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a98de090-c1c5-48bc-b4e7-84ab3477c5e9 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1273 microversion: 2.1 time: 0.220995 Oct 04 11:06:34.134119 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 905/1758] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:33 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:34.156836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:34.157843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:34.183675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.184466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.185290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:34.186780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.187470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.188280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:34.422241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.435251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.436912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.453887 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-439096e6-4d26-4305-84d9-7bb22f901c74 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.318323 Oct 04 11:06:34.455197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 906/1759] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:34 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:34.469025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0b684d88-e95b-4b24-9696-37c37e079f48 req-7d7bbf35-a6d4-4937-aa32-c150edc2bbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314aa825-15be-4c05-88d6-b47c202d4640", "name": "network-vif-plugged", "status": "completed", "tag": "fb97bf5a-d2d4-4256-9000-0254ba7aa594"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:34.498020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0b684d88-e95b-4b24-9696-37c37e079f48 req-7d7bbf35-a6d4-4937-aa32-c150edc2bbaf service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.498498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0b684d88-e95b-4b24-9696-37c37e079f48 req-7d7bbf35-a6d4-4937-aa32-c150edc2bbaf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.498934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0b684d88-e95b-4b24-9696-37c37e079f48 req-7d7bbf35-a6d4-4937-aa32-c150edc2bbaf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:34.529028 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0b684d88-e95b-4b24-9696-37c37e079f48 req-7d7bbf35-a6d4-4937-aa32-c150edc2bbaf service nova] Creating event network-vif-plugged:fb97bf5a-d2d4-4256-9000-0254ba7aa594 for instance 314aa825-15be-4c05-88d6-b47c202d4640 on n-h1-791135-8 Oct 04 11:06:34.537472 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0b684d88-e95b-4b24-9696-37c37e079f48 req-7d7bbf35-a6d4-4937-aa32-c150edc2bbaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080641 Oct 04 11:06:34.538659 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 907/1760] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:34.547631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:34.548662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:34.556720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.557542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.558174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:34.559110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.559813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.560472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:34.588637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.597506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.602522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.605480 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cabbd661-59e8-4855-850c-b0899d79fed0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1281 microversion: 2.25 time: 0.583730 Oct 04 11:06:34.606102 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 854/1761] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:34 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1281 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:34.709691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:34.717927 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c2e6ce9-6a2a-4783-b706-943c24fdbbb5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1278 microversion: 2.1 time: 0.177044 Oct 04 11:06:34.718520 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 908/1762] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:34 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:34.929775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:34.931099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:34.941085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.941989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.942489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:34.943268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:34.943910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:34.944340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.045316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:35.045890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:35.052679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.053180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.053646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.054353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.054814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.055243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.349850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:35.370568 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6859bba-4ff9-4b44-b978-ac365d093629 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.445932 Oct 04 11:06:35.371775 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 855/1763] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:34 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:35.379954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:35.381420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:35.400528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.401037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.401542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.403467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.403980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.406827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.443344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:35.458134 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09e09536-e3b0-4032-b61e-ec294c1a7e8c tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1478 microversion: 2.1 time: 0.416533 Oct 04 11:06:35.458991 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 909/1764] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:35 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1478 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:35.484354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:35.485067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:35.496270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.497257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.497795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.499261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.501720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.502239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.527876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:35.536825 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4026a8a-0ced-4f71-9271-7c70266a2af4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1339 microversion: 2.1 time: 0.163576 Oct 04 11:06:35.537448 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 856/1765] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:35 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1339 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:35.586168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:35.595284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:35.597271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:35.603586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-049756d9-c645-4d36-9fa2-80ddbb41c75e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.124396 Oct 04 11:06:35.604362 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 910/1766] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:35 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:35.636043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:35.636958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:35.643825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.644554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.645229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.646015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.646478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.646903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.744399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:35.745091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:35.755001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.755827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.756365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.757589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.758280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.758928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.881713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:35.904209 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b02850ce-884d-4ef9-b355-3374fccb3f54 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1266 microversion: 2.1 time: 0.164595 Oct 04 11:06:35.915416 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 911/1767] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:35 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:35.921673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-dcdd5784-34a8-40ef-a996-cf0ff9a10414 req-4ffc68b4-cb85-432d-8825-cc0261c8d313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f41f528-5f20-4e31-a726-104bb7620bf6", "tag": "558bbb9f-7c34-4bb2-8e38-805a0c4df9cd"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:35.943604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dcdd5784-34a8-40ef-a996-cf0ff9a10414 req-4ffc68b4-cb85-432d-8825-cc0261c8d313 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:35.944107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dcdd5784-34a8-40ef-a996-cf0ff9a10414 req-4ffc68b4-cb85-432d-8825-cc0261c8d313 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:35.944560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dcdd5784-34a8-40ef-a996-cf0ff9a10414 req-4ffc68b4-cb85-432d-8825-cc0261c8d313 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:35.964453 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-dcdd5784-34a8-40ef-a996-cf0ff9a10414 req-4ffc68b4-cb85-432d-8825-cc0261c8d313 service nova] Creating event network-changed:558bbb9f-7c34-4bb2-8e38-805a0c4df9cd for instance 2f41f528-5f20-4e31-a726-104bb7620bf6 on n-h2-791135-8 Oct 04 11:06:35.970094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-dcdd5784-34a8-40ef-a996-cf0ff9a10414 req-4ffc68b4-cb85-432d-8825-cc0261c8d313 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055815 Oct 04 11:06:35.971324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 912/1768] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:35.995728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:36.022070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:36.026655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:36.030860 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37d165cc-031f-4075-ae4a-86c40b91fd61 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1281 microversion: 2.25 time: 0.395831 Oct 04 11:06:36.032803 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 857/1769] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:35 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1281 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:36.395538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:36.396338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:36.407573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:36.408104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:36.408699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:36.409282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:36.414139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:36.414614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:36.481870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:36.483088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:36.490166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:36.490988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:36.491745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:36.492628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:36.493253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:36.493896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:36.992709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.001543 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1dbf465c-9aee-40a0-a2a7-055fb920b633 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.611044 Oct 04 11:06:37.012230 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 913/1770] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:36 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:37.025259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:37.026532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:37.034063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.034624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.035356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.036151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.036736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.037241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.137343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.148108 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e60fcd9d-6c39-4c73-990a-a7eab07735cf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1478 microversion: 2.1 time: 0.670038 Oct 04 11:06:37.149281 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 858/1771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:36 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1478 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:37.155097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:37.156053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:37.163942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.164978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.165778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.166616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.167325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.167752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.316946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.326485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.328700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.334388 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8be74f43-9cda-4162-9974-5339ee7556ba tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.183896 Oct 04 11:06:37.354230 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 859/1772] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:37 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:37.366818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e6d98c6a-be7d-4769-8726-01411bf6b2e6 req-86d976d0-88ac-4b3f-b9e4-cf2f8137b6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d278191-0937-47b3-bb59-4c40c4a98bda", "name": "network-vif-unplugged", "status": "completed", "tag": "db7d8832-93a3-4fdd-a30e-8d691ca33259"}, {"server_uuid": "95bfd7f2-1c04-4198-8e68-d74b326d8578", "name": "network-vif-plugged", "status": "completed", "tag": "81990cc3-a4e2-461a-a98a-cf92fd8bbaaf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:37.376280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.379479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6d98c6a-be7d-4769-8726-01411bf6b2e6 req-86d976d0-88ac-4b3f-b9e4-cf2f8137b6d2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.380166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6d98c6a-be7d-4769-8726-01411bf6b2e6 req-86d976d0-88ac-4b3f-b9e4-cf2f8137b6d2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.380770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6d98c6a-be7d-4769-8726-01411bf6b2e6 req-86d976d0-88ac-4b3f-b9e4-cf2f8137b6d2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.385296 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7fcb5d21-95a5-4a95-a963-0678dfd1d72c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1395 microversion: 2.1 time: 0.371581 Oct 04 11:06:37.396352 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e6d98c6a-be7d-4769-8726-01411bf6b2e6 req-86d976d0-88ac-4b3f-b9e4-cf2f8137b6d2 service nova] Creating event network-vif-unplugged:db7d8832-93a3-4fdd-a30e-8d691ca33259 for instance 9d278191-0937-47b3-bb59-4c40c4a98bda on n-h1-791135-8 Oct 04 11:06:37.397637 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e6d98c6a-be7d-4769-8726-01411bf6b2e6 req-86d976d0-88ac-4b3f-b9e4-cf2f8137b6d2 service nova] Creating event network-vif-plugged:81990cc3-a4e2-461a-a98a-cf92fd8bbaaf for instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 on n-h2-791135-8 Oct 04 11:06:37.398083 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 914/1773] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:37 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1395 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:37.408294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:37.409737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:37.411498 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e6d98c6a-be7d-4769-8726-01411bf6b2e6 req-86d976d0-88ac-4b3f-b9e4-cf2f8137b6d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.054916 Oct 04 11:06:37.412196 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 860/1774] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:37.417920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:37.418749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.418898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:37.419749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.420409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.421554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.422761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.423431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.426386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.426873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.427395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.428391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.428793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.429464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.701814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.710282 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc358dcb-56b3-4c31-a95d-604369bf0952 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1308 microversion: 2.1 time: 0.310988 Oct 04 11:06:37.716622 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 915/1775] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:37 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:37.716622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f033b18b-d7d2-4400-a773-a023ad44e473 req-2962ba6d-43ec-40da-92f3-0ef8ec250f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922cf522-37ef-40b7-93f9-5b774b6509f5", "tag": "e72b8805-d5b7-4013-ad4f-07fc4d0f8aeb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:37.725677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f033b18b-d7d2-4400-a773-a023ad44e473 req-2962ba6d-43ec-40da-92f3-0ef8ec250f11 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.726444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f033b18b-d7d2-4400-a773-a023ad44e473 req-2962ba6d-43ec-40da-92f3-0ef8ec250f11 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.727058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f033b18b-d7d2-4400-a773-a023ad44e473 req-2962ba6d-43ec-40da-92f3-0ef8ec250f11 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.741884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f033b18b-d7d2-4400-a773-a023ad44e473 req-2962ba6d-43ec-40da-92f3-0ef8ec250f11 service nova] Creating event network-changed:e72b8805-d5b7-4013-ad4f-07fc4d0f8aeb for instance 922cf522-37ef-40b7-93f9-5b774b6509f5 on n-h1-791135-8 Oct 04 11:06:37.748100 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f033b18b-d7d2-4400-a773-a023ad44e473 req-2962ba6d-43ec-40da-92f3-0ef8ec250f11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035665 Oct 04 11:06:37.749280 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 916/1776] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:37.749456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.760014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.761505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:37.762625 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5476460-b840-47b4-b304-34ad58a7c053 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1477 microversion: 2.25 time: 0.349302 Oct 04 11:06:37.763200 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 861/1777] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:37 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1477 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:37.940094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:37.942508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:37.952257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.953137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.953857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:37.954897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:37.955574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:37.956388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.032527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:38.033552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:38.043561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.044452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.045494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.046700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.047427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.048188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.570663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 314aa825-15be-4c05-88d6-b47c202d4640 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:38.584367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a09f3888-242b-4bb6-b5af-7c0eaa316f8e tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1970 microversion: 2.25 time: 0.797534 Oct 04 11:06:38.584954 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 917/1778] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:37 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1970 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:38.587131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:38.600921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:38.601567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:38.607235 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0dfe5a6f-0da2-45ca-968b-5c638f3abf6a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.580265 Oct 04 11:06:38.608006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.608174 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 862/1779] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:38 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:38.608792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.609416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.610313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.610764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.611361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.615345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:38.616280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:38.623919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.624424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.624861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.625776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.626401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.626933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.712621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:38.722684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:38.724377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:38.730656 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01665bb8-705e-438a-86fe-14d01ea4a98b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.121158 Oct 04 11:06:38.741449 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 863/1780] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:38 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:38.741449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-15244518-5fee-498a-9f15-2e9ca8dfc413 req-3cb3046d-b8cb-4f7b-bdc6-8fb3ceab06a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b343130c-9edd-4145-a732-d5730ffc7edc", "tag": "cad87f36-7301-414e-8fe8-6249065e7c49"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:38.747000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15244518-5fee-498a-9f15-2e9ca8dfc413 req-3cb3046d-b8cb-4f7b-bdc6-8fb3ceab06a8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.747567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15244518-5fee-498a-9f15-2e9ca8dfc413 req-3cb3046d-b8cb-4f7b-bdc6-8fb3ceab06a8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.748042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-15244518-5fee-498a-9f15-2e9ca8dfc413 req-3cb3046d-b8cb-4f7b-bdc6-8fb3ceab06a8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.763141 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-15244518-5fee-498a-9f15-2e9ca8dfc413 req-3cb3046d-b8cb-4f7b-bdc6-8fb3ceab06a8 service nova] Creating event network-changed:cad87f36-7301-414e-8fe8-6249065e7c49 for instance b343130c-9edd-4145-a732-d5730ffc7edc on n-h1-791135-8 Oct 04 11:06:38.769768 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-15244518-5fee-498a-9f15-2e9ca8dfc413 req-3cb3046d-b8cb-4f7b-bdc6-8fb3ceab06a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036264 Oct 04 11:06:38.770606 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 864/1781] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:38.776797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:38.776980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:38.778216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:38.784817 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-86dc9d40-652e-45f7-98de-ec7bc98b06f2 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1478 microversion: 2.1 time: 0.188129 Oct 04 11:06:38.785478 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 918/1782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:38 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1478 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:38.785630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.786039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.786739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.787646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.788118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.788755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.789813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:38.790675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:38.796633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.797159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.797635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:38.798335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:38.798798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:38.799334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.012284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:39.020852 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e49bf130-2f85-4ed8-8774-8936aeedf57e tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1395 microversion: 2.1 time: 0.248813 Oct 04 11:06:39.021604 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 865/1783] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:38 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1395 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:39.026092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:39.026690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:39.028941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 314aa825-15be-4c05-88d6-b47c202d4640 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:39.031916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:39.033406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.034812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.035337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.036252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.036815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.037314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.045091 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ec7049c-da4a-4562-a570-17d0b7f129b6 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1970 microversion: 2.25 time: 0.258496 Oct 04 11:06:39.046000 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 919/1784] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:38 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1970 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:39.074094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9a69848-6685-4424-90ba-48f968ee307f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:39.078471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9a69848-6685-4424-90ba-48f968ee307f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.079005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9a69848-6685-4424-90ba-48f968ee307f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.079631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9a69848-6685-4424-90ba-48f968ee307f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.080600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9a69848-6685-4424-90ba-48f968ee307f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.081832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9a69848-6685-4424-90ba-48f968ee307f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.082463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9a69848-6685-4424-90ba-48f968ee307f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.110773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9a69848-6685-4424-90ba-48f968ee307f tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.040452 Oct 04 11:06:39.113418 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 920/1785] 10.222.0.23 () {60 vars in 1217 bytes} [Tue Oct 4 11:06:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:06:39.124444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-791135-8", "block_migration": "auto"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:39.126967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:39.133280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.133799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.134227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.134943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.135387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.135804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.154384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:39.162140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'flavor' on Instance uuid 314aa825-15be-4c05-88d6-b47c202d4640 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:39.187960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Going to try to live migrate instance to n-h2-791135-8 {{(pid=122409) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:06:39.188372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:39.196874 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ecb2f7b-1fd6-4869-a5b7-7e811f18a66f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1308 microversion: 2.1 time: 0.174271 Oct 04 11:06:39.201434 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 866/1786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:39 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:39.433112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bba665d9-9645-44eb-beea-7a15ddf978a1 req-6040247d-b901-4ec9-b283-69d3159f7a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d278191-0937-47b3-bb59-4c40c4a98bda", "name": "network-vif-plugged", "status": "completed", "tag": "db7d8832-93a3-4fdd-a30e-8d691ca33259"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:39.443484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bba665d9-9645-44eb-beea-7a15ddf978a1 req-6040247d-b901-4ec9-b283-69d3159f7a20 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.444076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bba665d9-9645-44eb-beea-7a15ddf978a1 req-6040247d-b901-4ec9-b283-69d3159f7a20 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.444688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bba665d9-9645-44eb-beea-7a15ddf978a1 req-6040247d-b901-4ec9-b283-69d3159f7a20 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.458070 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bba665d9-9645-44eb-beea-7a15ddf978a1 req-6040247d-b901-4ec9-b283-69d3159f7a20 service nova] Creating event network-vif-plugged:db7d8832-93a3-4fdd-a30e-8d691ca33259 for instance 9d278191-0937-47b3-bb59-4c40c4a98bda on n-h1-791135-8 Oct 04 11:06:39.464527 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bba665d9-9645-44eb-beea-7a15ddf978a1 req-6040247d-b901-4ec9-b283-69d3159f7a20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035081 Oct 04 11:06:39.465523 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 867/1787] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:06:39.637824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:39.639058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:39.647192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.648049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.648723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.651351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.652153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.652874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.822645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:39.830318 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90358dc2-93c1-4204-af73-904aa3729262 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.197401 Oct 04 11:06:39.830929 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 868/1788] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:39 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:39.835516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:39.836379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:39.842370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.843056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.843490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.844181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.844632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.845051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.849573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:39.913842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:39.923969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:39.926766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:39.932466 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee35174e-4eee-4705-a178-28f59bb2779d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.100484 Oct 04 11:06:39.933050 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 869/1789] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:39 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:39.938957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:39.939675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:39.946631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.947118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.947645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:39.948344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:39.948801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:39.949226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:40.193995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:40.202000 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ca22d10-415b-416e-bf6a-7a33c089dd63 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1478 microversion: 2.1 time: 0.267634 Oct 04 11:06:40.202591 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 870/1790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:39 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1478 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:40.207707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:40.208313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:40.215416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:40.216395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:40.217203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:40.218494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:40.219495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:40.220394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:40.353446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:40.361250 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c9d0d9b0-ca45-42f2-8814-2c1c84f2956c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1395 microversion: 2.1 time: 0.157689 Oct 04 11:06:40.361855 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 871/1791] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:40 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:40.366260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:40.366858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:40.372387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:40.372869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:40.373302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:40.374013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:40.374648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:40.375073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:40.512925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:40.521111 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b56f419a-2334-4cdd-8b70-eaee745beb1e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1308 microversion: 2.1 time: 0.158271 Oct 04 11:06:40.521726 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 872/1792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:40 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:40.853552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:40.854180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:40.860082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:40.860551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:40.860974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:40.861679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:40.862160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:40.862579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:41.007354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:41.015441 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c75cd650-6324-402f-b390-9d865b0b5994 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.165806 Oct 04 11:06:41.016507 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 873/1793] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:40 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:41.027953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:41.029232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:41.038226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:41.039690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:41.040146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:41.040870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:41.041328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:41.042129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:41.124701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:41.134869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:41.136509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:41.142543 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99015cea-40b4-4c60-a5d5-399bb25ff563 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.120173 Oct 04 11:06:41.144074 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 874/1794] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:41 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:41.226821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:41.227720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:41.234830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:41.235535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:41.236292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:41.237728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:41.238242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:41.238672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:41.529653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:41.545432 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-910165f6-5b37-4a82-a3bf-3025a2b41a4d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1478 microversion: 2.1 time: 0.322918 Oct 04 11:06:41.546557 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 875/1795] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:41 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1478 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:41.573794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:41.574476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:41.588296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:41.588949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:41.589467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:41.590315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:41.590770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:41.591257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:41.890895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:41.901165 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a8b6c960-9e34-45d2-836c-8963ae4f0c48 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1395 microversion: 2.1 time: 0.333070 Oct 04 11:06:41.902042 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 876/1796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:41 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1395 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:41.906256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:41.906856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:41.913305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:41.913746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:41.914185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:41.914882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:41.915331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:41.915751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.199615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.210401 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b338c2c0-fda9-446d-a9ab-2448067c9b32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1308 microversion: 2.1 time: 0.307257 Oct 04 11:06:42.211682 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 877/1797] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:41 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:42.218823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:42.219872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:42.226725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.227370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.228005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.228927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.229599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.230242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.282714 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e12291d7-c6d1-4848-9047-758131f524da tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640/action" status: 202 len: 0 microversion: 2.25 time: 3.161179 Oct 04 11:06:42.283579 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 921/1798] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:06:39 2022] POST /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640/action => generated 0 bytes in 3164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:06:42.292623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:42.293316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:42.300889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.301939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.303422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.304534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.305344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.306138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.421005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.436595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.438747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.458218 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1e6a817f-e097-43e0-b6a1-a771790a319b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.172036 Oct 04 11:06:42.458881 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 922/1799] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:42 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:42.464211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:42.465052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:42.474041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.474904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.475553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.476457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.477294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.477888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.481620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.494535 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c769c7e-6be1-4318-96a6-c395dc52b65b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.280666 Oct 04 11:06:42.495429 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 878/1800] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:42 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:42.556266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:42.563494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.564183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Searching by: {'deleted': False, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:06:42.570891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.571275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.571707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.572554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.573007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.573524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.609064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:06:42.648917 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a34cb453-0768-41ec-b06c-511633a7ca01 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.096360 Oct 04 11:06:42.659616 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 879/1801] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:06:42 2022] GET /compute/v2.1/servers => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:06:42.659616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:42.659616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:42.663340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.663843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.664732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.665397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.666169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.666742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.753831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.762497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.763593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:42.763986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.766289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0fc79e4e-4259-4692-8eb5-db703213a15b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.305129 Oct 04 11:06:42.773418 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 923/1802] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:42 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:42.773418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:42.776543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.777494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Searching by: {'deleted': False, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:06:42.784531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.785020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.785513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.786349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.786682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.787103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.816035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:06:42.855051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.863562 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b5d3607-9495-4586-9634-2427fa75eecf tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1463 microversion: 2.1 time: 0.212210 Oct 04 11:06:42.864935 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 880/1803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:42 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:42.899384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:42.902501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:42.908908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.909990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.910541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.911295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.911753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.912755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.928373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:42.934421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:42.934905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:42.935435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:42.995550 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7e8b5a7-ab12-491c-96cb-916aa00d7c7e tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action" status: 202 len: 0 microversion: 2.1 time: 0.101935 Oct 04 11:06:42.999341 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 881/1804] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:06:42 2022] POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:06:43.000951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.001656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.009254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.009788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.010228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.011653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.012087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.012519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.208858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b1c3b82-ac8f-4733-909f-980dcc3140de tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.440515 Oct 04 11:06:43.209748 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 924/1805] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:06:42 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:43.214666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.215274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.222743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.223399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.223962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.224670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.225125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.225575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.260327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:43.262549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.263039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.263476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.264445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lazy-loading 'fault' on Instance uuid 9d278191-0937-47b3-bb59-4c40c4a98bda {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:43.272884 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83b5f581-9325-480b-91e9-c1a33f134f54 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1395 microversion: 2.1 time: 0.275509 Oct 04 11:06:43.273801 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 882/1806] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:42 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1395 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:43.279275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2d4bc2f-d2ce-4a9b-a40a-0c44958f0594 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.289444 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2d4bc2f-d2ce-4a9b-a40a-0c44958f0594 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014225 Oct 04 11:06:43.290327 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 883/1807] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:06:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:43.295970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.296929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.304424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.305198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.305397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.306057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.306516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.307002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.481413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f74a6e67-232d-4e32-af7e-b94484acabc3 tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1597 microversion: 2.1 time: 0.270695 Oct 04 11:06:43.482421 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 925/1808] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:43 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1597 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:43.490559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.491377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.503927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.504681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.505110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.505866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.506317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.506618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:43.506745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.517372 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-00f12c8a-173f-45f8-b428-44e0d0434338 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1308 microversion: 2.1 time: 0.225840 Oct 04 11:06:43.518114 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 884/1809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:43 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:43.522759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:43.525015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.530863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.531350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.531781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.532474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.532924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.533377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.535720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:43.595658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:43.606312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:43.608048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:43.613679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2b0a30b-c268-4301-8587-2425c076d79b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.129995 Oct 04 11:06:43.614262 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 926/1810] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:43 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:43.619261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.619920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.625995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.626707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.627108 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6dd04b74-0fbd-4ae4-b7f0-330cce431b6c tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action" status: 202 len: 0 microversion: 2.1 time: 0.107680 Oct 04 11:06:43.627813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.628263 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 885/1811] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:06:43 2022] POST /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:06:43.628926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.629753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.630182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.639711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.640601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.649492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.650079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.650583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.651383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.651936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.652486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.845173 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f87c42cf-5d28-41d2-99ce-52b350c58c4a tempest-ServersAdminTestJSON-446676025 tempest-ServersAdminTestJSON-446676025-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1614 microversion: 2.1 time: 0.211903 Oct 04 11:06:43.846932 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 886/1812] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:43 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1614 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:43.851931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.852637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.858584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.859355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.860011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.860939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.861650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.862879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.865031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:43.878169 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1794caec-e818-47c0-bdbb-967ebb4084e8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.262636 Oct 04 11:06:43.879634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 927/1813] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:43 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:43.884635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:43.885701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:43.892095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.892786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.893492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.894384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:43.894994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:43.895576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:43.906456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:06:44.008687 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd0a821e-2c8e-4563-81c8-23d1bc2d9830 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "DELETE /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 204 len: 0 microversion: 2.1 time: 0.159953 Oct 04 11:06:44.012656 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 887/1814] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:06:43 2022] DELETE /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:06:44.015306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:44.015904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:44.022188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.022686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.023123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.023831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.024286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.024711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.056421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:06:44.069557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.078923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.082076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.083305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea38dcb4-bf3a-425d-a7b5-ca559722ca66 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.202391 Oct 04 11:06:44.102085 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 928/1815] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:43 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:44.107109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:44.107795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:44.114840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.115341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.115792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.116500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.117030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.117490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.167848 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bbfcdbb1-d0a0-4732-92e1-153cf2b5738d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 204 len: 0 microversion: 2.1 time: 0.155250 Oct 04 11:06:44.168612 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 888/1816] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:06:44 2022] DELETE /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:06:44.189934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:44.190663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:44.197117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.197621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.198054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.198766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.199218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.199661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.373918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.382483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f23713bb-2286-40d8-bf50-117e9367299d tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1610 microversion: 2.1 time: 0.279254 Oct 04 11:06:44.394484 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 929/1817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:44 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1610 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:44.405022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:44.405958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:44.413493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.414240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.414927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.418387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.419106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.419783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.442350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.452565 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f97298b3-1d57-49c8-bab9-2a913b5b53d5 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1470 microversion: 2.1 time: 0.270782 Oct 04 11:06:44.453540 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 889/1818] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:44 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:44.465028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c791aee9-872a-40f1-8a9c-e1f721f8cc7a req-a00f1c03-65c7-4e93-a726-d662b1804aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922cf522-37ef-40b7-93f9-5b774b6509f5", "name": "network-vif-plugged", "status": "completed", "tag": "e72b8805-d5b7-4013-ad4f-07fc4d0f8aeb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:44.476914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c791aee9-872a-40f1-8a9c-e1f721f8cc7a req-a00f1c03-65c7-4e93-a726-d662b1804aa8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.477439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c791aee9-872a-40f1-8a9c-e1f721f8cc7a req-a00f1c03-65c7-4e93-a726-d662b1804aa8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.477878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c791aee9-872a-40f1-8a9c-e1f721f8cc7a req-a00f1c03-65c7-4e93-a726-d662b1804aa8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.490757 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c791aee9-872a-40f1-8a9c-e1f721f8cc7a req-a00f1c03-65c7-4e93-a726-d662b1804aa8 service nova] Creating event network-vif-plugged:e72b8805-d5b7-4013-ad4f-07fc4d0f8aeb for instance 922cf522-37ef-40b7-93f9-5b774b6509f5 on n-h1-791135-8 Oct 04 11:06:44.495639 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c791aee9-872a-40f1-8a9c-e1f721f8cc7a req-a00f1c03-65c7-4e93-a726-d662b1804aa8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040906 Oct 04 11:06:44.496543 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 890/1819] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:44.541584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:44.542460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:44.548561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.549045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.549548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.550252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.551166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.551166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.586698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.598116 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ce59223a-ee62-4c66-9014-e1b5550b6f0c tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1395 microversion: 2.1 time: 0.202196 Oct 04 11:06:44.598775 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 930/1820] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:44 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1395 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:44.641514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:44.642122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:44.649885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.650371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.650805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.652204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.652855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.653505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.691467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.701830 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83fbe041-4b8a-4b5c-8491-611b0a190c76 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1308 microversion: 2.1 time: 0.164428 Oct 04 11:06:44.705027 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 891/1821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:44 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:44.765960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.777778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.779217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:44.785527 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-acbbef0d-2534-4ee1-ad2e-f2cfca43bf6b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.147774 Oct 04 11:06:44.786490 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 931/1822] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:44 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:44.904298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:44.904986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:44.911281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.911968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.912266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:44.913054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:44.913709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:44.914287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.064232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.073031 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-faf594c0-ce87-4690-8913-b059466ee2a2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.172720 Oct 04 11:06:45.073832 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 892/1823] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:44 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:45.108585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:45.109482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:45.117072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.117781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.118317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.119104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.120015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.120449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.256466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.264932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.266534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.267825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b466ad6-ef2d-4482-bcf7-befbfbfb7169 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.163373 Oct 04 11:06:45.268933 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 932/1824] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:45 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:45.410166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:45.411006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:45.418121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.418599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.419024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.419715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.420163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.420582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.475873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:45.476383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:45.482923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.483414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.483850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.484546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.484992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.485438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.594149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.606568 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-845120e3-d4f1-4a60-8500-1cd1d82af555 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1610 microversion: 2.1 time: 0.200225 Oct 04 11:06:45.607156 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 893/1825] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:45 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1610 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:45.620307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:45.621304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:45.629281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.629875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.630380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.631221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.631753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.632245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.645159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.653793 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28a2e36a-5350-42fb-9f40-d0d7aad786f0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1470 microversion: 2.1 time: 0.181709 Oct 04 11:06:45.654374 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 933/1826] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:45 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:45.728882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:45.729593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:45.735805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.736525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.737540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.738341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.739280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.739280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.770819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.779179 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4006b4d4-f95e-470b-9910-89f3820be1d4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1395 microversion: 2.1 time: 0.162859 Oct 04 11:06:45.780065 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 894/1827] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:45 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1395 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:45.815572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:45.816189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:45.823051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.823538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.823971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.824671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:45.825129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:45.825712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:45.918696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.925899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.927918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b24b963c-1eb7-4d3d-bc2b-7a927320b902 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1308 microversion: 2.1 time: 0.203122 Oct 04 11:06:45.929119 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 934/1828] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:45 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:45.938778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.941117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:45.948450 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5634b363-28ec-466e-8714-5858aee9ca86 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.137019 Oct 04 11:06:45.949057 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 895/1829] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:45 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:46.095939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:46.096544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:46.102629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.103106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.103549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:46.104227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.104673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.105091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:46.109057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:46.238939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:46.246677 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b2e66037-c2bc-43d7-87ac-0bb9a9a3c0ad tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.154875 Oct 04 11:06:46.249340 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 935/1830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:46 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:46.293902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:46.294605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:46.300750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.301307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.301845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:46.302626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.303153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.303660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:46.433664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:46.442432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:46.443844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:46.444982 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b875408c-38f3-45c5-9357-a329c69ef40d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.155046 Oct 04 11:06:46.445569 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 896/1831] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:46 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:46.512791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f282a1ba-72e5-4456-b2a5-a3d6ab8ee27c req-209cf480-567b-4aba-8ea2-548b6cbb3136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f41f528-5f20-4e31-a726-104bb7620bf6", "name": "network-vif-plugged", "status": "completed", "tag": "558bbb9f-7c34-4bb2-8e38-805a0c4df9cd"}, {"server_uuid": "b343130c-9edd-4145-a732-d5730ffc7edc", "name": "network-vif-plugged", "status": "completed", "tag": "cad87f36-7301-414e-8fe8-6249065e7c49"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:46.524416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f282a1ba-72e5-4456-b2a5-a3d6ab8ee27c req-209cf480-567b-4aba-8ea2-548b6cbb3136 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.524893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f282a1ba-72e5-4456-b2a5-a3d6ab8ee27c req-209cf480-567b-4aba-8ea2-548b6cbb3136 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.525321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f282a1ba-72e5-4456-b2a5-a3d6ab8ee27c req-209cf480-567b-4aba-8ea2-548b6cbb3136 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:46.539910 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f282a1ba-72e5-4456-b2a5-a3d6ab8ee27c req-209cf480-567b-4aba-8ea2-548b6cbb3136 service nova] Creating event network-vif-plugged:558bbb9f-7c34-4bb2-8e38-805a0c4df9cd for instance 2f41f528-5f20-4e31-a726-104bb7620bf6 on n-h2-791135-8 Oct 04 11:06:46.540429 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f282a1ba-72e5-4456-b2a5-a3d6ab8ee27c req-209cf480-567b-4aba-8ea2-548b6cbb3136 service nova] Creating event network-vif-plugged:cad87f36-7301-414e-8fe8-6249065e7c49 for instance b343130c-9edd-4145-a732-d5730ffc7edc on n-h1-791135-8 Oct 04 11:06:46.558770 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f282a1ba-72e5-4456-b2a5-a3d6ab8ee27c req-209cf480-567b-4aba-8ea2-548b6cbb3136 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049664 Oct 04 11:06:46.559744 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 936/1832] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:46.632317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:46.633022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:46.643163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.644046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.644686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:46.645617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.646250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.646840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:46.673709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:46.681178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:46.682202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:46.698220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.699215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.699997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:46.701235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:46.702093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:46.702750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:47.516712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:47.526240 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ffdcd91-9cb2-4e44-9f5a-48d8de8221b2 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1610 microversion: 2.1 time: 0.900447 Oct 04 11:06:47.527377 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 897/1833] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:46 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1610 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:47.543063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:47.550788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:47.551850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:47.556683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8348b65c-874e-46dc-bf3b-49730e8b187b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1470 microversion: 2.1 time: 0.884159 Oct 04 11:06:47.557815 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 937/1834] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:46 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1470 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:47.564834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:47.566272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:47.575702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:47.576699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:47.578245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:47.578380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:47.578798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:47.579423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:47.579576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:47.580166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:47.580448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:47.580943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:47.581392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:47.582011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:47.949091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:47.958305 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29bdaf5f-d120-4637-901d-8c33d46976b4 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1395 microversion: 2.1 time: 0.413129 Oct 04 11:06:47.970088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:47.974052 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 898/1835] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:47 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1395 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:47.979047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:47.979873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:47.985900 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c33a944-cbe1-44e6-b717-5dd7095a2561 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1308 microversion: 2.1 time: 0.426511 Oct 04 11:06:47.986280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:47.987011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.001940 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 938/1836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:47 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:48.001940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:48.001940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:48.003171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.004443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.005133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.005974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.009441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.010332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.010985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.015784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.016649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.017488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.091026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.100581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.102118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.108037 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e256e25c-d392-4684-a63f-5a01d91a2d00 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.132423 Oct 04 11:06:48.108731 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 899/1837] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:47 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:48.114035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c4eadc63-2e26-4720-9088-2a9d098f8f12 req-3a4e9727-8c5a-4f3d-bd20-330cc7b35d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e948af-4417-4d7e-b6f3-bd626a4b78af", "name": "network-vif-deleted", "tag": "e3300dae-21c8-4d18-ac53-b687cdfa275e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:48.123605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c4eadc63-2e26-4720-9088-2a9d098f8f12 req-3a4e9727-8c5a-4f3d-bd20-330cc7b35d17 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.124077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c4eadc63-2e26-4720-9088-2a9d098f8f12 req-3a4e9727-8c5a-4f3d-bd20-330cc7b35d17 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.124506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c4eadc63-2e26-4720-9088-2a9d098f8f12 req-3a4e9727-8c5a-4f3d-bd20-330cc7b35d17 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.142120 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c4eadc63-2e26-4720-9088-2a9d098f8f12 req-3a4e9727-8c5a-4f3d-bd20-330cc7b35d17 service nova] Creating event network-vif-deleted:e3300dae-21c8-4d18-ac53-b687cdfa275e for instance f4e948af-4417-4d7e-b6f3-bd626a4b78af on n-h1-791135-8 Oct 04 11:06:48.148470 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c4eadc63-2e26-4720-9088-2a9d098f8f12 req-3a4e9727-8c5a-4f3d-bd20-330cc7b35d17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037501 Oct 04 11:06:48.149642 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 900/1838] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:48.155991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:48.156890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:48.166663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.167830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.168454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.169533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.170514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.171115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.343693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.353242 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46412697-3c80-4346-b81d-db04e30bbc3e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1318 microversion: 2.1 time: 0.364334 Oct 04 11:06:48.353940 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 939/1839] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:47 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:48.450031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.463879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.466226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.468572 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4bc53680-b163-4cdc-bfa4-92044e7d3568 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.316344 Oct 04 11:06:48.468572 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 901/1840] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:48 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:48.556225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:48.558946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:48.571764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.572682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.573325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.577029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.577943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.579629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.583414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:48.584038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:48.595408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.595885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.597432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.601230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.602008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.602609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.741856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.744122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.744744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.745401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lazy-loading 'fault' on Instance uuid f4e948af-4417-4d7e-b6f3-bd626a4b78af {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:48.906727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.920170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:48.923500 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4bbf4099-95c6-4c3d-a317-cbac912ebba5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1542 microversion: 2.1 time: 0.372339 Oct 04 11:06:48.926820 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 940/1841] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:48 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1542 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:48.936078 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d97ef626-6b3b-4e37-acfe-bc3235c0e14b tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 200 len: 1304 microversion: 2.1 time: 0.357627 Oct 04 11:06:48.944227 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 902/1842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:48 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 1304 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:48.957652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-715afbf0-9814-4425-beb9-440f8f8a52b9 req-f408d872-ddb1-4cef-85b8-3c0f92539746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628b765d-b4cf-4a47-b151-9414fc1934a0", "name": "network-vif-deleted", "tag": "197d9c40-744c-4f59-9b1b-41cad82ecf0d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:48.968468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:48.970525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-715afbf0-9814-4425-beb9-440f8f8a52b9 req-f408d872-ddb1-4cef-85b8-3c0f92539746 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:48.971344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-715afbf0-9814-4425-beb9-440f8f8a52b9 req-f408d872-ddb1-4cef-85b8-3c0f92539746 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:48.972600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-715afbf0-9814-4425-beb9-440f8f8a52b9 req-f408d872-ddb1-4cef-85b8-3c0f92539746 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:48.980998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:48.982273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:49.015435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.015974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.016420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.017158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.017755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.018224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.037934 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-715afbf0-9814-4425-beb9-440f8f8a52b9 req-f408d872-ddb1-4cef-85b8-3c0f92539746 service nova] Creating event network-vif-deleted:197d9c40-744c-4f59-9b1b-41cad82ecf0d for instance 628b765d-b4cf-4a47-b151-9414fc1934a0 on n-h1-791135-8 Oct 04 11:06:49.055691 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-715afbf0-9814-4425-beb9-440f8f8a52b9 req-f408d872-ddb1-4cef-85b8-3c0f92539746 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123034 Oct 04 11:06:49.058820 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 941/1843] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:06:49.069562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:49.074519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:49.088574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.092149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.092618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.095974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.098042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.099690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.406252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:49.449244 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1d00661-1be8-4117-b3e4-1a19a32772fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1576 microversion: 2.1 time: 0.466739 Oct 04 11:06:49.450313 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 903/1844] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:48 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1576 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:49.455373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:49.464087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:49.480713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.481337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.482879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.483695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.486105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.486625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.513626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:49.532828 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-59f8e770-9fa9-47ce-8422-8534d569741e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1488 microversion: 2.1 time: 0.472252 Oct 04 11:06:49.545202 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 942/1845] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:49 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1488 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:49.566163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:49.569862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:49.586555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.589195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.595080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:49.601193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.602119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.602611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.603052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.611203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:49.615322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:49.621267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:49.630007 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24da5c39-b9a7-472e-bfde-058bfeea1776 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.177564 Oct 04 11:06:49.631873 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 904/1846] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:49 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:49.640396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:49.641633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:49.652762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.654651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.655664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.656669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.657393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.658137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.795693 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba23966a-715d-4de0-b3cd-b0b7dd6aa313 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161949 Oct 04 11:06:49.797697 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 905/1847] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:06:49 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:49.805498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:49.807160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:49.816523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.817443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.818245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.819412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:49.820262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:49.820974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:49.997274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.014569 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b16d0a5f-52ab-4e79-a37e-bcc4dad09bc5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1468 microversion: 2.1 time: 0.476440 Oct 04 11:06:50.015332 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 943/1848] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:49 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1468 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:50.024702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:50.025769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:50.041899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.042524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.043160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.044129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.044797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.047144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.157723 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ddd9cd66-570e-449e-aceb-626d17c94872 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc/action" status: 202 len: 0 microversion: 2.1 time: 0.140284 Oct 04 11:06:50.158906 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 944/1849] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:06:50 2022] POST /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:06:50.172202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.181036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:50.182520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:50.191543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.192289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.192951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.193948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.194577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.195191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.203322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.210301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.211869 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b3f2e00-5808-42bb-bae4-da82f62049aa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.412494 Oct 04 11:06:50.212936 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 906/1850] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:49 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:50.218942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:50.220223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: f4e948af-4417-4d7e-b6f3-bd626a4b78af] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:50.226709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.229316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.232301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.233210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.233900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.236635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.256435 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] HTTP exception thrown: Instance f4e948af-4417-4d7e-b6f3-bd626a4b78af could not be found. Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Request method failure captured: Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af HTTP/1.1 Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMgGGfGAFGzTFL6nvDkF0YZdu2Zclk6IlD9_15-Opzrhk-5jq_veCf8Se0DAZHT8vp1eXN5kZT7wAEyZDrWVgAJ3lhExMHLulC2aRFlZqtaZi68nK0WXS2-uISCbrp1xHaZpAutXUCy1oMWQjhtDK8jCvAVXJyPl0NdpUDcP2i_u6A Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 8e8dfb2a0b8d4faa8e810e56fc749d2d Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}] Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 8e8dfb2a0b8d4faa8e810e56fc749d2d Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersAdminTestJSON-1241196672-project Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 671786f1a7c74682a66520aeb60a5f50 Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminTestJSON-1241196672-project Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance f4e948af-4417-4d7e-b6f3-bd626a4b78af could not be found. Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'f4e948af-4417-4d7e-b6f3-bd626a4b78af'} Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e948af-4417-4d7e-b6f3-bd626a4b78af could not be found. Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e948af-4417-4d7e-b6f3-bd626a4b78af could not be found. Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:50.258608 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e948af-4417-4d7e-b6f3-bd626a4b78af could not be found. Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Returning 404 to user: Instance f4e948af-4417-4d7e-b6f3-bd626a4b78af could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9ea369b-17d9-430d-9197-93f34872d9a6 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af" status: 404 len: 111 microversion: 2.1 time: 0.045924 Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 907/1851] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:50 2022] GET /compute/v2.1/servers/f4e948af-4417-4d7e-b6f3-bd626a4b78af => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:06:50.266272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:50.268262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:50.274448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.275595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.275837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.279516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.279516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.279516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.302736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.318570 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e55776f5-e0a7-487b-8b5e-e73b45950972 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1253 microversion: 2.1 time: 0.157748 Oct 04 11:06:50.319587 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 945/1852] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:50 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1253 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:50.329319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:50.349662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:50.365605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.366220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.366946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.369538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.369538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.369538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.659583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.666845 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12fb53a2-1d79-4e26-8171-a7285bfa9d92 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578" status: 200 len: 1468 microversion: 2.1 time: 0.405032 Oct 04 11:06:50.667751 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 908/1853] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:50 2022] GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578 => generated 1468 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:50.671950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.672335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:50.672831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:50.679534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.680028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.680471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.681192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.682025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.682625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.683931 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29f48ae8-0199-4b0d-a10f-36adcb7b92b8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1493 microversion: 2.1 time: 0.363187 Oct 04 11:06:50.685584 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 946/1854] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:50 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1493 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:50.694906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:50.695945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:50.708406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.709735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.710722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.711600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:06:50.712704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.715142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.715659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.807985 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c644a8fe-3ec2-440e-9497-6c7c98f89b46 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 204 len: 0 microversion: 2.1 time: 0.137909 Oct 04 11:06:50.808964 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 909/1855] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:06:50 2022] DELETE /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:06:50.817311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:50.822635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.823522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Searching by: {'reservation_id': 'r-7o2yn50q', 'deleted': False, 'project_id': 'bf100271e41c4475835267bcaf15c0b3'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:06:50.830490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.832409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.832587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.833046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.834506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.835739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.836287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.842377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.844629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:50.851161 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95140775-abc6-4b9d-a408-eeecd6733496 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.161443 Oct 04 11:06:50.866034 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 947/1856] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:50 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:50.871063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:50.871667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:50.885321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.886265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.886867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.888251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:50.888878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:50.889571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:50.994422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:06:51.079409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:51.088501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.088998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.089456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.443672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:51.451591 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70e1b60f-58d4-43c9-a0e3-d6181f49a0e4 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1469 microversion: 2.1 time: 0.584221 Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 948/1857] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:50 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1469 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.469259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.615254 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dce95982-6db4-4624-b0ed-2eaf44de855e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-7o2yn50q" status: 200 len: 2929 microversion: 2.1 time: 0.804295 Oct 04 11:06:51.629664 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 910/1858] 10.222.0.23 () {58 vars in 1197 bytes} [Tue Oct 4 11:06:50 2022] GET /compute/v2.1/servers/detail?reservation_id=r-7o2yn50q => generated 2929 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:51.629664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:51.629664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:51.629664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.630101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.630598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.631318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.631775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.632204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.717022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:51.725566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:51.726145 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6917a287-6b17-4239-8be2-0e06867648b5 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1253 microversion: 2.1 time: 0.109307 Oct 04 11:06:51.730815 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 911/1859] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:51 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1253 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:51.736435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd00d0b7-e6d9-47f2-9a1f-15f294a05409 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:51.749565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:51.752161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:51.755173 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff7934d7-2b6d-4be6-bc43-39887eed5f7d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.302001 Oct 04 11:06:51.755930 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 949/1860] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:51 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:51.761519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:51.762403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:51.771176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.771974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.773152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.774023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.774582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.774883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.compute.server_groups [None req-bd00d0b7-e6d9-47f2-9a1f-15f294a05409 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Querying cell 6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) for 2 instances {{(pid=122408) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 11:06:51.775228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.775624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd00d0b7-e6d9-47f2-9a1f-15f294a05409 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.776118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd00d0b7-e6d9-47f2-9a1f-15f294a05409 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.776542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd00d0b7-e6d9-47f2-9a1f-15f294a05409 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.815541 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd00d0b7-e6d9-47f2-9a1f-15f294a05409 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/315e223e-fc8e-4a6f-9f5c-75915503dd52" status: 200 len: 265 microversion: 2.1 time: 0.082792 Oct 04 11:06:51.816314 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 912/1861] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:06:51 2022] GET /compute/v2.1/os-server-groups/315e223e-fc8e-4a6f-9f5c-75915503dd52 => generated 265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:51.834141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:51.834898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:51.841212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.841838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.842404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.843194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:51.844442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:51.844982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:51.879943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:52.036371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:52.044084 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b98e339-01e6-417d-a914-ed7dc646a3ae tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 200 len: 1473 microversion: 2.1 time: 0.286634 Oct 04 11:06:52.055970 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-313161e7-9a79-4b5a-ac93-b596abdf3ff7 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 200 len: 1619 microversion: 2.1 time: 0.229540 Oct 04 11:06:52.057623 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 950/1862] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:51 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 1473 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:52.065818 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 913/1863] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:51 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 1619 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:52.068168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:52.068776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:52.075192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.075901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.076522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.077417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.078031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.078166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3572ab06-ebba-4812-adc8-635d0a6501cc req-6f049127-4e89-45be-be15-1b15210e3829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922cf522-37ef-40b7-93f9-5b774b6509f5", "tag": "e72b8805-d5b7-4013-ad4f-07fc4d0f8aeb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:52.078743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.087420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3572ab06-ebba-4812-adc8-635d0a6501cc req-6f049127-4e89-45be-be15-1b15210e3829 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.087897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3572ab06-ebba-4812-adc8-635d0a6501cc req-6f049127-4e89-45be-be15-1b15210e3829 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.088324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3572ab06-ebba-4812-adc8-635d0a6501cc req-6f049127-4e89-45be-be15-1b15210e3829 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.099983 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3572ab06-ebba-4812-adc8-635d0a6501cc req-6f049127-4e89-45be-be15-1b15210e3829 service nova] Creating event network-changed:e72b8805-d5b7-4013-ad4f-07fc4d0f8aeb for instance 922cf522-37ef-40b7-93f9-5b774b6509f5 on n-h1-791135-8 Oct 04 11:06:52.105063 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3572ab06-ebba-4812-adc8-635d0a6501cc req-6f049127-4e89-45be-be15-1b15210e3829 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037679 Oct 04 11:06:52.108861 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 914/1864] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:52.114183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:52.114888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:52.121263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.121974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.122207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.122914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.123368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.124015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.234008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:52.244710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:52.246492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:52.255950 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e240766e-3b91-48ad-ac52-156795ed9b49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.145512 Oct 04 11:06:52.269382 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 915/1865] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:52 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:52.269382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-879468702"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:52.269382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:52.280282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.280282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.280282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.280282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.280282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.280282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.306259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:52.315428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12456b55-25e4-47e9-935e-f1a25236d207 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1576 microversion: 2.1 time: 0.256109 Oct 04 11:06:52.316021 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 951/1866] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:52 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:52.320368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:52.320966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:52.345070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.345677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.346918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.347640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.348095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.348518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.390932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:52.561381 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f004658-6c9b-4ae3-a97b-b0aa738fbe45 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578" status: 200 len: 1619 microversion: 2.1 time: 0.244256 Oct 04 11:06:52.575696 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 952/1867] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:52 2022] GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578 => generated 1619 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:52.586898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:52.587545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:52.599641 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dde7b94e-2045-42b9-9b0b-9d11ee46f950 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc/action" status: 202 len: 0 microversion: 2.1 time: 0.340441 Oct 04 11:06:52.600234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.600874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.601303 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 916/1868] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:06:52 2022] POST /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:06:52.601510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.602232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.602691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.603123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.607996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c16d6e0e-2176-42da-9e9f-6d4d67e030de tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Action: 'create', calling method: .version_select at 0x7f71d4555c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1861930311", "policies": ["anti-affinity"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:52.631505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c16d6e0e-2176-42da-9e9f-6d4d67e030de tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:52.647601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c16d6e0e-2176-42da-9e9f-6d4d67e030de tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:52.742356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c16d6e0e-2176-42da-9e9f-6d4d67e030de tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:52.747528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c16d6e0e-2176-42da-9e9f-6d4d67e030de tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_groups'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:52.761695 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c16d6e0e-2176-42da-9e9f-6d4d67e030de tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.157824 Oct 04 11:06:52.762766 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 917/1869] 10.222.0.23 () {60 vars in 1174 bytes} [Tue Oct 4 11:06:52 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:52.776606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73177b96-bcd4-4e6a-9d2f-a99e954f1801 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cfffce50>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:52.793821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:52.861975 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73177b96-bcd4-4e6a-9d2f-a99e954f1801 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1411 microversion: 2.1 time: 0.089529 Oct 04 11:06:52.862970 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 918/1870] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:06:52 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:52.869167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:52.870122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:52.879499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.880103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.880817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.881687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.883031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.883494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.926030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:52.928728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=24 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:52.936076 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2d3cabf-8aa8-411f-a2f8-51102b148dbb tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1469 microversion: 2.1 time: 0.358019 Oct 04 11:06:52.936894 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 953/1871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:52 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:52.954426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:52.956804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:52.963607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.964101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.964541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.965251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:52.965742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:52.966163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:52.983954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:52.993845 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d09997a2-2d0a-487c-8b10-18690f355d60 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1253 microversion: 2.1 time: 0.129578 Oct 04 11:06:52.994626 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 919/1872] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:52 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1253 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:53.013606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1201635452", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "7b849dec-e686-4153-a150-b266f4a927ab"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:53.082241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:06:53.453668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:53.462860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:53.464430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:53.465836 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82637226-adb5-4918-91d8-408dc4eca5e4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.528023 Oct 04 11:06:53.466385 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 954/1873] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:52 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:53.473529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:53.474131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:53.481028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:53.481679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:53.482256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:53.483020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:53.483576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:53.484106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:53.597709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:53.607623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:53.615469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:53.621808 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfd9e036-f93b-4d87-b887-c7ace83c87da tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.154120 Oct 04 11:06:53.642492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 955/1874] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:53 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:53.695546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:06:53.696079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:06:53.696664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:06:53.697177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:06:53.697737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:06:53.712857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:53.713557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:53.714122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:53.714943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:53.715553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:53.716114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:53.723746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=11 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:53.736312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:53.742002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:53.756470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Going to run 2 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:06:53.759202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:06:53.825829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:53.829974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:53.860050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:53.874227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:53.879892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:53.883618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-15cbb6bf-8260-4b54-8056-f6f06125b936 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4245790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:53.897555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:06:53.955256 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-15cbb6bf-8260-4b54-8056-f6f06125b936 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1411 microversion: 2.1 time: 0.080656 Oct 04 11:06:53.957146 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 956/1875] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:06:53 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:53.961978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:53.962839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:53.969939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:53.970542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:53.971087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:53.971865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:53.972392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:53.972885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:53.989679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:53.996968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:54.043202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.050508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:06:54.054754 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-edfb2caa-6ed2-4d35-94a1-31cfdf73f0d0 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1427 microversion: 2.1 time: 0.096333 Oct 04 11:06:54.056217 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 957/1876] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:53 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:54.057144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'server_group_members'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:06:54.061424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:54.062320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:54.074641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.075138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.075573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.076291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.076743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.077172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.149897 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-333d90cb-ee94-4307-a8fc-a601a31bf0b3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.139715 Oct 04 11:06:54.151597 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 920/1877] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:06:52 2022] POST /compute/v2.1/servers => generated 32 bytes in 1156 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:06:54.158534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-73df7702-4cdd-4a84-8f13-42cac5c7f0e2 req-8770d2db-e9d4-4be2-8c60-d3998d6b3a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a138f63e-bcb7-4a95-baa5-08da1f47aad6", "name": "network-vif-deleted", "tag": "0f9193e2-f9f9-4947-bc48-2ebefb080a4d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:54.175734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-73df7702-4cdd-4a84-8f13-42cac5c7f0e2 req-8770d2db-e9d4-4be2-8c60-d3998d6b3a12 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.176300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-73df7702-4cdd-4a84-8f13-42cac5c7f0e2 req-8770d2db-e9d4-4be2-8c60-d3998d6b3a12 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.176793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-73df7702-4cdd-4a84-8f13-42cac5c7f0e2 req-8770d2db-e9d4-4be2-8c60-d3998d6b3a12 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.190861 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-73df7702-4cdd-4a84-8f13-42cac5c7f0e2 req-8770d2db-e9d4-4be2-8c60-d3998d6b3a12 service nova] Creating event network-vif-deleted:0f9193e2-f9f9-4947-bc48-2ebefb080a4d for instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 on n-h2-791135-8 Oct 04 11:06:54.197043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.197496 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-73df7702-4cdd-4a84-8f13-42cac5c7f0e2 req-8770d2db-e9d4-4be2-8c60-d3998d6b3a12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044293 Oct 04 11:06:54.199025 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 921/1878] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:54.207891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:54.209079 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-58cb83b9-9586-429a-aed2-df960ad5841a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1253 microversion: 2.1 time: 0.151500 Oct 04 11:06:54.210370 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 958/1879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:54 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1253 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:54.217673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.219084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Searching by: {'deleted': False, 'project_id': 'bf100271e41c4475835267bcaf15c0b3'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:06:54.239990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.240846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.241626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.244036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.244677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.245314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.287579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:06:54.324220 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03db51ff-fc9a-4d4a-a861-54d851e707dd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.122633 Oct 04 11:06:54.325663 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 922/1880] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:06:54 2022] GET /compute/v2.1/servers => generated 1664 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:54.343953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59331226-81fa-4005-abe7-9deff997d00e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:54.344753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-59331226-81fa-4005-abe7-9deff997d00e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:54.473581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-59331226-81fa-4005-abe7-9deff997d00e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.487052 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-59331226-81fa-4005-abe7-9deff997d00e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1219 microversion: 2.1 time: 0.147604 Oct 04 11:06:54.488097 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 959/1881] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:54 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:54.491437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:54.492180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:54.511961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.512677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.513290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.514289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.515022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.515924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.652396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:54.653045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:54.662747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.664332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.664786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.665559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:54.667541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:54.678604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:54.792086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.806420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.808788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.815947 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f6955a49-654d-4d1e-8965-63febd911702 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1560 microversion: 2.91 time: 0.167483 Oct 04 11:06:54.823029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.830266 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 960/1882] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:54 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:54.837647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.839129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:54.840702 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1169047f-17ec-4135-a999-dd4daa6e9d57 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.353390 Oct 04 11:06:54.841482 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 923/1883] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:54 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:54.972221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8657ee3e-2687-444e-aa37-40156a707468 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4269f70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:55.022792 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8657ee3e-2687-444e-aa37-40156a707468 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1411 microversion: 2.1 time: 0.054321 Oct 04 11:06:55.023668 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 961/1884] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:06:54 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1411 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:55.088197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:55.089084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:55.096632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.097167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.097641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.098347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.098804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.099228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.135690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.136171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.136608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.137076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lazy-loading 'fault' on Instance uuid a138f63e-bcb7-4a95-baa5-08da1f47aad6 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:55.179456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:55.187470 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44989f6d-08b7-4755-9d9b-69bfa4fdab7d tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1303 microversion: 2.1 time: 0.104401 Oct 04 11:06:55.188050 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 924/1885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:55 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:55.234929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:55.235545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:55.243061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.243866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.244369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.245179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.245743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.246265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.285127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.285796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.286223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.286677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lazy-loading 'fault' on Instance uuid 628b765d-b4cf-4a47-b151-9414fc1934a0 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:55.359370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21554eac00f49a88859835db6a7581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b968e6eb837f4be2b40439b79a0b7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:55.370777 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b094b9dc-ccd9-4c4e-8ab3-21ffac0b173a tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 200 len: 1258 microversion: 2.1 time: 0.140184 Oct 04 11:06:55.372023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 962/1886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:55 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 1258 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:55.512219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:55.512822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:55.519933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.520409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.520835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.521547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.522038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.522412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.633666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:55.642355 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14b371ca-6d9c-4314-98d6-eb3e5bead05b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1271 microversion: 2.1 time: 0.133938 Oct 04 11:06:55.643161 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 925/1887] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:55 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:55.849659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:55.853193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:55.865120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.865979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.866689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.867811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.868484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.869132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.869502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:55.870931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:55.884425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.885046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.885650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.886615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:55.887173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:55.887836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:55.985311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:55.999991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:56.001860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:56.010074 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72d4b8e4-bcab-4a58-8a06-35e9a4253d49 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1560 microversion: 2.91 time: 0.169032 Oct 04 11:06:56.011252 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 963/1888] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:55 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:56.039617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18b8a963-9887-44d3-84a3-cc227fe67edc tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4211e50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:56.091062 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18b8a963-9887-44d3-84a3-cc227fe67edc tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1411 microversion: 2.1 time: 0.056045 Oct 04 11:06:56.099902 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 964/1889] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:06:56 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1411 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:56.106142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:56.116121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:56.117674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:56.118919 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72a103d6-58a5-41fa-911c-c5795844db33 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.254273 Oct 04 11:06:56.119643 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 926/1890] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:55 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:06:56.212334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:56.213284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:56.228809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:56.229622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:56.230272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:56.231163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:56.231797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:56.232401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:56.305863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:56.306633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:56.307438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:56.308060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lazy-loading 'fault' on Instance uuid a138f63e-bcb7-4a95-baa5-08da1f47aad6 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:06:56.396035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:56.397467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] [instance: 628b765d-b4cf-4a47-b151-9414fc1934a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:56.414822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:56.415450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:56.416998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:56.418048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:56.418521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:56.418952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:56.472206 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] HTTP exception thrown: Instance 628b765d-b4cf-4a47-b151-9414fc1934a0 could not be found. Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Request method failure captured: Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 HTTP/1.1 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBNCQCxxX0QBftuvLv8UKSnblZf0P2q3YapGqJ_3qJeBHEoG_NCVyROdtJvSncGlt1wDzjMZvGKx-is4AbhAx9ogD2sq1O3__2DG7cU-L_fqsl88ag-tj0bpnBwpBN1KZQDm8uGLMEqtgsN4t_v1FZdJaDubFUaddS_rzjZwqd3Q37U Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: b968e6eb837f4be2b40439b79a0b7509 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestBootFromVolume-282039429 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b968e6eb837f4be2b40439b79a0b7509"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b968e6eb837f4be2b40439b79a0b7509"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b968e6eb837f4be2b40439b79a0b7509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b968e6eb837f4be2b40439b79a0b7509"}]}] Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestBootFromVolume-282039429 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: b968e6eb837f4be2b40439b79a0b7509 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestBootFromVolume-282039429 Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersTestBootFromVolume-282039429-project Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: c21554eac00f49a88859835db6a7581e Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestBootFromVolume-282039429-project Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 628b765d-b4cf-4a47-b151-9414fc1934a0 could not be found. Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '628b765d-b4cf-4a47-b151-9414fc1934a0'} Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628b765d-b4cf-4a47-b151-9414fc1934a0 could not be found. Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628b765d-b4cf-4a47-b151-9414fc1934a0 could not be found. Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:56.477786 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628b765d-b4cf-4a47-b151-9414fc1934a0 could not be found. Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Returning 404 to user: Instance 628b765d-b4cf-4a47-b151-9414fc1934a0 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:06:56.482376 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-997e7cda-f7a0-493e-bf9c-a7d2fb6904eb tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0" status: 404 len: 111 microversion: 2.1 time: 0.088954 Oct 04 11:06:56.486191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:56.487724 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 927/1891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:56 2022] GET /compute/v2.1/servers/628b765d-b4cf-4a47-b151-9414fc1934a0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:06:56.496642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-824cf1a7-4fce-4a91-bc7e-58ec2b3ddc58 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] Calling method '.version_select at 0x7f71cfe8a040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:56.498313 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc1f976a-3867-4bc0-be2f-899c4d7fffac tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 200 len: 1303 microversion: 2.1 time: 0.290121 Oct 04 11:06:56.519553 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 965/1892] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:56 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 1303 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:56.544091 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-824cf1a7-4fce-4a91-bc7e-58ec2b3ddc58 tempest-ServersTestBootFromVolume-282039429 tempest-ServersTestBootFromVolume-282039429-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360255257" status: 202 len: 0 microversion: 2.1 time: 0.053065 Oct 04 11:06:56.552589 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 928/1893] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360255257 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:06:56.667328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:56.667950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:56.676357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:56.676855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:56.677301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:56.690389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:56.691010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:56.693058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:56.833947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:56.847545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2240189-0316-4e9c-b384-5283d93ba6a9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1289 microversion: 2.1 time: 0.182446 Oct 04 11:06:56.849318 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 966/1894] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:56 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1289 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:57.041164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:57.042482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:57.053297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.055330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.058836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.059852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.060495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.061775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.108170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-86ffc962-258c-45ab-ad77-f0df397d7211 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d424daf0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:57.181077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-86ffc962-258c-45ab-ad77-f0df397d7211 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1411 microversion: 2.1 time: 0.077346 Oct 04 11:06:57.182111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 967/1895] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:06:57 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:57.189165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:57.190536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:57.201323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.202955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.203773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.204884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.208493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.208950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.404100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:57.439361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:57.449120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:57.487463 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a67bbbc0-d320-4af9-8375-859a2f9f99ae tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1560 microversion: 2.91 time: 0.447545 Oct 04 11:06:57.501421 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 929/1896] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:57 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1560 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:57.524218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:57.525126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: a138f63e-bcb7-4a95-baa5-08da1f47aad6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:57.533160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.534242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.534896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.535823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.536707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.537542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.582560 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] HTTP exception thrown: Instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 could not be found. Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Request method failure captured: Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 HTTP/1.1 Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMgGGfGAFGzTFL6nvDkF0YZdu2Zclk6IlD9_15-Opzrhk-5jq_veCf8Se0DAZHT8vp1eXN5kZT7wAEyZDrWVgAJ3lhExMHLulC2aRFlZqtaZi68nK0WXS2-uISCbrp1xHaZpAutXUCy1oMWQjhtDK8jCvAVXJyPl0NdpUDcP2i_u6A Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 8e8dfb2a0b8d4faa8e810e56fc749d2d Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}] Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 8e8dfb2a0b8d4faa8e810e56fc749d2d Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersAdminTestJSON-1241196672-project Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 671786f1a7c74682a66520aeb60a5f50 Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminTestJSON-1241196672-project Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 could not be found. Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'a138f63e-bcb7-4a95-baa5-08da1f47aad6'} Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 could not be found. Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 could not be found. Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:06:57.584412 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:57.589429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:06:57.589429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:06:57.589429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:06:57.589429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:06:57.589429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:06:57.589429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 could not be found. Oct 04 11:06:57.589429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:06:57.597153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Returning 404 to user: Instance a138f63e-bcb7-4a95-baa5-08da1f47aad6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:06:57.598057 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-120dd204-fd12-4a1f-9273-3b8c333da02e tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6" status: 404 len: 111 microversion: 2.1 time: 0.078329 Oct 04 11:06:57.598624 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 930/1897] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:57 2022] GET /compute/v2.1/servers/a138f63e-bcb7-4a95-baa5-08da1f47aad6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:06:57.612768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:57.613381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:57.619935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:57.631488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:57.632927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:57.634129 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a172db7a-e5d6-483a-9a34-35a56f04f610 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.450609 Oct 04 11:06:57.634680 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 968/1898] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:57 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:57.650731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.651480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.652076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.652951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.653591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.654172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.710133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:06:57.874960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:57.875594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:57.887691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.888462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.888818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.889572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.890042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.890468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.933717 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de189213-f7cc-47dd-81f1-5d61f6b0a7e8 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 204 len: 0 microversion: 2.1 time: 0.329449 Oct 04 11:06:57.934320 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 931/1899] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:06:57 2022] DELETE /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:06:57.954793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:57.956045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:57.974818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.975915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.976359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:57.977112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:57.978759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:57.979193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:58.189442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:58.209082 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b667435-97c8-478f-bed3-23470d653630 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1277 microversion: 2.1 time: 0.339229 Oct 04 11:06:58.213064 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 969/1900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:57 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1277 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:06:58.231293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f51a4b2-581d-410a-9a08-b1fd632db380 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d424dca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:58.315156 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f51a4b2-581d-410a-9a08-b1fd632db380 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1411 microversion: 2.1 time: 0.100439 Oct 04 11:06:58.316293 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 970/1901] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:06:58 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:58.328497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c6e1cf5e-45e0-415d-8ffc-6bb523671c42 req-31062d7f-4cb3-4b1a-8783-bd2e6b8b46f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b343130c-9edd-4145-a732-d5730ffc7edc", "name": "network-vif-plugged", "status": "completed", "tag": "cad87f36-7301-414e-8fe8-6249065e7c49"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:58.350521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c6e1cf5e-45e0-415d-8ffc-6bb523671c42 req-31062d7f-4cb3-4b1a-8783-bd2e6b8b46f8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:58.370375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c6e1cf5e-45e0-415d-8ffc-6bb523671c42 req-31062d7f-4cb3-4b1a-8783-bd2e6b8b46f8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:58.378532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c6e1cf5e-45e0-415d-8ffc-6bb523671c42 req-31062d7f-4cb3-4b1a-8783-bd2e6b8b46f8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:58.415245 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c6e1cf5e-45e0-415d-8ffc-6bb523671c42 req-31062d7f-4cb3-4b1a-8783-bd2e6b8b46f8 service nova] Creating event network-vif-plugged:cad87f36-7301-414e-8fe8-6249065e7c49 for instance b343130c-9edd-4145-a732-d5730ffc7edc on n-h1-791135-8 Oct 04 11:06:58.440896 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c6e1cf5e-45e0-415d-8ffc-6bb523671c42 req-31062d7f-4cb3-4b1a-8783-bd2e6b8b46f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119428 Oct 04 11:06:58.443737 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 971/1902] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:58.519562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:58.520594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:58.530468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:58.538162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:58.539047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:58.539996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:58.540631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:58.541236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:58.910594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:58.926522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:58.934252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:58.952386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-853ff7fe-d85e-4629-a576-212c51be7661 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1560 microversion: 2.91 time: 0.438087 Oct 04 11:06:58.953401 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 972/1903] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:58 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1560 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:58.969259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:58.972027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:58.983281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:58.983838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:58.984553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:58.985392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:58.986098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:58.987187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:58.996761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:59.006411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:06:59.015502 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a50894f1-e07d-45fd-88ec-a2ed55ecdc35 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1469 microversion: 2.1 time: 1.076048 Oct 04 11:06:59.016994 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 932/1904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:57 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1469 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:59.235989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:59.240438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:06:59.256534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:59.257343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:59.258404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:59.259604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:59.260523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:59.262503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:59.472177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:59.485774 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b550fd7d-b63c-4f62-9303-d8e49b48e840 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1277 microversion: 2.1 time: 0.253633 Oct 04 11:06:59.491765 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 933/1905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:06:59 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:59.501993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e82b742c-c4c7-4740-9261-286d5f21870b req-f3b4d81b-9203-4d19-8e86-379947feb08e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314aa825-15be-4c05-88d6-b47c202d4640", "name": "network-vif-unplugged", "status": "completed", "tag": "fb97bf5a-d2d4-4256-9000-0254ba7aa594"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:06:59.522614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:59.531325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:59.542121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:06:59.545045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0d90133-e992-47fb-aa24-246f9d58171f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.590367 Oct 04 11:06:59.571482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e82b742c-c4c7-4740-9261-286d5f21870b req-f3b4d81b-9203-4d19-8e86-379947feb08e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:06:59.571771 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 973/1906] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:58 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:06:59.582571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e82b742c-c4c7-4740-9261-286d5f21870b req-f3b4d81b-9203-4d19-8e86-379947feb08e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:06:59.583678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e82b742c-c4c7-4740-9261-286d5f21870b req-f3b4d81b-9203-4d19-8e86-379947feb08e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:06:59.586419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f759e9a7-a220-4257-b863-7a45db0a2d32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4269820>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:59.623560 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e82b742c-c4c7-4740-9261-286d5f21870b req-f3b4d81b-9203-4d19-8e86-379947feb08e service nova] Creating event network-vif-unplugged:fb97bf5a-d2d4-4256-9000-0254ba7aa594 for instance 314aa825-15be-4c05-88d6-b47c202d4640 on n-h1-791135-8 Oct 04 11:06:59.638602 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e82b742c-c4c7-4740-9261-286d5f21870b req-f3b4d81b-9203-4d19-8e86-379947feb08e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145510 Oct 04 11:06:59.640166 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 934/1907] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:06:59.699029 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f759e9a7-a220-4257-b863-7a45db0a2d32 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1411 microversion: 2.1 time: 0.122984 Oct 04 11:06:59.699674 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 974/1908] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:06:59 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:06:59.986552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:06:59.987601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:00.003530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:00.004460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:00.009412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:00.010916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:00.012924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:00.013621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:00.046605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:00.047226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:00.061633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:00.062137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:00.066778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:00.068096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:00.072130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:00.074197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:00.593192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:00.602617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:00.606179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:00.624143 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c09791f5-fbc1-453a-be61-3b1c5d5215e9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1560 microversion: 2.91 time: 0.642890 Oct 04 11:07:00.631792 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 935/1909] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:06:59 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1560 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:00.646233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:00.655284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:00.678168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:00.678661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:00.679709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:00.688725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:00.689389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:00.689945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:01.048711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:01.063779 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e00109d-d89e-48f6-844f-d1ccc520062a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1319 microversion: 2.1 time: 0.430514 Oct 04 11:07:01.068212 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 936/1910] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:00 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:01.079913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:01.082153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:01.091321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:01.092166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:01.092842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:01.094474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:01.095173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:01.096120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:01.097010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:01.103804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:01.109840 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db665b43-dd3c-4490-86ff-5b1f281535af tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1469 microversion: 2.1 time: 1.064626 Oct 04 11:07:01.130763 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 975/1911] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:00 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1469 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:01.137683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8588119e-af21-4ae2-a55a-b357bbc87322 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d86fea60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:01.495557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:01.507972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:01.507972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:01.513050 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-26555d6a-146a-4b06-8cb5-853a886572f8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.442414 Oct 04 11:07:01.518314 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 937/1912] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:01 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:01.664050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:01.664955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:01.689199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:01.695198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:01.696137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:01.699152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:01.701292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:01.702035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:01.884776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:01.895031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:01.897385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:01.905019 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32fe870f-4ad2-4390-ba8c-e573288ef033 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.248999 Oct 04 11:07:01.906859 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 938/1913] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:01 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:01.914258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-644f0a45-c86a-49d4-a8ef-f8d500db54d9 req-eb61801d-cb65-459d-a9d6-9909fb809991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314aa825-15be-4c05-88d6-b47c202d4640", "tag": "fb97bf5a-d2d4-4256-9000-0254ba7aa594"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:01.928952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-644f0a45-c86a-49d4-a8ef-f8d500db54d9 req-eb61801d-cb65-459d-a9d6-9909fb809991 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:01.930124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-644f0a45-c86a-49d4-a8ef-f8d500db54d9 req-eb61801d-cb65-459d-a9d6-9909fb809991 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:01.930779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-644f0a45-c86a-49d4-a8ef-f8d500db54d9 req-eb61801d-cb65-459d-a9d6-9909fb809991 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:01.944980 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-644f0a45-c86a-49d4-a8ef-f8d500db54d9 req-eb61801d-cb65-459d-a9d6-9909fb809991 service nova] Creating event network-changed:fb97bf5a-d2d4-4256-9000-0254ba7aa594 for instance 314aa825-15be-4c05-88d6-b47c202d4640 on n-h1-791135-8 Oct 04 11:07:01.951639 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-644f0a45-c86a-49d4-a8ef-f8d500db54d9 req-eb61801d-cb65-459d-a9d6-9909fb809991 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043303 Oct 04 11:07:01.959449 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 939/1914] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:02.100244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:02.107269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:02.120640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:02.123344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:02.123641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:02.124670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:02.127272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:02.133246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:02.490264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:02.505766 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4fc14f10-80a1-45a4-b48e-6229e93b1096 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1319 microversion: 2.1 time: 0.411710 Oct 04 11:07:02.546910 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 940/1915] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:02 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:02.566497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:02.567152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:02.589786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:02.594160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:02.597048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:02.598094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:02.598829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:02.599506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:02.701873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:02.702678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:02.703548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:02.705520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lazy-loading 'fault' on Instance uuid 9d278191-0937-47b3-bb59-4c40c4a98bda {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:02.911455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '671786f1a7c74682a66520aeb60a5f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8dfb2a0b8d4faa8e810e56fc749d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:02.944917 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72af3f8c-f1c1-4748-aa10-0a329c7a5a56 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 200 len: 1304 microversion: 2.1 time: 0.387235 Oct 04 11:07:02.951463 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 941/1916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:02 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 1304 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:02.966142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:02.973911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:02.998975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:03.002326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:03.002790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:03.006377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:03.007188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:03.007697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:03.257418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:03.272973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:03.275446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:03.276797 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06e93dc4-cce9-4ce2-ba90-b75316b3ff7b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.323503 Oct 04 11:07:03.277397 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 942/1917] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:02 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:03.308028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6f3cf8e0-1ee9-448a-b037-b9d80938a3df req-c827716f-ceb1-4d85-a8c6-64bfc6b1845f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d278191-0937-47b3-bb59-4c40c4a98bda", "name": "network-vif-deleted", "tag": "db7d8832-93a3-4fdd-a30e-8d691ca33259"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:03.348398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f3cf8e0-1ee9-448a-b037-b9d80938a3df req-c827716f-ceb1-4d85-a8c6-64bfc6b1845f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:03.350698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f3cf8e0-1ee9-448a-b037-b9d80938a3df req-c827716f-ceb1-4d85-a8c6-64bfc6b1845f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:03.355736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f3cf8e0-1ee9-448a-b037-b9d80938a3df req-c827716f-ceb1-4d85-a8c6-64bfc6b1845f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:03.407308 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6f3cf8e0-1ee9-448a-b037-b9d80938a3df req-c827716f-ceb1-4d85-a8c6-64bfc6b1845f service nova] Creating event network-vif-deleted:db7d8832-93a3-4fdd-a30e-8d691ca33259 for instance 9d278191-0937-47b3-bb59-4c40c4a98bda on n-h1-791135-8 Oct 04 11:07:03.426739 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6f3cf8e0-1ee9-448a-b037-b9d80938a3df req-c827716f-ceb1-4d85-a8c6-64bfc6b1845f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133428 Oct 04 11:07:03.430761 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 943/1918] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:03.452308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:03.457744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:03.462422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:03.490775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:03.493933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:03.494961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:03.501305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:03.502904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:03.503858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:03.869045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:03.883087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:03.884947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:03.890917 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb09f109-f273-4afa-82b0-4b7ae27f3289 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.456544 Oct 04 11:07:03.910330 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 944/1919] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:03 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:03.920751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:03.921435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:03.928495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:03.928995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:03.929544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:03.930752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:03.931220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:03.931654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:04.087358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:04.260338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:04.478897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:04.676210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:04.688748 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c76b51e4-0934-4fc2-b571-2d6a538d75c6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1319 microversion: 2.1 time: 0.774695 Oct 04 11:07:04.717003 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 945/1920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:03 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1319 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:04.733763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:04.735986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] [instance: 9d278191-0937-47b3-bb59-4c40c4a98bda] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:04.754610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:04.755657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:04.756283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:04.757216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:04.760419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:04.762293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:04.797767 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] HTTP exception thrown: Instance 9d278191-0937-47b3-bb59-4c40c4a98bda could not be found. Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Request method failure captured: Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda HTTP/1.1 Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBMgGGfGAFGzTFL6nvDkF0YZdu2Zclk6IlD9_15-Opzrhk-5jq_veCf8Se0DAZHT8vp1eXN5kZT7wAEyZDrWVgAJ3lhExMHLulC2aRFlZqtaZi68nK0WXS2-uISCbrp1xHaZpAutXUCy1oMWQjhtDK8jCvAVXJyPl0NdpUDcP2i_u6A Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 8e8dfb2a0b8d4faa8e810e56fc749d2d Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8dfb2a0b8d4faa8e810e56fc749d2d"}]}] Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 8e8dfb2a0b8d4faa8e810e56fc749d2d Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminTestJSON-1241196672 Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersAdminTestJSON-1241196672-project Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 671786f1a7c74682a66520aeb60a5f50 Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminTestJSON-1241196672-project Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 9d278191-0937-47b3-bb59-4c40c4a98bda could not be found. Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '9d278191-0937-47b3-bb59-4c40c4a98bda'} Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d278191-0937-47b3-bb59-4c40c4a98bda could not be found. Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d278191-0937-47b3-bb59-4c40c4a98bda could not be found. Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:04.799768 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:04.805485 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:04.805485 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:04.805485 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:04.805485 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:04.805485 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:04.805485 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d278191-0937-47b3-bb59-4c40c4a98bda could not be found. Oct 04 11:07:04.805485 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:04.809292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] Returning 404 to user: Instance 9d278191-0937-47b3-bb59-4c40c4a98bda could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:04.813418 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8200e7de-773c-4aab-8191-66c30fff5927 tempest-ServersAdminTestJSON-1241196672 tempest-ServersAdminTestJSON-1241196672-project] 10.222.0.23 "GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda" status: 404 len: 111 microversion: 2.1 time: 0.093631 Oct 04 11:07:04.815794 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 946/1921] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:04 2022] GET /compute/v2.1/servers/9d278191-0937-47b3-bb59-4c40c4a98bda => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:07:04.828575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:04.829533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:04.849316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:04.850360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:04.850994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:04.851958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:04.852584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:04.853202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:05.496509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:05.532798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:05.568166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:05.577450 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0b8c906-2445-46ee-a5c6-13592726baf0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.760271 Oct 04 11:07:05.585312 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 947/1922] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:04 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:05.598176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:05.617061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:05.653982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:05.656219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:05.657278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:05.663754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:05.666836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:05.668868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:06.343875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:06.373402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:06.379529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:06.421100 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9beee3bd-5876-4e34-93df-94aff34e864e tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.834528 Oct 04 11:07:06.436254 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 948/1923] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:05 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:06.456821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:06.460639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:06.478841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:06.485790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:06.487426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:06.491231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:06.492201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:06.494257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:07.262946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:07.308229 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c697485e-7666-4275-8364-453cfbcebb22 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1319 microversion: 2.1 time: 0.860739 Oct 04 11:07:07.332339 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 949/1924] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:06 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1319 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:07.351203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:07.351879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:07.368302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:07.368852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:07.369314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:07.375315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:07.375890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:07.376382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:09.019697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:09.034619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:09.038516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:09.040451 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9d44bd64-1974-4879-b1c2-374d8c139583 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2948 microversion: 2.42 time: 1.706590 Oct 04 11:07:09.069738 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 950/1925] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:07 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2948 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:09.080168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:09.081130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:09.095544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:09.096418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:09.097086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:09.098080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:09.100466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:09.101567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:09.558822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:09.566895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:09.576170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:09.587326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:09.589134 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c3a888ad-95b1-4077-914e-0583a2e0c050 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.517951 Oct 04 11:07:09.590375 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 951/1926] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:09 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:09.600131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-01af9e92-00a2-48ac-9628-88d63f4c8f0b req-379dde8e-167a-4703-8d5c-431333b9560d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1", "tag": "a97662ae-143c-430d-9d8c-c9b832315fed"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:09.646194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-01af9e92-00a2-48ac-9628-88d63f4c8f0b req-379dde8e-167a-4703-8d5c-431333b9560d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:09.670911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-01af9e92-00a2-48ac-9628-88d63f4c8f0b req-379dde8e-167a-4703-8d5c-431333b9560d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:09.671865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-01af9e92-00a2-48ac-9628-88d63f4c8f0b req-379dde8e-167a-4703-8d5c-431333b9560d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:09.696809 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-01af9e92-00a2-48ac-9628-88d63f4c8f0b req-379dde8e-167a-4703-8d5c-431333b9560d service nova] Creating event network-changed:a97662ae-143c-430d-9d8c-c9b832315fed for instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 on n-h2-791135-8 Oct 04 11:07:09.714740 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-01af9e92-00a2-48ac-9628-88d63f4c8f0b req-379dde8e-167a-4703-8d5c-431333b9560d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122730 Oct 04 11:07:09.716022 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 952/1927] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:09.724440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:09.726435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:09.747166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:09.748049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:09.748727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:09.749712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:09.750411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:09.755397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:09.992526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:10.015851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:10.021382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:10.037577 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b0e6ff0-4462-449f-9a12-777470aaeda3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.319448 Oct 04 11:07:10.040379 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 953/1928] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:09 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:10.061003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=73 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:10.067167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8ca6d4dc-df59-453e-81b9-1d4b4a36ee73 req-23a10b76-8754-43d3-ab65-13806ae152dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9107e30c-58de-43b5-bf5a-3f3e743f3fc0", "tag": "2e75d9ba-415e-49cf-b66c-3e6871b78f5d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:10.116008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ca6d4dc-df59-453e-81b9-1d4b4a36ee73 req-23a10b76-8754-43d3-ab65-13806ae152dc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:10.116572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ca6d4dc-df59-453e-81b9-1d4b4a36ee73 req-23a10b76-8754-43d3-ab65-13806ae152dc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:10.116990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8ca6d4dc-df59-453e-81b9-1d4b4a36ee73 req-23a10b76-8754-43d3-ab65-13806ae152dc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:10.163069 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8ca6d4dc-df59-453e-81b9-1d4b4a36ee73 req-23a10b76-8754-43d3-ab65-13806ae152dc service nova] Creating event network-changed:2e75d9ba-415e-49cf-b66c-3e6871b78f5d for instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 on n-h1-791135-8 Oct 04 11:07:10.183219 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8ca6d4dc-df59-453e-81b9-1d4b4a36ee73 req-23a10b76-8754-43d3-ab65-13806ae152dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120658 Oct 04 11:07:10.185210 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 954/1929] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:10.191053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:10.197334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:10.214197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:10.217672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:10.218134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:10.218975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:10.222420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:10.223080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:10.610263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:10.627517 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95330dc8-0147-4522-a2d0-484042628db3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1319 microversion: 2.1 time: 0.440444 Oct 04 11:07:10.630380 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 955/1930] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:10 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:10.652000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:10.654521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:10.668591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:10.676791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:10.677414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:10.678286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:10.678877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:10.679404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:11.058246 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23c5618f-edcb-4b19-bed8-caca89e610d1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.420005 Oct 04 11:07:11.059225 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 956/1931] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Oct 4 11:07:10 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5/os-interface => generated 1830 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:11.063974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:11.065231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:11.085986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:11.087549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:11.087991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:11.088711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:11.089166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:11.098593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:11.374633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:11.387465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:11.390336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:11.391948 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9cc81070-f2df-44f1-a4f1-4845fb6309ce tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.331728 Oct 04 11:07:11.393078 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 957/1932] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:11 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:11.400130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:11.402271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:11.410304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:11.411144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:11.411887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:11.412796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:11.413467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:11.414168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:11.683014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:11.699936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:11.717880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:11.749583 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-767ad782-36fb-4a89-88e7-44d55520f057 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.355080 Oct 04 11:07:11.767255 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 958/1933] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:11 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:11.789413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:11.793183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:11.830324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:11.830552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:11.830903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:11.831517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:11.831974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:11.832400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:12.774606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:12.807768 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-714650f6-8644-47e1-a3ae-a941bff6f5c5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1319 microversion: 2.1 time: 1.039721 Oct 04 11:07:12.809457 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 959/1934] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:11 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1319 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:12.821466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:12.826013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:12.843171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:12.844866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:12.845542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:12.850279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:12.851003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:12.851751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:13.599723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:13.615370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:13.630320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:13.632183 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b90b674-c605-4be9-adfc-7cad6979044a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1487 microversion: 2.25 time: 0.819955 Oct 04 11:07:13.637342 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 960/1935] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:12 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1487 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:13.658067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:13.659100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:13.665569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:13.671556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:13.672384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:13.674166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:13.674880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:13.677537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:13.843482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:13.856890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:13.861783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:13.876399 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62c2a6b4-1ec2-459e-95be-89b52af7394c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.237681 Oct 04 11:07:13.880166 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 961/1936] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:13 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:14.272138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-489246122", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:16.955191 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8588119e-af21-4ae2-a55a-b357bbc87322 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1420 microversion: 2.1 time: 15.823017 Oct 04 11:07:16.956298 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 976/1937] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:07:01 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1420 bytes in 15825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:16.962195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:16.962810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:16.978413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:16.979299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:07:16.979823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:16.980263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:16.981056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:16.981704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:16.982322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:17.415755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:17.426674 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5c527b7-187b-48c0-9f60-e4fb3a3d7695 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1319 microversion: 2.1 time: 0.468161 Oct 04 11:07:17.443707 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 977/1938] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:16 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:17.449679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:17.450669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:17.457907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:17.458636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:17.459272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:17.460187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:17.460813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:17.461434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:17.656957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:07:17.658882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:07:17.659360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:07:17.660029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:07:17.660631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:07:17.670334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:17.671072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:17.671713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:17.672619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:17.673324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:17.674276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:17.716515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Getting quotas for project 27999b103d2843229ec7e57d2cfce666. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:07:17.721390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Getting quotas for user 0794a3719ab34ae1b8ac6b955a0c7cb4 and project 27999b103d2843229ec7e57d2cfce666. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:07:17.727573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:17.739406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:17.740989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:17.742171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:07:17.743095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecf80df4-d31b-4fe6-902f-eb7766f44d01 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1477 microversion: 2.25 time: 0.298054 Oct 04 11:07:17.761405 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 978/1939] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:17 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:17.761405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:17.761405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:17.761405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:17.762754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:17.763485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:17.764987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:17.765767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:17.766111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:07:17.766777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:17.882385 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e26ff631-2ae5-47d8-b0db-30df8bcd6cf5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.997956 Oct 04 11:07:17.888768 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 962/1940] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:07:17.894447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b7d58edc-2f4b-4b19-ae90-588c1e2329ea req-4a8f58ed-3f0a-49e3-aaa3-a45a08e7dc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9107e30c-58de-43b5-bf5a-3f3e743f3fc0", "name": "network-vif-plugged", "status": "completed", "tag": "2e75d9ba-415e-49cf-b66c-3e6871b78f5d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:17.946995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b7d58edc-2f4b-4b19-ae90-588c1e2329ea req-4a8f58ed-3f0a-49e3-aaa3-a45a08e7dc1f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:17.950454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b7d58edc-2f4b-4b19-ae90-588c1e2329ea req-4a8f58ed-3f0a-49e3-aaa3-a45a08e7dc1f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:17.950858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b7d58edc-2f4b-4b19-ae90-588c1e2329ea req-4a8f58ed-3f0a-49e3-aaa3-a45a08e7dc1f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:18.007312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:18.011053 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b7d58edc-2f4b-4b19-ae90-588c1e2329ea req-4a8f58ed-3f0a-49e3-aaa3-a45a08e7dc1f service nova] Creating event network-vif-plugged:2e75d9ba-415e-49cf-b66c-3e6871b78f5d for instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 on n-h1-791135-8 Oct 04 11:07:18.016248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:18.023360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:18.033499 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b7d58edc-2f4b-4b19-ae90-588c1e2329ea req-4a8f58ed-3f0a-49e3-aaa3-a45a08e7dc1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146272 Oct 04 11:07:18.034266 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d73b8d45-5391-4e8c-aad6-a567f0d230b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.286983 Oct 04 11:07:18.038367 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 979/1941] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:17 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:18.050631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aea14d18-88bc-4447-8203-3b32b6fae055 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d421af70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:18.070268 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 963/1942] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:18.089263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9328b80a-2e75-4947-b424-1cef851bc771 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '.version_select at 0x7f71cfea79d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:18.103125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9328b80a-2e75-4947-b424-1cef851bc771 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:18.103625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9328b80a-2e75-4947-b424-1cef851bc771 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:18.106879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9328b80a-2e75-4947-b424-1cef851bc771 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:18.153342 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aea14d18-88bc-4447-8203-3b32b6fae055 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 200 len: 1420 microversion: 2.1 time: 0.113461 Oct 04 11:07:18.154473 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 980/1943] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:07:18 2022] GET /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:18.160474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4612b1ed-a7ef-4f00-8c37-9056ce5b0fcb tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:18.168375 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9328b80a-2e75-4947-b424-1cef851bc771 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.093110 Oct 04 11:07:18.171064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4612b1ed-a7ef-4f00-8c37-9056ce5b0fcb tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:18.174175 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 964/1944] 10.222.0.23 () {60 vars in 1184 bytes} [Tue Oct 4 11:07:18 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:18.208373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-edba0e91-c022-4c5c-8d86-4e72476de54d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cfe93790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:18.408735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4612b1ed-a7ef-4f00-8c37-9056ce5b0fcb tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:18.438193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4612b1ed-a7ef-4f00-8c37-9056ce5b0fcb tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1221 microversion: 2.1 time: 0.271608 Oct 04 11:07:18.439535 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 981/1945] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:18 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1221 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:18.464558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:18.467454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:18.483346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:18.484385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:18.485272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:18.487301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:18.490540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:18.491312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:18.844215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] Lazy-loading 'services' on Instance uuid 314aa825-15be-4c05-88d6-b47c202d4640 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:18.872218 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ce3a9ca-4f46-49c0-ac6e-8fc57f041b97 tempest-LiveAutoBlockMigrationV225Test-895746561 tempest-LiveAutoBlockMigrationV225Test-895746561-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1970 microversion: 2.25 time: 0.431170 Oct 04 11:07:18.873741 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 982/1946] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:18 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1970 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:18.890001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:18.891088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:18.902344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:18.903218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:18.904020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:18.905303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:18.907386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:18.909189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.283688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:19.295455 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36041f18-d534-4a19-93e7-65d9c59f5844 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1319 microversion: 2.1 time: 0.416887 Oct 04 11:07:19.296667 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 983/1947] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:18 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:19.324915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:19.326545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:19.334136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.335425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.336953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.339967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.342603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.343359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.425536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:07:19.589110 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-edba0e91-c022-4c5c-8d86-4e72476de54d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 204 len: 0 microversion: 2.1 time: 1.392491 Oct 04 11:07:19.590907 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93220fc2-2a2c-4203-bf71-475000218160 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "DELETE /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 204 len: 0 microversion: 2.25 time: 0.284860 Oct 04 11:07:19.592403 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 984/1949] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:07:19 2022] DELETE /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:07:19.597042 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 965/1949] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:18 2022] DELETE /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 0 bytes in 1400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:07:19.603571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:19.604210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:19.625925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:19.634130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:19.650228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.650579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.650710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.651105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.651248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.651870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.654458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.655283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.660848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.665715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.666247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.666702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.802420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:19.826695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:19.828689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:19.845581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98baadc0-faca-4dd8-9837-16d16bd59389 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.248065 Oct 04 11:07:19.855945 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 985/1950] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:19 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:19.892936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:19.893465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:19.910264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.911235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.911841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.912757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.916860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.922735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:19.931456 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0fc1ba5-1e80-443b-bf3b-06d6fc8ee25b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1217 microversion: 2.1 time: 0.332367 Oct 04 11:07:19.932351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.936045 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 966/1951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:19 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1217 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:19.946014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:19.946899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:19.965026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.967714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.968360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.971811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:19.972533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:19.975594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:19.996863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:07:20.189147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9c94f45b-8450-4009-a8e9-d51dbb486119 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 204 len: 0 microversion: 2.1 time: 0.313887 Oct 04 11:07:20.190134 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 986/1952] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:07:19 2022] DELETE /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:07:20.229713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:20.249239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a283c2ce-ab0b-4a84-a793-0c09b7747272 req-3683cd5f-9b42-4277-ba4e-28539ee81857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1", "name": "network-vif-plugged", "status": "completed", "tag": "a97662ae-143c-430d-9d8c-c9b832315fed"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:20.255931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:20.260864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:20.264152 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aba83281-18f8-4ceb-a596-3d21492d7e9b tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1483 microversion: 2.25 time: 0.326733 Oct 04 11:07:20.266396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 967/1953] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:19 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1483 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:20.268675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a283c2ce-ab0b-4a84-a793-0c09b7747272 req-3683cd5f-9b42-4277-ba4e-28539ee81857 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:20.269437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a283c2ce-ab0b-4a84-a793-0c09b7747272 req-3683cd5f-9b42-4277-ba4e-28539ee81857 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:20.270066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a283c2ce-ab0b-4a84-a793-0c09b7747272 req-3683cd5f-9b42-4277-ba4e-28539ee81857 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:20.283978 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a283c2ce-ab0b-4a84-a793-0c09b7747272 req-3683cd5f-9b42-4277-ba4e-28539ee81857 service nova] Creating event network-vif-plugged:a97662ae-143c-430d-9d8c-c9b832315fed for instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 on n-h2-791135-8 Oct 04 11:07:20.292104 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a283c2ce-ab0b-4a84-a793-0c09b7747272 req-3683cd5f-9b42-4277-ba4e-28539ee81857 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047677 Oct 04 11:07:20.292731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 987/1954] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:07:20.322689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:20.323705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:20.332929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:20.337653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:20.339165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:20.340878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:20.342012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:20.346495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:20.486056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-778840705", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "fe42e5c1-b0b0-4c86-b1a2-ac753c58d8e1"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:20.584917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:20.597121 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ed9f1c3-1403-403b-a7ba-5e42fe2c8793 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1468 microversion: 2.1 time: 0.278546 Oct 04 11:07:20.623143 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 968/1955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:20 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1468 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:20.630112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] validate_networks() for [('fe42e5c1-b0b0-4c86-b1a2-ac753c58d8e1', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:07:20.638609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:20.639232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:20.658772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:20.659260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:20.659692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:20.660413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:20.660863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:20.661289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:21.597224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:21.606198 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6cc2b950-07e7-4f15-8c21-642b2949d967 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1319 microversion: 2.1 time: 0.981895 Oct 04 11:07:21.614141 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 969/1956] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:20 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1319 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:21.619573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:21.623947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:21.636687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:21.637414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:21.638049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:21.644444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:21.645180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:21.645891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:21.850104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:21.864176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:21.870381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:21.877031 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b0511cc-523f-4e4b-96fa-b183d6a8a036 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.261024 Oct 04 11:07:21.898447 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 970/1957] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:21 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:21.912510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:21.914616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:21.930789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:21.931307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:21.931942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:21.932677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:21.933273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:21.933583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.074405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:22.085817 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0baf42ee-fcad-4656-b756-01c35724a2e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1273 microversion: 2.1 time: 0.185605 Oct 04 11:07:22.102387 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 971/1958] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:21 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:22.108108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:22.109064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:22.115890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.116858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.117592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.118564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.119255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.119913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.128109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:07:22.128711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:07:22.129639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:07:22.130059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:07:22.130480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:07:22.141669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.142640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.143548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.144643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.145397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.146001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.171916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Getting quotas for project ee7bbcbc81f547c0b5982b0f1efc54cc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:07:22.178754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Getting quotas for user 4dbb699b24b3432e9adc7b6d869e4744 and project ee7bbcbc81f547c0b5982b0f1efc54cc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:07:22.192653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:07:22.196894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:22.208188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:07:22.208945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:22.210707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:22.222461 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a75c72a6-aba1-476c-a350-cbf63d8f1cbc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1441 microversion: 2.25 time: 0.118365 Oct 04 11:07:22.223146 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 972/1959] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:22 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1441 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:22.228315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f6fc4b42-775f-4e3e-acdb-a77a94b3026a req-8674fc89-2e1a-40d9-846f-2136aa90969a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314aa825-15be-4c05-88d6-b47c202d4640", "name": "network-vif-deleted", "tag": "fb97bf5a-d2d4-4256-9000-0254ba7aa594"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:22.249156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6fc4b42-775f-4e3e-acdb-a77a94b3026a req-8674fc89-2e1a-40d9-846f-2136aa90969a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.250601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6fc4b42-775f-4e3e-acdb-a77a94b3026a req-8674fc89-2e1a-40d9-846f-2136aa90969a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.251292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6fc4b42-775f-4e3e-acdb-a77a94b3026a req-8674fc89-2e1a-40d9-846f-2136aa90969a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.276154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:22.286637 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f6fc4b42-775f-4e3e-acdb-a77a94b3026a req-8674fc89-2e1a-40d9-846f-2136aa90969a service nova] Creating event network-vif-deleted:fb97bf5a-d2d4-4256-9000-0254ba7aa594 for instance 314aa825-15be-4c05-88d6-b47c202d4640 on n-h2-791135-8 Oct 04 11:07:22.297272 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f6fc4b42-775f-4e3e-acdb-a77a94b3026a req-8674fc89-2e1a-40d9-846f-2136aa90969a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072644 Oct 04 11:07:22.299207 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 973/1960] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:22.331088 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-48d79cb8-e354-4484-8f3e-e4c75b4ab1db tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.848866 Oct 04 11:07:22.337862 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 988/1961] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:07:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:07:22.339945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c61e3672-2ae7-4eb2-a2f1-7224364b56ae req-8acaa9c1-b242-4570-a598-95af489ab687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b343130c-9edd-4145-a732-d5730ffc7edc", "name": "network-vif-unplugged", "status": "completed", "tag": "cad87f36-7301-414e-8fe8-6249065e7c49"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:22.344337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7050f3a-d376-4aec-ad40-ba6d62cfc993 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:22.345566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7050f3a-d376-4aec-ad40-ba6d62cfc993 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:22.377678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c61e3672-2ae7-4eb2-a2f1-7224364b56ae req-8acaa9c1-b242-4570-a598-95af489ab687 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.378568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c61e3672-2ae7-4eb2-a2f1-7224364b56ae req-8acaa9c1-b242-4570-a598-95af489ab687 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.380193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c61e3672-2ae7-4eb2-a2f1-7224364b56ae req-8acaa9c1-b242-4570-a598-95af489ab687 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.413588 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c61e3672-2ae7-4eb2-a2f1-7224364b56ae req-8acaa9c1-b242-4570-a598-95af489ab687 service nova] Creating event network-vif-unplugged:cad87f36-7301-414e-8fe8-6249065e7c49 for instance b343130c-9edd-4145-a732-d5730ffc7edc on n-h1-791135-8 Oct 04 11:07:22.441573 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c61e3672-2ae7-4eb2-a2f1-7224364b56ae req-8acaa9c1-b242-4570-a598-95af489ab687 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121375 Oct 04 11:07:22.448443 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 974/1962] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:22.537946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c7050f3a-d376-4aec-ad40-ba6d62cfc993 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:22.545325 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7050f3a-d376-4aec-ad40-ba6d62cfc993 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1207 microversion: 2.1 time: 0.205631 Oct 04 11:07:22.566960 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 989/1963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:22 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1207 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:22.637972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:22.639175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:22.652820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.653474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.657174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.659752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.661472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.663504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.924096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:22.924773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:22.939942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.940442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.940876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:22.941653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:22.942308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:22.942914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:23.101031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.129388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.138423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.156094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d8bdd90-ee86-4dd4-a564-79d1530effd6 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1555 microversion: 2.91 time: 0.236326 Oct 04 11:07:23.161642 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 990/1964] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:22 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:23.175840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.180992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:23.187455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:23.193083 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a47221c-e518-4ead-825b-e1ddf6e086fb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1319 microversion: 2.1 time: 0.560309 Oct 04 11:07:23.202162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:23.202786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:23.203227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:23.204037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:23.205107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:23.205570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:23.210279 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 975/1965] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:22 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:23.250711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:23.252931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:23.268635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:23.270920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:23.273174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:23.278340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:23.279313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:23.282385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:23.361599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.372359 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b455275-94d6-4d66-9e2b-7542ee92b9ff tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1279 microversion: 2.1 time: 0.206417 Oct 04 11:07:23.374567 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 991/1966] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:23 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1279 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:23.442470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.454686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.456127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.457294 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-443040d8-2ac4-4265-a555-36400abc7de0 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1266 microversion: 2.25 time: 0.210470 Oct 04 11:07:23.457894 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 976/1967] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:23 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:23.529932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-46d203ce-39d6-4050-ae65-aff62700eea2 req-166c4e7d-fc1b-4e67-b8bf-9d8df6962dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b343130c-9edd-4145-a732-d5730ffc7edc", "name": "network-vif-deleted", "tag": "cad87f36-7301-414e-8fe8-6249065e7c49"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:23.573500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-46d203ce-39d6-4050-ae65-aff62700eea2 req-166c4e7d-fc1b-4e67-b8bf-9d8df6962dbf service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:23.574137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-46d203ce-39d6-4050-ae65-aff62700eea2 req-166c4e7d-fc1b-4e67-b8bf-9d8df6962dbf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:23.574590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-46d203ce-39d6-4050-ae65-aff62700eea2 req-166c4e7d-fc1b-4e67-b8bf-9d8df6962dbf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:23.593510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:23.594132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:23.611068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:23.618298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:23.619979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:23.624490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:23.624978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:23.628170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:23.632504 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-46d203ce-39d6-4050-ae65-aff62700eea2 req-166c4e7d-fc1b-4e67-b8bf-9d8df6962dbf service nova] Creating event network-vif-deleted:cad87f36-7301-414e-8fe8-6249065e7c49 for instance b343130c-9edd-4145-a732-d5730ffc7edc on n-h1-791135-8 Oct 04 11:07:23.650059 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-46d203ce-39d6-4050-ae65-aff62700eea2 req-166c4e7d-fc1b-4e67-b8bf-9d8df6962dbf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123868 Oct 04 11:07:23.655624 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 992/1968] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:23.792547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:23.805045 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f68a8c61-458c-4444-998d-701b8e51e83b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1211 microversion: 2.1 time: 0.216720 Oct 04 11:07:23.806349 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 977/1969] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:23 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1211 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:24.198667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:24.201101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:24.231669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:24.236972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:24.253739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.257898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.260356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.267644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.268217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.271785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.292129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.292791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.301146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.315612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.316162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.320162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.468715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.486234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.491984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.514415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be6f77fb-3396-4bf3-affd-177031efc24a tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1537 microversion: 2.91 time: 0.327534 Oct 04 11:07:24.516483 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 993/1970] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:24 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1537 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:24.522474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:24.534342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:24.540969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.548298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.549196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.550217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.550902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.551590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.805928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.819510 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31f3ffd1-19b2-455b-8d95-0d4d13a9356e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1469 microversion: 2.1 time: 0.603079 Oct 04 11:07:24.837241 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 978/1971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:24 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1469 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:24.837892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.838037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:24.838037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:24.838294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:24.838413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.841060 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f11e20cb-8f77-4942-8902-d2deb0620baf tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1279 microversion: 2.1 time: 0.317648 Oct 04 11:07:24.845474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.845664 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 994/1972] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:24 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1279 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:24.854206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.854206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.854206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.854206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.865992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:24.866761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:24.884805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.885467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.886144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.887209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:24.887917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:24.888566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:24.945383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.954616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.957096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.958543 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eee6c756-5511-415f-8f27-3da31aa40349 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1266 microversion: 2.25 time: 0.134271 Oct 04 11:07:24.974875 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 979/1973] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:24 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:24.990583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:24.996617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:24.998609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Searching by: {'reservation_id': 'r-bwwwe0ea', 'deleted': False, 'project_id': 'bf100271e41c4475835267bcaf15c0b3'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:07:25.005683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.006402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.007031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.008586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.009240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.010446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.018215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:25.026421 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fbb12d4-f657-43e6-9e2a-99c3b13dc766 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1203 microversion: 2.1 time: 0.171234 Oct 04 11:07:25.032636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 995/1974] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:24 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:25.149562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:07:25.233494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:25.241342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.242155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.242828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.388171 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c45d34cf-14ba-401f-828a-0fc3e547b8ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-bwwwe0ea" status: 200 len: 2930 microversion: 2.1 time: 0.411623 Oct 04 11:07:25.389375 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 980/1975] 10.222.0.23 () {58 vars in 1197 bytes} [Tue Oct 4 11:07:24 2022] GET /compute/v2.1/servers/detail?reservation_id=r-bwwwe0ea => generated 2930 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:25.417154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0635b156-02db-4605-a521-1168bb17082b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:25.470950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.server_groups [None req-0635b156-02db-4605-a521-1168bb17082b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Querying cell 6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) for 2 instances {{(pid=122409) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 11:07:25.471947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0635b156-02db-4605-a521-1168bb17082b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.472599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0635b156-02db-4605-a521-1168bb17082b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.473235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0635b156-02db-4605-a521-1168bb17082b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.513685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0635b156-02db-4605-a521-1168bb17082b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/7b849dec-e686-4153-a150-b266f4a927ab" status: 200 len: 271 microversion: 2.1 time: 0.100489 Oct 04 11:07:25.514686 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 996/1976] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:07:25 2022] GET /compute/v2.1/os-server-groups/7b849dec-e686-4153-a150-b266f4a927ab => generated 271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:25.526560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:25.527612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:25.534804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.535536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.536132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.537013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.538108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.538893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.549816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:25.550717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:25.563026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.567898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.568736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.569689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.571400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.574761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.713871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:25.722956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:25.724387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:25.742253 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-175c5244-9932-4b20-a40c-4bc5d6d40ed5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1537 microversion: 2.91 time: 0.196382 Oct 04 11:07:25.743280 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 997/1977] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:25 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1537 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:25.827536 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1d45e6d-79b4-4f24-8775-8a0906526b89 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 200 len: 1619 microversion: 2.1 time: 0.304825 Oct 04 11:07:25.830300 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 981/1978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:25 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 1619 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:25.851181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:25.852660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:25.860400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.861147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.862569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.863672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.864317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.864988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.870031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:25.870902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:25.881955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:25.884919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.889164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.889824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:25.895417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:25.896574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:25.899625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.146310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:26.155115 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da4d916b-b925-4a81-b8ff-7e0a436dc7b5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.288725 Oct 04 11:07:26.158178 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 982/1979] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:25 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:26.164508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:26.165200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:26.175472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:26.185259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:26.185834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.186609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:26.187089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:26.187523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.210657 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4c721b8-3f0f-45e5-b57c-8ce80a0a0825 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1620 microversion: 2.1 time: 0.362828 Oct 04 11:07:26.211993 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 998/1980] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:25 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1620 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:26.223771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:26.227914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:26.247841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:26.249917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:26.252066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.253070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:26.256507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:26.257246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.379339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:26.388160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:26.395108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:26.399262 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70964182-7946-4791-9943-04710bcda6c5 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1266 microversion: 2.25 time: 0.236696 Oct 04 11:07:26.400243 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 983/1981] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:26 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:26.426240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-847207376", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1976caef-e757-4301-a92b-66d06d09fc3b"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:26.450665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:26.483824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-edce506e-28a3-4404-84ca-43d517e1f48f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1259 microversion: 2.1 time: 0.269816 Oct 04 11:07:26.487727 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 999/1982] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:26 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:26.531400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:07:26.770557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:26.771168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:26.781412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:26.783056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:26.783651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.784380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:26.784839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:26.785271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.884197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:07:26.884690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:07:26.885100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:07:26.885542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:07:26.885949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:07:26.901910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:26.902704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:26.903391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.904380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:26.905050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:26.905903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:26.918007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:26.931343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:26.935845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:26.949126 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7bc5f7ac-1b8c-45dd-99de-5371171a61ab tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1537 microversion: 2.91 time: 0.182561 Oct 04 11:07:26.957411 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1000/1983] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:26 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1537 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:26.964027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:07:26.970523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:07:26.984418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:07:26.987636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:07:27.051961 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fd3793a-4523-499a-b98e-591decd9d533 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650351 Oct 04 11:07:27.053275 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 984/1984] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:07:27.066421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-850a12af-8b5b-44c2-9576-20ebcaa2d9ff tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:27.067126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-850a12af-8b5b-44c2-9576-20ebcaa2d9ff tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:27.134015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-850a12af-8b5b-44c2-9576-20ebcaa2d9ff tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:27.151936 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-850a12af-8b5b-44c2-9576-20ebcaa2d9ff tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1216 microversion: 2.1 time: 0.090281 Oct 04 11:07:27.154081 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1001/1985] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:27 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:27.184230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:27.184838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:27.192714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:27.194168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:27.194778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:27.195661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:27.196282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:27.197363 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:27.426938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:27.427561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:27.439870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:27.440435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:27.452716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:27.453602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:27.454743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:27.455269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:27.494425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:27.503336 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d8f4b5c-fc1e-4685-8c2b-5277550909e0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.324274 Oct 04 11:07:27.506703 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 985/1986] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:27 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:27.645083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:27.661972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:27.673632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:27.676908 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2118c054-5377-461a-a050-dcc00151a7d4 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1266 microversion: 2.25 time: 0.255197 Oct 04 11:07:27.679545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1002/1987] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:27 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:27.692024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6e30f32b-f44d-4d05-a33c-72bfaa47cfd2 req-d3cc7a08-eabc-4b64-ad99-22771dd0616b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba29ceb-94b3-4a8d-815e-9f77895374c4", "tag": "a7d19265-2675-4eae-b867-b41411469d2d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:27.739563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6e30f32b-f44d-4d05-a33c-72bfaa47cfd2 req-d3cc7a08-eabc-4b64-ad99-22771dd0616b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:27.740160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6e30f32b-f44d-4d05-a33c-72bfaa47cfd2 req-d3cc7a08-eabc-4b64-ad99-22771dd0616b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:27.743371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6e30f32b-f44d-4d05-a33c-72bfaa47cfd2 req-d3cc7a08-eabc-4b64-ad99-22771dd0616b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:27.786732 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6e30f32b-f44d-4d05-a33c-72bfaa47cfd2 req-d3cc7a08-eabc-4b64-ad99-22771dd0616b service nova] Creating event network-changed:a7d19265-2675-4eae-b867-b41411469d2d for instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 on n-h1-791135-8 Oct 04 11:07:27.795315 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6e30f32b-f44d-4d05-a33c-72bfaa47cfd2 req-d3cc7a08-eabc-4b64-ad99-22771dd0616b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113855 Oct 04 11:07:27.796619 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1003/1988] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:27.804794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:27.806833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:27.813063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:27.830521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:27.831034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:27.831475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:27.835072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:27.835586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:27.836025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:27.844599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1817234512", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "9e1dbc7a-bacd-4455-b7e5-fd976ed3e4d2"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:27.937097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] validate_networks() for [('9e1dbc7a-bacd-4455-b7e5-fd976ed3e4d2', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:07:27.985676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:28.003364 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e7109dc-5bbd-4736-b973-89ebb1e99180 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1277 microversion: 2.1 time: 0.205210 Oct 04 11:07:28.004231 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1004/1989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:27 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:28.018888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:28.021022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:28.044767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.045548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.046165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.048809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.051881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.052855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.193398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:28.205783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:28.207383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:28.221713 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5215b91e-7652-45d7-ab2c-dc6d26c7dfb4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1540 microversion: 2.91 time: 0.213895 Oct 04 11:07:28.222505 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1005/1990] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:28 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1540 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:28.234560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:28.235964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:28.259689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.259689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.259689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.260356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.260797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.261227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.652831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:28.661915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca5bb1c5-f3d8-4102-99c3-0f61632fc2f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1268 microversion: 2.1 time: 0.438504 Oct 04 11:07:28.662500 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1006/1991] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:28 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1268 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:28.673279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:28.688372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:28.694812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.695301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.695737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.696440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.696891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.697313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.703759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:07:28.704962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:07:28.705719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:07:28.706361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:07:28.707519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:07:28.720428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.721822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.723589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.725435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.726290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.726912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.754067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Getting quotas for project c997f3c4047a43958d82b789a1d6edb0. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:07:28.760618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Getting quotas for user 0a723f4333c14765a850c2a6fea98737 and project c997f3c4047a43958d82b789a1d6edb0. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:07:28.778844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:07:28.781732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:07:28.787959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-791135-8". {{(pid=122409) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 11:07:28.846929 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd37d968-909d-4e96-bd83-392a34234ae0 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337535 Oct 04 11:07:28.848562 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 986/1992] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:07:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:07:28.854904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:28.855893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:28.863036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.863929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.864681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.865952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:28.866624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:28.867496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:28.980874 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28c035b8-d383-466a-a8e7-cce236a894ac tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe/action" status: 202 len: 0 microversion: 2.91 time: 0.314239 Oct 04 11:07:28.995646 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1007/1993] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:07:28 2022] POST /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:07:29.012135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:29.021978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:29.049965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:29.053986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:29.054449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:29.055240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:29.056632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:29.057072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:29.270623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.279427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.280801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.282035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1870230-44b8-442d-9c31-cc90366520ac tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1266 microversion: 2.25 time: 0.285017 Oct 04 11:07:29.306347 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1008/1994] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:28 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:29.333944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82b93bf1-22da-40be-87b1-3b5138f466a6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:29.334594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82b93bf1-22da-40be-87b1-3b5138f466a6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:29.372324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.383465 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b1ba6aa-8064-4770-a094-7e3e64813253 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.533266 Oct 04 11:07:29.383842 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 987/1995] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:28 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:29.407353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82b93bf1-22da-40be-87b1-3b5138f466a6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.414353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:29.415060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:29.416499 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82b93bf1-22da-40be-87b1-3b5138f466a6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1225 microversion: 2.1 time: 0.108014 Oct 04 11:07:29.417843 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1009/1996] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:29 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:29.423472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:29.423701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:29.424383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:29.424549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:29.425171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:29.426194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:29.426848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:29.427472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:29.431498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:29.432323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:29.433030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:29.434040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:29.434697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:29.435302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:29.613415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.644080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.647605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.654964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.657870 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5c8b73b-d946-4e67-9810-b4c020844d53 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1265 microversion: 2.1 time: 0.237992 Oct 04 11:07:29.667189 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd1667b7-193c-4682-b4c6-7a46af597968 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1488 microversion: 2.91 time: 0.264970 Oct 04 11:07:29.667588 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1010/1997] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:29 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:29.670269 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 988/1998] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:29 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1488 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:29.692247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:29.693374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:29.708473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:29.710025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:29.710490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:29.713282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:29.715121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:29.716430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:29.885058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:29.894917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94d6c6db-5d6a-4362-9ab8-d3a0b55b619d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1276 microversion: 2.1 time: 0.210723 Oct 04 11:07:29.896862 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1011/1999] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:29 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:30.324557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:30.325074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:30.339427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:30.340181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:30.340788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:30.343058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:30.368535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:30.371948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:30.411795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:30.412770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:30.422936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:30.432366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:30.435149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:30.436097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:30.436769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:30.441766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:30.564901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:30.577802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:30.580156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:30.581580 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ea783b1d-13dc-4002-ac7e-840913124b38 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1266 microversion: 2.25 time: 0.261459 Oct 04 11:07:30.597822 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 989/2000] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:30 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:30.604276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:30.605201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:30.611794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:30.612217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:30.612866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:30.613632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:30.614265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:30.614956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:30.800572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:30.816596 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f12bdfc7-0dc1-4a41-b2db-37a01c346344 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1277 microversion: 2.1 time: 0.217325 Oct 04 11:07:30.821621 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 990/2001] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:30 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:30.827916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:30.837425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:30.854887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:30.855786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:30.857643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:30.860816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:30.862506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:30.864096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:30.949157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:30.960371 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-85369fe0-f91b-4a84-a932-0b169194498d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.554296 Oct 04 11:07:30.974330 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1012/2002] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:30 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:30.989156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:30.990588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:31.002558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.003073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.003522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.004502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.006009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.020217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.027166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:31.184585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.197981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.201660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.215747 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75a98208-ebe1-4b9b-98e0-d391528639a9 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.240051 Oct 04 11:07:31.216717 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1013/2003] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:30 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:31.228219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:31.228836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:31.239305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.240612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.241259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.242032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.242534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.246415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.465719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.476734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.481133 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-da72b428-203e-482e-baf7-dffb5f672327 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1274 microversion: 2.1 time: 0.262846 Oct 04 11:07:31.482939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:31.485187 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c65db69-39ee-4872-9552-3f484b511b6b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.662282 Oct 04 11:07:31.485818 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 991/2004] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:30 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:31.498397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:31.498874 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1014/2005] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:31 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1274 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:31.509467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.510136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Searching by: {'deleted': False, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:07:31.530958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.532496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.533569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.550928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.554917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.555518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.594080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:07:31.613486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:31.613692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:31.669104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.669643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.670698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.671441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.672009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.672337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.698903 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85399d91-e956-4dec-8e9d-9c06b8cd75fb tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.204223 Oct 04 11:07:31.709646 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 992/2006] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:07:31 2022] GET /compute/v2.1/servers => generated 334 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:31.727315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:31.740927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.744684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Searching by: {'deleted': False, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:07:31.755599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.759332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.759886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.762547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.763873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.765659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.831869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.833229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.835512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.836384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lazy-loading 'fault' on Instance uuid 314aa825-15be-4c05-88d6-b47c202d4640 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:31.875445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:07:31.935472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.947397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.951535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.960560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a11cd35d-90b1-43c1-a714-9690324666d8 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 200 len: 1271 microversion: 2.25 time: 0.353520 Oct 04 11:07:31.963387 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1015/2007] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:31 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 1271 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:31.978903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:31.980268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:31.989584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.990442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.990618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:31.991310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:31.992285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:31.992987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:31.993658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.014090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.014576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.015017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.161599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:32.178474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:32.199128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-048a5d8f-22ad-4046-b3e3-406571fd9f98 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1283 microversion: 2.1 time: 0.233834 Oct 04 11:07:32.199757 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1016/2008] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:31 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1283 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:32.222824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:32.223775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:32.231399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.232228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.233006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.235350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.236074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.236730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.568576 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2dd26ea-ab8d-448a-979a-7cfdfc508282 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.855450 Oct 04 11:07:32.570807 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 993/2009] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:07:31 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:32.576346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:32.577239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:32.592479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.592863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.595777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.597316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.598042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.602130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.692251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:32.701037 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2129f1e-8a4f-4d1b-8420-c771fad2ce66 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.482245 Oct 04 11:07:32.721200 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1017/2010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:32 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:32.733063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:32.733720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:32.747987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:32.750991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.753046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.755040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.755969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.757542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:32.758116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.758756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.758963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:32.775991 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14495e4f-7b87-4b13-bfc4-a3aec72b64f4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.203308 Oct 04 11:07:32.776595 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 994/2011] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:32 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:32.781060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:32.782273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:32.817538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.820250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.820980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:32.827047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:32.827796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:32.828329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:33.804260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:33.814388 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bb57f77-cf1d-40cf-970e-6fed49d7045e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 1.036742 Oct 04 11:07:33.819428 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 995/2012] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:32 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:33.823414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:33.827679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05fc1008-8041-49aa-b2cc-0d746bf59b5a tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:33.839406 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7742d3f-894b-4245-8291-7ed3fcce9cd4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 1.116953 Oct 04 11:07:33.849510 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1018/2013] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:32 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:33.857246 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05fc1008-8041-49aa-b2cc-0d746bf59b5a tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036350 Oct 04 11:07:33.864790 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 996/2014] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:07:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:33.870090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:33.870973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:33.872206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:33.873439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 314aa825-15be-4c05-88d6-b47c202d4640] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:33.901328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:33.902386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:33.903701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:33.906345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:33.907569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:33.909876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:33.910354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:33.914216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:33.915145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:33.916280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:33.916993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:33.919448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:33.971299 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] HTTP exception thrown: Instance 314aa825-15be-4c05-88d6-b47c202d4640 could not be found. Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Request method failure captured: Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 HTTP/1.1 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJEkZ_mvErloqk-uT_5B880r-pDAyQzurJpiKTEoCT_usPfyd_JFKyon5XRrFzCiiprL7Cl3HDJy6cAYWq556tamQ5vAkCLpt3URvxanSjTJ6GsHiismaXIJw81ZH5fpNHfLCzMXsuoJ8vFSdftBvk_JCKrk8mOsN9WGmnrXjN4vwQ Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 83765ee4f79c49f49b8af1a56a260450 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83765ee4f79c49f49b8af1a56a260450"}]}] Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 83765ee4f79c49f49b8af1a56a260450 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveAutoBlockMigrationV225Test-1440003002-project Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 27f40f692eac4ea39019fe4921b054f7 Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002-project Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 314aa825-15be-4c05-88d6-b47c202d4640 could not be found. Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '314aa825-15be-4c05-88d6-b47c202d4640'} Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314aa825-15be-4c05-88d6-b47c202d4640 could not be found. Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314aa825-15be-4c05-88d6-b47c202d4640 could not be found. Oct 04 11:07:33.984673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314aa825-15be-4c05-88d6-b47c202d4640 could not be found. Oct 04 11:07:33.994442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:33.996058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Returning 404 to user: Instance 314aa825-15be-4c05-88d6-b47c202d4640 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:34.002953 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a03d761-0f6e-44da-8c7a-501c0907c17d tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640" status: 404 len: 111 microversion: 2.25 time: 0.149416 Oct 04 11:07:34.004032 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1019/2015] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:33 2022] GET /compute/v2.1/servers/314aa825-15be-4c05-88d6-b47c202d4640 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:07:34.028503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-05041532-a46c-4cc9-99a3-31f485d58142 req-2f84b5f6-23cc-4459-a5f4-92e7875696f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e6ec01-e1fa-4fff-b376-721ca1d75b44", "tag": "a7512ef0-9da7-4b2b-a541-1cd2d1702373"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:34.071883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-05041532-a46c-4cc9-99a3-31f485d58142 req-2f84b5f6-23cc-4459-a5f4-92e7875696f3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:34.072661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-05041532-a46c-4cc9-99a3-31f485d58142 req-2f84b5f6-23cc-4459-a5f4-92e7875696f3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:34.073263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-05041532-a46c-4cc9-99a3-31f485d58142 req-2f84b5f6-23cc-4459-a5f4-92e7875696f3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:34.103761 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-05041532-a46c-4cc9-99a3-31f485d58142 req-2f84b5f6-23cc-4459-a5f4-92e7875696f3 service nova] Creating event network-changed:a7512ef0-9da7-4b2b-a541-1cd2d1702373 for instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 on n-h2-791135-8 Oct 04 11:07:34.123128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-05041532-a46c-4cc9-99a3-31f485d58142 req-2f84b5f6-23cc-4459-a5f4-92e7875696f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101404 Oct 04 11:07:34.130102 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1020/2016] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:34.165948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:34.167356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:34.181889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:34.182739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:34.183387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:34.190372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:34.191409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:34.192067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:34.945518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:34.959491 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-58322946-9d92-4cd7-a901-78e6359549c0 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.810171 Oct 04 11:07:34.979794 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1021/2017] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:34 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:35.004965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:35.007864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:35.041902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.042418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.042864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.044982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.045923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.046361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.065830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:35.078269 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28cfdaf6-e71d-4d5d-b82e-947b86a659d6 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 1.211966 Oct 04 11:07:35.078903 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 997/2018] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:33 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:35.122403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:35.122833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:35.151213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.151717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.164791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.167064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.167549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.173572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.292030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:07:35.317467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:35.340720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:35.347722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:35.378099 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4476211-2a0f-45d4-b60e-82102789a063 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.394560 Oct 04 11:07:35.378986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1022/2019] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:34 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:35.403247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:35.403990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:35.423464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.428340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.428803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.429592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.436338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.438046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.537930 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e8b13d4-7202-49ba-a595-614521fdbf3b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "DELETE /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 204 len: 0 microversion: 2.1 time: 0.451339 Oct 04 11:07:35.541538 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 998/2020] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:07:35 2022] DELETE /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:07:35.549470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:35.558386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:35.577029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.584566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.585315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.588594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.589264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.589926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.866592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:35.880711 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81da9587-5073-4fce-8477-3fe3b09d77f1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.499031 Oct 04 11:07:35.882455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1023/2021] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:35 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:35.893542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:35.894691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:35.910331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.911236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.911870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:35.912941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:35.913625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:35.914231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.067857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:36.079171 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24bb2f70-9343-45b9-8d44-a0b3fc198d66 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.536085 Oct 04 11:07:36.080116 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 999/2022] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:35 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:36.087689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-47afa0a8-93aa-4622-b981-204a41ab4b55 req-f1019f26-9ae8-4a8d-81b3-c6b33ae69b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba29ceb-94b3-4a8d-815e-9f77895374c4", "name": "network-vif-plugged", "status": "completed", "tag": "a7d19265-2675-4eae-b867-b41411469d2d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:36.105738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47afa0a8-93aa-4622-b981-204a41ab4b55 req-f1019f26-9ae8-4a8d-81b3-c6b33ae69b51 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.106285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47afa0a8-93aa-4622-b981-204a41ab4b55 req-f1019f26-9ae8-4a8d-81b3-c6b33ae69b51 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.108470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-47afa0a8-93aa-4622-b981-204a41ab4b55 req-f1019f26-9ae8-4a8d-81b3-c6b33ae69b51 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.121324 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-47afa0a8-93aa-4622-b981-204a41ab4b55 req-f1019f26-9ae8-4a8d-81b3-c6b33ae69b51 service nova] Creating event network-vif-plugged:a7d19265-2675-4eae-b867-b41411469d2d for instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 on n-h1-791135-8 Oct 04 11:07:36.131598 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-47afa0a8-93aa-4622-b981-204a41ab4b55 req-f1019f26-9ae8-4a8d-81b3-c6b33ae69b51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049936 Oct 04 11:07:36.132840 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1000/2023] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:36.139287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:36.140206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:36.143020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:36.148382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.149341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.150004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.150891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.151186 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-103244b7-c3ed-44b6-a571-f826441314da tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1700 microversion: 2.1 time: 0.267504 Oct 04 11:07:36.151723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.152323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.162526 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1024/2024] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:35 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1700 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:36.173733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:36.174360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:36.180539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.180870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.181311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.182428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.182890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.183319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.317154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:36.326393 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7309dcc4-db6d-4495-b0c2-586832824133 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.191956 Oct 04 11:07:36.342585 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1001/2025] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:36 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:36.348416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-cc40a760-6932-4bc6-8185-57f09626d12b req-54c1d8e5-6e37-449c-89ac-fadbc07646ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943e3b9f-8717-4bdb-b308-0217b69276c4", "tag": "6efc52dd-8471-4968-9652-82d9b0da5dce"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:36.359177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cc40a760-6932-4bc6-8185-57f09626d12b req-54c1d8e5-6e37-449c-89ac-fadbc07646ed service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.359726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cc40a760-6932-4bc6-8185-57f09626d12b req-54c1d8e5-6e37-449c-89ac-fadbc07646ed service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.360685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-cc40a760-6932-4bc6-8185-57f09626d12b req-54c1d8e5-6e37-449c-89ac-fadbc07646ed service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.374268 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-cc40a760-6932-4bc6-8185-57f09626d12b req-54c1d8e5-6e37-449c-89ac-fadbc07646ed service nova] Creating event network-changed:6efc52dd-8471-4968-9652-82d9b0da5dce for instance 943e3b9f-8717-4bdb-b308-0217b69276c4 on n-h1-791135-8 Oct 04 11:07:36.380072 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-cc40a760-6932-4bc6-8185-57f09626d12b req-54c1d8e5-6e37-449c-89ac-fadbc07646ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036075 Oct 04 11:07:36.384527 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1002/2026] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:36.412743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:36.413579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:36.421793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.423043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.423619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.425144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.425773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.426785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.569980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:36.581758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:36.583894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:36.593199 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8754333-07a4-43fd-91f1-1fe1b9b3b81c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.184825 Oct 04 11:07:36.596359 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1003/2027] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:36 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:36.626676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:36.635352 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c820e2c-08d1-417d-b3d6-a7baa2ca3c61 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.471567 Oct 04 11:07:36.638568 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1025/2028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:36 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:36.908016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:36.908942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:36.920744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.921227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.921677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:36.922416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:36.922859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:36.923276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.103770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:37.104386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:37.126001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.126487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.126916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.127630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.128079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.128498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.167183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:37.176281 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b43e8a5-bcce-4ed8-9de8-a92e95949803 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.273009 Oct 04 11:07:37.193552 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1004/2029] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:36 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:37.198930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:37.199680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:37.206982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.207682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.208225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.209032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.209697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.210223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.415576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:37.425507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c209ae18-f952-455e-ad3b-8da7a941c8cc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.326502 Oct 04 11:07:37.433063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1026/2030] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:37 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:37.439004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:37.442325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:37.448296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.450186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:37.458811 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6924156-b882-4377-9339-1b5ac500f465 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1700 microversion: 2.1 time: 0.263911 Oct 04 11:07:37.460320 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1005/2031] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:37 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1700 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:37.468651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.468651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.468651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.468651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.468651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.624544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:37.625852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:37.638290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.638869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.639378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.640159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.640690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.642207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.719279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:37.741019 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e76f607d-4a50-4253-b34a-4cc927d79e78 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.306413 Oct 04 11:07:37.742448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1027/2032] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:37 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:37.747154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:37.747767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:37.754842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.755351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.755777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.756826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:37.757720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:37.758158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:37.850614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:37.862837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:37.864329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:37.876663 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e476e08d-2653-4ecd-a1b0-a554a5b3f8f3 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.256021 Oct 04 11:07:37.891275 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1006/2033] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:37 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:37.995571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:38.005479 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e54ab0a-0900-4f90-8e52-c7163bcc5cff tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.261796 Oct 04 11:07:38.006394 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1028/2034] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:37 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:38.198712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:38.199995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:38.218363 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:38.219830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:38.220479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:38.221416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:38.222062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:38.222679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:38.450801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:38.458958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:38.483017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:38.492905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:38.493806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:38.494738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:38.497533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:38.498187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:38.564424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:38.577086 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1417cd0e-f96c-44bc-9252-821b7c9e2503 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.380683 Oct 04 11:07:38.582061 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1007/2035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:38 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:38.596956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:38.598382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:38.636044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:38.638302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:38.647903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:38.649057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:38.654251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:38.656286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:38.725253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:39.322882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:39.332024 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2857cf6-989c-4a05-a036-7ea1a4ad98a6 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1700 microversion: 2.1 time: 0.748779 Oct 04 11:07:39.335384 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1008/2036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:38 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1700 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:39.340819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:39.341340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:39.349967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:39.350468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:39.350915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:39.351909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:39.352558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:39.353591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:39.354436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:39.363363 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d67ba9c1-e547-4306-a8b8-d5cd5676fbd7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.917480 Oct 04 11:07:39.369286 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1029/2037] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:38 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:39.374282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:39.380624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:39.390498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:39.392475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:39.393020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:39.394332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:39.398183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:39.398680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:39.434324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:39.600288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:39.605046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:39.612263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:39.614702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:39.621595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32fe42d7-b11f-4d3c-bd7f-c40cb79906b4 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.251079 Oct 04 11:07:39.635083 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1030/2038] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:39 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:39.650140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:39.651664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:39.659706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:39.660552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:39.661229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:39.662223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:39.662898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:39.663537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:39.685940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:39.695137 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-db3f089d-dc87-4579-b56c-607b60b60fa6 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.358554 Oct 04 11:07:39.700654 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1009/2039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:39 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:39.711944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:39.713215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:39.730495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:39.734545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:39.735380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:39.738046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:39.739213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:39.741266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:39.742079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.103524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:40.114658 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5123e63c-f713-45c5-980a-719ea2115361 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.412314 Oct 04 11:07:40.118687 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1010/2040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:39 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:40.130093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:40.138066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:40.138679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:40.142710 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ce4ebdbe-742f-4b6b-8650-7ca910e8a157 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.505981 Oct 04 11:07:40.145312 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1031/2041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:39 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:40.154280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.154280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.154280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.154280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.154280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.154280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.191440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4a913ddb-63ff-46a6-80ef-e057708d0433 req-2f1b4b01-ebbb-491c-b0fa-6d98ce0c5c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e54f514-dae6-4a1d-8819-88de1734dc73", "tag": "8e69dcb1-00a9-4f3f-96d4-01f194a15bcb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:40.201016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:07:40.221284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a913ddb-63ff-46a6-80ef-e057708d0433 req-2f1b4b01-ebbb-491c-b0fa-6d98ce0c5c96 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.222084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a913ddb-63ff-46a6-80ef-e057708d0433 req-2f1b4b01-ebbb-491c-b0fa-6d98ce0c5c96 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.222701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a913ddb-63ff-46a6-80ef-e057708d0433 req-2f1b4b01-ebbb-491c-b0fa-6d98ce0c5c96 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.251404 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4a913ddb-63ff-46a6-80ef-e057708d0433 req-2f1b4b01-ebbb-491c-b0fa-6d98ce0c5c96 service nova] Creating event network-changed:8e69dcb1-00a9-4f3f-96d4-01f194a15bcb for instance 7e54f514-dae6-4a1d-8819-88de1734dc73 on n-h2-791135-8 Oct 04 11:07:40.260528 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4a913ddb-63ff-46a6-80ef-e057708d0433 req-2f1b4b01-ebbb-491c-b0fa-6d98ce0c5c96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070356 Oct 04 11:07:40.263195 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1032/2042] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:07:40.365330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:40.365967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:40.382773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.383271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.383714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.385757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.385757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.385757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.396552 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cdb73234-49de-42c5-b565-b72b731edc23 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 204 len: 0 microversion: 2.25 time: 0.276227 Oct 04 11:07:40.397439 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1011/2043] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:07:40 2022] DELETE /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:07:40.403066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:40.403773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:40.410176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.410661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.411094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.411798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.412250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.412675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.902254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:40.916606 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4175420c-d3d4-44e4-a20f-1f936178477b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.517644 Oct 04 11:07:40.917295 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1012/2044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:40 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:40.924075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:40.924789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:40.938309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.939641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.940563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:40.942850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:40.943348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:40.950256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.095659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.104550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-207b6dec-4bfe-493c-a595-5e9b19166878 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1700 microversion: 2.1 time: 0.743676 Oct 04 11:07:41.105454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1033/2045] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:40 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1700 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:41.120979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:41.122160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:41.134989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.135841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.138957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.140326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.141176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.142566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.258172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.274386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.275582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.275856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.277241 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2d7a645-2e2c-41ce-9c73-a21fab8f2f58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1733 microversion: 2.25 time: 0.358839 Oct 04 11:07:41.278683 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1013/2046] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:40 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1733 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:41.285703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:41.286217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:41.302730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.304893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.305220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.305417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.305843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.306707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.307001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.307428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.327700 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ed8d31ba-eb2f-4919-a013-f677a97633d1 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.219386 Oct 04 11:07:41.334756 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1034/2047] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:41 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:41.334756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:41.334756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:41.347984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.354730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.355482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.356898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.357403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.357911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.593126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.603641 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-602f10dd-815c-4f37-976a-2a53dff80aee tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.322664 Oct 04 11:07:41.605796 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1014/2048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:41 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:41.612725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:41.613594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:41.621526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.622229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.622862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.623876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.624491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.634096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.679323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.689430 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22ee1d29-1b48-4f61-8f42-c60045c3cb35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.359006 Oct 04 11:07:41.690542 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1035/2049] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:41 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:41.803212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:41.822417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:41.833159 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0fbdce68-4c5c-4782-b591-97e543b9dc8f tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.225466 Oct 04 11:07:41.834063 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1015/2050] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:41 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:41.941860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:41.942910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:41.950625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.951431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.952054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:41.953009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:41.954261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:41.954885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.097614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.105618 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c62e3c2a-a5dc-4534-a722-89cd2e197a79 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.168239 Oct 04 11:07:42.106284 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1036/2051] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:41 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:42.129525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:42.130261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:42.132254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=22 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:42.138034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.138659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.139166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.139942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.140462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.140970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.288755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.296585 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4925aec2-e268-42d8-bc43-9aeec62f3842 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1700 microversion: 2.1 time: 0.172251 Oct 04 11:07:42.297910 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1016/2052] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:42 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1700 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:42.306031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:42.306767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:42.313977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.314479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.314964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.315628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.316146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.316578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.355672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:42.356395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:42.363683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.364165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.364592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.365286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.365844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.366246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.460504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.469952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.471589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.477064 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-26b634d0-9719-4d1e-bf67-f88addd17b5c tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.125113 Oct 04 11:07:42.489308 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1017/2053] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:42 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:42.513667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.522979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.524459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.526060 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3dd06e80-f529-4a58-b12e-e7d5324e871f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1733 microversion: 2.25 time: 0.223524 Oct 04 11:07:42.526542 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1037/2054] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:42 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:42.628271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:42.629145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:42.635477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.635971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.636406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.637106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.637589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.638016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.638150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-91449cc0-4ffa-4f17-b025-40f36a9a55cb req-90180974-20ff-4c0a-8527-401a627ffd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e6ec01-e1fa-4fff-b376-721ca1d75b44", "name": "network-vif-plugged", "status": "completed", "tag": "a7512ef0-9da7-4b2b-a541-1cd2d1702373"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:42.658524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91449cc0-4ffa-4f17-b025-40f36a9a55cb req-90180974-20ff-4c0a-8527-401a627ffd72 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.659312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91449cc0-4ffa-4f17-b025-40f36a9a55cb req-90180974-20ff-4c0a-8527-401a627ffd72 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.661182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91449cc0-4ffa-4f17-b025-40f36a9a55cb req-90180974-20ff-4c0a-8527-401a627ffd72 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.675746 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-91449cc0-4ffa-4f17-b025-40f36a9a55cb req-90180974-20ff-4c0a-8527-401a627ffd72 service nova] Creating event network-vif-plugged:a7512ef0-9da7-4b2b-a541-1cd2d1702373 for instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 on n-h2-791135-8 Oct 04 11:07:42.682824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-91449cc0-4ffa-4f17-b025-40f36a9a55cb req-90180974-20ff-4c0a-8527-401a627ffd72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049833 Oct 04 11:07:42.684050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1038/2055] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:07:42.722311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:42.723039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:42.739819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.740722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.744143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.745549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.746642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.747699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.844647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.854048 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c5ea055-0820-462f-b534-ab05a1ba9c0b tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.230384 Oct 04 11:07:42.866299 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1018/2056] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:42 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:42.866299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:42.866299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:42.873578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.873578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.874235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.881398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:42.881607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:42.885750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:42.973475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:42.986260 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9ecb92e0-3111-41cb-8d15-57db277785a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.274898 Oct 04 11:07:42.987025 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1039/2057] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:42 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:43.129958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:43.132779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:43.142391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.143161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.143769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.144675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.145290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.145893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.355271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.364029 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca12fa14-fa30-436e-bbe8-75ba7307cc60 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.505831 Oct 04 11:07:43.378070 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1019/2058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:42 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:43.385153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:43.385729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:43.388980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.392608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.393106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.393560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.394263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.394713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.395133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.397136 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7aeb3411-a5ed-46bb-8a41-d221dd220ba1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.271827 Oct 04 11:07:43.399706 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1040/2059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:43 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:43.506258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:43.507012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:43.513840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.514474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.515014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.516355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.516919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.517509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.537882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.554400 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c61f376-ce21-4ab3-a8d1-fb4338e28110 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1700 microversion: 2.1 time: 0.174819 Oct 04 11:07:43.554993 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1020/2060] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:43 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1700 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:43.574542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:43.575150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:43.582011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.582526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.582948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.583639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.584084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.584498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.585149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.594301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.595748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.600738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f9abaeda-dd5d-413b-b24e-75d231c155cc tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.098608 Oct 04 11:07:43.601307 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1041/2061] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:43 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:43.717145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.726115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.727620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:43.728793 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d428cb08-9c26-4076-9af8-3aed481f1d49 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1733 microversion: 2.25 time: 0.158347 Oct 04 11:07:43.729380 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1021/2062] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:43 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:43.881904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:43.882513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:43.889648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.890210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.891327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:43.892160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:43.892620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:43.893161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.015470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:44.016094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:44.020885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:44.022899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.023383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.023816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.024515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.024964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.025439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.028716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-485893eb-612b-4325-bae5-171e1e604eba tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.150970 Oct 04 11:07:44.029282 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1042/2063] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:43 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:44.157818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:44.165452 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06f37943-aa25-40fd-8acd-dc148d1d5b2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.154792 Oct 04 11:07:44.166031 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1022/2064] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:44 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:44.388000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:44.388627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:44.394752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.395227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.395655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.396336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.396784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.397202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.426840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:44.427457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:44.434062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.434544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.434978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.435676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.436128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.436550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.441268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:44.624258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:44.632682 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5a27ee3-fdf5-4fd9-a3a9-54880d8b1d07 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.248481 Oct 04 11:07:44.633296 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1043/2065] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:44 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:44.637899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:44.638580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:44.641667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:44.645281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.645813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.646285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.647040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.647436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.647866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.649827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:44.658915 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d35c558-aa8f-484a-9e4c-53563a64f341 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.235936 Oct 04 11:07:44.659495 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1023/2066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:44 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:44.665106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:44.665270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:44.671499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.672637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.673196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.674180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.674644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.675069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.750580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:44.760408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:44.761894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:44.767070 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df82e4f7-f850-4ddd-be0f-7ab7f60af4e5 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.106573 Oct 04 11:07:44.780198 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1024/2067] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:44 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:44.780198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:44.780198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:44.780198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.780198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.780198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.780995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:44.780995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:44.781813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:44.930675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:44.938546 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5e36fbc-8978-4738-b5b9-5ffe4cf11d1b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1700 microversion: 2.1 time: 0.304236 Oct 04 11:07:44.939445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1044/2068] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:44 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1700 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:45.024236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:45.033022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:45.034483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:45.035647 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1002a5e0-77e9-403e-9e79-2ac4f67e6ec7 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1733 microversion: 2.25 time: 0.267082 Oct 04 11:07:45.036201 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1025/2069] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:44 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1733 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:45.051190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:45.051810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:45.057900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:45.058385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:45.058827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:45.059524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:45.059986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:45.060417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:45.187869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:45.188043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:45.188639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:45.194525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:45.195030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:45.195464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:45.195585 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1f8ed827-8be1-4c6b-a994-56901265b6b4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.148205 Oct 04 11:07:45.196129 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1045/2070] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:45 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:45.196311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:45.196601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:45.197021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:45.329023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:45.337273 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1cd2d6a2-d1a5-4b16-a8e8-6ff310cd909a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1307 microversion: 2.1 time: 0.153198 Oct 04 11:07:45.337870 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1026/2071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:45 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:45.655388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:45.656054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:45.665407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:45.665919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:45.666375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:45.667411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:45.667913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:45.668342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:45.681704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:45.682402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:45.689927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:45.691217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:45.691731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:45.692528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:45.693060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:45.693590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.160963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.169157 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f16ff575-e8b0-4b84-a1ff-f0fa298276b5 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.518293 Oct 04 11:07:46.169917 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1046/2072] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:45 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:46.174851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.175373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:46.175828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:46.182258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.182973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.183581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.184645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.185392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.185989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.193943 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98120a39-3fad-4564-a977-9915a585c298 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.515233 Oct 04 11:07:46.198993 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1027/2073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:45 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:46.204894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:46.210004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:46.216226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.216811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.217309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.218115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.219178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.219660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.344238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.353105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.354873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.360375 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f11b9cfe-ab2e-4ef3-9829-8d79b8ecf4e8 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.189462 Oct 04 11:07:46.361155 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1047/2074] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:46 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:46.365770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:46.366727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:46.372389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.372889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.373334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.374084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.374545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.375345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.554830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.570139 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-112c1431-fbf6-4ab0-92b5-1e0b62883d1d tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1700 microversion: 2.1 time: 0.369929 Oct 04 11:07:46.571034 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1028/2075] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:46 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1700 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:46.575624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:46.576231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:46.582860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.583357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.583876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.584564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.585020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.585485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.759810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.766410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:46.778575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.780613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:46.782965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-59a9a4c8-252c-4221-b229-028ed631a126 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1733 microversion: 2.25 time: 0.420798 Oct 04 11:07:46.793383 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1048/2076] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:46 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1733 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:46.793383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:46.793383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:46.808139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.808644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.809159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:46.810157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:46.810620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:46.811047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.003888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:47.017078 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56c5fb90-82c4-461d-bcf5-76daad6a227d tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1321 microversion: 2.1 time: 0.444443 Oct 04 11:07:47.018519 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1029/2077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:46 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:47.108163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:47.128353 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a2d4d5f-d9f7-4b81-950b-605557daa7df tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1487 microversion: 2.1 time: 0.342919 Oct 04 11:07:47.154097 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1049/2078] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:46 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1487 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:47.159700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6deacd4a-3309-47c3-ab5e-254b62cc9414 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:47.178814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6deacd4a-3309-47c3-ab5e-254b62cc9414 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:47.184791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6deacd4a-3309-47c3-ab5e-254b62cc9414 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:47.185483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6deacd4a-3309-47c3-ab5e-254b62cc9414 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.197809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:47.198872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:47.216226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:47.218772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:47.222926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.224126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:47.225281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:47.226080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.353913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6deacd4a-3309-47c3-ab5e-254b62cc9414 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Going to try to stop instance {{(pid=122408) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:07:47.471527 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6deacd4a-3309-47c3-ab5e-254b62cc9414 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44/action" status: 202 len: 0 microversion: 2.1 time: 0.315124 Oct 04 11:07:47.472489 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1030/2079] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:07:47 2022] POST /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:07:47.503074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:47.511903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:47.532074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:47.544995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:47.545571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.555419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:47.558173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:47.560829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.636513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:47.651707 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d812a5e-2fb4-4e1f-a0da-21bd8ff83ce3 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.462330 Oct 04 11:07:47.652304 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1050/2080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:47 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:47.683286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e8ad36fd-63e3-47d5-b40d-f01d0f5a68b2 req-19ae6650-33a7-4da1-8a27-0b044f65eeab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5813e7a4-1b03-438c-bf70-c2b544030ce4", "name": "network-vif-deleted", "tag": "b429cae8-ebcb-4a50-988d-0ebd70deba67"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:47.709064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8ad36fd-63e3-47d5-b40d-f01d0f5a68b2 req-19ae6650-33a7-4da1-8a27-0b044f65eeab service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:47.709751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8ad36fd-63e3-47d5-b40d-f01d0f5a68b2 req-19ae6650-33a7-4da1-8a27-0b044f65eeab service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:47.710198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8ad36fd-63e3-47d5-b40d-f01d0f5a68b2 req-19ae6650-33a7-4da1-8a27-0b044f65eeab service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.764787 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e8ad36fd-63e3-47d5-b40d-f01d0f5a68b2 req-19ae6650-33a7-4da1-8a27-0b044f65eeab service nova] Creating event network-vif-deleted:b429cae8-ebcb-4a50-988d-0ebd70deba67 for instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 on n-h1-791135-8 Oct 04 11:07:47.776205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e8ad36fd-63e3-47d5-b40d-f01d0f5a68b2 req-19ae6650-33a7-4da1-8a27-0b044f65eeab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106050 Oct 04 11:07:47.779634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1051/2081] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:47.802799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:47.803663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:47.822785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:47.823793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:47.824399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.825144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:47.841784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:47.842564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:47.988665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.002445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.007663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.016876 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-44653819-2f65-4da7-8785-73af6534d04b tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.232436 Oct 04 11:07:48.031534 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1052/2082] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:47 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:48.051921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:48.053010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:48.063076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.064081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.064954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.065793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.067340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.067783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.141430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.150107 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-745766ac-4b41-4ef6-80ae-fb808ade5bb9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.676106 Oct 04 11:07:48.151357 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1031/2083] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:47 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:48.157298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:48.158234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:48.164948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.165798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.166454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.167377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.167848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.168279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.258408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.268940 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b954a32f-973b-4723-b8da-a6d3af01a228 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1632 microversion: 2.1 time: 0.115884 Oct 04 11:07:48.269772 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1032/2084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:48 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1632 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:48.290882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:48.292109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:48.299681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.300515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.301275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.302851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.303487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.304109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.333971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.341480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.341976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.342416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.342869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lazy-loading 'fault' on Instance uuid 5813e7a4-1b03-438c-bf70-c2b544030ce4 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:48.350361 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ba03f67-9638-45d3-affa-edcf3480626d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.317430 Oct 04 11:07:48.351232 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1053/2085] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:48 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:48.369852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:48.370425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:48.378858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.379638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.380789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.381770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.382242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.382679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.399824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.408226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.410936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.414231 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a2d8bb9-b63b-47d8-a8c2-f88814731395 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 200 len: 1375 microversion: 2.25 time: 0.125363 Oct 04 11:07:48.415373 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1033/2086] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:48 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 1375 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:48.420640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f96c944b-6d1c-4371-9021-45fcd47c0b8e req-ff50ffb8-6ca2-45d8-8c04-0d2cdc0cecd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922cf522-37ef-40b7-93f9-5b774b6509f5", "name": "network-vif-deleted", "tag": "e72b8805-d5b7-4013-ad4f-07fc4d0f8aeb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:48.430625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f96c944b-6d1c-4371-9021-45fcd47c0b8e req-ff50ffb8-6ca2-45d8-8c04-0d2cdc0cecd3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.431642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f96c944b-6d1c-4371-9021-45fcd47c0b8e req-ff50ffb8-6ca2-45d8-8c04-0d2cdc0cecd3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.432249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f96c944b-6d1c-4371-9021-45fcd47c0b8e req-ff50ffb8-6ca2-45d8-8c04-0d2cdc0cecd3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.446647 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f96c944b-6d1c-4371-9021-45fcd47c0b8e req-ff50ffb8-6ca2-45d8-8c04-0d2cdc0cecd3 service nova] Creating event network-vif-deleted:e72b8805-d5b7-4013-ad4f-07fc4d0f8aeb for instance 922cf522-37ef-40b7-93f9-5b774b6509f5 on n-h1-791135-8 Oct 04 11:07:48.451954 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f96c944b-6d1c-4371-9021-45fcd47c0b8e req-ff50ffb8-6ca2-45d8-8c04-0d2cdc0cecd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035029 Oct 04 11:07:48.454823 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1034/2087] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:48.564619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.572814 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dbe49891-fff4-4c6d-bc3d-fe6948673d4e tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1471 microversion: 2.1 time: 0.220558 Oct 04 11:07:48.591684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1054/2088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:48 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:48.677037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:48.678077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:48.685065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.685796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.687882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.689876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:48.690573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:48.691193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:48.759355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c5a49fa-746d-4b6e-9df7-889426832215 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:48.760282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c5a49fa-746d-4b6e-9df7-889426832215 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] [instance: eeaab07c-b26f-4360-a18b-23c89f3e391f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:48.773704 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2c5a49fa-746d-4b6e-9df7-889426832215 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] HTTP exception thrown: Instance eeaab07c-b26f-4360-a18b-23c89f3e391f could not be found. Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c5a49fa-746d-4b6e-9df7-889426832215 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Request method failure captured: Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/eeaab07c-b26f-4360-a18b-23c89f3e391f/action HTTP/1.1 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 15 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBPhXOxh7ub2ldPxW1Dx9UFbv6slFhpm4Tjnh0Yyw3IjnACVv7zBNS4bl2CkpBBn3sYR2hL8Ty0__qtYSFFqk5fkA-Po_Yu-W1soIasUAbZ0SfktrJu330PhEqfxWdfZ1f5BxQxiiZiBiGDL5UXr2kxhVjfikNVmdOckRPj_FG5EI8M Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61c93a62430c4efda2eb03e653bf2bb7"}]}] Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 0b9f4c9b6cfc481e91e935622a164e9f Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: {"migrate": {}} Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance eeaab07c-b26f-4360-a18b-23c89f3e391f could not be found. Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'eeaab07c-b26f-4360-a18b-23c89f3e391f', 'body': {'migrate': {}}} Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeaab07c-b26f-4360-a18b-23c89f3e391f could not be found. Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeaab07c-b26f-4360-a18b-23c89f3e391f could not be found. Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:48.776793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeaab07c-b26f-4360-a18b-23c89f3e391f could not be found. Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c5a49fa-746d-4b6e-9df7-889426832215 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Returning 404 to user: Instance eeaab07c-b26f-4360-a18b-23c89f3e391f could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c5a49fa-746d-4b6e-9df7-889426832215 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/eeaab07c-b26f-4360-a18b-23c89f3e391f/action" status: 404 len: 111 microversion: 2.1 time: 0.184970 Oct 04 11:07:48.781962 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1035/2089] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:07:48 2022] POST /compute/v2.1/servers/eeaab07c-b26f-4360-a18b-23c89f3e391f/action => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:07:48.855076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:48.864713 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a32418d-4c57-40b9-8bd7-5d425019a843 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.192070 Oct 04 11:07:48.874446 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1055/2090] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:48 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:48.901313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-122834287", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:48.959264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:07:49.055350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:49.056028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:49.063811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.069210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.075237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.076270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.076951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.077610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.167742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:49.179171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:49.180725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:49.186767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73012bbb-a9f8-409a-957e-ccd225cd9b18 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1546 microversion: 2.91 time: 0.137365 Oct 04 11:07:49.188311 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1056/2091] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:49 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:49.193287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:49.194221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:49.202163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.202633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.203722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.204711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.206234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.206970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.335651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:07:49.336238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:07:49.339275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:07:49.340549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:07:49.341057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:07:49.361935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.365156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.369632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.370689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.371358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.371981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.414663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:49.419376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Getting quotas for project 27999b103d2843229ec7e57d2cfce666. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:07:49.424658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Getting quotas for user 0794a3719ab34ae1b8ac6b955a0c7cb4 and project 27999b103d2843229ec7e57d2cfce666. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:07:49.427760 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b6bcb8f-baed-4bc9-ac0f-9b5081133efc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.238212 Oct 04 11:07:49.429768 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1057/2092] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:49 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:49.435757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:49.436552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:49.439287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:07:49.441613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:07:49.443280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.444338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.445201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.446115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.446740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.447349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.491237 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8609c3bc-fd11-4c33-81a3-52a341673490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593920 Oct 04 11:07:49.492194 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1036/2093] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:07:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:07:49.497276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:49.498277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:49.502539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.503050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.503760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.504229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lazy-loading 'fault' on Instance uuid 922cf522-37ef-40b7-93f9-5b774b6509f5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:49.506722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.507420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.508028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.508984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.510212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.510924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.569663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd04405bf8f724455be376b1428e54061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf84a0f9e4d4832be12ec83a2c5b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:49.579901 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4d5e5e35-8951-45c6-b938-be65e7604f69 tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 200 len: 1359 microversion: 2.1 time: 0.148444 Oct 04 11:07:49.581021 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1058/2094] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:49 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:49.587874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:49.588838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 5813e7a4-1b03-438c-bf70-c2b544030ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:49.599208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.599779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.600217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.601626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.602098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.603600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.625072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] HTTP exception thrown: Instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 could not be found. Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Request method failure captured: Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 HTTP/1.1 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBJEkZ_mvErloqk-uT_5B880r-pDAyQzurJpiKTEoCT_usPfyd_JFKyon5XRrFzCiiprL7Cl3HDJy6cAYWq556tamQ5vAkCLpt3URvxanSjTJ6GsHiismaXIJw81ZH5fpNHfLCzMXsuoJ8vFSdftBvk_JCKrk8mOsN9WGmnrXjN4vwQ Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 83765ee4f79c49f49b8af1a56a260450 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83765ee4f79c49f49b8af1a56a260450"}]}] Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 83765ee4f79c49f49b8af1a56a260450 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveAutoBlockMigrationV225Test-1440003002-project Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 27f40f692eac4ea39019fe4921b054f7 Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002-project Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 could not be found. Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5813e7a4-1b03-438c-bf70-c2b544030ce4'} Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 could not be found. Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 could not be found. Oct 04 11:07:49.626861 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 could not be found. Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Returning 404 to user: Instance 5813e7a4-1b03-438c-bf70-c2b544030ce4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:49.631872 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45ac82ce-b72a-409c-84cb-7beb8f50adbd tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4" status: 404 len: 111 microversion: 2.25 time: 0.045979 Oct 04 11:07:49.633081 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1059/2095] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:49 2022] GET /compute/v2.1/servers/5813e7a4-1b03-438c-bf70-c2b544030ce4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:07:49.638284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9795f4d9-4045-4294-8e24-66371fb4bb27 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:49.638914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9795f4d9-4045-4294-8e24-66371fb4bb27 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:49.738428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9795f4d9-4045-4294-8e24-66371fb4bb27 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:49.748263 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9795f4d9-4045-4294-8e24-66371fb4bb27 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1221 microversion: 2.1 time: 0.113984 Oct 04 11:07:49.762516 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1060/2096] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:49 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:49.762516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-792459c9-3a07-42df-88e1-bbbf5b6fdcd3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '.version_select at 0x7f71d417b310>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:49.798893 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-792459c9-3a07-42df-88e1-bbbf5b6fdcd3 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561121247" status: 204 len: 0 microversion: 2.25 time: 0.047642 Oct 04 11:07:49.802442 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1061/2097] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:07:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561121247 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:07:49.821226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:49.829693 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b32f68f-d74a-42a2-a058-41e0faece77e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.336228 Oct 04 11:07:49.830277 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1037/2098] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:49 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:49.871692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-138b87d0-e517-4b4d-bdca-acb4bb9e7c44 req-082b0725-d83f-4dbe-8852-7e55aef0ef97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e54f514-dae6-4a1d-8819-88de1734dc73", "name": "network-vif-plugged", "status": "completed", "tag": "8e69dcb1-00a9-4f3f-96d4-01f194a15bcb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:49.892594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:49.893236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:49.902670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.903172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.903615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.904499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-138b87d0-e517-4b4d-bdca-acb4bb9e7c44 req-082b0725-d83f-4dbe-8852-7e55aef0ef97 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.905545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-138b87d0-e517-4b4d-bdca-acb4bb9e7c44 req-082b0725-d83f-4dbe-8852-7e55aef0ef97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.906686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-138b87d0-e517-4b4d-bdca-acb4bb9e7c44 req-082b0725-d83f-4dbe-8852-7e55aef0ef97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.907671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:49.911237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:49.911649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:49.941792 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-138b87d0-e517-4b4d-bdca-acb4bb9e7c44 req-082b0725-d83f-4dbe-8852-7e55aef0ef97 service nova] Creating event network-vif-plugged:8e69dcb1-00a9-4f3f-96d4-01f194a15bcb for instance 7e54f514-dae6-4a1d-8819-88de1734dc73 on n-h2-791135-8 Oct 04 11:07:49.952508 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-138b87d0-e517-4b4d-bdca-acb4bb9e7c44 req-082b0725-d83f-4dbe-8852-7e55aef0ef97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083886 Oct 04 11:07:49.954016 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1062/2099] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:50.168956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.182757 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15438cfd-8f8c-4dfa-8653-f6469434a5cf tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.297369 Oct 04 11:07:50.183347 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1038/2100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:49 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:50.219277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.221063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.230020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.230607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.231057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.231948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.232415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.232980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.300595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.308858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.310330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.315630 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d86c5f3-b9ae-404a-a9b2-77321a902b36 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1533 microversion: 2.91 time: 0.102315 Oct 04 11:07:50.316684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1063/2101] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:50 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1533 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:50.342845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.344673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.350677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.351391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.352006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.353513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.354149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.354759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.439738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] Lazy-loading 'services' on Instance uuid d547029e-7d82-43c1-b62b-e86b323bfcbe {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:50.451711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.452335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.459148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.459672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.460097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.460990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.461869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.462469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.469754 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f52e9cc6-1f6e-437d-8d41-466ee4bb722a tempest-UnshelveToHostMultiNodesTest-874363728 tempest-UnshelveToHostMultiNodesTest-874363728-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1938 microversion: 2.91 time: 0.130407 Oct 04 11:07:50.504481 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1039/2102] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:50 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1938 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:50.532417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.532926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.542580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.543582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.544246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.545143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.545796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.546440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.571318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:50.583081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:07:50.630113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.641403 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25451f7e-bf74-4ebd-9ee4-d77e1d704e89 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.193234 Oct 04 11:07:50.643051 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1064/2103] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:50 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:50.654183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.655101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.664958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.665941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.669504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.670661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.672079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.673838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.677713 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7a0a11a-c283-4916-b87b-ee9a46847ecd tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 204 len: 0 microversion: 2.91 time: 0.150928 Oct 04 11:07:50.679901 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1040/2104] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:07:50 2022] DELETE /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:07:50.688943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.689735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] [instance: 922cf522-37ef-40b7-93f9-5b774b6509f5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.697099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.697606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.698230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.698937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.699390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.699802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.714367 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] HTTP exception thrown: Instance 922cf522-37ef-40b7-93f9-5b774b6509f5 could not be found. Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Request method failure captured: Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 HTTP/1.1 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBOxxwUs6Fw9m8phktH6AXlNTYmlvs6969qpCTChynDc0frRs6Sb6LbiBzp7fTJ4in32C6F8NFgo0HHHdS6e6FE3mPX5NG1sHsJWnUDVw5bn38PPpoHE9XHJCtEVAkC03JKhIJlhgQidWkiujvgZ9VXgBuT2aig1fh-IcKpTtWtqhos Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 8cf84a0f9e4d4832be12ec83a2c5b192 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestJSON-535230735 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8cf84a0f9e4d4832be12ec83a2c5b192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8cf84a0f9e4d4832be12ec83a2c5b192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8cf84a0f9e4d4832be12ec83a2c5b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8cf84a0f9e4d4832be12ec83a2c5b192"}]}] Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestJSON-535230735 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 8cf84a0f9e4d4832be12ec83a2c5b192 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestJSON-535230735 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersTestJSON-535230735-project Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: d04405bf8f724455be376b1428e54061 Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestJSON-535230735-project Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 922cf522-37ef-40b7-93f9-5b774b6509f5 could not be found. Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '922cf522-37ef-40b7-93f9-5b774b6509f5'} Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922cf522-37ef-40b7-93f9-5b774b6509f5 could not be found. Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922cf522-37ef-40b7-93f9-5b774b6509f5 could not be found. Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:50.716214 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:50.721808 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:50.721808 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:50.721808 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:50.721808 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:50.721808 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922cf522-37ef-40b7-93f9-5b774b6509f5 could not be found. Oct 04 11:07:50.721808 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:50.721808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Returning 404 to user: Instance 922cf522-37ef-40b7-93f9-5b774b6509f5 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:50.721808 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-07e56631-3a11-4093-ad51-d94c49db08ae tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5" status: 404 len: 111 microversion: 2.1 time: 0.035800 Oct 04 11:07:50.722500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:07:50.722614 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1041/2105] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:50 2022] GET /compute/v2.1/servers/922cf522-37ef-40b7-93f9-5b774b6509f5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:07:50.726463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.727068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.732855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.733335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.733821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.734516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.734965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.735381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.804090 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f6485676-84c2-4c7b-8454-dbebaf077a58 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "DELETE /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 204 len: 0 microversion: 2.25 time: 0.159038 Oct 04 11:07:50.804592 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1065/2106] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:07:50 2022] DELETE /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:07:50.809627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.810226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a8fd64d-6597-4229-a643-3627f21f9f2b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] Calling method '.version_select at 0x7f71d43b1e50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.818705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.820160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.823012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:50.826430 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-caad7f65-a804-4a87-9e74-501e1141f591 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.103590 Oct 04 11:07:50.826999 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1042/2107] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:50 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:50.841709 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a8fd64d-6597-4229-a643-3627f21f9f2b tempest-ServersTestJSON-535230735 tempest-ServersTestJSON-535230735-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-633193538" status: 202 len: 0 microversion: 2.1 time: 0.024163 Oct 04 11:07:50.841709 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1066/2108] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:07:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-633193538 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:07:50.841709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.841709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.847780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.847780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.850348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.850857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.851353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.852062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.853265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.853734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.857564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.858206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.858727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.859785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.860437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.860988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.952366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:50.960868 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-582075cd-4c87-4002-aa07-9f8f96ba10bc tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1273 microversion: 2.1 time: 0.129147 Oct 04 11:07:50.973556 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1067/2109] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:50 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:50.981726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:50.982354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:50.989200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.989707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.990425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:50.991379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:50.992065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:50.992705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:51.012358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:51.239093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:51.248825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:51.251218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:51.252661 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b3f74ab-1ca6-47fa-981d-8824d72cff32 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1549 microversion: 2.25 time: 0.418194 Oct 04 11:07:51.253241 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1043/2110] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:50 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1549 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:51.272110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:51.273005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:51.279900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:51.280597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:51.281138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:51.282123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:51.282693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:51.283230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:51.345048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:51.353506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d70dbf18-18a2-4d34-8c02-129d918930ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.378413 Oct 04 11:07:51.354662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1068/2111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:50 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:51.664848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:51.665531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:51.672409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:51.672891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:51.673322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:51.674049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:51.674499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:51.674925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:51.939914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:51.944860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:51.948265 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d959725c-2146-4cb8-b09e-04b3f6464584 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1325 microversion: 2.1 time: 0.682075 Oct 04 11:07:51.949084 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1044/2112] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:51 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1325 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:51.953714 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-559d3dcd-b56d-46ec-9e65-f9a82662b130 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.292829 Oct 04 11:07:51.954346 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1069/2113] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:51 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:51.954478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:51.954971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:51.962527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:51.963777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:51.964437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:51.965338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:51.966032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:51.966667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:51.988802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:51.989922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:51.996720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:51.997470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:51.998319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:51.999198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:51.999968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:52.000593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:52.087291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:52.098679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:52.100466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:52.106369 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5d13fd72-f1ba-4eb3-8ff2-32a4f88b7c63 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1539 microversion: 2.91 time: 0.156096 Oct 04 11:07:52.106954 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1045/2114] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:51 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1539 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:52.125983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:52.134939 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc9a5b82-095f-46ab-9bb3-0468ce7e55d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1279 microversion: 2.1 time: 0.150819 Oct 04 11:07:52.135512 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1070/2115] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:51 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:52.277788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:52.278323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:52.285246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:52.285886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:52.286424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:52.287247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:52.287816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:52.288402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:52.379487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:52.380105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:52.387072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:52.387839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:52.388458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:52.389381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:52.389849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:52.390912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:52.770644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:52.779675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:52.781264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:52.782839 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83894ab3-1bfa-4ba8-b780-678cc3917afa tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1549 microversion: 2.25 time: 0.509017 Oct 04 11:07:52.783535 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1046/2116] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:52 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1549 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:52.821815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:52.834069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-334b89d3-35bd-4434-a87f-88026df779fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.459195 Oct 04 11:07:52.851616 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1071/2117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:52 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:52.977060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:52.978698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:52.979894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:52.983141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:52.996584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:52.997236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:52.997790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.000530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.001028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.001647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.001891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.002128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.002564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.002974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.014001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.015050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.404904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:53.422371 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81bb20cf-be89-4210-b0c4-13c71f01c721 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.449161 Oct 04 11:07:53.424105 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1072/2118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:52 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:53.429319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:53.430256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:53.441932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.443950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.444685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.446017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.446695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.447200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.487940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.488882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.489592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.490476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lazy-loading 'fault' on Instance uuid d547029e-7d82-43c1-b62b-e86b323bfcbe {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:53.590279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:53.594940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:53.607777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:53.610116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '968e4ed3b1ef447b9a1f3621a371fbd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e637210d112043fbab064bc4e65ea917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:53.614169 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eefa19d4-9515-4d3b-b466-9af50a6f0a5e tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1522 microversion: 2.1 time: 0.645783 Oct 04 11:07:53.614761 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1047/2119] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:52 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:53.619173 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4dd55612-dc04-4fbf-a052-a40570fadca7 tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 200 len: 1544 microversion: 2.91 time: 0.190682 Oct 04 11:07:53.620497 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1073/2120] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:53 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 1544 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:53.628728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-34993020-a826-4185-b8dc-e24f9eae43c7 req-5a04ac94-f7ed-49da-8708-6ce1c57abd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240456d4-736b-475f-a025-74e9d41f65e5", "name": "network-vif-deleted", "tag": "f2941df9-a2f4-43d4-bf97-726d9c9a9ab8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:53.630855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:53.631819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:53.641677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-34993020-a826-4185-b8dc-e24f9eae43c7 req-5a04ac94-f7ed-49da-8708-6ce1c57abd2d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.642551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-34993020-a826-4185-b8dc-e24f9eae43c7 req-5a04ac94-f7ed-49da-8708-6ce1c57abd2d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.643343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-34993020-a826-4185-b8dc-e24f9eae43c7 req-5a04ac94-f7ed-49da-8708-6ce1c57abd2d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.646036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.647321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.647775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.648826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.649564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.650013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.696000 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-34993020-a826-4185-b8dc-e24f9eae43c7 req-5a04ac94-f7ed-49da-8708-6ce1c57abd2d service nova] Creating event network-vif-deleted:f2941df9-a2f4-43d4-bf97-726d9c9a9ab8 for instance 240456d4-736b-475f-a025-74e9d41f65e5 on n-h2-791135-8 Oct 04 11:07:53.702684 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-34993020-a826-4185-b8dc-e24f9eae43c7 req-5a04ac94-f7ed-49da-8708-6ce1c57abd2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079970 Oct 04 11:07:53.703825 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1074/2121] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:53.711837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:53.712704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:53.720629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.721478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.722298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.723364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.723828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.724251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.786706 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] HTTP exception thrown: Action 999 not found Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Request method failure captured: Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73/os-instance-actions/999 HTTP/1.1 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBPvbHAS3lBwPsIl-YTvBylaDwSp9zYrj3C3a2Itkai0w_LiC7E5gQZZQ_dwU1DMehytFCbhH9_Sexyq8wngPot5c383nd-RQ_dCTcGK7V-XGSY-rxW8wp2ypalnV_n-bcuiBI8UjaOpQyfnR9v8qAyaISJUGP8lSREyOHvN9CKGhhw Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c997f3c4047a43958d82b789a1d6edb0 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c997f3c4047a43958d82b789a1d6edb0"}]}] Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c997f3c4047a43958d82b789a1d6edb0 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceActionsNegativeTestJSON-392056605-project Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0a723f4333c14765a850c2a6fea98737 Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-392056605-project Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: exception: Action 999 not found Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '7e54f514-dae6-4a1d-8819-88de1734dc73', 'id': '999'} Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 11:07:53.795431 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:53.802371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Returning 404 to user: Action 999 not found {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:53.802371 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53460590-ff30-4c6b-bd57-61b13361364a tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.092678 Oct 04 11:07:53.802371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1075/2122] 10.222.0.23 () {58 vars in 1308 bytes} [Tue Oct 4 11:07:53 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73/os-instance-actions/999 => generated 66 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:07:53.814813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:53.817041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:53.832995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.833342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.834446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.834446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.837304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.837667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.924822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:53.925310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:53.929162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:53.929853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lazy-loading 'fault' on Instance uuid 240456d4-736b-475f-a025-74e9d41f65e5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:53.998343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:54.016460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:54.018483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:54.022456 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3bd7ce7d-72d3-4925-95a7-fffd9f18012a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1352 microversion: 2.25 time: 0.214843 Oct 04 11:07:54.024768 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1076/2123] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:53 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1352 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:54.037986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd4cb490-41aa-48ee-8c6d-ccf1a1d2154c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '.version_select at 0x7f71d41f5430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:54.039091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd4cb490-41aa-48ee-8c6d-ccf1a1d2154c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:54.049777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:54.053446 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-fd4cb490-41aa-48ee-8c6d-ccf1a1d2154c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] HTTP exception thrown: Instance 58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d could not be found. Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd4cb490-41aa-48ee-8c6d-ccf1a1d2154c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Request method failure captured: Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d/os-instance-actions HTTP/1.1 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBPvbHAS3lBwPsIl-YTvBylaDwSp9zYrj3C3a2Itkai0w_LiC7E5gQZZQ_dwU1DMehytFCbhH9_Sexyq8wngPot5c383nd-RQ_dCTcGK7V-XGSY-rxW8wp2ypalnV_n-bcuiBI8UjaOpQyfnR9v8qAyaISJUGP8lSREyOHvN9CKGhhw Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c997f3c4047a43958d82b789a1d6edb0 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c997f3c4047a43958d82b789a1d6edb0"}]}] Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c997f3c4047a43958d82b789a1d6edb0 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceActionsNegativeTestJSON-392056605-project Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0a723f4333c14765a850c2a6fea98737 Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-392056605-project Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d could not be found. Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d'} Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d could not be found. Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:07:54.059377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d could not be found. Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d could not be found. Oct 04 11:07:54.064408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.069632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd4cb490-41aa-48ee-8c6d-ccf1a1d2154c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Returning 404 to user: Instance 58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:54.070805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd4cb490-41aa-48ee-8c6d-ccf1a1d2154c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.043140 Oct 04 11:07:54.076605 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5717eb44-fef0-457f-96f7-f78d8f502063 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1321 microversion: 2.1 time: 0.457511 Oct 04 11:07:54.079277 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1048/2124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:53 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:54.079886 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1077/2125] 10.222.0.23 () {58 vars in 1296 bytes} [Tue Oct 4 11:07:54 2022] GET /compute/v2.1/servers/58364fb8-eb8e-4f5d-a2cd-a1ad3b7ca94d/os-instance-actions => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:07:54.089244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-22a7b5c3-bb10-4325-92e7-92757bc40c8f req-84cd77dd-219b-4bba-b0c4-d8c594d283ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4e7be2-e1ee-45e6-877e-4eea387fd50c", "tag": "95fc2767-1914-4dd1-8cbd-b93e9fe7099e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:54.105099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:54.105923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:54.112912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.113443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.114114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.114854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.115305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.115737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.120886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22a7b5c3-bb10-4325-92e7-92757bc40c8f req-84cd77dd-219b-4bba-b0c4-d8c594d283ca service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.121514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22a7b5c3-bb10-4325-92e7-92757bc40c8f req-84cd77dd-219b-4bba-b0c4-d8c594d283ca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.121963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22a7b5c3-bb10-4325-92e7-92757bc40c8f req-84cd77dd-219b-4bba-b0c4-d8c594d283ca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.135475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-22a7b5c3-bb10-4325-92e7-92757bc40c8f req-84cd77dd-219b-4bba-b0c4-d8c594d283ca service nova] Creating event network-changed:95fc2767-1914-4dd1-8cbd-b93e9fe7099e for instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c on n-h1-791135-8 Oct 04 11:07:54.167132 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-22a7b5c3-bb10-4325-92e7-92757bc40c8f req-84cd77dd-219b-4bba-b0c4-d8c594d283ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085578 Oct 04 11:07:54.168541 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1078/2126] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:54.180906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:54.181622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:54.190112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.190849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.191356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.192132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.193027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.194437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.247249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:07:54.337880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:54.352157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:54.355265 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec945cc8-c86c-49ee-bcbd-c4033ffb7cbb tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 204 len: 0 microversion: 2.1 time: 0.183636 Oct 04 11:07:54.357428 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1079/2127] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:07:54 2022] DELETE /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:07:54.364755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:54.365787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:54.370104 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff7a60f1-bfe8-4068-a6b5-2a46ea258535 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.289074 Oct 04 11:07:54.370804 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1049/2128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:54 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:54.373626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.375001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.375685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.376676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.377371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.378259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.448355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:54.449332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:54.459629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.460435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.461189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.462211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.463047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.463683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.763387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:54.771936 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd6f3f7c-e12f-4dca-b32a-9f928f1abf0c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1528 microversion: 2.1 time: 0.411821 Oct 04 11:07:54.772602 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1080/2129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:54 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1528 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:54.777231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:54.777932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] [instance: d547029e-7d82-43c1-b62b-e86b323bfcbe] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:54.783965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.784671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.785535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.786479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.787141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.787769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.788753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:54.799490 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e214d18-48cb-4784-8268-ecfc41011ce7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.355987 Oct 04 11:07:54.800119 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1050/2130] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:54 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:54.805005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a8efb875-5b0a-4810-83c5-e5afe56f4ce3 req-5da51aef-acff-4d3f-8ad0-f18ceea6ebb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943e3b9f-8717-4bdb-b308-0217b69276c4", "name": "network-vif-plugged", "status": "completed", "tag": "6efc52dd-8471-4968-9652-82d9b0da5dce"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:54.805327 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] HTTP exception thrown: Instance d547029e-7d82-43c1-b62b-e86b323bfcbe could not be found. Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Request method failure captured: Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe HTTP/1.1 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBM4Jx-G4XHt9dL-xiHJ9yqx0Vkdfc8WgbCyA02skeciRPbK1fFalDiYrw2iPyVXd1Z9Yxalc5LtlEFy180Gtzs24rYkv_reREfcg7cklfPx5Ti5P4sCDR09LRudOt5mveqv5ajh9K69L7gw2z5wCpV8sLwyfrThZbUFEygMi-yXRJ0 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e637210d112043fbab064bc4e65ea917 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-720212573 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e637210d112043fbab064bc4e65ea917"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e637210d112043fbab064bc4e65ea917"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e637210d112043fbab064bc4e65ea917"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e637210d112043fbab064bc4e65ea917"}]}] Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-720212573 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e637210d112043fbab064bc4e65ea917 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-720212573 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-UnshelveToHostMultiNodesTest-720212573-project Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 968e4ed3b1ef447b9a1f3621a371fbd6 Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-720212573-project Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance d547029e-7d82-43c1-b62b-e86b323bfcbe could not be found. Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'd547029e-7d82-43c1-b62b-e86b323bfcbe'} Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d547029e-7d82-43c1-b62b-e86b323bfcbe could not be found. Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d547029e-7d82-43c1-b62b-e86b323bfcbe could not be found. Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.807101 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d547029e-7d82-43c1-b62b-e86b323bfcbe could not be found. Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] Returning 404 to user: Instance d547029e-7d82-43c1-b62b-e86b323bfcbe could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-363d249c-4541-41e6-af70-79f16e73a25d tempest-UnshelveToHostMultiNodesTest-720212573 tempest-UnshelveToHostMultiNodesTest-720212573-project] 10.222.0.23 "GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe" status: 404 len: 111 microversion: 2.91 time: 0.034915 Oct 04 11:07:54.813585 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1081/2131] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:54 2022] GET /compute/v2.1/servers/d547029e-7d82-43c1-b62b-e86b323bfcbe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:07:54.838396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a8efb875-5b0a-4810-83c5-e5afe56f4ce3 req-5da51aef-acff-4d3f-8ad0-f18ceea6ebb3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:54.838900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a8efb875-5b0a-4810-83c5-e5afe56f4ce3 req-5da51aef-acff-4d3f-8ad0-f18ceea6ebb3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:54.840593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a8efb875-5b0a-4810-83c5-e5afe56f4ce3 req-5da51aef-acff-4d3f-8ad0-f18ceea6ebb3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:54.859728 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a8efb875-5b0a-4810-83c5-e5afe56f4ce3 req-5da51aef-acff-4d3f-8ad0-f18ceea6ebb3 service nova] Creating event network-vif-plugged:6efc52dd-8471-4968-9652-82d9b0da5dce for instance 943e3b9f-8717-4bdb-b308-0217b69276c4 on n-h1-791135-8 Oct 04 11:07:54.867613 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a8efb875-5b0a-4810-83c5-e5afe56f4ce3 req-5da51aef-acff-4d3f-8ad0-f18ceea6ebb3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065833 Oct 04 11:07:54.868668 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1051/2132] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:07:55.052655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:55.053618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:55.060898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.061506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.062584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:55.063446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.064005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.064515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:55.103518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.103899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.104335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:55.104794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lazy-loading 'fault' on Instance uuid 240456d4-736b-475f-a025-74e9d41f65e5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:55.107661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:55.108440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:55.115788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.116277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.116743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:55.117690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.118172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.118597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:55.191139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:55.199305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:55.200895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:55.202039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8cee497e-f71f-4a75-b35c-9797811f59cc tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 200 len: 1352 microversion: 2.25 time: 0.153430 Oct 04 11:07:55.202634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1082/2133] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:55 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 1352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:55.383585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:55.394455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:55.395403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:55.404893 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b7e2023-c02f-44f7-9ae3-f97f4e635d4f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1321 microversion: 2.1 time: 0.303143 Oct 04 11:07:55.409582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.410360 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1052/2134] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:55 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:55.411081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.411799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:55.412770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.413501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.414190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:55.797694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:55.798321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:55.812708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.813208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.813675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:55.814399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:55.814857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:55.824481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.005466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:56.027160 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3284816d-8ebb-498f-b1a8-66abc31e4578 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.636231 Oct 04 11:07:56.027826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1083/2135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:55 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:56.033272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:56.034123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:56.044550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.045508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.046111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.047441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.058025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.058872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.305999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:56.316316 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-077f9da9-0e17-480f-9d2a-9310e8dbb0ad tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1528 microversion: 2.1 time: 0.524596 Oct 04 11:07:56.317842 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1053/2136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:55 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1528 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:56.326016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:56.326870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 240456d4-736b-475f-a025-74e9d41f65e5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:56.339567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.340526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.342202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.347012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.349586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.351073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.374884 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] HTTP exception thrown: Instance 240456d4-736b-475f-a025-74e9d41f65e5 could not be found. Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Request method failure captured: Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 HTTP/1.1 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJEkZ_mvErloqk-uT_5B880r-pDAyQzurJpiKTEoCT_usPfyd_JFKyon5XRrFzCiiprL7Cl3HDJy6cAYWq556tamQ5vAkCLpt3URvxanSjTJ6GsHiismaXIJw81ZH5fpNHfLCzMXsuoJ8vFSdftBvk_JCKrk8mOsN9WGmnrXjN4vwQ Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 83765ee4f79c49f49b8af1a56a260450 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83765ee4f79c49f49b8af1a56a260450"}]}] Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 83765ee4f79c49f49b8af1a56a260450 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-LiveAutoBlockMigrationV225Test-1440003002-project Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 27f40f692eac4ea39019fe4921b054f7 Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002-project Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 240456d4-736b-475f-a025-74e9d41f65e5 could not be found. Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '240456d4-736b-475f-a025-74e9d41f65e5'} Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240456d4-736b-475f-a025-74e9d41f65e5 could not be found. Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240456d4-736b-475f-a025-74e9d41f65e5 could not be found. Oct 04 11:07:56.376890 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240456d4-736b-475f-a025-74e9d41f65e5 could not be found. Oct 04 11:07:56.385784 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:07:56.390790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Returning 404 to user: Instance 240456d4-736b-475f-a025-74e9d41f65e5 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:07:56.393801 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-690fb81b-e9ea-426f-8884-1608da8d79f9 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5" status: 404 len: 111 microversion: 2.25 time: 0.073525 Oct 04 11:07:56.396728 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1054/2137] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:56 2022] GET /compute/v2.1/servers/240456d4-736b-475f-a025-74e9d41f65e5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:07:56.411342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:56.413649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:56.426295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.428469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.438172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.439813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.440631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.441334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.494204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:07:56.549440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:56.562814 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-123de9c3-5507-4bee-ab81-0e9dfd78da27 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1316 microversion: 2.1 time: 0.533628 Oct 04 11:07:56.567104 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1084/2138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:56 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:56.586729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:56.588090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:56.601460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.603698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.605722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:56.606427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.607591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.610285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.610669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.678839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:56.684490 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-224d7c67-ea7f-43bb-80a7-14cbd942b82f tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "DELETE /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 204 len: 0 microversion: 2.25 time: 0.282343 Oct 04 11:07:56.685442 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1055/2139] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:07:56 2022] DELETE /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:07:56.694712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:56.695724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:56.706082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.706582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.707024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:56.707780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:56.708249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:56.708710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:57.126389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:57.133923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:57.142295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:57.147194 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1bdbd7a0-2111-4a3f-8dde-0dab2ee9657f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1321 microversion: 2.1 time: 0.576407 Oct 04 11:07:57.147909 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1085/2140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:56 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:57.153048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:57.154582 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c75361be-a783-4d5b-9869-9030a33d7b39 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1565 microversion: 2.25 time: 0.464302 Oct 04 11:07:57.156882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:57.169707 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1056/2141] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:56 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1565 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:07:57.170521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:57.182800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:57.183547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:57.184422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:57.184924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:57.185599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:57.186039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:57.350577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:57.351205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:57.361062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:57.362497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:57.363182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:57.365474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:57.366132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:57.366845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:57.621658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:57.630400 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8ae2be49-f1f2-4b52-af7a-e16399f60d18 tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1486 microversion: 2.1 time: 0.289942 Oct 04 11:07:57.646192 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1057/2142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:57 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1486 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:07:57.651786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:57.652526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:57.659830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:57.660403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:57.660912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:57.661737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:57.662265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:57.662831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:57.675655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:57.687914 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f1f8377-c769-452f-a0a0-8dfc13c65c15 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.538860 Oct 04 11:07:57.688518 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1086/2143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:57 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:57.713904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2789971d-a41a-4d3c-b974-977c8c7453c2 req-d3bdf714-cb4c-4dcc-a728-31d4233d0e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e54f514-dae6-4a1d-8819-88de1734dc73", "name": "network-vif-deleted", "tag": "8e69dcb1-00a9-4f3f-96d4-01f194a15bcb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:57.748406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2789971d-a41a-4d3c-b974-977c8c7453c2 req-d3bdf714-cb4c-4dcc-a728-31d4233d0e57 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:57.750320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2789971d-a41a-4d3c-b974-977c8c7453c2 req-d3bdf714-cb4c-4dcc-a728-31d4233d0e57 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:57.751963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2789971d-a41a-4d3c-b974-977c8c7453c2 req-d3bdf714-cb4c-4dcc-a728-31d4233d0e57 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:57.768531 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2789971d-a41a-4d3c-b974-977c8c7453c2 req-d3bdf714-cb4c-4dcc-a728-31d4233d0e57 service nova] Creating event network-vif-deleted:8e69dcb1-00a9-4f3f-96d4-01f194a15bcb for instance 7e54f514-dae6-4a1d-8819-88de1734dc73 on n-h2-791135-8 Oct 04 11:07:57.773615 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2789971d-a41a-4d3c-b974-977c8c7453c2 req-d3bdf714-cb4c-4dcc-a728-31d4233d0e57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064043 Oct 04 11:07:57.775135 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1087/2144] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:07:58.050542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:58.060897 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd0c59e6-db2d-4cb2-b543-e9f3389ac50f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1465 microversion: 2.1 time: 0.413448 Oct 04 11:07:58.063498 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1058/2145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:57 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1465 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:58.134798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:58.134798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:58.134798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.134798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.134798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.134798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.134798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.134798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.175414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:58.176614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:58.186009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.187735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.188487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.189776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.190857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.191523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.363102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c3cc062-a063-404d-a0af-e2aec7f54542 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1616 microversion: 2.1 time: 0.277962 Oct 04 11:07:58.363798 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1088/2146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:58 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1616 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:58.390451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:58.391568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:58.401598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.402294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.403484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.404637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.405684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.406554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.428193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:58.441626 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f642d9c-84ba-4061-b36b-970d0d8a4c36 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1321 microversion: 2.1 time: 0.272138 Oct 04 11:07:58.443699 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1059/2147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:58 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:58.512265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:58.520470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1897247723", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1976caef-e757-4301-a92b-66d06d09fc3b"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:58.523655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:58.527462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:58.532511 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f2a916f-a3d6-4166-902a-0ae7feddb81a tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1523 microversion: 2.25 time: 0.147317 Oct 04 11:07:58.533106 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1089/2148] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:58 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:07:58.588519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3b9890f8-dbf8-487a-a923-7488dee9c87b req-eda262dc-376a-41bf-b2a8-2b0c5103c361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bf74f9-21f7-4f34-9676-662ac379bf2b", "name": "network-vif-deleted", "tag": "572986c9-5f62-4f60-abf7-58a1035c9adf"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:07:58.656708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3b9890f8-dbf8-487a-a923-7488dee9c87b req-eda262dc-376a-41bf-b2a8-2b0c5103c361 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.660707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:07:58.664833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3b9890f8-dbf8-487a-a923-7488dee9c87b req-eda262dc-376a-41bf-b2a8-2b0c5103c361 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.666555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3b9890f8-dbf8-487a-a923-7488dee9c87b req-eda262dc-376a-41bf-b2a8-2b0c5103c361 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.702355 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3b9890f8-dbf8-487a-a923-7488dee9c87b req-eda262dc-376a-41bf-b2a8-2b0c5103c361 service nova] Creating event network-vif-deleted:572986c9-5f62-4f60-abf7-58a1035c9adf for instance 03bf74f9-21f7-4f34-9676-662ac379bf2b on n-h1-791135-8 Oct 04 11:07:58.709723 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3b9890f8-dbf8-487a-a923-7488dee9c87b req-eda262dc-376a-41bf-b2a8-2b0c5103c361 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133011 Oct 04 11:07:58.712580 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1090/2149] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:07:58.726870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:58.728098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:58.739964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.740803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.741562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.742524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.743202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.743918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.825431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:58.826344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:58.827005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:58.828078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lazy-loading 'fault' on Instance uuid 7e54f514-dae6-4a1d-8819-88de1734dc73 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:58.993891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a723f4333c14765a850c2a6fea98737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c997f3c4047a43958d82b789a1d6edb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:59.004011 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b58dd981-0594-4dc0-9b50-1a4250a69fce tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 200 len: 1315 microversion: 2.1 time: 0.288804 Oct 04 11:07:59.005631 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1091/2150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:58 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:59.016176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:59.016809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:59.054877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.055384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.058966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.060155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.066274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.067368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.402272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:59.416293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:59.434012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:59.451160 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb9a629a-44e6-4e3c-ab35-5dcb14b7a636 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.441712 Oct 04 11:07:59.462824 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1092/2151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:59 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:59.477149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:59.480702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:59.497436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.497960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.500461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.501311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.501819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.502257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.542009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:07:59.542440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:07:59.542924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:07:59.543342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:07:59.543759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:07:59.577720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.578397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.578833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.580386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.580992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.581594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.605563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:07:59.615375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:07:59.636176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:07:59.639464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:07:59.702012 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68e2ed0e-37c6-4690-aaf5-ea425a5cde50 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186223 Oct 04 11:07:59.703378 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1060/2152] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:07:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:07:59.720145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:59.721174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:59.735745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.736584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.737555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.738485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.739224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.740147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.743447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:07:59.806773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:07:59.807677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:07:59.808495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:07:59.809146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lazy-loading 'fault' on Instance uuid 03bf74f9-21f7-4f34-9676-662ac379bf2b {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:07:59.856219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:59.870040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfcf7574-dd14-46d4-ae57-6446f5e324a4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1321 microversion: 2.1 time: 0.402992 Oct 04 11:07:59.871405 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1093/2153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:59 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:07:59.879301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8f8bdeb-2e5d-46ff-9bfd-f3e842450353 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:07:59.880589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8f8bdeb-2e5d-46ff-9bfd-f3e842450353 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:07:59.881869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:59.891607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:59.893188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27f40f692eac4ea39019fe4921b054f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83765ee4f79c49f49b8af1a56a260450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:07:59.894985 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-edde4337-0e01-49f8-a2e1-70d0f5ed7f6e tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 200 len: 1352 microversion: 2.25 time: 0.189847 Oct 04 11:07:59.895923 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1061/2154] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:07:59 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 1352 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:08:00.025515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8f8bdeb-2e5d-46ff-9bfd-f3e842450353 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:00.034307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8f8bdeb-2e5d-46ff-9bfd-f3e842450353 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1217 microversion: 2.1 time: 0.159811 Oct 04 11:08:00.034488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:00.035282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] [instance: 7e54f514-dae6-4a1d-8819-88de1734dc73] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:00.042928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:00.048675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:00.050610 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1094/2155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:07:59 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:00.051376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:00.052842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:00.055399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:00.056100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:00.102645 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] HTTP exception thrown: Instance 7e54f514-dae6-4a1d-8819-88de1734dc73 could not be found. Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Request method failure captured: Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 HTTP/1.1 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBPvbHAS3lBwPsIl-YTvBylaDwSp9zYrj3C3a2Itkai0w_LiC7E5gQZZQ_dwU1DMehytFCbhH9_Sexyq8wngPot5c383nd-RQ_dCTcGK7V-XGSY-rxW8wp2ypalnV_n-bcuiBI8UjaOpQyfnR9v8qAyaISJUGP8lSREyOHvN9CKGhhw Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: c997f3c4047a43958d82b789a1d6edb0 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c997f3c4047a43958d82b789a1d6edb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c997f3c4047a43958d82b789a1d6edb0"}]}] Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: c997f3c4047a43958d82b789a1d6edb0 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-392056605 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-InstanceActionsNegativeTestJSON-392056605-project Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 0a723f4333c14765a850c2a6fea98737 Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-392056605-project Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 7e54f514-dae6-4a1d-8819-88de1734dc73 could not be found. Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '7e54f514-dae6-4a1d-8819-88de1734dc73'} Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e54f514-dae6-4a1d-8819-88de1734dc73 could not be found. Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e54f514-dae6-4a1d-8819-88de1734dc73 could not be found. Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:00.107450 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e54f514-dae6-4a1d-8819-88de1734dc73 could not be found. Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] Returning 404 to user: Instance 7e54f514-dae6-4a1d-8819-88de1734dc73 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f09e794b-9c3f-4d7c-befc-f3a80a12176c tempest-InstanceActionsNegativeTestJSON-392056605 tempest-InstanceActionsNegativeTestJSON-392056605-project] 10.222.0.23 "GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73" status: 404 len: 111 microversion: 2.1 time: 0.080589 Oct 04 11:08:00.110604 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1062/2156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:00 2022] GET /compute/v2.1/servers/7e54f514-dae6-4a1d-8819-88de1734dc73 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:08:00.480979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:00.481658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:00.490682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:00.491459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:00.492820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:00.499819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:00.500562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:00.501576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:00.900904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:00.902158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:00.911642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:00.912500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:00.913142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:00.914083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:00.915606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:00.916588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:01.236295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:01.254233 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-432a6df2-efa9-43b1-b2e0-abad1d22a9d5 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1321 microversion: 2.1 time: 0.359828 Oct 04 11:08:01.259603 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1063/2157] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:00 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:01.266500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:01.285010 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52e806d7-0022-448c-b15f-89543624c82e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.810514 Oct 04 11:08:01.286854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:01.287479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] [instance: 03bf74f9-21f7-4f34-9676-662ac379bf2b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:01.290587 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1095/2158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:00 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:01.295478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:01.296130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:01.299663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:01.307473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:01.308319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:01.311094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:01.314234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:01.314948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:01.316578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:01.317300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:01.319439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:01.320366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:01.323660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:01.324276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:01.345459 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] HTTP exception thrown: Instance 03bf74f9-21f7-4f34-9676-662ac379bf2b could not be found. Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Request method failure captured: Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b HTTP/1.1 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBJEkZ_mvErloqk-uT_5B880r-pDAyQzurJpiKTEoCT_usPfyd_JFKyon5XRrFzCiiprL7Cl3HDJy6cAYWq556tamQ5vAkCLpt3URvxanSjTJ6GsHiismaXIJw81ZH5fpNHfLCzMXsuoJ8vFSdftBvk_JCKrk8mOsN9WGmnrXjN4vwQ Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 83765ee4f79c49f49b8af1a56a260450 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/83765ee4f79c49f49b8af1a56a260450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/83765ee4f79c49f49b8af1a56a260450"}]}] Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 83765ee4f79c49f49b8af1a56a260450 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-LiveAutoBlockMigrationV225Test-1440003002-project Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 27f40f692eac4ea39019fe4921b054f7 Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1440003002-project Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 03bf74f9-21f7-4f34-9676-662ac379bf2b could not be found. Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '03bf74f9-21f7-4f34-9676-662ac379bf2b'} Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bf74f9-21f7-4f34-9676-662ac379bf2b could not be found. Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bf74f9-21f7-4f34-9676-662ac379bf2b could not be found. Oct 04 11:08:01.347231 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bf74f9-21f7-4f34-9676-662ac379bf2b could not be found. Oct 04 11:08:01.350880 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:01.358794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] Returning 404 to user: Instance 03bf74f9-21f7-4f34-9676-662ac379bf2b could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:01.362456 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53c5221d-84b5-4697-a3d4-126ff25e9369 tempest-LiveAutoBlockMigrationV225Test-1440003002 tempest-LiveAutoBlockMigrationV225Test-1440003002-project] 10.222.0.23 "GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b" status: 404 len: 111 microversion: 2.25 time: 0.099099 Oct 04 11:08:01.366920 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1064/2159] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:08:01 2022] GET /compute/v2.1/servers/03bf74f9-21f7-4f34-9676-662ac379bf2b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:08:01.376908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-08280602-339f-4155-ae85-8d3603f91603 req-c9dc7130-6d27-4a02-8259-af1fee59af73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4e7be2-e1ee-45e6-877e-4eea387fd50c", "name": "network-vif-plugged", "status": "completed", "tag": "95fc2767-1914-4dd1-8cbd-b93e9fe7099e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:01.401795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-08280602-339f-4155-ae85-8d3603f91603 req-c9dc7130-6d27-4a02-8259-af1fee59af73 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:01.406843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-08280602-339f-4155-ae85-8d3603f91603 req-c9dc7130-6d27-4a02-8259-af1fee59af73 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:01.407479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-08280602-339f-4155-ae85-8d3603f91603 req-c9dc7130-6d27-4a02-8259-af1fee59af73 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:01.423047 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-08280602-339f-4155-ae85-8d3603f91603 req-c9dc7130-6d27-4a02-8259-af1fee59af73 service nova] Creating event network-vif-plugged:95fc2767-1914-4dd1-8cbd-b93e9fe7099e for instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c on n-h1-791135-8 Oct 04 11:08:01.430440 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-08280602-339f-4155-ae85-8d3603f91603 req-c9dc7130-6d27-4a02-8259-af1fee59af73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062035 Oct 04 11:08:01.431332 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1065/2160] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:01.492448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:01.504984 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b565ff5-cae6-4847-bdd7-b989373cabdb tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1269 microversion: 2.1 time: 0.213113 Oct 04 11:08:01.518085 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1096/2161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:01 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:02.292545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:02.293926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:02.308139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:02.308379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:02.308991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:02.309723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:02.310776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:02.311837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:02.312298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:02.313166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:02.323943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:02.324441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:02.325031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:02.325910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:02.326513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:02.329683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:02.824821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:02.857509 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77b916b9-2d8a-4368-b367-a5e6b91072b1 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1321 microversion: 2.1 time: 0.572181 Oct 04 11:08:02.883882 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1066/2162] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:02 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:02.894093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:02.895096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:02.906784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:02.908039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:02.908864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:02.910414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:02.911344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:02.913681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:03.110383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:03.118561 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5b57849-ee0a-4e39-a4e9-a1316a9dfdc3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1275 microversion: 2.1 time: 0.232894 Oct 04 11:08:03.119346 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1067/2163] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:02 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:03.151316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:03.161665 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4db9f305-461e-4506-abe3-97710a2c08a7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.857050 Oct 04 11:08:03.163372 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1097/2164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:02 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:03.890686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:03.892458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:03.905330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:03.906613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:03.907243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:03.908231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:03.908876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:03.910403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:04.148436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:04.149261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:04.164009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:04.167578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:04.168271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:04.169945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:04.171929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:04.172612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:04.483675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:04.495934 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7024a71e-15ac-4f5d-87c5-04da1cbbb701 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1471 microversion: 2.1 time: 0.610894 Oct 04 11:08:04.497650 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1068/2165] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:03 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1471 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:04.504115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:04.505208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:04.516694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:04.517580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:04.518232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:04.519177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:04.519903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:04.520543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:05.143028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:05.152580 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4bb9c9cb-720f-4f66-ba1e-a254218fb5c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1317 microversion: 2.1 time: 1.009546 Oct 04 11:08:05.153176 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1098/2166] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:04 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1317 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:05.169218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:05.170491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:05.182661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:05.186445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:05.187147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:05.188293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:05.189586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:05.190121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:05.247750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lazy-loading 'flavor' on Instance uuid cb4e7be2-e1ee-45e6-877e-4eea387fd50c {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:08:05.390594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-530d8086-887d-4333-9cae-712ff3fddffc tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c/action" status: 202 len: 0 microversion: 2.1 time: 0.223930 Oct 04 11:08:05.396713 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1099/2167] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:08:05 2022] POST /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:08:05.406568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:05.408488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:05.418949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:05.421933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:05.422662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:05.423881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:05.434302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:05.435072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:05.462070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:05.472743 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13be258a-2f73-4ce3-ae02-5187e0a1d763 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.973154 Oct 04 11:08:05.477615 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1069/2168] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:04 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:06.030729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d3ee64ac-d237-40e2-8cef-923a2b10fbaa req-211dc68b-3c3f-4ad6-a7f6-e294d234d1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5408a263-9848-4fa4-9f50-30117a1974a8", "tag": "88917fbb-e51b-42d1-9dae-500c7df052d1"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:06.052484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d3ee64ac-d237-40e2-8cef-923a2b10fbaa req-211dc68b-3c3f-4ad6-a7f6-e294d234d1b5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:06.053015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d3ee64ac-d237-40e2-8cef-923a2b10fbaa req-211dc68b-3c3f-4ad6-a7f6-e294d234d1b5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:06.053477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d3ee64ac-d237-40e2-8cef-923a2b10fbaa req-211dc68b-3c3f-4ad6-a7f6-e294d234d1b5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:06.084080 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d3ee64ac-d237-40e2-8cef-923a2b10fbaa req-211dc68b-3c3f-4ad6-a7f6-e294d234d1b5 service nova] Creating event network-changed:88917fbb-e51b-42d1-9dae-500c7df052d1 for instance 5408a263-9848-4fa4-9f50-30117a1974a8 on n-h1-791135-8 Oct 04 11:08:06.092874 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d3ee64ac-d237-40e2-8cef-923a2b10fbaa req-211dc68b-3c3f-4ad6-a7f6-e294d234d1b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065152 Oct 04 11:08:06.094860 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1070/2169] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:08:06.176767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:06.177518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:06.183840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:06.184313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:06.184902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:06.185995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:06.187252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:06.187922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:07.430878 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63ec6a00-5468-460e-8b2f-0f63605f8ac6 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1630 microversion: 2.1 time: 2.031884 Oct 04 11:08:07.442965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1100/2170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:05 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1630 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:07.453217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:07.453862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:07.459944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:07.460700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:07.461279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:07.462066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:07.462716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:07.463282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:07.534165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:07.543154 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f18e5c4-abd5-4515-90e8-0873168bf607 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1317 microversion: 2.1 time: 1.370603 Oct 04 11:08:07.543925 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1071/2171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:06 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1317 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:07.693763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-294b681f-b124-4e80-b114-f43a687defa3 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Action: 'create', calling method: .version_select at 0x7f71d405a8b0>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:08.612972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:08.636025 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32aa667c-0c04-4b5d-84d3-1d47a6f55d29 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 1.191151 Oct 04 11:08:08.637265 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1101/2172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:07 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:08.644168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:08.645075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:08.655236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:08.659736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:08.660405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:08.662987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:08.663552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:08.665252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:08.709158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:09.334876 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7846017-5791-4829-a58b-c200bfe43ae1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1613 microversion: 2.1 time: 0.696084 Oct 04 11:08:09.335453 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1102/2173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:08 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1613 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:09.355976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:09.356602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:09.372923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:09.373975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:09.374417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:09.375318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:09.375786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:09.376212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:09.590285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:09.632051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:10.034435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:10.295941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:10.307224 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-506347ef-066b-4078-afd1-7d84cb2ac337 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1317 microversion: 2.1 time: 0.967364 Oct 04 11:08:10.308915 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1103/2174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:09 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:10.320359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:10.321038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:10.334091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:10.334668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:10.335929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:10.338227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:10.338798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:10.341054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:10.414013 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] HTTP exception thrown: Cannot 'migrate' instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c while it is in vm_state suspended Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Request method failure captured: Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c/action HTTP/1.1 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBPhXOxh7ub2ldPxW1Dx9UFbv6slFhpm4Tjnh0Yyw3IjnACVv7zBNS4bl2CkpBBn3sYR2hL8Ty0__qtYSFFqk5fkA-Po_Yu-W1soIasUAbZ0SfktrJu330PhEqfxWdfZ1f5BxQxiiZiBiGDL5UXr2kxhVjfikNVmdOckRPj_FG5EI8M Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61c93a62430c4efda2eb03e653bf2bb7"}]}] Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0b9f4c9b6cfc481e91e935622a164e9f Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: {"migrate": {}} Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'migrate' instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c while it is in vm_state suspended Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'cb4e7be2-e1ee-45e6-877e-4eea387fd50c', 'body': {'migrate': {}}} Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:08:10.417158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c while it is in vm_state suspended Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c while it is in vm_state suspended Oct 04 11:08:10.422409 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.424917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Returning 409 to user: Cannot 'migrate' instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c while it is in vm_state suspended {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:10.427821 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-23793df9-58f9-4bfc-adb4-d888e3da3529 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c/action" status: 409 len: 148 microversion: 2.1 time: 0.111079 Oct 04 11:08:10.428546 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1104/2175] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:08:10 2022] POST /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c/action => generated 148 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:08:10.446227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:10.449956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:10.468094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:10.478739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:10.483802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:10.484893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:10.485627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:10.486284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:10.898662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:10.916390 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d3c45ae-3902-4f7f-98ea-51d5aa64eb86 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.475449 Oct 04 11:08:10.916934 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1105/2176] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:10 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:10.929146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65d52445-883a-49c3-a157-adb4b23241ac tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65d52445-883a-49c3-a157-adb4b23241ac tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Request method failure captured: Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4/action HTTP/1.1 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 39 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBPhXOxh7ub2ldPxW1Dx9UFbv6slFhpm4Tjnh0Yyw3IjnACVv7zBNS4bl2CkpBBn3sYR2hL8Ty0__qtYSFFqk5fkA-Po_Yu-W1soIasUAbZ0SfktrJu330PhEqfxWdfZ1f5BxQxiiZiBiGDL5UXr2kxhVjfikNVmdOckRPj_FG5EI8M Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61c93a62430c4efda2eb03e653bf2bb7"}]}] Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0b9f4c9b6cfc481e91e935622a164e9f Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: {"os-resetState": {"state": "invalid"}} Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2ba29ceb-94b3-4a8d-815e-9f77895374c4', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:08:10.936744 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.939993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65d52445-883a-49c3-a157-adb4b23241ac tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:10.941065 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-65d52445-883a-49c3-a157-adb4b23241ac tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4/action" status: 400 len: 144 microversion: 2.1 time: 0.021719 Oct 04 11:08:10.942059 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1106/2177] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:08:10 2022] POST /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:08:10.951203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-769ea324-b90c-46b1-8d31-fda15649b4f1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-769ea324-b90c-46b1-8d31-fda15649b4f1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Request method failure captured: Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4/action HTTP/1.1 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 31 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBPhXOxh7ub2ldPxW1Dx9UFbv6slFhpm4Tjnh0Yyw3IjnACVv7zBNS4bl2CkpBBn3sYR2hL8Ty0__qtYSFFqk5fkA-Po_Yu-W1soIasUAbZ0SfktrJu330PhEqfxWdfZ1f5BxQxiiZiBiGDL5UXr2kxhVjfikNVmdOckRPj_FG5EI8M Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61c93a62430c4efda2eb03e653bf2bb7"}]}] Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0b9f4c9b6cfc481e91e935622a164e9f Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: {"os-resetState": {"state": 1}} Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2ba29ceb-94b3-4a8d-815e-9f77895374c4', 'body': {'os-resetState': {'state': 1}}} Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 1 Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 11:08:10.955600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 11:08:10.959428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.961267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-769ea324-b90c-46b1-8d31-fda15649b4f1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:10.962337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-769ea324-b90c-46b1-8d31-fda15649b4f1 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4/action" status: 400 len: 120 microversion: 2.1 time: 0.015173 Oct 04 11:08:10.963463 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1107/2178] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:08:10 2022] POST /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:08:10.987940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ede1089-444a-4df8-b0cc-289ba9868037 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:10.990577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ede1089-444a-4df8-b0cc-289ba9868037 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Failed to fetch instance by id 999 {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 11:08:10.991358 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1ede1089-444a-4df8-b0cc-289ba9868037 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ede1089-444a-4df8-b0cc-289ba9868037 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Request method failure captured: Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 37 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBPhXOxh7ub2ldPxW1Dx9UFbv6slFhpm4Tjnh0Yyw3IjnACVv7zBNS4bl2CkpBBn3sYR2hL8Ty0__qtYSFFqk5fkA-Po_Yu-W1soIasUAbZ0SfktrJu330PhEqfxWdfZ1f5BxQxiiZiBiGDL5UXr2kxhVjfikNVmdOckRPj_FG5EI8M Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61c93a62430c4efda2eb03e653bf2bb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61c93a62430c4efda2eb03e653bf2bb7"}]}] Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 61c93a62430c4efda2eb03e653bf2bb7 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1507635933 Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0b9f4c9b6cfc481e91e935622a164e9f Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1507635933-project-admin Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: {"os-resetState": {"state": "error"}} Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 999 could not be found. Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:10.995891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:11.000493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:11.000493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 11:08:11.000493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:11.002778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ede1089-444a-4df8-b0cc-289ba9868037 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:11.004203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ede1089-444a-4df8-b0cc-289ba9868037 tempest-ServersAdminNegativeTestJSON-1507635933 tempest-ServersAdminNegativeTestJSON-1507635933-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.035098 Oct 04 11:08:11.005576 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1108/2179] 10.222.0.23 () {60 vars in 1179 bytes} [Tue Oct 4 11:08:10 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:08:11.021560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:11.022507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:11.030751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:11.031430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:11.038268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:11.039139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:11.039762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:11.040260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:11.083854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:08:11.208788 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-361047ee-4c50-49ab-b477-968c5e2c24d9 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 204 len: 0 microversion: 2.1 time: 0.194482 Oct 04 11:08:11.210600 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1109/2180] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:08:11 2022] DELETE /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:08:11.220123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:11.221643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:11.247942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:11.251664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:11.252381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:11.254701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:11.255795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:11.256869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:11.961227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:11.973744 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57faf5a8-5f50-41a1-94f4-df2358640da4 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1468 microversion: 2.1 time: 0.758808 Oct 04 11:08:11.974354 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1110/2181] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:11 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1468 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:12.002147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:12.003576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:12.014693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:12.015186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:12.015782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:12.022469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:12.023610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:12.024269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:12.565012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:12.575831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-66aba6d8-0869-4f0a-8f23-c090d7dfa27c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1317 microversion: 2.1 time: 0.582088 Oct 04 11:08:12.576508 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1111/2182] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:11 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:12.581105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:12.581735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:12.602810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:12.611150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:12.611603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:12.612356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:12.612807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:12.624645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:13.119633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:13.130780 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-267e1833-87ca-4f88-8daf-02ead0f91a5c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.553187 Oct 04 11:08:13.143533 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1112/2183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:12 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:13.152966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:13.162942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:13.179996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:13.181416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:13.182019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:13.182732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:13.183168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:13.184479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:13.601239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:13.610145 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ae380f3-6a9b-46aa-9275-72ae901d7c71 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1468 microversion: 2.1 time: 0.460802 Oct 04 11:08:13.625780 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1113/2184] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:13 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1468 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:13.631793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:13.632696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:13.641502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:13.642270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:13.642947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:13.643812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:13.644436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:13.645108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:14.160618 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-294b681f-b124-4e80-b114-f43a687defa3 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.613576 Oct 04 11:08:14.190187 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1072/2185] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:08:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:14.206479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:14.207112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:14.257405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:14.276761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:14.278496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:14.279716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:14.281296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:14.281966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:14.439455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:14.449831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf89f00c-0e97-4a15-bb9f-93711f6f34e1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1317 microversion: 2.1 time: 0.822522 Oct 04 11:08:14.455627 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1114/2186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:13 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1317 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:14.481818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-578c9525-234b-4365-bbc5-544aaf4228eb tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Calling method '.version_select at 0x7f71d41da040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:14.625096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:14.638378 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5737884e-2777-4287-b1a4-c0ff841b6066 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.445870 Oct 04 11:08:14.639030 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1073/2187] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:14 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:14.653318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:14.660618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:14.675832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:14.676512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:14.677100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:14.678016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:14.679759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:14.680359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:14.926826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:14.952093 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a28d8d8b-d44b-4dd0-9a1a-5b9402e8ee4a tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 200 len: 1426 microversion: 2.1 time: 0.308986 Oct 04 11:08:14.959770 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1074/2188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:14 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 1426 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:14.982183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-deca34fc-3191-407f-adaa-56233d67561d req-d1870f3f-7e88-439c-881b-76db526f60bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4e7be2-e1ee-45e6-877e-4eea387fd50c", "name": "network-vif-deleted", "tag": "95fc2767-1914-4dd1-8cbd-b93e9fe7099e"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:15.007477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-deca34fc-3191-407f-adaa-56233d67561d req-d1870f3f-7e88-439c-881b-76db526f60bd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:15.008357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-deca34fc-3191-407f-adaa-56233d67561d req-d1870f3f-7e88-439c-881b-76db526f60bd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:15.009026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-deca34fc-3191-407f-adaa-56233d67561d req-d1870f3f-7e88-439c-881b-76db526f60bd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:15.046030 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-578c9525-234b-4365-bbc5-544aaf4228eb tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/3032df88-374c-4bfe-ac98-77b70080a4f1" status: 200 len: 142 microversion: 2.1 time: 0.585115 Oct 04 11:08:15.053697 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-deca34fc-3191-407f-adaa-56233d67561d req-d1870f3f-7e88-439c-881b-76db526f60bd service nova] Creating event network-vif-deleted:95fc2767-1914-4dd1-8cbd-b93e9fe7099e for instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c on n-h1-791135-8 Oct 04 11:08:15.053977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1115/2189] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:08:14 2022] GET /compute/v2.1/os-floating-ips/3032df88-374c-4bfe-ac98-77b70080a4f1 => generated 142 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:15.055899 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-deca34fc-3191-407f-adaa-56233d67561d req-d1870f3f-7e88-439c-881b-76db526f60bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093165 Oct 04 11:08:15.056655 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1075/2190] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:15.058996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9fa8bc53-6aac-4f1d-a489-5aaec8ca2274 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Calling method '.version_select at 0x7f71d4729b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:15.341603 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9fa8bc53-6aac-4f1d-a489-5aaec8ca2274 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.286577 Oct 04 11:08:15.343872 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1116/2191] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 11:08:15 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:08:15.358333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a064bc34-1205-4f7f-bf77-b14af2cd0a7b tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Calling method '.version_select at 0x7f71d404df70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:15.379339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-748fbd27-9923-4d33-a602-9040fd0bd4c6 req-b0e2d999-a065-4e6e-9d21-85db54933968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5408a263-9848-4fa4-9f50-30117a1974a8", "name": "network-vif-plugged", "status": "completed", "tag": "88917fbb-e51b-42d1-9dae-500c7df052d1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:15.399100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-748fbd27-9923-4d33-a602-9040fd0bd4c6 req-b0e2d999-a065-4e6e-9d21-85db54933968 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:15.399817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-748fbd27-9923-4d33-a602-9040fd0bd4c6 req-b0e2d999-a065-4e6e-9d21-85db54933968 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:15.400403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-748fbd27-9923-4d33-a602-9040fd0bd4c6 req-b0e2d999-a065-4e6e-9d21-85db54933968 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:15.414416 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-748fbd27-9923-4d33-a602-9040fd0bd4c6 req-b0e2d999-a065-4e6e-9d21-85db54933968 service nova] Creating event network-vif-plugged:88917fbb-e51b-42d1-9dae-500c7df052d1 for instance 5408a263-9848-4fa4-9f50-30117a1974a8 on n-h1-791135-8 Oct 04 11:08:15.422826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-748fbd27-9923-4d33-a602-9040fd0bd4c6 req-b0e2d999-a065-4e6e-9d21-85db54933968 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046778 Oct 04 11:08:15.424351 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1117/2192] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:15.486607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:15.488082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:15.495562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:15.496325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:15.498186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:15.500615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:15.501412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:15.525031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.098851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:16.110267 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f3bd7a9-632b-4dab-aee6-6878c9d53b88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1317 microversion: 2.1 time: 0.631118 Oct 04 11:08:16.114632 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1118/2193] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:15 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:16.119747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:16.124745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:16.132590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:16.133592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:16.134208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.135096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:16.135823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:16.136312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.410723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:16.424497 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e07cd94c-57f4-4d79-9285-f7c62c5ba998 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.308293 Oct 04 11:08:16.428267 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1119/2194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:16 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:16.437292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:16.437944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: cb4e7be2-e1ee-45e6-877e-4eea387fd50c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:16.444897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:16.445628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:16.446076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.446793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:16.447273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:16.447685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.469018 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] HTTP exception thrown: Instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c could not be found. Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Request method failure captured: Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c HTTP/1.1 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBPflRsE6qORvCmvmP6K2BJeym15Um9ngB9NhQtgoyl6ovowh_1fJMu5Ajc0Lj83tQXcWuo7U0vO__Neb1yxpuJqNlSPm0QY5l0wymWUrz7JrWuRhghqWG917FVYkcOUv5cKme-06VOfs7g0JkWNRvXwIkSr8_ukkVbuiTUX9VlcdGg Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 27999b103d2843229ec7e57d2cfce666 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1051953104 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_27999b103d2843229ec7e57d2cfce666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27999b103d2843229ec7e57d2cfce666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27999b103d2843229ec7e57d2cfce666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/27999b103d2843229ec7e57d2cfce666"}]}] Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1051953104 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 27999b103d2843229ec7e57d2cfce666 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1051953104 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersAdminNegativeTestJSON-1051953104-project Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0794a3719ab34ae1b8ac6b955a0c7cb4 Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1051953104-project Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c could not be found. Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'cb4e7be2-e1ee-45e6-877e-4eea387fd50c'} Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c could not be found. Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c could not be found. Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:16.470905 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c could not be found. Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Returning 404 to user: Instance cb4e7be2-e1ee-45e6-877e-4eea387fd50c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71e606e4-ea22-414c-b210-194bf1b55205 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c" status: 404 len: 111 microversion: 2.1 time: 0.042585 Oct 04 11:08:16.474806 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1120/2195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:16 2022] GET /compute/v2.1/servers/cb4e7be2-e1ee-45e6-877e-4eea387fd50c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:08:16.484648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:16.485155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:16.496537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:16.497039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:16.497517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.498314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:16.498774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:16.499204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.534800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:08:16.626032 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a602cbf1-2096-438f-99ab-787aef4ad89f tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 204 len: 0 microversion: 2.1 time: 0.148622 Oct 04 11:08:16.630479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1121/2196] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:08:16 2022] DELETE /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:08:16.636188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:16.637182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:16.643888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:16.644542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:16.645130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.646025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:16.646614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:16.647206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:16.673973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:16.778695 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a064bc34-1205-4f7f-bf77-b14af2cd0a7b tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/3032df88-374c-4bfe-ac98-77b70080a4f1" status: 202 len: 0 microversion: 2.1 time: 1.426193 Oct 04 11:08:16.783781 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1076/2197] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:08:15 2022] DELETE /compute/v2.1/os-floating-ips/3032df88-374c-4bfe-ac98-77b70080a4f1 => generated 0 bytes in 1428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:08:16.788996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74c928be-2a4a-4b2d-b453-d9bdd68d3eae tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Action: 'create', calling method: .version_select at 0x7f71d4599940>, body: {"pool": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:16.903557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:16.912273 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49c68905-ec74-45dc-b680-d2fd43d5d490 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1477 microversion: 2.1 time: 0.280310 Oct 04 11:08:16.925790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1122/2198] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:16 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1477 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:17.140088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:17.140868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:17.144717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:17.151329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:17.152064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:17.152676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:17.153672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:17.154472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:17.155241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:17.558436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:17.570538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d313d2cc-f73f-4934-8938-87ef8c9c985c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1317 microversion: 2.1 time: 0.432777 Oct 04 11:08:17.573658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1123/2199] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:17 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:17.580929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:17.581559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:17.602003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:17.602684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:17.603266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:17.604782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:17.605391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:17.605949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:18.032889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:18.049689 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f103e04c-21aa-4f30-abfb-0148dacdab28 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1497 microversion: 2.1 time: 0.474677 Oct 04 11:08:18.050645 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1124/2200] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:17 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1497 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:18.055273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:18.055893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:18.073515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:18.074403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:18.075013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:18.076708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:18.077999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:18.078720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:18.520989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:18.533345 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1e48d361-6d16-4829-b7fb-84ba9bed5ce7 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1477 microversion: 2.1 time: 0.481563 Oct 04 11:08:18.549379 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1125/2201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:18 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1477 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:18.596496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:18.597337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:18.610204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:18.613340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:18.613865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:18.614641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:18.617803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:18.619631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:19.048944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:19.063194 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c95b354-d19d-49ab-b665-6fe88bedd9f6 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1467 microversion: 2.1 time: 0.470166 Oct 04 11:08:19.077592 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1126/2202] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:18 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1467 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:19.083557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:19.086185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:19.117386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:19.118150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:19.119971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:19.123490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:19.124756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:19.125875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:19.921287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:19.929740 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72b8fdad-6e59-412b-ab36-13193ac34cbb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 200 len: 1474 microversion: 2.1 time: 0.859383 Oct 04 11:08:19.930311 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1127/2203] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:19 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 1474 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:19.946464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:19.947316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:19.954375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:19.954871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:19.961129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:19.962092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:19.962600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:19.963034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:19.992893 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74c928be-2a4a-4b2d-b453-d9bdd68d3eae tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.207582 Oct 04 11:08:19.996194 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1077/2204] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:08:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:20.002660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:20.004601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:20.023180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:20.023710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:20.024160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:20.027609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:20.028368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:20.028970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:20.613958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0794a3719ab34ae1b8ac6b955a0c7cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27999b103d2843229ec7e57d2cfce666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:20.629282 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1796795-e99a-4e86-b1b1-2a5f490b6fb5 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1618 microversion: 2.1 time: 0.692232 Oct 04 11:08:20.639794 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b0cf3cbc-1fd3-472d-8902-3d92a4409291 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 200 len: 1477 microversion: 2.1 time: 0.632056 Oct 04 11:08:20.651652 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1128/2205] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:19 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1618 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:20.658377 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1078/2206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:19 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 1477 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:20.673567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0dacb3d0-2e1d-40c6-9120-c0c85c1e3706 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Calling method '.version_select at 0x7f71d42e6af0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:20.674794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-508751557"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:20.685010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:20.704437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:20.704948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:20.706554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:20.709459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:20.710022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:20.710463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:21.074759 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b9581fd-ee3d-48de-b99f-6e5c5d4c0731 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44/action" status: 202 len: 0 microversion: 2.1 time: 0.421756 Oct 04 11:08:21.076989 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1129/2207] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:08:20 2022] POST /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:08:21.087934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3d59e39e-a11f-41ec-aa17-22217c5e1e78 req-765b9aab-e9a6-48d9-bc33-8e1332f699b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba29ceb-94b3-4a8d-815e-9f77895374c4", "name": "network-vif-deleted", "tag": "a7d19265-2675-4eae-b867-b41411469d2d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:21.103540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d59e39e-a11f-41ec-aa17-22217c5e1e78 req-765b9aab-e9a6-48d9-bc33-8e1332f699b4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:21.105172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d59e39e-a11f-41ec-aa17-22217c5e1e78 req-765b9aab-e9a6-48d9-bc33-8e1332f699b4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:21.106033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d59e39e-a11f-41ec-aa17-22217c5e1e78 req-765b9aab-e9a6-48d9-bc33-8e1332f699b4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:21.138529 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3d59e39e-a11f-41ec-aa17-22217c5e1e78 req-765b9aab-e9a6-48d9-bc33-8e1332f699b4 service nova] Creating event network-vif-deleted:a7d19265-2675-4eae-b867-b41411469d2d for instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 on n-h1-791135-8 Oct 04 11:08:21.151088 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3d59e39e-a11f-41ec-aa17-22217c5e1e78 req-765b9aab-e9a6-48d9-bc33-8e1332f699b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071029 Oct 04 11:08:21.155609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1130/2208] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:21.167578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-645271866", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1976caef-e757-4301-a92b-66d06d09fc3b"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:21.266135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:08:22.383130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:08:22.384370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:08:22.385110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:08:22.386045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:08:22.387414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:08:22.423509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:22.424181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:22.424836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:22.425899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:22.426891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:22.428239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:22.510101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:08:22.517764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Getting quotas for user 5797d5cb0e13468585a42a3e909c1165 and project bf100271e41c4475835267bcaf15c0b3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:08:22.539374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:08:22.562376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:08:22.659850 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1729d27-662c-4171-afd8-3b717d35398b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.502154 Oct 04 11:08:22.663660 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1131/2209] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:08:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:08:22.673834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82c26239-fc02-4ba2-b791-fd764ea6ee7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4d2c4c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:22.731271 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82c26239-fc02-4ba2-b791-fd764ea6ee7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.066339 Oct 04 11:08:22.742688 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1132/2210] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:22 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:22.754228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:22.757678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] [instance: 2ba29ceb-94b3-4a8d-815e-9f77895374c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:22.774785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:22.775566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:22.777027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:22.778031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:22.780498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:22.782775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:22.825409 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] HTTP exception thrown: Instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 could not be found. Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Request method failure captured: Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 HTTP/1.1 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBPflRsE6qORvCmvmP6K2BJeym15Um9ngB9NhQtgoyl6ovowh_1fJMu5Ajc0Lj83tQXcWuo7U0vO__Neb1yxpuJqNlSPm0QY5l0wymWUrz7JrWuRhghqWG917FVYkcOUv5cKme-06VOfs7g0JkWNRvXwIkSr8_ukkVbuiTUX9VlcdGg Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 27999b103d2843229ec7e57d2cfce666 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1051953104 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_27999b103d2843229ec7e57d2cfce666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27999b103d2843229ec7e57d2cfce666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27999b103d2843229ec7e57d2cfce666"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/27999b103d2843229ec7e57d2cfce666"}]}] Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1051953104 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 27999b103d2843229ec7e57d2cfce666 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1051953104 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersAdminNegativeTestJSON-1051953104-project Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0794a3719ab34ae1b8ac6b955a0c7cb4 Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1051953104-project Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 could not be found. Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2ba29ceb-94b3-4a8d-815e-9f77895374c4'} Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 could not be found. Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 could not be found. Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:22.831263 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 could not be found. Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:08:22.835397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] Returning 404 to user: Instance 2ba29ceb-94b3-4a8d-815e-9f77895374c4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:22.836272 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34cb4ed0-f7be-4b4b-aba4-370df7ecd362 tempest-ServersAdminNegativeTestJSON-1051953104 tempest-ServersAdminNegativeTestJSON-1051953104-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4" status: 404 len: 111 microversion: 2.1 time: 0.088072 Oct 04 11:08:22.837185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1133/2211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:22 2022] GET /compute/v2.1/servers/2ba29ceb-94b3-4a8d-815e-9f77895374c4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:08:22.867831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-274323c4-b012-408a-83f0-c848943356f1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:22.869801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-274323c4-b012-408a-83f0-c848943356f1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:23.043692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-274323c4-b012-408a-83f0-c848943356f1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:23.051184 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-274323c4-b012-408a-83f0-c848943356f1 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1216 microversion: 2.1 time: 0.211088 Oct 04 11:08:23.052041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1134/2212] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:22 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1216 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:23.760882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-89581827-53ce-41d8-b5eb-9dceceba5f9c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4269a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:23.781371 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0dacb3d0-2e1d-40c6-9120-c0c85c1e3706 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/fb8ea71e-b156-45a7-aa85-f9aee09448a9" status: 202 len: 0 microversion: 2.1 time: 3.121770 Oct 04 11:08:23.782501 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1079/2213] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:08:20 2022] DELETE /compute/v2.1/os-floating-ips/fb8ea71e-b156-45a7-aa85-f9aee09448a9 => generated 0 bytes in 3124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:08:23.791713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df03fe94-5f54-422e-8959-59fc0e860bf4 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Calling method '.version_select at 0x7f71d405aee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:23.863187 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-89581827-53ce-41d8-b5eb-9dceceba5f9c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.113921 Oct 04 11:08:23.864925 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1135/2214] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:23 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:23.898339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-149981845", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "fa2dad4f-23cd-4147-a824-9e626de4eff7"}, {"uuid": "38284cab-012e-4cd7-81bb-9267498127bd"}, {"uuid": "fa2dad4f-23cd-4147-a824-9e626de4eff7"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:23.977846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] validate_networks() for [('fa2dad4f-23cd-4147-a824-9e626de4eff7', None, None, None, None, None), ('38284cab-012e-4cd7-81bb-9267498127bd', None, None, None, None, None), ('fa2dad4f-23cd-4147-a824-9e626de4eff7', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:08:24.264493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-df03fe94-5f54-422e-8959-59fc0e860bf4 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fb8ea71e-b156-45a7-aa85-f9aee09448a9 could not be found", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:08:24.269666 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-df03fe94-5f54-422e-8959-59fc0e860bf4 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] HTTP exception thrown: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df03fe94-5f54-422e-8959-59fc0e860bf4 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Request method failure captured: Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-floating-ips/fb8ea71e-b156-45a7-aa85-f9aee09448a9 HTTP/1.1 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBQWS9rDk3AiVyFDMFlF_CpFjGJ3Ny7ahFvd456AFnMDlLTKSTUo___oyM5Yo826pjR2FfIibnBeXDpRwfUZkkk7K4iUnN43-JFKClZ0UHX1Zimb8D4M_edQKLhKz9z5G8mMHSLkxAzQ8xsQVMQ78vjOxWlQ5MDbDSkGUHTZDTQc0E4 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: f9513e1802724cac9dc0d2292856550a Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsTestJSON-65707808 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9513e1802724cac9dc0d2292856550a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9513e1802724cac9dc0d2292856550a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9513e1802724cac9dc0d2292856550a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9513e1802724cac9dc0d2292856550a"}]}] Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsTestJSON-65707808 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: f9513e1802724cac9dc0d2292856550a Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsTestJSON-65707808 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsTestJSON-65707808-project Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: bf8ece53544641ab968dd3bef51da1b5 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsTestJSON-65707808-project Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: exception: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'fb8ea71e-b156-45a7-aa85-f9aee09448a9'} Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fb8ea71e-b156-45a7-aa85-f9aee09448a9 could not be found Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e0734b3-1d9c-40f4-8c3b-257e3b8e07d9'] Oct 04 11:08:24.271466 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9. Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df03fe94-5f54-422e-8959-59fc0e860bf4 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Returning 404 to user: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df03fe94-5f54-422e-8959-59fc0e860bf4 tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/fb8ea71e-b156-45a7-aa85-f9aee09448a9" status: 404 len: 111 microversion: 2.1 time: 0.486291 Oct 04 11:08:24.279793 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1080/2215] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:08:23 2022] GET /compute/v2.1/os-floating-ips/fb8ea71e-b156-45a7-aa85-f9aee09448a9 => generated 111 bytes in 487 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:08:24.288300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:24.288300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:24.288300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:24.303066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:24.303590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:24.303997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:24.304845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:24.305168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:24.305669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:24.365056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:24.552629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:24.568671 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93a059cd-4d49-40da-b54d-4dcc78fe0f5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1268 microversion: 2.1 time: 0.293557 Oct 04 11:08:24.584023 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1081/2216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:24 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1268 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:24.584023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c8afe01-ded5-4676-9bbd-f090301a197e tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Calling method '.version_select at 0x7f71cfef95e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:24.865311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-3c8afe01-ded5-4676-9bbd-f090301a197e tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fb8ea71e-b156-45a7-aa85-f9aee09448a9 could not be found", "detail": ""}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:08:24.866034 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-3c8afe01-ded5-4676-9bbd-f090301a197e tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] HTTP exception thrown: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c8afe01-ded5-4676-9bbd-f090301a197e tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Request method failure captured: Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/os-floating-ips/fb8ea71e-b156-45a7-aa85-f9aee09448a9 HTTP/1.1 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBQWS9rDk3AiVyFDMFlF_CpFjGJ3Ny7ahFvd456AFnMDlLTKSTUo___oyM5Yo826pjR2FfIibnBeXDpRwfUZkkk7K4iUnN43-JFKClZ0UHX1Zimb8D4M_edQKLhKz9z5G8mMHSLkxAzQ8xsQVMQ78vjOxWlQ5MDbDSkGUHTZDTQc0E4 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: f9513e1802724cac9dc0d2292856550a Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FloatingIPsTestJSON-65707808 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f9513e1802724cac9dc0d2292856550a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9513e1802724cac9dc0d2292856550a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f9513e1802724cac9dc0d2292856550a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f9513e1802724cac9dc0d2292856550a"}]}] Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FloatingIPsTestJSON-65707808 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: f9513e1802724cac9dc0d2292856550a Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FloatingIPsTestJSON-65707808 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FloatingIPsTestJSON-65707808-project Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: bf8ece53544641ab968dd3bef51da1b5 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FloatingIPsTestJSON-65707808-project Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: exception: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'fb8ea71e-b156-45a7-aa85-f9aee09448a9'} Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fb8ea71e-b156-45a7-aa85-f9aee09448a9 could not be found Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5fb708ff-7289-410d-b444-a3533ad5657e'] Oct 04 11:08:24.867868 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9. Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c8afe01-ded5-4676-9bbd-f090301a197e tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] Returning 404 to user: Floating IP not found for ID fb8ea71e-b156-45a7-aa85-f9aee09448a9 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3c8afe01-ded5-4676-9bbd-f090301a197e tempest-FloatingIPsTestJSON-65707808 tempest-FloatingIPsTestJSON-65707808-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/fb8ea71e-b156-45a7-aa85-f9aee09448a9" status: 404 len: 111 microversion: 2.1 time: 0.298378 Oct 04 11:08:24.871132 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1082/2217] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:08:24 2022] DELETE /compute/v2.1/os-floating-ips/fb8ea71e-b156-45a7-aa85-f9aee09448a9 => generated 111 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:08:24.884084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e2f91ab-70b3-4661-be17-bbde24122d4c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4a5e430>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:25.005940 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e2f91ab-70b3-4661-be17-bbde24122d4c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.124076 Oct 04 11:08:25.007443 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1083/2218] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:24 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:25.619518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:25.620376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:25.636997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:25.641393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:25.642313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:25.643203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:25.644704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:25.647274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:26.297926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:26.313095 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f5381dc-9f97-43a4-a5d5-067b3fa86371 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1274 microversion: 2.1 time: 0.718377 Oct 04 11:08:26.331178 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1084/2219] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:25 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1274 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:26.348735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e59c241-4b12-4050-b99b-b1dc1d09afba tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cfff6af0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:26.444995 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e59c241-4b12-4050-b99b-b1dc1d09afba tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.103858 Oct 04 11:08:26.458201 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1085/2220] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:26 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:27.344892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:27.346858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:27.363748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:27.367658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:27.369931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:27.370944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:27.372666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:27.373867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:28.049302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:28.063854 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8fcf594c-54ed-4700-b31a-3ec8f9ed3310 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1316 microversion: 2.1 time: 0.723297 Oct 04 11:08:28.066217 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1086/2221] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:27 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:28.087259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7118f96-11f6-4380-849f-1b61f2e1fc6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cfff63a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:28.191997 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7118f96-11f6-4380-849f-1b61f2e1fc6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.118430 Oct 04 11:08:28.195046 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1087/2222] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:28 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:28.869408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:08:28.871577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:08:28.875353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:08:28.880043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:08:28.881231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:08:28.908469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:28.910182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:28.912194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:28.914232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:28.915105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:28.915794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:28.948224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Getting quotas for project b5c1dad20fdd43cdbab89cd4f79fbed6. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:08:28.979026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Getting quotas for user 14277c6865464b2ea0e881d88b516f8f and project b5c1dad20fdd43cdbab89cd4f79fbed6. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:08:29.000527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:08:29.025049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:08:29.152412 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-58fbc3ca-5c4c-4247-a033-fb3cc2f76abf tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.257951 Oct 04 11:08:29.167357 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1136/2223] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:08:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:08:29.179419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:29.190290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:29.210945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:29.211846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:29.212764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:29.214334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:29.215322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:29.215956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:29.341127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8208d652-a5ea-4f90-826c-83498777b1ed tempest-FlavorsV2NegativeTest-1435018284 tempest-FlavorsV2NegativeTest-1435018284-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:29.357594 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8208d652-a5ea-4f90-826c-83498777b1ed tempest-FlavorsV2NegativeTest-1435018284 tempest-FlavorsV2NegativeTest-1435018284-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.324134 Oct 04 11:08:29.359388 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1088/2224] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:08:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:29.364079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-746296fc-f7ca-454e-b6e2-a45e9cefaa90 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:29.364702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-746296fc-f7ca-454e-b6e2-a45e9cefaa90 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:30.381140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-746296fc-f7ca-454e-b6e2-a45e9cefaa90 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:30.393846 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-746296fc-f7ca-454e-b6e2-a45e9cefaa90 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1212 microversion: 2.1 time: 1.032518 Oct 04 11:08:30.395282 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1089/2225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:29 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1212 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:30.401121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e0f0df2-a702-4392-a6aa-046ba1bf388a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4927f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:30.614587 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e0f0df2-a702-4392-a6aa-046ba1bf388a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.216898 Oct 04 11:08:30.615190 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1090/2226] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:30 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:30.634693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-adb7c2ba-7635-4571-8ddd-d05e4f248229 req-8ab0bd6a-c1b4-46cc-90c1-e3a4dfb40f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3856292-7f40-4752-9530-1e48b55492dc", "tag": "9aae5dcb-c5ce-4db7-925d-bad617f10cba"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:30.661081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-adb7c2ba-7635-4571-8ddd-d05e4f248229 req-8ab0bd6a-c1b4-46cc-90c1-e3a4dfb40f5b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:30.661611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-adb7c2ba-7635-4571-8ddd-d05e4f248229 req-8ab0bd6a-c1b4-46cc-90c1-e3a4dfb40f5b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:30.664828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-adb7c2ba-7635-4571-8ddd-d05e4f248229 req-8ab0bd6a-c1b4-46cc-90c1-e3a4dfb40f5b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:30.707710 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-adb7c2ba-7635-4571-8ddd-d05e4f248229 req-8ab0bd6a-c1b4-46cc-90c1-e3a4dfb40f5b service nova] Creating event network-changed:9aae5dcb-c5ce-4db7-925d-bad617f10cba for instance c3856292-7f40-4752-9530-1e48b55492dc on n-h2-791135-8 Oct 04 11:08:30.720703 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-adb7c2ba-7635-4571-8ddd-d05e4f248229 req-8ab0bd6a-c1b4-46cc-90c1-e3a4dfb40f5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094840 Oct 04 11:08:30.722119 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1091/2227] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:08:30.793261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:30.809021 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91e01973-eba4-481e-92ce-de31eec2376a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1316 microversion: 2.1 time: 1.639443 Oct 04 11:08:30.812984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1137/2228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:29 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1316 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:30.864460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aab22d22-4311-4c84-acfd-8ab572faddc6 tempest-FlavorsV2NegativeTest-1435018284 tempest-FlavorsV2NegativeTest-1435018284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1624026323", "imageRef": "29e2ccc3-21ae-45d9-9c56-9865c13e5bf6", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:30.983614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-aab22d22-4311-4c84-acfd-8ab572faddc6 tempest-FlavorsV2NegativeTest-1435018284 tempest-FlavorsV2NegativeTest-1435018284-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:08:31.419964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:31.420975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:31.442503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:31.448555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:31.449342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:31.451411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:31.454299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:31.455004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:31.827492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:31.840716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-100600e6-569d-47d6-98a8-8226ad9ccbf2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1264 microversion: 2.1 time: 0.424980 Oct 04 11:08:31.860697 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1138/2229] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:31 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1264 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:31.880217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-382717b8-e015-4330-9b55-eefc351b0e9e req-d5efa643-b322-48ca-8c31-13570f99c258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e6ec01-e1fa-4fff-b376-721ca1d75b44", "name": "network-vif-plugged", "status": "completed", "tag": "a7512ef0-9da7-4b2b-a541-1cd2d1702373"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:31.925231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-382717b8-e015-4330-9b55-eefc351b0e9e req-d5efa643-b322-48ca-8c31-13570f99c258 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:31.927907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-382717b8-e015-4330-9b55-eefc351b0e9e req-d5efa643-b322-48ca-8c31-13570f99c258 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:31.928556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-382717b8-e015-4330-9b55-eefc351b0e9e req-d5efa643-b322-48ca-8c31-13570f99c258 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:31.960388 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-382717b8-e015-4330-9b55-eefc351b0e9e req-d5efa643-b322-48ca-8c31-13570f99c258 service nova] Creating event network-vif-plugged:a7512ef0-9da7-4b2b-a541-1cd2d1702373 for instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 on n-h2-791135-8 Oct 04 11:08:31.970760 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-382717b8-e015-4330-9b55-eefc351b0e9e req-d5efa643-b322-48ca-8c31-13570f99c258 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107347 Oct 04 11:08:31.974161 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1139/2230] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:31.980923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a5a4644-fdce-4336-be55-724d8e07ecb7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d46153a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:32.076669 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a5a4644-fdce-4336-be55-724d8e07ecb7 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.100082 Oct 04 11:08:32.077755 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1140/2231] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:31 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:32.337391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-689534534", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "cd8973ba-220e-4e15-bf4e-b6b0e9142ef1"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:32.392165 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-aab22d22-4311-4c84-acfd-8ab572faddc6 tempest-FlavorsV2NegativeTest-1435018284 tempest-FlavorsV2NegativeTest-1435018284-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aab22d22-4311-4c84-acfd-8ab572faddc6 tempest-FlavorsV2NegativeTest-1435018284 tempest-FlavorsV2NegativeTest-1435018284-project] Request method failure captured: Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 143 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBQs-Hjfzp9MlzT1tLwCp2xfE_AOpLB0BolTRvAHuyXDvOpXkSTG9CkzR_HNotjpJT1DHfV8iy2RnAhbrmYYchA8fk7q4h69kFK2SJMnKSMFgfJp23AgPxbIkYFiVWTOlR5hKff60GP-VSSRCvbnF7dIaB4WhSh4H0agyznU8F7BsaM Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: a64191114e2844508f0bd90bb19d7cb7 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-FlavorsV2NegativeTest-1435018284 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a64191114e2844508f0bd90bb19d7cb7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64191114e2844508f0bd90bb19d7cb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a64191114e2844508f0bd90bb19d7cb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a64191114e2844508f0bd90bb19d7cb7"}]}] Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-FlavorsV2NegativeTest-1435018284 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: a64191114e2844508f0bd90bb19d7cb7 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1435018284 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-FlavorsV2NegativeTest-1435018284-project Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 0bd4e7c143c44876a133f4b68fdacbd9 Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-FlavorsV2NegativeTest-1435018284-project Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1624026323", "imageRef": "29e2ccc3-21ae-45d9-9c56-9865c13e5bf6", "flavorRef": "452"}} Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: exception: Flavor's memory is too small for requested image. Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1624026323', 'imageRef': '29e2ccc3-21ae-45d9-9c56-9865c13e5bf6', 'flavorRef': '452'}}} Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:08:32.399739 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 11:08:32.403367 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:32.406095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aab22d22-4311-4c84-acfd-8ab572faddc6 tempest-FlavorsV2NegativeTest-1435018284 tempest-FlavorsV2NegativeTest-1435018284-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:32.414257 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aab22d22-4311-4c84-acfd-8ab572faddc6 tempest-FlavorsV2NegativeTest-1435018284 tempest-FlavorsV2NegativeTest-1435018284-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.552975 Oct 04 11:08:32.424193 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1092/2232] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:08:30 2022] POST /compute/v2.1/servers => generated 93 bytes in 1566 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:08:32.449168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:32.451033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:32.459573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:32.460508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:32.461460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:32.462712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:32.464448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:32.465106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:32.977614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:32.989670 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15eddd84-d426-4edd-b398-7b56889f07a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1316 microversion: 2.1 time: 0.558768 Oct 04 11:08:32.994321 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1093/2233] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:32 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:33.005063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:33.005941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:33.024769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:33.027211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:33.027943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:33.030399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:33.037608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:33.038306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:33.047481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] validate_networks() for [('cd8973ba-220e-4e15-bf4e-b6b0e9142ef1', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:08:33.449554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:33.468957 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dfcc3138-6710-40bb-ad04-fcb5c71612c0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1270 microversion: 2.1 time: 0.468247 Oct 04 11:08:33.477473 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1094/2234] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:32 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1270 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:33.495317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88fc469b-319d-485c-9a69-e6d377dadfc3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cffd03a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:33.614361 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88fc469b-319d-485c-9a69-e6d377dadfc3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.133134 Oct 04 11:08:33.624527 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1095/2235] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:33 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:34.013374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:34.014711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:34.027141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:34.030302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:34.032392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:34.036478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:34.037195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:34.037879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:34.387366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:08:34.387848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:08:34.388304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:08:34.389185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:08:34.389775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:08:34.409602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:34.410358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:34.414192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:34.415209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:34.415840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:34.416425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:34.469513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Getting quotas for project ca8d711757c0420fa87cd982e622f04d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:08:34.475716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Getting quotas for user baed8d21db4f4df8b561a99ab3e8645e and project ca8d711757c0420fa87cd982e622f04d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:08:34.498118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Going to run 3 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:08:34.503626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:08:34.575870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: aed0de21-1977-4186-9cfd-caae0fd077fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=9cd968df-41f0-4020-9dbc-24a05a115e0d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:08:34.660405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=aed0de21-1977-4186-9cfd-caae0fd077fd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:08:34.737226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:34.754428 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3dca47ca-35cd-4274-ba2c-17a0518a93a0 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1316 microversion: 2.1 time: 0.745975 Oct 04 11:08:34.755013 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1096/2236] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:34 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:34.760226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:34.761910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:34.775732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:34.776470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:34.782019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:34.783126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:34.783778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:34.784364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:34.813025 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1a205de-9b35-41ec-923c-f49aa1e4619e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.733945 Oct 04 11:08:34.817636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1141/2237] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:08:34.826293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99e0c0d1-537c-4d8f-93d2-8e9f62773a37 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4d40550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:34.960181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:34.971980 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7c8f1b03-2da1-43e5-8ac3-f247c4de83a0 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1270 microversion: 2.1 time: 0.215656 Oct 04 11:08:34.972603 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1097/2238] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:34 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:34.983744 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99e0c0d1-537c-4d8f-93d2-8e9f62773a37 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.164689 Oct 04 11:08:34.984326 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1142/2239] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:34 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:35.006943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:35.020255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:35.023924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'deleted': False, 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:08:35.122914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:35.123619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:35.124274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:35.125530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:35.126134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:35.128510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:35.167036 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0e5d783-a7cd-4e19-964b-2ed29b3a8b14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.193260 Oct 04 11:08:35.168717 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1098/2240] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:08:34 2022] GET /compute/v2.1/servers => generated 1015 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:35.181869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0eb2e34-ea9a-4638-bccd-f972164ba7c1 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:35.183043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b0eb2e34-ea9a-4638-bccd-f972164ba7c1 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:35.779226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:35.780090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:35.799328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:35.801175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:35.820255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:35.823416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:35.824604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:35.827117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:36.475812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b0eb2e34-ea9a-4638-bccd-f972164ba7c1 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:36.494939 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0eb2e34-ea9a-4638-bccd-f972164ba7c1 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1222 microversion: 2.1 time: 1.312114 Oct 04 11:08:36.498560 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1143/2241] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:35 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1222 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:36.517476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:36.518109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:36.544718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:36.547077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:36.549274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:36.551377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:36.556363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:36.556853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:38.084822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:38.097888 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3b4ec983-0407-4f08-b55a-bc95c71e57b9 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1316 microversion: 2.1 time: 2.324201 Oct 04 11:08:38.104600 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1099/2242] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:35 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1316 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:38.119072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02da1edc-3b83-4806-8532-29050fa69d19 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d405a160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:38.187990 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02da1edc-3b83-4806-8532-29050fa69d19 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.081805 Oct 04 11:08:38.189751 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1100/2243] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:38 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:38.201954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:38.202804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:38.217016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:38.219249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:38.219849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:38.222983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:38.223614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:38.224990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:38.232931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:38.245086 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-30a41e41-1fc1-41e3-96c5-dc2362f98233 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1312 microversion: 2.1 time: 1.745186 Oct 04 11:08:38.252402 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1144/2244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:36 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1312 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:38.418323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:38.443259 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30ad76b7-1b6a-4d69-b323-f1b343da84c2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1218 microversion: 2.1 time: 0.247622 Oct 04 11:08:38.447664 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1101/2245] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:38 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:39.131490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:39.132404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:39.168159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:39.172572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:39.173183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:39.176968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:39.179067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:39.179673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:39.205566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c8ed781-597b-4c74-a65f-bd1facc98554 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cffd0f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:39.335642 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c8ed781-597b-4c74-a65f-bd1facc98554 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.135409 Oct 04 11:08:39.336850 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1102/2246] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:39 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:39.366156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:39.366787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:39.384115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:39.384619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:39.385181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:39.385936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:39.386564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:39.389383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:40.389628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:40.961146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:40.970071 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11ecab72-0c42-413d-a1fd-d1c3cf7d255b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1316 microversion: 2.1 time: 1.844501 Oct 04 11:08:40.974359 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1145/2247] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:39 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1316 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:40.986379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:40.987377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:41.002019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:41.003392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:41.005941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:41.006782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:41.010053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:41.010746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:41.699077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:41.712197 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-098a6075-ff49-45f2-b384-4427beadbcf3 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1333 microversion: 2.1 time: 2.373982 Oct 04 11:08:41.719243 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1103/2248] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:39 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1333 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:41.738256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1eba3f4-9c34-455c-a60e-6bbd5f569730 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d405af70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:41.814398 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1eba3f4-9c34-455c-a60e-6bbd5f569730 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.093586 Oct 04 11:08:41.829064 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1104/2249] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:41 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:41.956991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:41.970296 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb85adbc-aba7-4d48-8eea-4f6a65e14adc tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1280 microversion: 2.1 time: 0.994492 Oct 04 11:08:41.974148 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1146/2250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:40 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1280 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:42.002393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:42.003346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:42.019539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:42.020319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:42.023440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:42.024483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:42.025847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:42.026460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:42.273928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-177ff071-bbc3-4550-85cd-3077ddc2018e req-8274a512-8709-443a-ab3f-ada615a872ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3856292-7f40-4752-9530-1e48b55492dc", "name": "network-vif-plugged", "status": "completed", "tag": "9aae5dcb-c5ce-4db7-925d-bad617f10cba"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:42.297546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-177ff071-bbc3-4550-85cd-3077ddc2018e req-8274a512-8709-443a-ab3f-ada615a872ef service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:42.305960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-177ff071-bbc3-4550-85cd-3077ddc2018e req-8274a512-8709-443a-ab3f-ada615a872ef service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:42.313926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-177ff071-bbc3-4550-85cd-3077ddc2018e req-8274a512-8709-443a-ab3f-ada615a872ef service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:42.355989 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-177ff071-bbc3-4550-85cd-3077ddc2018e req-8274a512-8709-443a-ab3f-ada615a872ef service nova] Creating event network-vif-plugged:9aae5dcb-c5ce-4db7-925d-bad617f10cba for instance c3856292-7f40-4752-9530-1e48b55492dc on n-h2-791135-8 Oct 04 11:08:42.377089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-177ff071-bbc3-4550-85cd-3077ddc2018e req-8274a512-8709-443a-ab3f-ada615a872ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105274 Oct 04 11:08:42.380780 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1147/2251] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:42.753283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:42.754381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:42.800001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:42.802131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:42.804169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:42.807822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:42.814394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:42.816542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:42.921097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:43.066213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:43.080400 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0592e4e2-f4d5-4642-9b37-4114a436763b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1316 microversion: 2.1 time: 1.081784 Oct 04 11:08:43.084074 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1105/2252] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:41 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1316 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:43.107695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d0f8110-a576-4a82-ade6-f3d119acc3fb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cfe93040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:43.234361 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d0f8110-a576-4a82-ade6-f3d119acc3fb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.149137 Oct 04 11:08:43.238532 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1106/2253] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:43 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:43.245226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:43.259834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:43.275456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:43.275966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:43.276407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:43.277134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:43.277623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:43.278706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:43.954063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:43.968240 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e58d935-b360-4f4f-801d-be1d0274cb4a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1280 microversion: 2.1 time: 0.726693 Oct 04 11:08:43.970166 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1107/2254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:43 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1280 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:44.110388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:44.111040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:44.123099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:44.127338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:44.128909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:44.129762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:44.130243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:44.130680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:44.433737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:44.485888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:44.522389 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2a088f4-37bf-44b0-8e1b-0ef21d0fcd67 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1333 microversion: 2.1 time: 1.780243 Oct 04 11:08:44.527634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1148/2255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:42 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1333 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:44.568509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-821eade9-5591-490a-8997-a737dba1009f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d46d9b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:44.646035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-821eade9-5591-490a-8997-a737dba1009f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.116448 Oct 04 11:08:44.655473 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1149/2256] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:44 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:45.003941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:45.004880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:45.024409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:45.024921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:45.025452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:45.026195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:45.030671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:45.031215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:45.139175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:45.449426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:45.459043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de24a75b-445c-4a07-a4dc-fc51776b181c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1280 microversion: 2.1 time: 0.464884 Oct 04 11:08:45.468942 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1150/2257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:44 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1280 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:45.560390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:45.561401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:45.573701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:45.578641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:45.581009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:45.581717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:45.583828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:45.585783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:45.586498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:45.863630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:45.878740 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-51bf09a3-0db3-44e3-b8fb-8aa93ec958bd tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1316 microversion: 2.1 time: 1.773110 Oct 04 11:08:45.899963 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1108/2258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:44 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1316 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:45.909239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce19a59a-6308-4546-ab75-51f776ab2305 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cfe93160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:45.987313 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce19a59a-6308-4546-ab75-51f776ab2305 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.085245 Oct 04 11:08:45.988624 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1109/2259] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:45 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:46.487008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=22 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:46.499088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:46.520640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:46.561444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:46.564308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:46.570344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:46.577577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:46.578750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:46.582277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:46.882915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:46.894544 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-219b753f-a3d7-421d-ba1b-f4c4b812310d tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 1.343273 Oct 04 11:08:46.897324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1151/2260] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:45 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:46.921437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:46.922415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:46.931074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:46.936690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:46.937191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:46.938000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:46.938475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:46.938912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:47.284399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:47.310691 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0683a34e-9f4a-4b4c-b5e2-4aa523a7bb77 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1322 microversion: 2.1 time: 0.819950 Oct 04 11:08:47.311293 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1110/2261] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:46 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:47.340743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b14c22c9-d314-4a78-811b-b2dc8a4f5ce2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cfef2ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:47.431801 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b14c22c9-d314-4a78-811b-b2dc8a4f5ce2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.098105 Oct 04 11:08:47.434921 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1111/2262] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:47 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:47.640124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:47.654535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf5d2cd5-4a2d-4999-af16-6a8fe04c0bba tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1465 microversion: 2.1 time: 0.738655 Oct 04 11:08:47.655627 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1152/2263] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:46 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1465 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:47.686986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:47.688176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:47.715904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:47.716665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:47.717253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:47.718829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:47.719445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:47.720256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:47.925326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:47.925998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:47.946479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:47.947154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:47.947396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:47.948307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:47.948913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:47.952627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:48.417864 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1041d1c-91c3-4742-8f8b-bb79100321b1 tempest-ServersOnMultiNodesTest-1265835419 tempest-ServersOnMultiNodesTest-1265835419-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1616 microversion: 2.1 time: 0.736242 Oct 04 11:08:48.429782 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1112/2264] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:47 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1616 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:48.442193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:48.443209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:48.457162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:48.458268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:48.464540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:48.466730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:48.467707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:48.468572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:48.780516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:48.798691 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-024ebde4-6e79-4c31-94e2-31a164798b24 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.876108 Oct 04 11:08:48.800010 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1153/2265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:47 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:48.828803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b57f925a-8208-4f91-9d0f-f7bdc1581785 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4a6a700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:48.952415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b57f925a-8208-4f91-9d0f-f7bdc1581785 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.135531 Oct 04 11:08:48.953182 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1154/2266] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:48 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:48.968349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:48.972162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:48.986276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:48.986683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:48.987115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:48.990377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:48.991017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:48.992337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:49.055119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:08:49.082742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:49.094377 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12539dd4-050e-4819-954b-0a3d2b06d55d tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1322 microversion: 2.1 time: 0.663130 Oct 04 11:08:49.094976 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1113/2267] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:48 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1322 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:49.118472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4a8c9039-79f5-4b9c-add7-eb29df46a4b4 req-0216ee61-a985-4c90-a9cd-fa90e9841f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed0de21-1977-4186-9cfd-caae0fd077fd", "tag": "5ef7b6a8-281c-4002-8b72-a0f5c1c79507"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:49.139786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4a8c9039-79f5-4b9c-add7-eb29df46a4b4 req-0216ee61-a985-4c90-a9cd-fa90e9841f0d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:49.140270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4a8c9039-79f5-4b9c-add7-eb29df46a4b4 req-0216ee61-a985-4c90-a9cd-fa90e9841f0d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:49.140695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4a8c9039-79f5-4b9c-add7-eb29df46a4b4 req-0216ee61-a985-4c90-a9cd-fa90e9841f0d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:49.167508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:49.170991 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4a8c9039-79f5-4b9c-add7-eb29df46a4b4 req-0216ee61-a985-4c90-a9cd-fa90e9841f0d service nova] Creating event network-changed:5ef7b6a8-281c-4002-8b72-a0f5c1c79507 for instance aed0de21-1977-4186-9cfd-caae0fd077fd on n-h1-791135-8 Oct 04 11:08:49.192186 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4a8c9039-79f5-4b9c-add7-eb29df46a4b4 req-0216ee61-a985-4c90-a9cd-fa90e9841f0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088924 Oct 04 11:08:49.193480 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1114/2268] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:49.242647 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9ca5a34-19d1-40e9-b186-9d9b2eca3f9a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 204 len: 0 microversion: 2.1 time: 0.286258 Oct 04 11:08:49.243794 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1155/2269] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:08:48 2022] DELETE /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:08:49.264559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:49.272759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:49.327617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:49.329399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:49.330625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:49.332769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:49.333418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:49.334836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:49.828888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:49.829904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:49.844618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:49.845119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:49.853243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:49.854833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:49.855335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:49.855848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:51.290618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:51.299896 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e66b05b0-9582-48a5-8f12-689957482252 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1471 microversion: 2.1 time: 2.049748 Oct 04 11:08:51.306928 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1115/2270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:49 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1471 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:51.326961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd155e5a-1012-4f49-ba6f-ebc110316cda tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d404ddc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:51.393905 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd155e5a-1012-4f49-ba6f-ebc110316cda tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.085504 Oct 04 11:08:51.408082 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1116/2271] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:51 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:51.423321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:51.424761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:51.446385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:51.447165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:51.457587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:51.458786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:51.459477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:51.460563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:53.292385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:53.304634 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b70df83c-bd61-4963-a679-53ff7daeba49 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 3.480056 Oct 04 11:08:53.309591 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1156/2272] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:49 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 3486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:53.324769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1190c1c7-f207-43b9-9e34-0ef824618e54 req-a9e27ea6-cf60-4167-915e-6dc0b54fcf71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "tag": "9a2f3c79-5f7e-427d-9171-461f24336e57"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:53.353111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1190c1c7-f207-43b9-9e34-0ef824618e54 req-a9e27ea6-cf60-4167-915e-6dc0b54fcf71 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:53.357565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1190c1c7-f207-43b9-9e34-0ef824618e54 req-a9e27ea6-cf60-4167-915e-6dc0b54fcf71 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:53.358302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1190c1c7-f207-43b9-9e34-0ef824618e54 req-a9e27ea6-cf60-4167-915e-6dc0b54fcf71 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:53.387754 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1190c1c7-f207-43b9-9e34-0ef824618e54 req-a9e27ea6-cf60-4167-915e-6dc0b54fcf71 service nova] Creating event network-changed:9a2f3c79-5f7e-427d-9171-461f24336e57 for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:08:53.393525 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1190c1c7-f207-43b9-9e34-0ef824618e54 req-a9e27ea6-cf60-4167-915e-6dc0b54fcf71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082235 Oct 04 11:08:53.394760 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1157/2273] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:53.403444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f19cfbb7-5e11-47ac-8d7d-ffb6c73ee143 req-895e2723-360c-4b60-b3fc-2ce722ce01ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a9ffdf-b539-4b98-97f5-f943a852876f", "tag": "be3d9536-4785-4af5-afd6-69e98f320f53"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:53.428960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f19cfbb7-5e11-47ac-8d7d-ffb6c73ee143 req-895e2723-360c-4b60-b3fc-2ce722ce01ae service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:53.429677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f19cfbb7-5e11-47ac-8d7d-ffb6c73ee143 req-895e2723-360c-4b60-b3fc-2ce722ce01ae service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:53.430600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f19cfbb7-5e11-47ac-8d7d-ffb6c73ee143 req-895e2723-360c-4b60-b3fc-2ce722ce01ae service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:53.449721 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f19cfbb7-5e11-47ac-8d7d-ffb6c73ee143 req-895e2723-360c-4b60-b3fc-2ce722ce01ae service nova] Creating event network-changed:be3d9536-4785-4af5-afd6-69e98f320f53 for instance f2a9ffdf-b539-4b98-97f5-f943a852876f on n-h1-791135-8 Oct 04 11:08:53.458891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f19cfbb7-5e11-47ac-8d7d-ffb6c73ee143 req-895e2723-360c-4b60-b3fc-2ce722ce01ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062518 Oct 04 11:08:53.460180 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1158/2274] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:53.473518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:53.484561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:53.492322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:53.496987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:53.497843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:53.498845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:53.499530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:53.500181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:53.633826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:53.651023 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61aecbb6-19bf-48c8-9c69-101f4c2cd501 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1322 microversion: 2.1 time: 2.241301 Oct 04 11:08:53.668465 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1117/2275] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:51 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1322 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:53.681043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8bd05d60-e509-47f2-a46f-3df8131a8510 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d405adc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:53.815592 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8bd05d60-e509-47f2-a46f-3df8131a8510 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.159228 Oct 04 11:08:53.817786 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1118/2276] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:53 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:54.269829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d6aafc8a-f97b-42e0-bd51-49430d010bfa req-db42194c-0872-46cb-85c7-dc3540d0a06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3856292-7f40-4752-9530-1e48b55492dc", "name": "network-vif-unplugged", "status": "completed", "tag": "9aae5dcb-c5ce-4db7-925d-bad617f10cba"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:54.289413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d6aafc8a-f97b-42e0-bd51-49430d010bfa req-db42194c-0872-46cb-85c7-dc3540d0a06e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:54.291473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d6aafc8a-f97b-42e0-bd51-49430d010bfa req-db42194c-0872-46cb-85c7-dc3540d0a06e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:54.292259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d6aafc8a-f97b-42e0-bd51-49430d010bfa req-db42194c-0872-46cb-85c7-dc3540d0a06e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:54.327887 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d6aafc8a-f97b-42e0-bd51-49430d010bfa req-db42194c-0872-46cb-85c7-dc3540d0a06e service nova] Creating event network-vif-unplugged:9aae5dcb-c5ce-4db7-925d-bad617f10cba for instance c3856292-7f40-4752-9530-1e48b55492dc on n-h2-791135-8 Oct 04 11:08:54.341710 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d6aafc8a-f97b-42e0-bd51-49430d010bfa req-db42194c-0872-46cb-85c7-dc3540d0a06e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075336 Oct 04 11:08:54.344841 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1119/2277] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:54.356101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:54.359462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:54.378409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:54.378945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:54.379402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:54.380163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:54.380634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:54.381067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:54.612803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:54.649151 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-40b280b3-0cf3-41dc-baf7-a53c12c6456d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1471 microversion: 2.1 time: 1.186045 Oct 04 11:08:54.690609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1159/2278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:53 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1471 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:54.719381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:54.722238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:54.736786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:54.737311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:54.738532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:54.744105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:54.746690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:54.746690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:56.396479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:56.420701 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9659328b-c59a-4090-88f3-89ec4574963b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 2.072769 Oct 04 11:08:56.446424 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1120/2279] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:54 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:56.455835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6d4914c-78e9-44f7-a2d0-dbaf684f8aed tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cff81c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:56.571304 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6d4914c-78e9-44f7-a2d0-dbaf684f8aed tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.123428 Oct 04 11:08:56.574221 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1121/2280] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:56 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:56.587859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:56.588817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:56.591670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=54 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:08:56.609263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:56.610020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:56.610703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:56.612453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:56.615192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:56.615858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:57.011293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:57.034057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6bab62b-a84d-4d0c-a29d-b8b5c60aafac tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1322 microversion: 2.1 time: 2.342148 Oct 04 11:08:57.049383 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1160/2281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:54 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1322 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:57.062157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-452cf6a2-137f-45b9-8c47-fab2e53f8d87 req-485fa549-26ed-4c69-8e27-a58d27ea6a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd968df-41f0-4020-9dbc-24a05a115e0d", "tag": "6511e76d-4f71-4bf0-844d-9b2e4e77b018"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:57.107949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-452cf6a2-137f-45b9-8c47-fab2e53f8d87 req-485fa549-26ed-4c69-8e27-a58d27ea6a59 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:57.108680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-452cf6a2-137f-45b9-8c47-fab2e53f8d87 req-485fa549-26ed-4c69-8e27-a58d27ea6a59 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:57.109729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-452cf6a2-137f-45b9-8c47-fab2e53f8d87 req-485fa549-26ed-4c69-8e27-a58d27ea6a59 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:57.127046 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-452cf6a2-137f-45b9-8c47-fab2e53f8d87 req-485fa549-26ed-4c69-8e27-a58d27ea6a59 service nova] Creating event network-changed:6511e76d-4f71-4bf0-844d-9b2e4e77b018 for instance 9cd968df-41f0-4020-9dbc-24a05a115e0d on n-h2-791135-8 Oct 04 11:08:57.143282 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-452cf6a2-137f-45b9-8c47-fab2e53f8d87 req-485fa549-26ed-4c69-8e27-a58d27ea6a59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098967 Oct 04 11:08:57.146646 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1161/2282] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:08:57.191148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:57.201298 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7e38c04-9df8-4d61-8f44-a399d9adca06 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 200 len: 1429 microversion: 2.1 time: 0.622726 Oct 04 11:08:57.206369 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1122/2283] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:56 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 1429 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:57.354782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1418073690", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "97ba7ff9-cb75-4cab-8f67-2b898005c316"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:08:57.453600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:57.454901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:57.461471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:57.462219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:57.463128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:57.464262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:57.465667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:57.466304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:57.472583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] validate_networks() for [('97ba7ff9-cb75-4cab-8f67-2b898005c316', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:08:58.027956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:58.042872 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-296f85f2-ee51-4f48-9a6f-a388da74564c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.588381 Oct 04 11:08:58.043939 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1123/2284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:57 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:08:58.055912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-167a2d64-0c2f-45e3-8fa4-69c6a7ca8fbc tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d42e68b0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:58.112880 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-167a2d64-0c2f-45e3-8fa4-69c6a7ca8fbc tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1411 microversion: 2.1 time: 0.065353 Oct 04 11:08:58.113456 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1124/2285] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:08:58 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:58.118311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:58.119081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:58.126760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:58.127785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:58.131308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:58.132260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:58.133253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:58.133848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:58.874188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:08:58.884788 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-220a2c82-37b5-44d3-972d-d4e3cdbb1fd0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1322 microversion: 2.1 time: 0.770153 Oct 04 11:08:58.885552 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1125/2286] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:58 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:08:58.891096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:58.891986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: c3856292-7f40-4752-9530-1e48b55492dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:58.898531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:58.899296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:58.899943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:58.900874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:58.901567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:58.903022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:58.918392 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] HTTP exception thrown: Instance c3856292-7f40-4752-9530-1e48b55492dc could not be found. Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Request method failure captured: Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc HTTP/1.1 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBOE7i53fZwQDTjfY9ZSyTRKb_ULWkjhExJkrx8N3__n_riOZD5HMnT56o7Xj5qnqcGrvnO-1ecShxCljMm6yp6Ld5crD6aqCTHWnOG7-BD4-9t604gGVS5q4-1jaaz-6gxHJ99A7AMUjglx25aB9BeQgXmiJGHgIbT2hL94ng6WLGE Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf100271e41c4475835267bcaf15c0b3"}]}] Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 5797d5cb0e13468585a42a3e909c1165 Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance c3856292-7f40-4752-9530-1e48b55492dc could not be found. Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'c3856292-7f40-4752-9530-1e48b55492dc'} Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3856292-7f40-4752-9530-1e48b55492dc could not be found. Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3856292-7f40-4752-9530-1e48b55492dc could not be found. Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:08:58.920209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:58.923874 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:08:58.923874 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:08:58.923874 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:08:58.923874 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:08:58.923874 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:08:58.923874 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3856292-7f40-4752-9530-1e48b55492dc could not be found. Oct 04 11:08:58.923874 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:08:58.925643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Returning 404 to user: Instance c3856292-7f40-4752-9530-1e48b55492dc could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:08:58.926597 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7ec4006-750e-4dc3-8b70-68c0d84b1bb3 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc" status: 404 len: 111 microversion: 2.1 time: 0.039076 Oct 04 11:08:58.927706 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1126/2287] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:58 2022] GET /compute/v2.1/servers/c3856292-7f40-4752-9530-1e48b55492dc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:08:58.935271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:58.935769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:58.942161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:58.942863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:58.943455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:58.944317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:58.945098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:58.945713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:58.977811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:08:59.077976 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd0e1117-adad-492d-ae48-536c3a133116 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 204 len: 0 microversion: 2.1 time: 0.146166 Oct 04 11:08:59.078943 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1127/2288] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:08:58 2022] DELETE /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:08:59.088539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:08:59.090168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:08:59.096698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:59.097476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:59.098208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:59.099138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:59.099753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:59.100336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:59.893814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:08:59.894778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:08:59.895733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:08:59.896163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:08:59.896583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:08:59.913876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:59.914372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:59.916558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:59.916558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:08:59.916558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:08:59.916558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:08:59.967614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Getting quotas for project 826a9134c65f4fda991182b92eb57365. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:08:59.972323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Getting quotas for user 7fb5241c84dc4aa69417d467ac7972bb and project 826a9134c65f4fda991182b92eb57365. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:08:59.993751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:08:59.999899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:09:00.098069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2af92c3c-ecbb-46ed-9426-5aeac39e405b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.938253 Oct 04 11:09:00.099379 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1162/2289] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:09:00.104251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:00.105030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:00.112060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:00.112784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:00.113431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:00.114348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:00.114952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:00.115550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:00.637038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:00.647719 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f1bd5457-3943-49c0-a57e-a63930aa31f9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 1.561337 Oct 04 11:09:00.653100 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1128/2290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:08:59 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:00.674588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22f75a94-1011-4572-bf0f-36626632a043 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d478e940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:00.785108 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22f75a94-1011-4572-bf0f-36626632a043 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1420 microversion: 2.1 time: 0.114373 Oct 04 11:09:00.787844 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1129/2291] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:00 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:00.800168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a11aac1f-6930-4e6d-9abc-4e09506e2e1d req-a5053b6c-a6e7-45ee-b68d-43dff3509b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3856292-7f40-4752-9530-1e48b55492dc", "name": "network-vif-deleted", "tag": "9aae5dcb-c5ce-4db7-925d-bad617f10cba"}, {"name": "network-changed", "server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "tag": "8fa1cf3a-8d18-4fd1-8b16-d8aefe548c59"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:00.859152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a11aac1f-6930-4e6d-9abc-4e09506e2e1d req-a5053b6c-a6e7-45ee-b68d-43dff3509b59 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:00.859152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a11aac1f-6930-4e6d-9abc-4e09506e2e1d req-a5053b6c-a6e7-45ee-b68d-43dff3509b59 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:00.859152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a11aac1f-6930-4e6d-9abc-4e09506e2e1d req-a5053b6c-a6e7-45ee-b68d-43dff3509b59 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:00.892466 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a11aac1f-6930-4e6d-9abc-4e09506e2e1d req-a5053b6c-a6e7-45ee-b68d-43dff3509b59 service nova] Creating event network-vif-deleted:9aae5dcb-c5ce-4db7-925d-bad617f10cba for instance c3856292-7f40-4752-9530-1e48b55492dc on n-h2-791135-8 Oct 04 11:09:00.895816 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a11aac1f-6930-4e6d-9abc-4e09506e2e1d req-a5053b6c-a6e7-45ee-b68d-43dff3509b59 service nova] Creating event network-changed:8fa1cf3a-8d18-4fd1-8b16-d8aefe548c59 for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:09:00.921155 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a11aac1f-6930-4e6d-9abc-4e09506e2e1d req-a5053b6c-a6e7-45ee-b68d-43dff3509b59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.122468 Oct 04 11:09:00.924089 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1130/2292] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:00.936704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c08ecc7b-f9f7-4d92-80a0-deaaecf5f20a req-d626a0a3-3f70-41c7-9eaa-e98ed4abbae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed0de21-1977-4186-9cfd-caae0fd077fd", "name": "network-vif-plugged", "status": "completed", "tag": "5ef7b6a8-281c-4002-8b72-a0f5c1c79507"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:00.972944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c08ecc7b-f9f7-4d92-80a0-deaaecf5f20a req-d626a0a3-3f70-41c7-9eaa-e98ed4abbae0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:00.973485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c08ecc7b-f9f7-4d92-80a0-deaaecf5f20a req-d626a0a3-3f70-41c7-9eaa-e98ed4abbae0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:00.974868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c08ecc7b-f9f7-4d92-80a0-deaaecf5f20a req-d626a0a3-3f70-41c7-9eaa-e98ed4abbae0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:01.010061 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c08ecc7b-f9f7-4d92-80a0-deaaecf5f20a req-d626a0a3-3f70-41c7-9eaa-e98ed4abbae0 service nova] Creating event network-vif-plugged:5ef7b6a8-281c-4002-8b72-a0f5c1c79507 for instance aed0de21-1977-4186-9cfd-caae0fd077fd on n-h1-791135-8 Oct 04 11:09:01.023145 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c08ecc7b-f9f7-4d92-80a0-deaaecf5f20a req-d626a0a3-3f70-41c7-9eaa-e98ed4abbae0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094671 Oct 04 11:09:01.023808 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1131/2293] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:01.040282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:01.041219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:01.060301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:01.061001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:01.061486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:01.062423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:01.062801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:01.063232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:01.175394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:01.192780 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1cde37a-39d9-4ae9-a807-c7d70cc925a5 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1473 microversion: 2.1 time: 1.092102 Oct 04 11:09:01.193393 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1163/2294] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:00 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1473 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:01.226553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8f3c575-92cf-4abd-b687-db50cfc5ba3f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:01.227462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f8f3c575-92cf-4abd-b687-db50cfc5ba3f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:01.400591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f8f3c575-92cf-4abd-b687-db50cfc5ba3f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:01.409082 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f8f3c575-92cf-4abd-b687-db50cfc5ba3f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1216 microversion: 2.1 time: 0.214307 Oct 04 11:09:01.416119 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1164/2295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:01 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1216 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:01.429262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c97972c-95a2-4e7d-8474-a9d22effb37f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4635670>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:01.518479 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c97972c-95a2-4e7d-8474-a9d22effb37f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 200 len: 1420 microversion: 2.1 time: 0.100940 Oct 04 11:09:01.520874 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1165/2296] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:01 2022] GET /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:01.539957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ada30fc6-818f-4ea3-ae6e-85f7fbd6bf1f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d41f5430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:01.661603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:01.669894 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4fa95761-740b-4588-bc02-bfe24d241ac0 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1322 microversion: 2.1 time: 0.641421 Oct 04 11:09:01.673820 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1132/2297] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:01 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1322 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:01.684721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:01.690531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:01.703627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:01.705837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:01.706441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:01.710934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:01.711658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:01.712544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:02.412965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:02.451536 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e55c6bf2-edc1-4601-a695-8d6db91341c8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.759333 Oct 04 11:09:02.452193 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1133/2298] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:01 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:02.477305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:02.477878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:02.490896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:02.491401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:02.491847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:02.492571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:02.493029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:02.497957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:02.974869 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ada30fc6-818f-4ea3-ae6e-85f7fbd6bf1f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 204 len: 0 microversion: 2.1 time: 1.439551 Oct 04 11:09:02.976357 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1166/2299] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:01 2022] DELETE /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 0 bytes in 1442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:02.983098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:02.984004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:03.001171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.002598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.010917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.012113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.013786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.019389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.323232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:03.339597 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a93654b8-b4ef-460c-9def-05e57d8953d2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1473 microversion: 2.1 time: 0.871319 Oct 04 11:09:03.341162 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1134/2300] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:02 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1473 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:03.354037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:03.354828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:03.366489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.366937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.367371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.368115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.375552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.376014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.471903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:03.485407 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02b2dc3f-18ea-4249-a5f5-2e3953e682e1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1274 microversion: 2.1 time: 0.507711 Oct 04 11:09:03.491395 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1167/2301] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:02 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1274 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:03.514707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:03.515248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:03.526044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.527997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.528685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.529792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.530523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.531448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.583356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:03.660307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:03.686726 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5239340-fc35-4aa8-bcdb-4e4e2ec124e7 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1322 microversion: 2.1 time: 0.341259 Oct 04 11:09:03.689466 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1135/2302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:03 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:03.698198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ea283e3d-54ef-4954-8552-5c3bd0c1668a req-43ebdb73-6363-4cd2-b814-24d650068742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "tag": "a3840260-c4ac-408c-810b-ecfd0314c7bb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:03.749534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ea283e3d-54ef-4954-8552-5c3bd0c1668a req-43ebdb73-6363-4cd2-b814-24d650068742 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.751292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ea283e3d-54ef-4954-8552-5c3bd0c1668a req-43ebdb73-6363-4cd2-b814-24d650068742 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.753885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ea283e3d-54ef-4954-8552-5c3bd0c1668a req-43ebdb73-6363-4cd2-b814-24d650068742 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.759494 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-08a690f6-b3f1-452d-8ecb-8b5e3039a40b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 204 len: 0 microversion: 2.1 time: 0.265834 Oct 04 11:09:03.760803 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1168/2303] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:03 2022] DELETE /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:03.792283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ffb12ea9-a601-4f61-9f02-de70778707d2 req-d80a18c3-ea4a-4c06-bfb7-0ca369d56ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a9ffdf-b539-4b98-97f5-f943a852876f", "name": "network-vif-plugged", "status": "completed", "tag": "be3d9536-4785-4af5-afd6-69e98f320f53"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:03.811089 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ea283e3d-54ef-4954-8552-5c3bd0c1668a req-43ebdb73-6363-4cd2-b814-24d650068742 service nova] Creating event network-changed:a3840260-c4ac-408c-810b-ecfd0314c7bb for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:09:03.823355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ffb12ea9-a601-4f61-9f02-de70778707d2 req-d80a18c3-ea4a-4c06-bfb7-0ca369d56ded service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.825924 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ea283e3d-54ef-4954-8552-5c3bd0c1668a req-43ebdb73-6363-4cd2-b814-24d650068742 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133586 Oct 04 11:09:03.826744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ffb12ea9-a601-4f61-9f02-de70778707d2 req-d80a18c3-ea4a-4c06-bfb7-0ca369d56ded service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.827591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ffb12ea9-a601-4f61-9f02-de70778707d2 req-d80a18c3-ea4a-4c06-bfb7-0ca369d56ded service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.831475 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1136/2304] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:03.844506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:03.845234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:03.856660 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ffb12ea9-a601-4f61-9f02-de70778707d2 req-d80a18c3-ea4a-4c06-bfb7-0ca369d56ded service nova] Creating event network-vif-plugged:be3d9536-4785-4af5-afd6-69e98f320f53 for instance f2a9ffdf-b539-4b98-97f5-f943a852876f on n-h1-791135-8 Oct 04 11:09:03.864382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.864985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.865456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.867298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:03.867882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:03.868295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:03.870758 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ffb12ea9-a601-4f61-9f02-de70778707d2 req-d80a18c3-ea4a-4c06-bfb7-0ca369d56ded service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106369 Oct 04 11:09:03.871382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1169/2305] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:04.011475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1352630618", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "fe42e5c1-b0b0-4c86-b1a2-ac753c58d8e1"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:04.145552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] validate_networks() for [('fe42e5c1-b0b0-4c86-b1a2-ac753c58d8e1', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:09:04.480901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:04.494464 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14743df7-2069-40f8-a70c-bdcc5bacf855 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.661304 Oct 04 11:09:04.496318 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1137/2306] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:03 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:04.510824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bf5864d1-5ba6-4165-8842-7068c9249fe4 req-3cf57c1a-8c4e-4b93-b51c-5af89c54baf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5408a263-9848-4fa4-9f50-30117a1974a8", "name": "network-vif-deleted", "tag": "88917fbb-e51b-42d1-9dae-500c7df052d1"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:04.542286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bf5864d1-5ba6-4165-8842-7068c9249fe4 req-3cf57c1a-8c4e-4b93-b51c-5af89c54baf3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:04.544300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bf5864d1-5ba6-4165-8842-7068c9249fe4 req-3cf57c1a-8c4e-4b93-b51c-5af89c54baf3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:04.544748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bf5864d1-5ba6-4165-8842-7068c9249fe4 req-3cf57c1a-8c4e-4b93-b51c-5af89c54baf3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:04.566923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:04.576030 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bf5864d1-5ba6-4165-8842-7068c9249fe4 req-3cf57c1a-8c4e-4b93-b51c-5af89c54baf3 service nova] Creating event network-vif-deleted:88917fbb-e51b-42d1-9dae-500c7df052d1 for instance 5408a263-9848-4fa4-9f50-30117a1974a8 on n-h1-791135-8 Oct 04 11:09:04.581121 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bf5864d1-5ba6-4165-8842-7068c9249fe4 req-3cf57c1a-8c4e-4b93-b51c-5af89c54baf3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082495 Oct 04 11:09:04.588330 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1138/2307] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:04.597312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:04.598002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:04.616056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:04.617581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:04.618419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:04.619257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:04.619815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:04.620335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:04.670741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:04.671219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:04.671819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:04.672518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lazy-loading 'fault' on Instance uuid 5408a263-9848-4fa4-9f50-30117a1974a8 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:09:04.806721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:04.839609 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b61d7fc4-ebae-4b3a-80aa-8e5e80c18939 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 200 len: 1307 microversion: 2.1 time: 0.242943 Oct 04 11:09:04.843913 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1139/2308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:04 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:04.863856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:04.865883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:04.901120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:04.905504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:04.906187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:04.907382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:04.910034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:04.910725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:05.189186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:05.204672 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebb7a6d5-4e97-43bc-b035-93999496e4ef tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1274 microversion: 2.1 time: 0.357151 Oct 04 11:09:05.220749 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1140/2309] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:04 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1274 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:05.245187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:05.246943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:05.269497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:05.271106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:05.273581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:05.276029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:05.278797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:05.285768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:05.909180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:05.927305 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-691276ee-e714-4397-baf1-d4da06ab1200 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1322 microversion: 2.1 time: 0.704536 Oct 04 11:09:05.941382 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1141/2310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:05 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1322 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:05.941382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:05.941382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:05.960061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:05.962733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:05.963183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:05.965197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:05.967259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:05.967853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:06.638664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:09:06.639206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:09:06.639793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:09:06.640387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:09:06.640985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:09:06.660488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:06.661196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:06.662258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:06.664817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:06.668264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:06.669242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:06.691988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:06.735277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Getting quotas for project ee7bbcbc81f547c0b5982b0f1efc54cc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:09:06.749205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Getting quotas for user 4dbb699b24b3432e9adc7b6d869e4744 and project ee7bbcbc81f547c0b5982b0f1efc54cc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:09:06.784229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:09:06.788500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:09:06.904486 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0224becc-0f56-4fc5-a0c4-06d9cbc38bcd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.897303 Oct 04 11:09:06.919866 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1170/2311] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:09:06.936069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:06.939390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 5408a263-9848-4fa4-9f50-30117a1974a8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:06.970057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:06.971473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:06.972215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:06.975006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:06.975779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:06.976649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:07.002606 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] HTTP exception thrown: Instance 5408a263-9848-4fa4-9f50-30117a1974a8 could not be found. Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Request method failure captured: Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 HTTP/1.1 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBOE7i53fZwQDTjfY9ZSyTRKb_ULWkjhExJkrx8N3__n_riOZD5HMnT56o7Xj5qnqcGrvnO-1ecShxCljMm6yp6Ld5crD6aqCTHWnOG7-BD4-9t604gGVS5q4-1jaaz-6gxHJ99A7AMUjglx25aB9BeQgXmiJGHgIbT2hL94ng6WLGE Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf100271e41c4475835267bcaf15c0b3"}]}] Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5797d5cb0e13468585a42a3e909c1165 Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5408a263-9848-4fa4-9f50-30117a1974a8 could not be found. Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5408a263-9848-4fa4-9f50-30117a1974a8'} Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5408a263-9848-4fa4-9f50-30117a1974a8 could not be found. Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5408a263-9848-4fa4-9f50-30117a1974a8 could not be found. Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:07.006033 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:07.011703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:07.011703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:07.011703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:07.011703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:07.011703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:07.011703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5408a263-9848-4fa4-9f50-30117a1974a8 could not be found. Oct 04 11:09:07.011703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:07.014833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Returning 404 to user: Instance 5408a263-9848-4fa4-9f50-30117a1974a8 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:07.016291 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a878fb3-7307-495d-bfdd-72cc7c57516d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8" status: 404 len: 111 microversion: 2.1 time: 0.093785 Oct 04 11:09:07.020544 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1171/2312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:06 2022] GET /compute/v2.1/servers/5408a263-9848-4fa4-9f50-30117a1974a8 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:07.027942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-31902131-14fd-43b2-9f27-1929d301d48a req-5cf258c4-bda1-4842-b8e3-a5d2238a7424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e6ec01-e1fa-4fff-b376-721ca1d75b44", "name": "network-vif-unplugged", "status": "completed", "tag": "a7512ef0-9da7-4b2b-a541-1cd2d1702373"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:07.035117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:07.044127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-31902131-14fd-43b2-9f27-1929d301d48a req-5cf258c4-bda1-4842-b8e3-a5d2238a7424 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:07.045502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-31902131-14fd-43b2-9f27-1929d301d48a req-5cf258c4-bda1-4842-b8e3-a5d2238a7424 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:07.046258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-31902131-14fd-43b2-9f27-1929d301d48a req-5cf258c4-bda1-4842-b8e3-a5d2238a7424 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:07.060452 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-31902131-14fd-43b2-9f27-1929d301d48a req-5cf258c4-bda1-4842-b8e3-a5d2238a7424 service nova] Creating event network-vif-unplugged:a7512ef0-9da7-4b2b-a541-1cd2d1702373 for instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 on n-h2-791135-8 Oct 04 11:09:07.065927 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49e7863e-dab5-4781-9c2f-c5a20125250c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 1.134786 Oct 04 11:09:07.081410 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1142/2313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:05 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:07.085313 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-31902131-14fd-43b2-9f27-1929d301d48a req-5cf258c4-bda1-4842-b8e3-a5d2238a7424 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062999 Oct 04 11:09:07.086198 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1172/2314] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:07.088669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:07.089849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:07.093721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7a4c6e6-b378-46d0-8998-eae4274bf51e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:07.094708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7a4c6e6-b378-46d0-8998-eae4274bf51e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:07.111775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:07.112274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:07.112706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:07.113448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:07.113905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:07.114338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:07.680777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7a4c6e6-b378-46d0-8998-eae4274bf51e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:07.691823 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7a4c6e6-b378-46d0-8998-eae4274bf51e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1208 microversion: 2.1 time: 0.601220 Oct 04 11:09:07.692662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1173/2315] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:07 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1208 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:07.697612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:07.708198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:07.723704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:07.731106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:07.731585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:07.750622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:07.751706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:07.754178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:08.452632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:08.466097 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6f99609f-7641-4127-a3c9-52044a738452 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 1.389365 Oct 04 11:09:08.466710 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1143/2316] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:07 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:08.484457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:08.485051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:08.497108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:08.497649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:08.503428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:08.506364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:08.509480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:08.513013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:08.567370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:08.580510 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e629054-37bf-43c7-83a6-01616ed2c875 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 200 len: 1514 microversion: 2.1 time: 0.886250 Oct 04 11:09:08.581479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1174/2317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:07 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 1514 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:08.593226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:08.593871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:08.663901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:08.665624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:08.666971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:08.670372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:08.671216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:08.672124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:08.683973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:08.864310 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-07381a2e-7a97-45ac-9972-9207609a786c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 204 len: 0 microversion: 2.1 time: 0.393833 Oct 04 11:09:08.866442 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1144/2318] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:08 2022] DELETE /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:08.879658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:08.882824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: aed0de21-1977-4186-9cfd-caae0fd077fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:08.896236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:08.900039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:08.900780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:08.902422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:08.903545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:08.905704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:09.605152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:09.618403 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6fd65eeb-3d78-4953-b6cb-258adf28892b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 1.033838 Oct 04 11:09:09.626232 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1175/2319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:08 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:09.641301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:09.641883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:09.660873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:09.663959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:09.671542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:09.673673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:09.674306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:09.676144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:09.899147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:09.907605 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8603a2d-f450-470a-b701-0810e6ba2324 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1204 microversion: 2.1 time: 0.280249 Oct 04 11:09:09.926354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:09.928502 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1176/2320] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:09 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1204 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:09.935757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:09.936749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:09.946387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:09.947200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:09.947832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:09.949396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:09.950320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:09.950981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:09.951336 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-710b70bc-c745-4a40-863f-3045bc8ba428 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd" status: 200 len: 1515 microversion: 2.1 time: 1.073257 Oct 04 11:09:09.963483 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1145/2321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:08 2022] GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd => generated 1515 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:09.980522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fccef5fd-51e4-4cb1-90a4-522f84f1c4d9 req-40cf6de8-2472-42ca-b3aa-a6e609415869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd968df-41f0-4020-9dbc-24a05a115e0d", "name": "network-vif-plugged", "status": "completed", "tag": "6511e76d-4f71-4bf0-844d-9b2e4e77b018"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:10.019397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fccef5fd-51e4-4cb1-90a4-522f84f1c4d9 req-40cf6de8-2472-42ca-b3aa-a6e609415869 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:10.019884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fccef5fd-51e4-4cb1-90a4-522f84f1c4d9 req-40cf6de8-2472-42ca-b3aa-a6e609415869 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:10.020318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fccef5fd-51e4-4cb1-90a4-522f84f1c4d9 req-40cf6de8-2472-42ca-b3aa-a6e609415869 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:10.080987 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fccef5fd-51e4-4cb1-90a4-522f84f1c4d9 req-40cf6de8-2472-42ca-b3aa-a6e609415869 service nova] Creating event network-vif-plugged:6511e76d-4f71-4bf0-844d-9b2e4e77b018 for instance 9cd968df-41f0-4020-9dbc-24a05a115e0d on n-h2-791135-8 Oct 04 11:09:10.088595 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fccef5fd-51e4-4cb1-90a4-522f84f1c4d9 req-40cf6de8-2472-42ca-b3aa-a6e609415869 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123518 Oct 04 11:09:10.093080 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1146/2322] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:10.104150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8148554f-e003-4128-a41d-dcaceb55dc02 req-9ac2bca0-d8a3-4a18-99b5-c639aaf3e92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e6ec01-e1fa-4fff-b376-721ca1d75b44", "name": "network-vif-deleted", "tag": "a7512ef0-9da7-4b2b-a541-1cd2d1702373"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:10.128186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8148554f-e003-4128-a41d-dcaceb55dc02 req-9ac2bca0-d8a3-4a18-99b5-c639aaf3e92e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:10.132253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8148554f-e003-4128-a41d-dcaceb55dc02 req-9ac2bca0-d8a3-4a18-99b5-c639aaf3e92e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:10.132872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8148554f-e003-4128-a41d-dcaceb55dc02 req-9ac2bca0-d8a3-4a18-99b5-c639aaf3e92e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:10.175524 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8148554f-e003-4128-a41d-dcaceb55dc02 req-9ac2bca0-d8a3-4a18-99b5-c639aaf3e92e service nova] Creating event network-vif-deleted:a7512ef0-9da7-4b2b-a541-1cd2d1702373 for instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 on n-h2-791135-8 Oct 04 11:09:10.186502 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8148554f-e003-4128-a41d-dcaceb55dc02 req-9ac2bca0-d8a3-4a18-99b5-c639aaf3e92e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091481 Oct 04 11:09:10.202386 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1147/2323] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:10.217698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:10.218508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:10.231882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:10.232682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:10.233918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:10.235756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:10.240415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:10.241050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:10.373889 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:09:10.374234 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:09:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 (ip 10.222.0.23) !!! Oct 04 11:09:10.866915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:10.893010 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-59f7bd18-b951-4ed8-8386-02926317897c tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.687733 Oct 04 11:09:10.918097 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1148/2324] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:10 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:10.923327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:10.924113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:10.935555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:10.937955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:10.940194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:10.941734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:10.943629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:10.944237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:11.125176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:11.150916 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-86004eda-8178-409a-b667-69dcb1c35ba4 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1471 microversion: 2.1 time: 1.217335 Oct 04 11:09:11.155863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1177/2325] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:09 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1471 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:11.175593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:11.180823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:11.202988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:11.205998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:11.207190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:11.208330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:11.210678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:11.211334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:11.973972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:12.012371 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b6b6bf6-c793-4ba1-87f0-519b0e897723 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 200 len: 1322 microversion: 2.1 time: 1.092686 Oct 04 11:09:12.013218 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1149/2326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:10 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 1322 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:12.036127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:12.037018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:12.043768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:12.044532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:12.045128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:12.046014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:12.046612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:12.047188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:12.126708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:12.150083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba30cb23-2a0b-4905-86ed-887c237f73ca tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.991239 Oct 04 11:09:12.153200 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1178/2327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:11 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:12.164729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:12.179153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:12.195302 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1a962cc-013c-4be8-addc-29fbd83adc33 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1266 microversion: 2.1 time: 0.166282 Oct 04 11:09:12.200967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:12.203958 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1150/2328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:12 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:12.220431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:12.221230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:12.222010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:12.222618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:12.223616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:12.224031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:12.224626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:12.229853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:12.251360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:12.252393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:12.252990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:12.253908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:12.254520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:12.255104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:12.997272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:13.008781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6bfbe12-f50b-4683-ba0e-b1c11c8ab6b3 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.854260 Oct 04 11:09:13.019968 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1179/2329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:12 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:13.028246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ca5da93b-00c3-4ff3-ae2c-d90ae4c1f694 req-f4d36420-c121-49f3-8349-939e96f5fd64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba683a7-7aed-41c9-b80a-f8df12270432", "tag": "f556fc7e-2ee2-40f4-89ff-37534b21acce"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:13.064073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ca5da93b-00c3-4ff3-ae2c-d90ae4c1f694 req-f4d36420-c121-49f3-8349-939e96f5fd64 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:13.066682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ca5da93b-00c3-4ff3-ae2c-d90ae4c1f694 req-f4d36420-c121-49f3-8349-939e96f5fd64 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:13.069705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ca5da93b-00c3-4ff3-ae2c-d90ae4c1f694 req-f4d36420-c121-49f3-8349-939e96f5fd64 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:13.112246 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ca5da93b-00c3-4ff3-ae2c-d90ae4c1f694 req-f4d36420-c121-49f3-8349-939e96f5fd64 service nova] Creating event network-changed:f556fc7e-2ee2-40f4-89ff-37534b21acce for instance 3ba683a7-7aed-41c9-b80a-f8df12270432 on n-h2-791135-8 Oct 04 11:09:13.135231 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ca5da93b-00c3-4ff3-ae2c-d90ae4c1f694 req-f4d36420-c121-49f3-8349-939e96f5fd64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113677 Oct 04 11:09:13.136273 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1180/2330] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:13.151696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-003048a7-dc66-427b-a437-2a5541115e21 req-05124e14-32c1-4de5-bfb7-20f93b407406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943e3b9f-8717-4bdb-b308-0217b69276c4", "name": "network-vif-deleted", "tag": "6efc52dd-8471-4968-9652-82d9b0da5dce"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:13.188730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-003048a7-dc66-427b-a437-2a5541115e21 req-05124e14-32c1-4de5-bfb7-20f93b407406 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:13.196690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-003048a7-dc66-427b-a437-2a5541115e21 req-05124e14-32c1-4de5-bfb7-20f93b407406 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:13.202019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-003048a7-dc66-427b-a437-2a5541115e21 req-05124e14-32c1-4de5-bfb7-20f93b407406 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:13.271005 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-003048a7-dc66-427b-a437-2a5541115e21 req-05124e14-32c1-4de5-bfb7-20f93b407406 service nova] Creating event network-vif-deleted:6efc52dd-8471-4968-9652-82d9b0da5dce for instance 943e3b9f-8717-4bdb-b308-0217b69276c4 on n-h1-791135-8 Oct 04 11:09:13.299661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-003048a7-dc66-427b-a437-2a5541115e21 req-05124e14-32c1-4de5-bfb7-20f93b407406 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151030 Oct 04 11:09:13.303892 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1181/2331] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:13.336638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:13.338300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:13.347878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:13.370022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:13.373218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:13.373958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:13.375041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:13.377498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:13.380831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.008843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:14.023971 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e6eb9b0-b883-4303-a592-1f1a22fdea0a tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 200 len: 1514 microversion: 2.1 time: 0.716563 Oct 04 11:09:14.024969 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1182/2332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:13 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 1514 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:14.050285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:14.051146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:14.059618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.060485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.061096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.062551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.063246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.063823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.125695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:14.179929 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8d7677a-bf8e-4a4c-9da7-ca3aee2df9d7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 200 len: 1471 microversion: 2.1 time: 1.972076 Oct 04 11:09:14.183911 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1151/2333] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:12 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 1471 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:14.194209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:14.204757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:14.246285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.248844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.249498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.250337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.252357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.252806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.430183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:14.450014 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82b1d8e9-fa57-477c-ad0e-200c4e462ef2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.414741 Oct 04 11:09:14.452259 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1183/2334] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:14 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:14.459991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:14.460907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:14.470290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.471094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.471984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.473553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.474277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.475268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.731475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:14.748661 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b1c26a3-ab11-4c8e-9f21-cb3120b97984 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 0.561779 Oct 04 11:09:14.749959 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1152/2335] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:14 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:14.755395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:14.756240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:14.766679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.767566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.768270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.769729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.770626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.771662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.781509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:14.793752 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a45e8814-848b-4bf7-9cd6-a7b3862ecec7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.337206 Oct 04 11:09:14.801151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:14.806185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1184/2336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:14 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:14.841620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:14.894470 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55c5459d-9d3a-4aa6-8426-8a8f352f4f6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 204 len: 0 microversion: 2.1 time: 0.142942 Oct 04 11:09:14.895471 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1153/2337] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:14 2022] DELETE /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:14.903971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:14.904951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:14.911898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.912715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.913405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:14.914350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:14.915035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:14.915681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.080888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:15.090674 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f544462-029c-4058-a45c-33c9c4f2fbe5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 200 len: 1520 microversion: 2.1 time: 0.190786 Oct 04 11:09:15.091286 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1185/2338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:14 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:15.209140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:15.210537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 943e3b9f-8717-4bdb-b308-0217b69276c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:15.218401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.219016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.219635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.220715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.221272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.222025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.246528 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] HTTP exception thrown: Instance 943e3b9f-8717-4bdb-b308-0217b69276c4 could not be found. Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Request method failure captured: Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 HTTP/1.1 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBOE7i53fZwQDTjfY9ZSyTRKb_ULWkjhExJkrx8N3__n_riOZD5HMnT56o7Xj5qnqcGrvnO-1ecShxCljMm6yp6Ld5crD6aqCTHWnOG7-BD4-9t604gGVS5q4-1jaaz-6gxHJ99A7AMUjglx25aB9BeQgXmiJGHgIbT2hL94ng6WLGE Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf100271e41c4475835267bcaf15c0b3"}]}] Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 5797d5cb0e13468585a42a3e909c1165 Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 943e3b9f-8717-4bdb-b308-0217b69276c4 could not be found. Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '943e3b9f-8717-4bdb-b308-0217b69276c4'} Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943e3b9f-8717-4bdb-b308-0217b69276c4 could not be found. Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943e3b9f-8717-4bdb-b308-0217b69276c4 could not be found. Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:15.248663 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:15.252722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:15.252722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:15.252722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:15.252722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:15.252722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:15.252722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943e3b9f-8717-4bdb-b308-0217b69276c4 could not be found. Oct 04 11:09:15.252722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:15.255112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Returning 404 to user: Instance 943e3b9f-8717-4bdb-b308-0217b69276c4 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:15.256212 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb102d19-754f-4404-9b08-7cef9a8a4355 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4" status: 404 len: 111 microversion: 2.1 time: 0.051844 Oct 04 11:09:15.257304 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1154/2339] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:15 2022] GET /compute/v2.1/servers/943e3b9f-8717-4bdb-b308-0217b69276c4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:15.267133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:15.267383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:15.274126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.274817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.275258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.276117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.277129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.277775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.310717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:15.417550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-203cf0fa-99e6-4a87-9e20-70dc2f678f3b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 204 len: 0 microversion: 2.1 time: 0.154691 Oct 04 11:09:15.428089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:15.428975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:15.435702 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1186/2340] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:15 2022] DELETE /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:15.439804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.440546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.441278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.443193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.444188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.444767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.476549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:15.477270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:15.489828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.490343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.490769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.491491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.491956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.492385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.497996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:15.688716 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a04ff52-53c2-4e7a-8d04-16218e5f0e88 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 204 len: 0 microversion: 2.1 time: 0.264309 Oct 04 11:09:15.693316 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1155/2341] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:15 2022] DELETE /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:15.707963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:15.710586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:15.724307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.728114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.728667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.734005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:15.735745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:15.736891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:15.983754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:15.994826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18f85304-486b-49db-8a49-de5e9818fb3c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.523071 Oct 04 11:09:16.001718 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1187/2342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:15 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:16.014044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:16.015341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:16.034525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.035376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.036065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.037037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.038533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.040725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.139950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:16.149556 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b08905e3-f11d-4c06-93f1-8c53ed46f8f2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1475 microversion: 2.1 time: 0.454787 Oct 04 11:09:16.152476 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1156/2343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:15 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1475 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:16.164950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:16.169550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:16.183555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.184200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.184762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.185612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.186170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.186701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.410032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:16.418687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a1ece0d-5372-4b4f-ab06-41d494ec8a6c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 0.415290 Oct 04 11:09:16.435410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1188/2344] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:16 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:16.441800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:16.443102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:16.449647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.450358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.450956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.452050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.452683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.453271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.477868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:16.505381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:16.516746 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-41e98daf-1572-4f60-af53-f2dc13be12c1 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.361813 Oct 04 11:09:16.574595 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1157/2345] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:16 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:16.580437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9dcedf7a-322b-4377-a953-d202e3fc794c req-d76d8933-eecc-4c0c-a3ee-9b378e16ff55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964982db-00fc-459f-ab6f-c1dab81e9c49", "tag": "b59d1369-05c7-4f30-a1b1-2f6d74013825"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:16.597967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9dcedf7a-322b-4377-a953-d202e3fc794c req-d76d8933-eecc-4c0c-a3ee-9b378e16ff55 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.598641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9dcedf7a-322b-4377-a953-d202e3fc794c req-d76d8933-eecc-4c0c-a3ee-9b378e16ff55 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.599236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9dcedf7a-322b-4377-a953-d202e3fc794c req-d76d8933-eecc-4c0c-a3ee-9b378e16ff55 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.613702 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9dcedf7a-322b-4377-a953-d202e3fc794c req-d76d8933-eecc-4c0c-a3ee-9b378e16ff55 service nova] Creating event network-changed:b59d1369-05c7-4f30-a1b1-2f6d74013825 for instance 964982db-00fc-459f-ab6f-c1dab81e9c49 on n-h1-791135-8 Oct 04 11:09:16.619507 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9dcedf7a-322b-4377-a953-d202e3fc794c req-d76d8933-eecc-4c0c-a3ee-9b378e16ff55 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042696 Oct 04 11:09:16.620811 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1158/2346] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:16.691741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:16.795260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:16.810247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf4a4e36-155d-4441-b4a4-dded9f0451a2 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 200 len: 1520 microversion: 2.1 time: 0.373416 Oct 04 11:09:16.813698 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1189/2347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:16 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:16.898409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:16.899199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:16.909517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.914782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.915354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.916057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:16.916524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:16.917006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:16.973954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:17.030827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:17.031458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:17.045052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:17.045805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:17.046217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:17.047823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:17.048318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:17.051247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:17.130648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:17.140960 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63e430d9-dc09-4b27-9df5-a586848a52a2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 204 len: 0 microversion: 2.42 time: 0.518320 Oct 04 11:09:17.144952 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1159/2348] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:09:16 2022] DELETE /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:09:17.154996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:17.155835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:17.179522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:17.180117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:17.180588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:17.181428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:17.182600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:17.183044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:17.688318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=16 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:18.015422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:18.026554 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9c971ccf-ab80-44c9-942b-9631af058728 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 1.000755 Oct 04 11:09:18.027435 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1190/2349] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:17 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:18.034030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:18.038172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:18.054990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:18.055495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:18.055934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:18.062232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:18.062713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:18.063160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:18.281367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:18.293446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:18.313597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:18.323940 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc2e2c4f-1069-4592-bc3a-418a85a99cfd tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2954 microversion: 2.42 time: 1.175502 Oct 04 11:09:18.324614 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1160/2350] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:17 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2954 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:18.340520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:18.341939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:18.365101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:18.365961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:18.371687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:18.372625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:18.373247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:18.373853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:18.715314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:18.725183 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02d46e11-3db0-46da-a6a8-0d508ff616ec tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1475 microversion: 2.1 time: 0.696504 Oct 04 11:09:18.731648 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1191/2351] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:18 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1475 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:18.736750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:18.740644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:18.759731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:18.761493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:18.764490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:18.766664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:18.767369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:18.769012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:18.856854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:18.870975 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-824e3f06-5935-44a4-8a4f-705d058745e0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 0.542292 Oct 04 11:09:18.872322 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1161/2352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:18 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:18.884306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:18.886675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:18.897974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:18.898944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:18.904526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:18.925378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:18.926331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:18.927020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:19.101222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:19.109663 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f50a4d9-f1db-4088-ad8f-8b6c1a116ad2 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.376510 Oct 04 11:09:19.114244 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1192/2353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:18 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:19.139858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-49606e13-f151-4c8e-a5e8-e5894f59b9b6 req-2ec381fc-4495-49d8-8a33-643d83e266ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "name": "network-vif-plugged", "status": "completed", "tag": "8fa1cf3a-8d18-4fd1-8b16-d8aefe548c59"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:19.150852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-49606e13-f151-4c8e-a5e8-e5894f59b9b6 req-2ec381fc-4495-49d8-8a33-643d83e266ce service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:19.151604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-49606e13-f151-4c8e-a5e8-e5894f59b9b6 req-2ec381fc-4495-49d8-8a33-643d83e266ce service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:19.152183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-49606e13-f151-4c8e-a5e8-e5894f59b9b6 req-2ec381fc-4495-49d8-8a33-643d83e266ce service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:19.167620 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-49606e13-f151-4c8e-a5e8-e5894f59b9b6 req-2ec381fc-4495-49d8-8a33-643d83e266ce service nova] Creating event network-vif-plugged:8fa1cf3a-8d18-4fd1-8b16-d8aefe548c59 for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:09:19.194513 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-49606e13-f151-4c8e-a5e8-e5894f59b9b6 req-2ec381fc-4495-49d8-8a33-643d83e266ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061183 Oct 04 11:09:19.195693 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1193/2354] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:19.201179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:19.202236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:19.208981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:19.209859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:19.210861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:19.211820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:19.212983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:19.214003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:19.471494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:19.506869 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c52f9ab-fecf-4125-bb8a-eb74a7fde28b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 200 len: 1520 microversion: 2.1 time: 0.633113 Oct 04 11:09:19.509903 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1162/2355] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:18 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 1520 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:19.557966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:19.559074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:19.581684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:19.582509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:19.583157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:19.584088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:19.584756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:19.585416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.029384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:20.045655 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a11cb1e6-73b2-4b54-a88f-05d1537baf71 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.848382 Oct 04 11:09:20.046616 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1194/2356] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:19 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:20.053840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e73819bd-ff72-4897-aa5d-811cccc22f0c req-362ad726-2835-40a9-b07a-fb6fbed99522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9107e30c-58de-43b5-bf5a-3f3e743f3fc0", "name": "network-vif-deleted", "tag": "2e75d9ba-415e-49cf-b66c-3e6871b78f5d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:20.072730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e73819bd-ff72-4897-aa5d-811cccc22f0c req-362ad726-2835-40a9-b07a-fb6fbed99522 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.078250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e73819bd-ff72-4897-aa5d-811cccc22f0c req-362ad726-2835-40a9-b07a-fb6fbed99522 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.081486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e73819bd-ff72-4897-aa5d-811cccc22f0c req-362ad726-2835-40a9-b07a-fb6fbed99522 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.106539 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e73819bd-ff72-4897-aa5d-811cccc22f0c req-362ad726-2835-40a9-b07a-fb6fbed99522 service nova] Creating event network-vif-deleted:2e75d9ba-415e-49cf-b66c-3e6871b78f5d for instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 on n-h1-791135-8 Oct 04 11:09:20.122068 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e73819bd-ff72-4897-aa5d-811cccc22f0c req-362ad726-2835-40a9-b07a-fb6fbed99522 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074119 Oct 04 11:09:20.122688 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1195/2357] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:20.136408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:20.140177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:20.152141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.152709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.153151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.153832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.154296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.155199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.178127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:20.194991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:20.199008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:20.201700 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdd895bb-e51a-4cec-ab30-0dc0a016703d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2954 microversion: 2.42 time: 0.668718 Oct 04 11:09:20.202927 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1163/2358] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:19 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2954 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:20.209225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:20.210108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:20.219263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.220362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.223842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.225563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.226311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.226759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.485518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:20.502237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3bd03900-c26b-4877-8ad0-703ac9d7994d tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1475 microversion: 2.1 time: 0.373687 Oct 04 11:09:20.518463 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1196/2359] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:20 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1475 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:20.524701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:20.525328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:20.532033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.534407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.534859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.535646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.536051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.536482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.556986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:20.570894 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-234d87fe-da6d-4e5c-b6e7-94c23b3dfe91 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 0.366831 Oct 04 11:09:20.571681 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1164/2360] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:20 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:20.576716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:20.577549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:20.584398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.585170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.585788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.586659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:20.587335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:20.587906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:20.937877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:20.958437 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70304929-f03d-4efc-94bb-c3dc4221656e tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.429083 Oct 04 11:09:20.959410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1197/2361] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:20 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:20.970291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:20.980972 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-05218db5-ce01-42d0-a7e2-152b6f0c35fe tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 200 len: 1520 microversion: 2.1 time: 0.407861 Oct 04 11:09:20.981938 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1165/2362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:20 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:21.069224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:21.069884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:21.080639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.081146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.081620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.082341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.104956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.107693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.236465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:21.238871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:21.288147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.293294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.294529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.298706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.300777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.301655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.543526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:21.567620 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2c8183f-a163-4785-90a8-4168b73c5127 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.502313 Oct 04 11:09:21.568369 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1198/2363] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:21 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:21.573479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-88bc7a0e-bc8d-49dc-b9da-7d7405f3ffcd req-a13f7f5b-b939-4c20-8e8b-6887516e2ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "name": "network-vif-plugged", "status": "completed", "tag": "a3840260-c4ac-408c-810b-ecfd0314c7bb"}, {"server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "name": "network-vif-plugged", "status": "completed", "tag": "9a2f3c79-5f7e-427d-9171-461f24336e57"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:21.584868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88bc7a0e-bc8d-49dc-b9da-7d7405f3ffcd req-a13f7f5b-b939-4c20-8e8b-6887516e2ec8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.585758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88bc7a0e-bc8d-49dc-b9da-7d7405f3ffcd req-a13f7f5b-b939-4c20-8e8b-6887516e2ec8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.586403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88bc7a0e-bc8d-49dc-b9da-7d7405f3ffcd req-a13f7f5b-b939-4c20-8e8b-6887516e2ec8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.599169 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-88bc7a0e-bc8d-49dc-b9da-7d7405f3ffcd req-a13f7f5b-b939-4c20-8e8b-6887516e2ec8 service nova] Creating event network-vif-plugged:a3840260-c4ac-408c-810b-ecfd0314c7bb for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:09:21.599819 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-88bc7a0e-bc8d-49dc-b9da-7d7405f3ffcd req-a13f7f5b-b939-4c20-8e8b-6887516e2ec8 service nova] Creating event network-vif-plugged:9a2f3c79-5f7e-427d-9171-461f24336e57 for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:09:21.607025 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-88bc7a0e-bc8d-49dc-b9da-7d7405f3ffcd req-a13f7f5b-b939-4c20-8e8b-6887516e2ec8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037238 Oct 04 11:09:21.608289 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1199/2364] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:21.614860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:21.615648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:21.622121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.622819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.623437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.624213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.624614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.625041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.703735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:21.739999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:21.749185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:21.750758 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c821152f-004a-410d-992c-db14896491b2 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2954 microversion: 2.42 time: 0.520236 Oct 04 11:09:21.751341 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1166/2365] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:21 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2954 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:21.762027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:21.762849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:21.785799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.787070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.787681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.789189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.791940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.792375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.898207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:21.911875 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-79f949b3-b91e-4a3f-9717-3b88ef2e0316 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1475 microversion: 2.1 time: 0.302082 Oct 04 11:09:21.913035 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1200/2366] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:21 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1475 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:21.982783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:21.983315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:21.995833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:21.996330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:21.996887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:21.997654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:22.003195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:22.003782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:22.423812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:22.427872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:22.447746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:22.452000 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-94972a06-3942-428f-a33c-348229b082ad tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 0.698456 Oct 04 11:09:22.452616 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1167/2367] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:21 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:22.457761 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b2a07601-20c1-4c60-8a63-d5f64cdfcbb7 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.479183 Oct 04 11:09:22.461032 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1201/2368] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:21 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:22.466723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:22.467331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:22.486238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:22.487724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:22.488338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:22.489042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:22.489518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:22.490012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:22.599583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:22.608449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:22.625385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:22.625983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:22.627863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:22.631046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:22.631544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:22.631986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:23.084474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:23.093440 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-954c8782-ffa3-4672-8424-bbddae6d0683 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 200 len: 1520 microversion: 2.1 time: 0.639674 Oct 04 11:09:23.119467 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1168/2369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:22 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 1520 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:23.136546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:23.137309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:23.150294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:23.150852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:23.151848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:23.152497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:23.152951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:23.153392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:23.215517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:23.228498 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-42c9980a-ec7c-464c-b768-86fee84d57d2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1354 microversion: 2.1 time: 0.629574 Oct 04 11:09:23.230936 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1202/2370] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:22 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1354 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:23.244119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:23.245538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:23.269982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:23.272955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:23.276993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:23.279373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:23.280018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:23.281476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:24.092286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:24.102905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:24.116272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:24.117866 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e6623de-1131-4b2d-9e02-6aa513ac25bc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2954 microversion: 2.42 time: 0.997069 Oct 04 11:09:24.129549 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1169/2371] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:23 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2954 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:24.140755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:24.141388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:24.158574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:24.160411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:24.166425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:24.167646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:24.168148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:24.168593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:24.299041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:24.317297 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-48a0af72-805f-4dcc-87a3-c110f43e757b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1475 microversion: 2.1 time: 1.083199 Oct 04 11:09:24.318407 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1203/2372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:23 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1475 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:24.323898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:24.324686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:24.333076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:24.333630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:24.334068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:24.335087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:24.335689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:24.336594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:25.446268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:25.464235 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-79a38fa1-7b4f-4b56-9de6-186ba70b61fa tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 1.142704 Oct 04 11:09:25.475359 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1204/2373] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:24 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:25.493448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:25.495563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:25.496385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:25.505844 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c22113fe-f9d0-4fa6-a548-55bbb4fcf88b tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 1.368697 Oct 04 11:09:25.514572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:25.519923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:25.522632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:25.524672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:25.526233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:25.527685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:25.532088 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1170/2374] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:24 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:25.544948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:25.547628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:25.563732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:25.568728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:25.570693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:25.574203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:25.578016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:25.578545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:25.981087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:26.009231 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a8d68fb-2768-429f-9fa6-ab3ebdfe0164 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 200 len: 1478 microversion: 2.1 time: 0.529962 Oct 04 11:09:26.024490 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1205/2375] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:25 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 1478 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:26.030528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:26.031160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:26.050288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:26.052494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:26.052947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:26.055862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:26.057810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:26.058455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:26.507826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:26.519494 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-678008da-e775-4bf3-afc6-f0d75c6ce62b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1803 microversion: 2.1 time: 0.983977 Oct 04 11:09:26.521154 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1171/2376] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:25 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1803 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:26.538453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:26.539671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:26.562978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:26.565986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:26.568014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:26.576964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:26.577841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:26.579423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:26.708714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:26.723974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:26.725661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:26.726985 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9dffd7ec-4758-4861-be88-d8a2ec3009aa tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2954 microversion: 2.42 time: 0.714561 Oct 04 11:09:26.750798 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1206/2377] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:26 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2954 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:26.871530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:26.886226 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4787ef9b-f8fa-42c1-8800-b6a00ea8a7c7 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 200 len: 1433 microversion: 2.1 time: 0.359748 Oct 04 11:09:26.890152 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1172/2378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:26 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 1433 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:26.914086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:26.915041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:26.959268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:26.960223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:26.961169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:26.963077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:26.968572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:26.969514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:26.970449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-69f5f3d8-0815-4b3d-baf9-be5d682b3e11 req-b7537ad9-7034-42fd-b26b-f3b01a193786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd968df-41f0-4020-9dbc-24a05a115e0d", "name": "network-vif-deleted", "tag": "6511e76d-4f71-4bf0-844d-9b2e4e77b018"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:27.001026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-69f5f3d8-0815-4b3d-baf9-be5d682b3e11 req-b7537ad9-7034-42fd-b26b-f3b01a193786 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.002259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-69f5f3d8-0815-4b3d-baf9-be5d682b3e11 req-b7537ad9-7034-42fd-b26b-f3b01a193786 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.004210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-69f5f3d8-0815-4b3d-baf9-be5d682b3e11 req-b7537ad9-7034-42fd-b26b-f3b01a193786 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.047039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-69f5f3d8-0815-4b3d-baf9-be5d682b3e11 req-b7537ad9-7034-42fd-b26b-f3b01a193786 service nova] Creating event network-vif-deleted:6511e76d-4f71-4bf0-844d-9b2e4e77b018 for instance 9cd968df-41f0-4020-9dbc-24a05a115e0d on n-h2-791135-8 Oct 04 11:09:27.067419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-69f5f3d8-0815-4b3d-baf9-be5d682b3e11 req-b7537ad9-7034-42fd-b26b-f3b01a193786 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314965 Oct 04 11:09:27.071567 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1207/2379] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:27.090347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:27.093695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:27.112254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.116823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.117696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.118659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.119846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.122179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.175102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7de19e20-dec5-46e8-98eb-bf74c53b3f05 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4/ips" status: 200 len: 217 microversion: 2.1 time: 0.100541 Oct 04 11:09:27.175993 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1208/2380] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:09:27 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4/ips => generated 217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:27.187230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:27.196361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:27.223105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.223542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.223993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.233547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.234084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.239359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.254943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:27.566776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:27.576619 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b2ace4c6-6265-4321-ab8f-3b006e9c7ddc tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.683969 Oct 04 11:09:27.598436 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1173/2381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:26 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:27.610762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a0e2b090-1003-4a11-807e-3b41f4d93878 req-0fac2bec-3c8b-4811-be8c-9971577442b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1", "name": "network-vif-deleted", "tag": "a97662ae-143c-430d-9d8c-c9b832315fed"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:27.638923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0e2b090-1003-4a11-807e-3b41f4d93878 req-0fac2bec-3c8b-4811-be8c-9971577442b7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.639854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0e2b090-1003-4a11-807e-3b41f4d93878 req-0fac2bec-3c8b-4811-be8c-9971577442b7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.640627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0e2b090-1003-4a11-807e-3b41f4d93878 req-0fac2bec-3c8b-4811-be8c-9971577442b7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.663616 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a0e2b090-1003-4a11-807e-3b41f4d93878 req-0fac2bec-3c8b-4811-be8c-9971577442b7 service nova] Creating event network-vif-deleted:a97662ae-143c-430d-9d8c-c9b832315fed for instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 on n-h2-791135-8 Oct 04 11:09:27.673808 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a0e2b090-1003-4a11-807e-3b41f4d93878 req-0fac2bec-3c8b-4811-be8c-9971577442b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073673 Oct 04 11:09:27.677381 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1174/2382] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:27.693793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:27.698570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:27.716486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.717329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.717992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.718911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.719560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.720251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.761190 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] HTTP exception thrown: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Request method failure captured: Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d HTTP/1.1 Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBQv6MIIjfmnmH8G6lS6H8uA7kJPc8BHuHqwfu7nKtLdIwPxNdy1DjTC8av9GUPiRUNDErvU5qOWwZ43B6s-yxrgcaqk-Or83plzy6jpwZLhqIx9ob-CY5YAjfJPxw7UKnnMiCymyJmxNzr9xqDgKT8glul2TPJUGo-GLB9l_XtRBXM Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca8d711757c0420fa87cd982e622f04d"}]}] Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: baed8d21db4f4df8b561a99ab3e8645e Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '9cd968df-41f0-4020-9dbc-24a05a115e0d'} Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:27.774437 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Returning 404 to user: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfc5d405-eb2d-4ab2-b620-012eac866a9c tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 404 len: 111 microversion: 2.1 time: 0.097176 Oct 04 11:09:27.778702 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1175/2383] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:27 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:27.785103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:27.786423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:27.806232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.807556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.808098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.810229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.810830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.814787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.873314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:27.928876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:27.940310 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbc6cf90-69ea-4b7a-aecb-e213d0e68ea8 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 0.759452 Oct 04 11:09:27.943167 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1209/2384] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:27 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:27.951236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:27.952263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:27.969457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.970833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.971551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:27.972554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:27.973127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:27.974136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.064629 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b2cdd21b-8161-434e-8af2-9bc29a8fadee tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 204 len: 0 microversion: 2.1 time: 0.284053 Oct 04 11:09:28.068617 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1176/2385] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:27 2022] DELETE /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:28.074205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:28.090669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:28.091900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:09:28.107800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.108290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.108722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.109490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.109949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.110379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.277577 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d580484a-26f9-4bdb-8ec8-a0fa5519b936 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.207469 Oct 04 11:09:28.278490 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1177/2386] 10.222.0.23 () {58 vars in 1230 bytes} [Tue Oct 4 11:09:28 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:09:28.283109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:28.285153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:28.306438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.307537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.308063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.308792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.309250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.309704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.336395 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] HTTP exception thrown: Instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 could not be found. Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Request method failure captured: Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 HTTP/1.1 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBOE7i53fZwQDTjfY9ZSyTRKb_ULWkjhExJkrx8N3__n_riOZD5HMnT56o7Xj5qnqcGrvnO-1ecShxCljMm6yp6Ld5crD6aqCTHWnOG7-BD4-9t604gGVS5q4-1jaaz-6gxHJ99A7AMUjglx25aB9BeQgXmiJGHgIbT2hL94ng6WLGE Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf100271e41c4475835267bcaf15c0b3"}]}] Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 5797d5cb0e13468585a42a3e909c1165 Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 could not be found. Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1'} Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 could not be found. Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 could not be found. Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:28.338187 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 could not be found. Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Returning 404 to user: Instance e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:28.341699 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-54cd7028-49ce-4a9b-a80c-d6d3386a7046 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1" status: 404 len: 111 microversion: 2.1 time: 0.060093 Oct 04 11:09:28.342896 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1178/2387] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:28 2022] GET /compute/v2.1/servers/e5908dcb-4fc2-4780-93b5-c7d8d9c34ea1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:28.351512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:28.352127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:28.371404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.371903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.372343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.373061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.373546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.373974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.437525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:28.464872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:28.475521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:28.477116 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8c00ece-c71a-413c-8d9a-4475b716c845 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2933 microversion: 2.42 time: 0.532494 Oct 04 11:09:28.511735 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1210/2388] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:27 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2933 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:28.519347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-198674b7-6b65-4100-96a3-5993edc9ce6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-198674b7-6b65-4100-96a3-5993edc9ce6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Request method failure captured: Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQv6MIIjfmnmH8G6lS6H8uA7kJPc8BHuHqwfu7nKtLdIwPxNdy1DjTC8av9GUPiRUNDErvU5qOWwZ43B6s-yxrgcaqk-Or83plzy6jpwZLhqIx9ob-CY5YAjfJPxw7UKnnMiCymyJmxNzr9xqDgKT8glul2TPJUGo-GLB9l_XtRBXM Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca8d711757c0420fa87cd982e622f04d"}]}] Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: baed8d21db4f4df8b561a99ab3e8645e Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: action_args: {} Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 11:09:28.537146 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 11:09:28.542326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.555954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-198674b7-6b65-4100-96a3-5993edc9ce6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:28.558095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-198674b7-6b65-4100-96a3-5993edc9ce6e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.042777 Oct 04 11:09:28.566287 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1211/2389] 10.222.0.23 () {58 vars in 1182 bytes} [Tue Oct 4 11:09:28 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:09:28.574420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ce737e43-7206-4882-9402-44f97272aec5 req-0e8e89fe-d741-47ec-a69e-d334e8cdc71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964982db-00fc-459f-ab6f-c1dab81e9c49", "name": "network-vif-plugged", "status": "completed", "tag": "b59d1369-05c7-4f30-a1b1-2f6d74013825"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:28.593570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ce737e43-7206-4882-9402-44f97272aec5 req-0e8e89fe-d741-47ec-a69e-d334e8cdc71a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.594365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ce737e43-7206-4882-9402-44f97272aec5 req-0e8e89fe-d741-47ec-a69e-d334e8cdc71a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.595026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ce737e43-7206-4882-9402-44f97272aec5 req-0e8e89fe-d741-47ec-a69e-d334e8cdc71a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.609804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ce737e43-7206-4882-9402-44f97272aec5 req-0e8e89fe-d741-47ec-a69e-d334e8cdc71a service nova] Creating event network-vif-plugged:b59d1369-05c7-4f30-a1b1-2f6d74013825 for instance 964982db-00fc-459f-ab6f-c1dab81e9c49 on n-h1-791135-8 Oct 04 11:09:28.615698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ce737e43-7206-4882-9402-44f97272aec5 req-0e8e89fe-d741-47ec-a69e-d334e8cdc71a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047918 Oct 04 11:09:28.616752 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1212/2390] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:28.623010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:28.624021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 9107e30c-58de-43b5-bf5a-3f3e743f3fc0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:28.632002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.632804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.633637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.634591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.635147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.635789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.652734 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] HTTP exception thrown: Instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 could not be found. Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Request method failure captured: Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 HTTP/1.1 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBOE7i53fZwQDTjfY9ZSyTRKb_ULWkjhExJkrx8N3__n_riOZD5HMnT56o7Xj5qnqcGrvnO-1ecShxCljMm6yp6Ld5crD6aqCTHWnOG7-BD4-9t604gGVS5q4-1jaaz-6gxHJ99A7AMUjglx25aB9BeQgXmiJGHgIbT2hL94ng6WLGE Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf100271e41c4475835267bcaf15c0b3"}]}] Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5797d5cb0e13468585a42a3e909c1165 Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 could not be found. Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '9107e30c-58de-43b5-bf5a-3f3e743f3fc0'} Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 could not be found. Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 could not be found. Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:28.654895 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.658487 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:28.658487 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:28.658487 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:28.658487 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:28.658487 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:28.658487 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 could not be found. Oct 04 11:09:28.658487 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:28.661093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Returning 404 to user: Instance 9107e30c-58de-43b5-bf5a-3f3e743f3fc0 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:28.662560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b05a6bcf-edcf-45a5-b6a5-a3fc08f2f81e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0" status: 404 len: 111 microversion: 2.1 time: 0.044333 Oct 04 11:09:28.667340 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1213/2391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:28 2022] GET /compute/v2.1/servers/9107e30c-58de-43b5-bf5a-3f3e743f3fc0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:28.673021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:28.679353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:28.681329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'deleted': False, 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:09:28.687618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.688350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.688966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.689907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.691321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.691705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.812678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:09:28.875940 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-917f9c3c-e4b3-4305-b7e2-652394b396ad tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.207105 Oct 04 11:09:28.884676 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1214/2392] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:09:28 2022] GET /compute/v2.1/servers => generated 681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:28.894737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:28.895464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:28.902230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.903303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.903740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.904458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:28.904916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:28.905604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:28.960966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:28.981102 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5bd57b12-27ff-4160-b171-36be7c4e1e07 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1809 microversion: 2.1 time: 0.637326 Oct 04 11:09:28.983096 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1179/2393] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:28 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1809 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:28.989676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96cfaf9d-df75-4caa-9aaf-6b18215e00c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:29.044829 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-96cfaf9d-df75-4caa-9aaf-6b18215e00c2 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/7b849dec-e686-4153-a150-b266f4a927ab" status: 204 len: 0 microversion: 2.1 time: 0.060305 Oct 04 11:09:29.046094 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1180/2394] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:09:28 2022] DELETE /compute/v2.1/os-server-groups/7b849dec-e686-4153-a150-b266f4a927ab => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:29.056848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:29.063049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:29.064332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.compute.servers [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Removing options 'limit' from query {{(pid=122408) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 11:09:29.066442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'deleted': False, 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:09:29.073522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.075365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.075985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.077157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.077838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.078728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.117735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.multi_cell_list [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:09:29.162776 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-350686e3-8eb8-4372-a77b-9c4d1907fe70 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.114343 Oct 04 11:09:29.164034 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1181/2395] 10.222.0.23 () {58 vars in 1144 bytes} [Tue Oct 4 11:09:29 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:29.169767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:29.170620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:29.182559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.183266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.184002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.184902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.185573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.186172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.265994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:29.274594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e0b1a57-6b95-4ac6-9df3-d84b2453eb11 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.384427 Oct 04 11:09:29.279400 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1215/2396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:28 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:29.291690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:29.292491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:29.304885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.305637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.310315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.311293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.311914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.312487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.371629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:29.529960 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7e525cd-ff80-4418-a883-d524bb65fd5b tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578" status: 204 len: 0 microversion: 2.1 time: 0.248785 Oct 04 11:09:29.531090 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1216/2397] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:29 2022] DELETE /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:29.536772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18cf2fa7-dca1-4e61-853b-09fe2eb1942f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18cf2fa7-dca1-4e61-853b-09fe2eb1942f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Request method failure captured: Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQv6MIIjfmnmH8G6lS6H8uA7kJPc8BHuHqwfu7nKtLdIwPxNdy1DjTC8av9GUPiRUNDErvU5qOWwZ43B6s-yxrgcaqk-Or83plzy6jpwZLhqIx9ob-CY5YAjfJPxw7UKnnMiCymyJmxNzr9xqDgKT8glul2TPJUGo-GLB9l_XtRBXM Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca8d711757c0420fa87cd982e622f04d"}]}] Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: baed8d21db4f4df8b561a99ab3e8645e Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: action_args: {} Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '-1' Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 11:09:29.545979 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18cf2fa7-dca1-4e61-853b-09fe2eb1942f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:29.550137 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18cf2fa7-dca1-4e61-853b-09fe2eb1942f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.015060 Oct 04 11:09:29.557639 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1217/2398] 10.222.0.23 () {58 vars in 1142 bytes} [Tue Oct 4 11:09:29 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:09:29.567289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:29.568123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:29.583598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.588102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.588706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.589682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.590286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.591385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.748304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:29.779738 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-362007da-e31a-4430-a4c8-e7342dcd4080 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 0.610345 Oct 04 11:09:29.784851 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1182/2399] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:29 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:29.811817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:29.813546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:29.829887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.831370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.832103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.833695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:29.835607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:29.839140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:29.899098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:29.921295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:29.936948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:29.942744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:29.944374 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d2221e93-a01a-435a-a718-86899d3cfcbc tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2912 microversion: 2.42 time: 0.385587 Oct 04 11:09:29.962130 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1218/2400] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:29 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2912 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:29.991695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ef2ec29-a4dd-4aa2-8198-161e21d12660 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ef2ec29-a4dd-4aa2-8198-161e21d12660 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Request method failure captured: Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQv6MIIjfmnmH8G6lS6H8uA7kJPc8BHuHqwfu7nKtLdIwPxNdy1DjTC8av9GUPiRUNDErvU5qOWwZ43B6s-yxrgcaqk-Or83plzy6jpwZLhqIx9ob-CY5YAjfJPxw7UKnnMiCymyJmxNzr9xqDgKT8glul2TPJUGo-GLB9l_XtRBXM Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca8d711757c0420fa87cd982e622f04d"}]}] Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: baed8d21db4f4df8b561a99ab3e8645e Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: action_args: {} Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 11:09:29.996985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 11:09:30.000726 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:30.004165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ef2ec29-a4dd-4aa2-8198-161e21d12660 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:30.005248 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ef2ec29-a4dd-4aa2-8198-161e21d12660 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.041715 Oct 04 11:09:30.010280 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1219/2401] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:09:29 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:09:30.015890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:30.016728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:30.026398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.027153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.027838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.028761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.029462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.030113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.110823 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf061184-9649-429a-8d4f-94fd63c8769a tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 204 len: 0 microversion: 2.1 time: 0.317637 Oct 04 11:09:30.114475 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1183/2402] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:29 2022] DELETE /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:30.122641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9947c903-dc21-40d8-aa92-300e149864d5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:30.136582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9947c903-dc21-40d8-aa92-300e149864d5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:30.141809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9947c903-dc21-40d8-aa92-300e149864d5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:09:30.161217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.compute.servers [None req-9947c903-dc21-40d8-aa92-300e149864d5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Flavor 'non_existing_flavor' could not be found {{(pid=122408) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 11:09:30.165188 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9947c903-dc21-40d8-aa92-300e149864d5 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.052242 Oct 04 11:09:30.175075 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1184/2403] 10.222.0.23 () {58 vars in 1178 bytes} [Tue Oct 4 11:09:30 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:09:30.182562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:30.183674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:30.210347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.212020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.212471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.213755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.214778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.215215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.261396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:30.390872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:30.406027 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73a6b4fd-4687-4a9e-9cf0-2bcd1c6db936 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1809 microversion: 2.1 time: 0.394366 Oct 04 11:09:30.406618 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1220/2404] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:30 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:30.411050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:30.415890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:30.416907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:09:30.432257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.432967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.433635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.434549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.434989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.435405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.527261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:30.530506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-03c548e8-84ff-4ead-9e0d-713db8965837 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.122817 Oct 04 11:09:30.538752 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1221/2405] 10.222.0.23 () {58 vars in 1174 bytes} [Tue Oct 4 11:09:30 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:09:30.543456 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f885ea3a-aaa8-4fc8-8113-223583d4f831 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578" status: 200 len: 1474 microversion: 2.1 time: 0.373155 Oct 04 11:09:30.544076 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1185/2406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:30 2022] GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578 => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:30.544655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:30.552245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:30.554112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:30.568845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:30.569581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.570234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.570355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122408) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:09:30.570943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.571809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.573253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.573923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.584642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.585138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.587109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.587985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.588942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.589393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.855862 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c7a7065-81b9-48b0-9be7-32105385fd07 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.310697 Oct 04 11:09:30.856887 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1186/2407] 10.222.0.23 () {58 vars in 1184 bytes} [Tue Oct 4 11:09:30 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:09:30.865104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-850d40dc-0a67-4734-988b-eb24654f5f6c req-aca0aba7-7213-4260-a1f6-6e4c8464917c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba683a7-7aed-41c9-b80a-f8df12270432", "name": "network-vif-plugged", "status": "completed", "tag": "f556fc7e-2ee2-40f4-89ff-37534b21acce"}, {"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-unplugged", "status": "completed", "tag": "b88d59fb-34d8-4876-b140-ab257f0d6a64"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:30.886715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-850d40dc-0a67-4734-988b-eb24654f5f6c req-aca0aba7-7213-4260-a1f6-6e4c8464917c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.888451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-850d40dc-0a67-4734-988b-eb24654f5f6c req-aca0aba7-7213-4260-a1f6-6e4c8464917c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.888575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-850d40dc-0a67-4734-988b-eb24654f5f6c req-aca0aba7-7213-4260-a1f6-6e4c8464917c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.942332 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-850d40dc-0a67-4734-988b-eb24654f5f6c req-aca0aba7-7213-4260-a1f6-6e4c8464917c service nova] Creating event network-vif-plugged:f556fc7e-2ee2-40f4-89ff-37534b21acce for instance 3ba683a7-7aed-41c9-b80a-f8df12270432 on n-h2-791135-8 Oct 04 11:09:30.943180 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-850d40dc-0a67-4734-988b-eb24654f5f6c req-aca0aba7-7213-4260-a1f6-6e4c8464917c service nova] Creating event network-vif-unplugged:b88d59fb-34d8-4876-b140-ab257f0d6a64 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:30.954179 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-850d40dc-0a67-4734-988b-eb24654f5f6c req-aca0aba7-7213-4260-a1f6-6e4c8464917c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.095477 Oct 04 11:09:30.955113 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1187/2408] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:30.967742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:30.969952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:30.988407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.988999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.989579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:30.990441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:30.990937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:30.993133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:31.051963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:31.070000 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5b5d7fd-4064-46ca-914e-6371d42c3574 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.529771 Oct 04 11:09:31.070994 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1222/2409] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:30 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:31.088962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:31.093966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:31.094712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'deleted': False, 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:09:31.111442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:31.111931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:31.112385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:31.113075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:31.113559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:31.113983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:31.171342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:09:31.246757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:31.270799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:31.271283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:31.271723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:31.607183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:31.618405 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f2694bb-c793-42f7-b819-706bb7f2c9d9 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1308 microversion: 2.1 time: 0.661086 Oct 04 11:09:31.625306 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1188/2410] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:30 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1308 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:31.630931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:31.632099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:31.648496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:31.648991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:31.649459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:31.650185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:31.650686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:31.651114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:31.740489 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ead89d3d-095a-444f-a595-76533dd1cfb8 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.668423 Oct 04 11:09:31.741814 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1223/2411] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:09:31 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:31.758422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:31.759395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:31.767053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:31.773421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:31.774148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:31.775226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:31.778574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:31.781254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:32.783854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:32.795143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:32.807915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:32.809525 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35c1e3b0-9b88-400e-93af-ac4f1a1d4afb tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2912 microversion: 2.42 time: 1.182680 Oct 04 11:09:32.825808 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1189/2412] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:31 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2912 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:32.845658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a21c7965-06b4-486a-b440-479d804f7bc3 req-811df27e-698d-482c-887a-8bed58d67aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "name": "network-vif-deleted", "tag": "8fa1cf3a-8d18-4fd1-8b16-d8aefe548c59"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:32.858869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a21c7965-06b4-486a-b440-479d804f7bc3 req-811df27e-698d-482c-887a-8bed58d67aa5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:32.859291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a21c7965-06b4-486a-b440-479d804f7bc3 req-811df27e-698d-482c-887a-8bed58d67aa5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:32.865320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a21c7965-06b4-486a-b440-479d804f7bc3 req-811df27e-698d-482c-887a-8bed58d67aa5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:32.899863 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a21c7965-06b4-486a-b440-479d804f7bc3 req-811df27e-698d-482c-887a-8bed58d67aa5 service nova] Creating event network-vif-deleted:8fa1cf3a-8d18-4fd1-8b16-d8aefe548c59 for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:09:32.918842 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a21c7965-06b4-486a-b440-479d804f7bc3 req-811df27e-698d-482c-887a-8bed58d67aa5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088509 Oct 04 11:09:32.947061 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1190/2413] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:32.948379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:32.956580 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-20956eb4-13de-4c3b-b8a8-5fcde7b5a839 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1788 microversion: 2.1 time: 1.213290 Oct 04 11:09:32.961535 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1224/2414] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:31 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1788 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:32.971968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35bc395e-7ea5-4c6d-a956-f331ddcb8fe9 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:32.986249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-35bc395e-7ea5-4c6d-a956-f331ddcb8fe9 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:32.988368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35bc395e-7ea5-4c6d-a956-f331ddcb8fe9 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.025641 Oct 04 11:09:32.993628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:32.997262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:33.005663 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1225/2415] 10.222.0.23 () {58 vars in 1178 bytes} [Tue Oct 4 11:09:32 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:09:33.017228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.018082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.018698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.019586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.020227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.020830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.031994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:33.032734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:33.049874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.050692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.051346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.052259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.052911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.053823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.473067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:33.483347 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66c571e0-c6be-4906-8519-f8351978b773 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578" status: 200 len: 1474 microversion: 2.1 time: 0.514988 Oct 04 11:09:33.498558 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1191/2416] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:32 2022] GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578 => generated 1474 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:33.506427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:33.507264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:33.515587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.516311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.517173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.518066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.519383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.520183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.524314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:33.543689 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1de39651-f6d5-4e39-bb21-dabed1cda279 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1316 microversion: 2.1 time: 0.530870 Oct 04 11:09:33.545988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1226/2417] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:33 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1316 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:33.553972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:33.566510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:33.582379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Searching by: {'deleted': False, 'project_id': 'ca8d711757c0420fa87cd982e622f04d'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:09:33.590445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.591438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.592046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.593011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.594025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.594897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.624448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:09:33.657872 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e478914-5721-446e-819e-dba87b3c7fdb tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.110135 Oct 04 11:09:33.658383 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1227/2418] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:09:33 2022] GET /compute/v2.1/servers => generated 681 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:33.663033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3fdd82cc-656d-4819-ae57-cc29d98e55c3 req-cbe90121-61d1-44fd-baf5-334ac1564ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-unplugged", "status": "completed", "tag": "b3a2f117-dbc4-4c90-9ddf-05e06c43e6b6"}, {"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-unplugged", "status": "completed", "tag": "3b9ced07-b4bf-4318-8dc4-527be99dccbd"}, {"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-unplugged", "status": "completed", "tag": "e7349ae7-773f-4e2b-ab5a-79cbcf7c41eb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:33.676789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3fdd82cc-656d-4819-ae57-cc29d98e55c3 req-cbe90121-61d1-44fd-baf5-334ac1564ddd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.678275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3fdd82cc-656d-4819-ae57-cc29d98e55c3 req-cbe90121-61d1-44fd-baf5-334ac1564ddd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.678782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3fdd82cc-656d-4819-ae57-cc29d98e55c3 req-cbe90121-61d1-44fd-baf5-334ac1564ddd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.697883 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3fdd82cc-656d-4819-ae57-cc29d98e55c3 req-cbe90121-61d1-44fd-baf5-334ac1564ddd service nova] Creating event network-vif-unplugged:b3a2f117-dbc4-4c90-9ddf-05e06c43e6b6 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:33.698429 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3fdd82cc-656d-4819-ae57-cc29d98e55c3 req-cbe90121-61d1-44fd-baf5-334ac1564ddd service nova] Creating event network-vif-unplugged:3b9ced07-b4bf-4318-8dc4-527be99dccbd for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:33.698930 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3fdd82cc-656d-4819-ae57-cc29d98e55c3 req-cbe90121-61d1-44fd-baf5-334ac1564ddd service nova] Creating event network-vif-unplugged:e7349ae7-773f-4e2b-ab5a-79cbcf7c41eb for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:33.707322 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3fdd82cc-656d-4819-ae57-cc29d98e55c3 req-cbe90121-61d1-44fd-baf5-334ac1564ddd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.047528 Oct 04 11:09:33.707945 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1228/2419] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:33.717517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4697cf08-1e59-4a70-941f-daf0ca88d747 req-e87a42ce-fe56-4148-8a89-23d999e59196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-deleted", "tag": "5414b7fc-31df-462b-b968-1450587a3ef8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:33.742550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:33.754131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4697cf08-1e59-4a70-941f-daf0ca88d747 req-e87a42ce-fe56-4148-8a89-23d999e59196 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.754900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4697cf08-1e59-4a70-941f-daf0ca88d747 req-e87a42ce-fe56-4148-8a89-23d999e59196 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.755561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4697cf08-1e59-4a70-941f-daf0ca88d747 req-e87a42ce-fe56-4148-8a89-23d999e59196 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.787250 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4697cf08-1e59-4a70-941f-daf0ca88d747 req-e87a42ce-fe56-4148-8a89-23d999e59196 service nova] Creating event network-vif-deleted:5414b7fc-31df-462b-b968-1450587a3ef8 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:33.800110 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4697cf08-1e59-4a70-941f-daf0ca88d747 req-e87a42ce-fe56-4148-8a89-23d999e59196 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089114 Oct 04 11:09:33.803310 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1229/2420] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:33.817505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:33.818461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:33.832086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.834937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.835657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.837022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.841184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.842106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.850462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:33.878978 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] HTTP exception thrown: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Request method failure captured: Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d HTTP/1.1 Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQv6MIIjfmnmH8G6lS6H8uA7kJPc8BHuHqwfu7nKtLdIwPxNdy1DjTC8av9GUPiRUNDErvU5qOWwZ43B6s-yxrgcaqk-Or83plzy6jpwZLhqIx9ob-CY5YAjfJPxw7UKnnMiCymyJmxNzr9xqDgKT8glul2TPJUGo-GLB9l_XtRBXM Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca8d711757c0420fa87cd982e622f04d"}]}] Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: baed8d21db4f4df8b561a99ab3e8645e Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '9cd968df-41f0-4020-9dbc-24a05a115e0d'} Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:33.881265 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:33.885664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:33.889398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Returning 404 to user: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:33.891142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4159b6d1-9229-4127-b7d6-848216f3ee14 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 404 len: 111 microversion: 2.1 time: 0.085913 Oct 04 11:09:33.892244 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1230/2421] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:33 2022] DELETE /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:33.898731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:33.899669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:33.910656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.911412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.912109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.913074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.920469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.921476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.944340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:33.960082 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e49a997f-d09a-4f8a-93f4-873dfb824061 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1488 microversion: 2.1 time: 0.459935 Oct 04 11:09:33.961012 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1192/2422] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:33 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1488 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:33.973294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:33.973699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: aed0de21-1977-4186-9cfd-caae0fd077fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:33.993664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.994747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.995479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:33.996230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:33.996684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:33.999178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.133852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: aed0de21-1977-4186-9cfd-caae0fd077fd] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:34.419945 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8f2dd81-e385-4a42-a655-fe2ae77ec77f tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd" status: 204 len: 0 microversion: 2.1 time: 0.456474 Oct 04 11:09:34.420694 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1193/2423] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:33 2022] DELETE /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:34.435304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:34.436756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:34.450698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.451589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.452245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.466584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.470402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.476815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.581984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:34.595286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:34.599157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:34.603011 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b95aa52-9803-403e-86c2-08f76e5feef7 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2866 microversion: 2.42 time: 0.709499 Oct 04 11:09:34.617958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1231/2424] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:33 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2866 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:34.638725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:34.642560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:34.658210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.659735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.660409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.662849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.665617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.666857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.699736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lazy-loading 'flavor' on Instance uuid 964982db-00fc-459f-ab6f-c1dab81e9c49 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:09:34.725137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:34.737911 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3674ef60-8556-49e6-8317-9b324fa9570f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1568 microversion: 2.1 time: 0.310273 Oct 04 11:09:34.741872 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1194/2425] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:34 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1568 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:34.753289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:34.760856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:34.770779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.774699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.776805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.777713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.780508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.781035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.836920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:34.866832 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe493a6e-61a1-48ee-8a0a-2e5ce130b4a5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49/action" status: 202 len: 0 microversion: 2.1 time: 0.243447 Oct 04 11:09:34.876713 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1232/2426] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:09:34 2022] POST /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:09:34.897778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:34.898531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:34.906155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.907204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.908145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.909016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.909682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.910305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.972599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:34.973234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:34.973703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:34.974152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lazy-loading 'fault' on Instance uuid 95bfd7f2-1c04-4198-8e68-d74b326d8578 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:09:34.983977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:35.012395 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7314dee-5ed1-4b93-bf61-ae9c6c926ed3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 204 len: 0 microversion: 2.1 time: 0.268663 Oct 04 11:09:35.013622 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1195/2427] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:34 2022] DELETE /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:35.021192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:35.022148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:35.029820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.030772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.031354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.032216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.033007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.033910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.204820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:35.225788 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35c276fb-eb4e-4323-a822-cb436488250c tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578" status: 200 len: 1308 microversion: 2.1 time: 0.343146 Oct 04 11:09:35.226742 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1233/2428] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:34 2022] GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578 => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:35.239710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:35.243008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:35.265598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.266845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.267460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.272087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.272847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.273702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.659380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:35.671767 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2acfcd7-c441-4fb5-aaea-d46f3c0ff242 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1504 microversion: 2.1 time: 0.656472 Oct 04 11:09:35.672740 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1196/2429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:35 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:35.678361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "name": "network-vif-deleted", "tag": "9a2f3c79-5f7e-427d-9171-461f24336e57"}, {"server_uuid": "95bfd7f2-1c04-4198-8e68-d74b326d8578", "name": "network-vif-deleted", "tag": "81990cc3-a4e2-461a-a98a-cf92fd8bbaaf"}, {"server_uuid": "a8bd608a-e699-4be9-a701-121633db69c4", "name": "network-vif-deleted", "tag": "a3840260-c4ac-408c-810b-ecfd0314c7bb"}, {"server_uuid": "2f41f528-5f20-4e31-a726-104bb7620bf6", "name": "network-vif-deleted", "tag": "558bbb9f-7c34-4bb2-8e38-805a0c4df9cd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:35.693975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.694738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.695366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.715025 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] Creating event network-vif-deleted:9a2f3c79-5f7e-427d-9171-461f24336e57 for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:09:35.716105 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] Creating event network-vif-deleted:81990cc3-a4e2-461a-a98a-cf92fd8bbaaf for instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 on n-h2-791135-8 Oct 04 11:09:35.717001 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] Creating event network-vif-deleted:a3840260-c4ac-408c-810b-ecfd0314c7bb for instance a8bd608a-e699-4be9-a701-121633db69c4 on n-h1-791135-8 Oct 04 11:09:35.717676 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] Creating event network-vif-deleted:558bbb9f-7c34-4bb2-8e38-805a0c4df9cd for instance 2f41f528-5f20-4e31-a726-104bb7620bf6 on n-h2-791135-8 Oct 04 11:09:35.729844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:35.731417 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-77075eed-b4b4-4146-9622-7f00e479db0c req-43d8b7f6-9068-4be2-b236-dd2ad7b436ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.056986 Oct 04 11:09:35.732693 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1197/2430] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:35.739701 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b701f069-8cf5-4458-8031-5b8d9965ff45 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1496 microversion: 2.1 time: 0.504973 Oct 04 11:09:35.739858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:35.740282 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1234/2431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:35 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1496 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:35.749905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: 9cd968df-41f0-4020-9dbc-24a05a115e0d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:35.749905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.749905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.749905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.749905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.749905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.750649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.765219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:35.766107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:35.767457 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] HTTP exception thrown: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Request method failure captured: Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d HTTP/1.1 Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBQv6MIIjfmnmH8G6lS6H8uA7kJPc8BHuHqwfu7nKtLdIwPxNdy1DjTC8av9GUPiRUNDErvU5qOWwZ43B6s-yxrgcaqk-Or83plzy6jpwZLhqIx9ob-CY5YAjfJPxw7UKnnMiCymyJmxNzr9xqDgKT8glul2TPJUGo-GLB9l_XtRBXM Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca8d711757c0420fa87cd982e622f04d"}]}] Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: baed8d21db4f4df8b561a99ab3e8645e Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '9cd968df-41f0-4020-9dbc-24a05a115e0d'} Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:35.769627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Returning 404 to user: Instance 9cd968df-41f0-4020-9dbc-24a05a115e0d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c573c19-35f5-475a-b630-78c1caffe5ca tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d" status: 404 len: 111 microversion: 2.1 time: 0.037482 Oct 04 11:09:35.777577 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1198/2432] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:35 2022] GET /compute/v2.1/servers/9cd968df-41f0-4020-9dbc-24a05a115e0d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:35.780665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:35.781178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:35.783294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.784536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.785405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.787753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.788723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.789340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.794151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.795202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.795686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.796720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:35.797325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:35.798123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:35.862296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:36.169189 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c6b1325-0253-45e4-b8e8-652981208a3b tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 204 len: 0 microversion: 2.1 time: 0.390298 Oct 04 11:09:36.171002 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1199/2433] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:35 2022] DELETE /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:36.179441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:36.180908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:36.191119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.191841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.192503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.194209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.194834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.195451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.234949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:36.238960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:36.248647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:36.252673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:36.259575 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ec6ea94-b7c9-46a9-9c28-5d86e8f49fea tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2707 microversion: 2.42 time: 0.507561 Oct 04 11:09:36.266529 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1235/2434] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:35 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2707 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:36.274590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:36.281394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: aed0de21-1977-4186-9cfd-caae0fd077fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:36.296910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.297726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.298529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.299652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.300260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.300864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.348779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:36.358387 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76a2eecc-edb3-4514-a377-6597ecbad5e5 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1297 microversion: 2.1 time: 0.185880 Oct 04 11:09:36.359942 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1200/2435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:36 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1297 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:36.371570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-80ecfc24-ab96-4a67-b557-a7118b18c3a0 req-749a0a18-e432-477d-b10e-d378915231bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-deleted", "tag": "e7349ae7-773f-4e2b-ab5a-79cbcf7c41eb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:36.396515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80ecfc24-ab96-4a67-b557-a7118b18c3a0 req-749a0a18-e432-477d-b10e-d378915231bd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.397709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80ecfc24-ab96-4a67-b557-a7118b18c3a0 req-749a0a18-e432-477d-b10e-d378915231bd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.399970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80ecfc24-ab96-4a67-b557-a7118b18c3a0 req-749a0a18-e432-477d-b10e-d378915231bd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.431760 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-80ecfc24-ab96-4a67-b557-a7118b18c3a0 req-749a0a18-e432-477d-b10e-d378915231bd service nova] Creating event network-vif-deleted:e7349ae7-773f-4e2b-ab5a-79cbcf7c41eb for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:36.448505 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-80ecfc24-ab96-4a67-b557-a7118b18c3a0 req-749a0a18-e432-477d-b10e-d378915231bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085323 Oct 04 11:09:36.450003 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1201/2436] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:36.458260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:36.459529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:36.466979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.468258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.468990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.469955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.470584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.471017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.691383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:36.701889 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4dfa238-1a59-4d6f-91e0-fed5a37b1aaa tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd" status: 200 len: 1521 microversion: 2.1 time: 0.430908 Oct 04 11:09:36.719826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1236/2437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:36 2022] GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:36.733197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:36.738268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 95bfd7f2-1c04-4198-8e68-d74b326d8578] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:36.748961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.750361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.751311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.753077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.753798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.754595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.774182 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] HTTP exception thrown: Instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 could not be found. Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Request method failure captured: Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578 HTTP/1.1 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBOE7i53fZwQDTjfY9ZSyTRKb_ULWkjhExJkrx8N3__n_riOZD5HMnT56o7Xj5qnqcGrvnO-1ecShxCljMm6yp6Ld5crD6aqCTHWnOG7-BD4-9t604gGVS5q4-1jaaz-6gxHJ99A7AMUjglx25aB9BeQgXmiJGHgIbT2hL94ng6WLGE Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf100271e41c4475835267bcaf15c0b3"}]}] Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5797d5cb0e13468585a42a3e909c1165 Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 could not be found. Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '95bfd7f2-1c04-4198-8e68-d74b326d8578'} Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 could not be found. Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 could not be found. Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:36.776394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 could not be found. Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Returning 404 to user: Instance 95bfd7f2-1c04-4198-8e68-d74b326d8578 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6361c7fb-4fc2-4615-bd4f-bd7ecf7913d8 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578" status: 404 len: 111 microversion: 2.1 time: 0.055931 Oct 04 11:09:36.781310 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1237/2438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:36 2022] GET /compute/v2.1/servers/95bfd7f2-1c04-4198-8e68-d74b326d8578 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:36.783673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:36.784368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:36.790573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.791676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.792093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.792971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.793462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.794033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.798988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:36.807208 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88f37b82-98f0-4504-9a2a-d39397c7985f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1510 microversion: 2.1 time: 0.355798 Oct 04 11:09:36.810930 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1202/2439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:36 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:36.816930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:36.817563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 2f41f528-5f20-4e31-a726-104bb7620bf6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:36.834339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.836213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.836738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.838501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.839290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.839908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.857332 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] HTTP exception thrown: Instance 2f41f528-5f20-4e31-a726-104bb7620bf6 could not be found. Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Request method failure captured: Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 HTTP/1.1 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBOE7i53fZwQDTjfY9ZSyTRKb_ULWkjhExJkrx8N3__n_riOZD5HMnT56o7Xj5qnqcGrvnO-1ecShxCljMm6yp6Ld5crD6aqCTHWnOG7-BD4-9t604gGVS5q4-1jaaz-6gxHJ99A7AMUjglx25aB9BeQgXmiJGHgIbT2hL94ng6WLGE Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf100271e41c4475835267bcaf15c0b3"}]}] Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 5797d5cb0e13468585a42a3e909c1165 Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 2f41f528-5f20-4e31-a726-104bb7620bf6 could not be found. Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '2f41f528-5f20-4e31-a726-104bb7620bf6'} Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f41f528-5f20-4e31-a726-104bb7620bf6 could not be found. Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f41f528-5f20-4e31-a726-104bb7620bf6 could not be found. Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:36.859275 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f41f528-5f20-4e31-a726-104bb7620bf6 could not be found. Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Returning 404 to user: Instance 2f41f528-5f20-4e31-a726-104bb7620bf6 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:36.862824 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d774121-aea4-472b-9190-0b12cac3e940 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6" status: 404 len: 111 microversion: 2.1 time: 0.048714 Oct 04 11:09:36.865098 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1203/2440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:36 2022] GET /compute/v2.1/servers/2f41f528-5f20-4e31-a726-104bb7620bf6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:36.871501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ee4d578-4ffe-408d-abdb-4ceabf194f9e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:36.911906 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7ee4d578-4ffe-408d-abdb-4ceabf194f9e tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/315e223e-fc8e-4a6f-9f5c-75915503dd52" status: 204 len: 0 microversion: 2.1 time: 0.045681 Oct 04 11:09:36.912547 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1204/2441] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:09:36 2022] DELETE /compute/v2.1/os-server-groups/315e223e-fc8e-4a6f-9f5c-75915503dd52 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:09:36.929416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:36.931066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:36.950335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.952954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.953421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.955364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:36.956391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:36.957031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:36.998342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:09:37.144427 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60c6f17b-a939-4870-bfbb-4a119b488545 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 204 len: 0 microversion: 2.1 time: 0.226792 Oct 04 11:09:37.145365 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1205/2442] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:36 2022] DELETE /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:09:37.149717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:37.155476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:37.155755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:37.164179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.165210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.166725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.168151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.169532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.171146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.171292 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f180af2-72f0-4f3d-bb4a-92e84669987f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1496 microversion: 2.1 time: 0.391632 Oct 04 11:09:37.171867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1238/2443] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:36 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1496 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:37.299655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:37.303678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:37.315459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.317303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.318201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.319419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.320161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.320808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.610535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:37.630227 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc8ec888-5f10-4729-93ce-611834abd82f tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1473 microversion: 2.1 time: 0.480645 Oct 04 11:09:37.631382 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1206/2444] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:37 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1473 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:37.637227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:37.638275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:37.645073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.645504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:37.645988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.646744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.647601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.648196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.648773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.662345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:37.663825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:37.665078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d0c8d56-86a0-453e-8426-68e2e22a15ed tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2547 microversion: 2.42 time: 0.372171 Oct 04 11:09:37.667049 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1239/2445] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:37 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2547 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:37.712209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.712209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.712209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.712209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lazy-loading 'fault' on Instance uuid a8bd608a-e699-4be9-a701-121633db69c4 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:09:37.726930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:37.727844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: aed0de21-1977-4186-9cfd-caae0fd077fd] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:37.758437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.761144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.763661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.767289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.769308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.771621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.855422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:37.881177 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3830cfa2-4ee4-4c63-994c-2d4b88b185ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 200 len: 1302 microversion: 2.1 time: 0.248660 Oct 04 11:09:37.886859 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1207/2446] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:37 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 1302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:37.894391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:37.895340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:37.903658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.906698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.907511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:37.908499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:37.910242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:37.910935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.077332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:38.088069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e83164e-3220-441b-b6fb-0db3c59bd019 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd" status: 200 len: 1521 microversion: 2.1 time: 0.365700 Oct 04 11:09:38.089458 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1240/2447] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:37 2022] GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:38.196804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:38.198819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:38.208060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.209564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.210080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.213905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.215174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.216347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.226798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:38.240544 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d561c2c9-4b3e-4c88-a276-2293cbcab382 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1510 microversion: 2.1 time: 0.351532 Oct 04 11:09:38.258993 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1208/2448] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:37 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:38.330627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e5fbcadd-eec3-4187-8685-89f2465b6508 req-26aa50ef-4d3a-446c-b92a-c4a6d8a9269a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed0de21-1977-4186-9cfd-caae0fd077fd", "name": "network-vif-deleted", "tag": "5ef7b6a8-281c-4002-8b72-a0f5c1c79507"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:38.346920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e5fbcadd-eec3-4187-8685-89f2465b6508 req-26aa50ef-4d3a-446c-b92a-c4a6d8a9269a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.347647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e5fbcadd-eec3-4187-8685-89f2465b6508 req-26aa50ef-4d3a-446c-b92a-c4a6d8a9269a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.348238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e5fbcadd-eec3-4187-8685-89f2465b6508 req-26aa50ef-4d3a-446c-b92a-c4a6d8a9269a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.372663 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e5fbcadd-eec3-4187-8685-89f2465b6508 req-26aa50ef-4d3a-446c-b92a-c4a6d8a9269a service nova] Creating event network-vif-deleted:5ef7b6a8-281c-4002-8b72-a0f5c1c79507 for instance aed0de21-1977-4186-9cfd-caae0fd077fd on n-h1-791135-8 Oct 04 11:09:38.390393 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e5fbcadd-eec3-4187-8685-89f2465b6508 req-26aa50ef-4d3a-446c-b92a-c4a6d8a9269a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063134 Oct 04 11:09:38.391597 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1209/2449] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:09:38.506882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:38.518319 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b1d9072-f4bc-423e-a841-7cbf1bef2abf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 200 len: 1479 microversion: 2.1 time: 0.325724 Oct 04 11:09:38.523601 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1241/2450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:38 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 1479 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:38.543387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b791004a-e958-4560-93a5-61a2cf3da56a req-5f67038f-16f8-448c-8a45-bfa591ee7b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-deleted", "tag": "b88d59fb-34d8-4876-b140-ab257f0d6a64"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:38.554538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-193880010"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:38.558930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:38.564049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b791004a-e958-4560-93a5-61a2cf3da56a req-5f67038f-16f8-448c-8a45-bfa591ee7b69 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.564904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b791004a-e958-4560-93a5-61a2cf3da56a req-5f67038f-16f8-448c-8a45-bfa591ee7b69 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.564999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b791004a-e958-4560-93a5-61a2cf3da56a req-5f67038f-16f8-448c-8a45-bfa591ee7b69 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.577663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.578195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.578604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.579316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.579767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.580185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.600811 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b791004a-e958-4560-93a5-61a2cf3da56a req-5f67038f-16f8-448c-8a45-bfa591ee7b69 service nova] Creating event network-vif-deleted:b88d59fb-34d8-4876-b140-ab257f0d6a64 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:38.617677 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b791004a-e958-4560-93a5-61a2cf3da56a req-5f67038f-16f8-448c-8a45-bfa591ee7b69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079686 Oct 04 11:09:38.632091 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1210/2451] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:38.656786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:38.657529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:38.675102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.675500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.675933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.676632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.677082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.677533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.954463 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-754cdffb-28be-46d5-ad51-ffbc70571d35 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49/action" status: 202 len: 0 microversion: 2.1 time: 0.409224 Oct 04 11:09:38.957042 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1242/2452] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:09:38 2022] POST /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 11:09:38.968434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:38.969652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:38.976989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.977742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.978392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:38.979345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:38.979955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:38.981408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:39.025038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:39.035669 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c85397b7-53c8-4e58-8e47-6f6340dad317 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1473 microversion: 2.1 time: 0.382830 Oct 04 11:09:39.038024 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1211/2453] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:38 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:39.057718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:39.058766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:39.065223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:39.066074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:39.066737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:39.067684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:39.068338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:39.068961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:39.088600 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] HTTP exception thrown: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Request method failure captured: Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 HTTP/1.1 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBQiY0SBdbPveGiv7ET-2I1g1Yj1qutc-3109CSN4-gtnnNOewTCwYzVjyuT-kjCgCT-BokIytj8HT_bipPu7az6N1rgvpKabFkXP3MWHRP5g8Gx0R7q2-O7T31yKYtLcTC2a9VCeFTFyP5Elxni_KBscXZwOxUpLtEI4ndk-38wRCc Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}] Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersTestMultiNic-1250698670 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 14277c6865464b2ea0e881d88b516f8f Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'a8bd608a-e699-4be9-a701-121633db69c4'} Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:39.090943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:39.095282 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:39.095282 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:39.095282 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:39.095282 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:39.095282 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:39.095282 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:09:39.095282 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:39.096980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Returning 404 to user: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:39.098721 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2fc29495-e0e9-4614-97fd-97a7738c6e7c tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 404 len: 111 microversion: 2.1 time: 0.059438 Oct 04 11:09:39.101631 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1212/2454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:39 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:39.113976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a294b453-79b9-499b-80da-23108f70dfcb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4555a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:39.211916 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a294b453-79b9-499b-80da-23108f70dfcb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.108809 Oct 04 11:09:39.213036 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1213/2455] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:39 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:39.233827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:39.235568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: aed0de21-1977-4186-9cfd-caae0fd077fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:39.267223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:39.272620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:39.273300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:39.280407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:39.281136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:39.281849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:39.382143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:39.382741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:39.383451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:39.384049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lazy-loading 'fault' on Instance uuid aed0de21-1977-4186-9cfd-caae0fd077fd {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:09:39.578975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8d21db4f4df8b561a99ab3e8645e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca8d711757c0420fa87cd982e622f04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:39.617252 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a42420ed-fca2-439e-b4c2-4534c35d3f8e tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd" status: 200 len: 1312 microversion: 2.1 time: 0.399063 Oct 04 11:09:39.619831 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1214/2456] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:39 2022] GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd => generated 1312 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:39.625162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:39.626253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:39.634504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:39.635310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:39.635943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:39.653122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:39.653847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:39.655969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:39.659931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:39.673323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:39.679270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:39.680890 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10ad17cf-9797-4193-a878-9a65e59365d5 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2434 microversion: 2.42 time: 0.720186 Oct 04 11:09:39.687092 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1243/2457] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:38 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2434 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:40.063475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:40.064104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:40.077009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.077545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.077992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.078683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.079307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.079879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.154761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:40.169049 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3f975fb-f635-45c8-add5-6571688fef25 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1468 microversion: 2.1 time: 0.547148 Oct 04 11:09:40.170343 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1215/2458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:39 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1468 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:40.230876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-abac7316-417f-4986-9aeb-03c908d064c4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4288790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:40.364427 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-abac7316-417f-4986-9aeb-03c908d064c4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.134195 Oct 04 11:09:40.366940 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1216/2459] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:40 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:40.449220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-139a6144-6b9a-44eb-bc1f-3a5e8b7c4c15 req-41f68fff-c276-40cb-98e4-475ff0484aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a9ffdf-b539-4b98-97f5-f943a852876f", "name": "network-vif-deleted", "tag": "be3d9536-4785-4af5-afd6-69e98f320f53"}, {"server_uuid": "3ba683a7-7aed-41c9-b80a-f8df12270432", "name": "network-vif-deleted", "tag": "f556fc7e-2ee2-40f4-89ff-37534b21acce"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:40.509504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-139a6144-6b9a-44eb-bc1f-3a5e8b7c4c15 req-41f68fff-c276-40cb-98e4-475ff0484aaf service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.510534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-139a6144-6b9a-44eb-bc1f-3a5e8b7c4c15 req-41f68fff-c276-40cb-98e4-475ff0484aaf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.512605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-139a6144-6b9a-44eb-bc1f-3a5e8b7c4c15 req-41f68fff-c276-40cb-98e4-475ff0484aaf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.570072 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-139a6144-6b9a-44eb-bc1f-3a5e8b7c4c15 req-41f68fff-c276-40cb-98e4-475ff0484aaf service nova] Creating event network-vif-deleted:be3d9536-4785-4af5-afd6-69e98f320f53 for instance f2a9ffdf-b539-4b98-97f5-f943a852876f on n-h1-791135-8 Oct 04 11:09:40.574789 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-139a6144-6b9a-44eb-bc1f-3a5e8b7c4c15 req-41f68fff-c276-40cb-98e4-475ff0484aaf service nova] Creating event network-vif-deleted:f556fc7e-2ee2-40f4-89ff-37534b21acce for instance 3ba683a7-7aed-41c9-b80a-f8df12270432 on n-h2-791135-8 Oct 04 11:09:40.611571 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-139a6144-6b9a-44eb-bc1f-3a5e8b7c4c15 req-41f68fff-c276-40cb-98e4-475ff0484aaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.185431 Oct 04 11:09:40.617470 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1217/2460] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:09:40.649636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:40.651065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: aed0de21-1977-4186-9cfd-caae0fd077fd] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:40.675389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.675884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.676317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.677022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.677507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.678121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.704930 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] HTTP exception thrown: Instance aed0de21-1977-4186-9cfd-caae0fd077fd could not be found. Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Request method failure captured: Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd HTTP/1.1 Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBQv6MIIjfmnmH8G6lS6H8uA7kJPc8BHuHqwfu7nKtLdIwPxNdy1DjTC8av9GUPiRUNDErvU5qOWwZ43B6s-yxrgcaqk-Or83plzy6jpwZLhqIx9ob-CY5YAjfJPxw7UKnnMiCymyJmxNzr9xqDgKT8glul2TPJUGo-GLB9l_XtRBXM Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca8d711757c0420fa87cd982e622f04d"}]}] Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: baed8d21db4f4df8b561a99ab3e8645e Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance aed0de21-1977-4186-9cfd-caae0fd077fd could not be found. Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'aed0de21-1977-4186-9cfd-caae0fd077fd'} Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed0de21-1977-4186-9cfd-caae0fd077fd could not be found. Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed0de21-1977-4186-9cfd-caae0fd077fd could not be found. Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.711484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:40.716049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.716049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:40.716049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:40.716049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:40.716049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:40.716049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:40.716049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed0de21-1977-4186-9cfd-caae0fd077fd could not be found. Oct 04 11:09:40.716049 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.718054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Returning 404 to user: Instance aed0de21-1977-4186-9cfd-caae0fd077fd could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:40.719179 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e156cb1-db7b-4986-be82-db4984c537e3 tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd" status: 404 len: 111 microversion: 2.1 time: 0.074680 Oct 04 11:09:40.730450 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1218/2461] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:40 2022] GET /compute/v2.1/servers/aed0de21-1977-4186-9cfd-caae0fd077fd => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:40.733152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:40.737736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:40.738697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:40.749974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.762711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.763320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.764181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.764751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.765276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.837087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:40.841520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:40.849417 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca7c0a8b-f2a7-488d-ab9e-f532d16ffe72 tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1473 microversion: 2.1 time: 0.790127 Oct 04 11:09:40.861523 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1244/2462] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:40 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1473 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:40.890896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:40.891522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] [instance: f2a9ffdf-b539-4b98-97f5-f943a852876f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:40.906884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.907444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.908866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.911496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:40.912238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:40.912684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:40.945747 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] HTTP exception thrown: Instance f2a9ffdf-b539-4b98-97f5-f943a852876f could not be found. Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Request method failure captured: Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f HTTP/1.1 Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQv6MIIjfmnmH8G6lS6H8uA7kJPc8BHuHqwfu7nKtLdIwPxNdy1DjTC8av9GUPiRUNDErvU5qOWwZ43B6s-yxrgcaqk-Or83plzy6jpwZLhqIx9ob-CY5YAjfJPxw7UKnnMiCymyJmxNzr9xqDgKT8glul2TPJUGo-GLB9l_XtRBXM Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ca8d711757c0420fa87cd982e622f04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ca8d711757c0420fa87cd982e622f04d"}]}] Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ca8d711757c0420fa87cd982e622f04d Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-731317708 Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: baed8d21db4f4df8b561a99ab3e8645e Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListServersNegativeTestJSON-731317708-project Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f2a9ffdf-b539-4b98-97f5-f943a852876f could not be found. Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f2a9ffdf-b539-4b98-97f5-f943a852876f'} Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a9ffdf-b539-4b98-97f5-f943a852876f could not be found. Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a9ffdf-b539-4b98-97f5-f943a852876f could not be found. Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.947957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a9ffdf-b539-4b98-97f5-f943a852876f could not be found. Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] Returning 404 to user: Instance f2a9ffdf-b539-4b98-97f5-f943a852876f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:40.952845 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69a653ac-8d65-4523-915b-b167a582740b tempest-ListServersNegativeTestJSON-731317708 tempest-ListServersNegativeTestJSON-731317708-project] 10.222.0.23 "GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f" status: 404 len: 111 microversion: 2.1 time: 0.086178 Oct 04 11:09:40.954183 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1245/2463] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:40 2022] GET /compute/v2.1/servers/f2a9ffdf-b539-4b98-97f5-f943a852876f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:41.195448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:41.197236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:41.208272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:41.210080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:41.210707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:41.214491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:41.215179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:41.215975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:41.281855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:41.311764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:41.312610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:41.313302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:41.313981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lazy-loading 'fault' on Instance uuid 3ba683a7-7aed-41c9-b80a-f8df12270432 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:09:41.447384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:41.469987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:41.478174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:41.482158 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91f569f6-b86e-4470-923e-0d83d814cdab tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2388 microversion: 2.42 time: 0.750219 Oct 04 11:09:41.504911 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1219/2464] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:40 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2388 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:41.514793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbac6e17-319c-4133-9339-db8edac55ee6 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4509700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:41.682565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb5241c84dc4aa69417d467ac7972bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826a9134c65f4fda991182b92eb57365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:41.691427 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92346a81-4a65-4af4-8ce4-4de99ca24e9d tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 200 len: 1306 microversion: 2.1 time: 0.499952 Oct 04 11:09:41.705717 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1246/2465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:41 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 1306 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:41.842294 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbac6e17-319c-4133-9339-db8edac55ee6 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.333604 Oct 04 11:09:41.842899 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1220/2466] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:41 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:41.877622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:41.878478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:41.887900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:41.888630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:41.891284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:41.892272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:41.892901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:41.894829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:41.993210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:41.993879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:41.994202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:41.994756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lazy-loading 'fault' on Instance uuid 1976caef-e757-4301-a92b-66d06d09fc3b {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:09:42.150643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5797d5cb0e13468585a42a3e909c1165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf100271e41c4475835267bcaf15c0b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:42.159901 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51b910ba-5d31-448b-acdd-6ae12e530dbe tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 200 len: 1307 microversion: 2.1 time: 0.286822 Oct 04 11:09:42.160500 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1247/2467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:41 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 1307 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:42.375236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6c8f6ede-3eb9-4d56-82c1-9daf827744e0 req-eb4865e8-0103-4729-92d2-9a263bb2cc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-deleted", "tag": "3b9ced07-b4bf-4318-8dc4-527be99dccbd"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:42.395231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6c8f6ede-3eb9-4d56-82c1-9daf827744e0 req-eb4865e8-0103-4729-92d2-9a263bb2cc5d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:42.400594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6c8f6ede-3eb9-4d56-82c1-9daf827744e0 req-eb4865e8-0103-4729-92d2-9a263bb2cc5d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:42.401382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6c8f6ede-3eb9-4d56-82c1-9daf827744e0 req-eb4865e8-0103-4729-92d2-9a263bb2cc5d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:42.445114 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6c8f6ede-3eb9-4d56-82c1-9daf827744e0 req-eb4865e8-0103-4729-92d2-9a263bb2cc5d service nova] Creating event network-vif-deleted:3b9ced07-b4bf-4318-8dc4-527be99dccbd for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:42.451699 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6c8f6ede-3eb9-4d56-82c1-9daf827744e0 req-eb4865e8-0103-4729-92d2-9a263bb2cc5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082583 Oct 04 11:09:42.456550 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1221/2468] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:42.511818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:42.513116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:42.522246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:42.526630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:42.527361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:42.530326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:42.531040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:42.532300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:42.656716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-84acd0e9-5653-4201-a743-9c0d447c1fa2 req-3f5d0caf-32d5-4de8-a5ea-40b97e242ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1976caef-e757-4301-a92b-66d06d09fc3b", "name": "network-vif-deleted", "tag": "dd891def-01c0-4d99-9aee-31340fccf0a0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:42.677526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-84acd0e9-5653-4201-a743-9c0d447c1fa2 req-3f5d0caf-32d5-4de8-a5ea-40b97e242ad1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:42.678824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-84acd0e9-5653-4201-a743-9c0d447c1fa2 req-3f5d0caf-32d5-4de8-a5ea-40b97e242ad1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:42.679442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-84acd0e9-5653-4201-a743-9c0d447c1fa2 req-3f5d0caf-32d5-4de8-a5ea-40b97e242ad1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:42.696080 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-84acd0e9-5653-4201-a743-9c0d447c1fa2 req-3f5d0caf-32d5-4de8-a5ea-40b97e242ad1 service nova] Creating event network-vif-deleted:dd891def-01c0-4d99-9aee-31340fccf0a0 for instance 1976caef-e757-4301-a92b-66d06d09fc3b on n-h2-791135-8 Oct 04 11:09:42.704438 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-84acd0e9-5653-4201-a743-9c0d447c1fa2 req-3f5d0caf-32d5-4de8-a5ea-40b97e242ad1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051521 Oct 04 11:09:42.706980 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1222/2469] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:09:42.724468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:42.725779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:42.739004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:42.739754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:42.740353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:42.741286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:42.741918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:42.752884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:42.805041 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] HTTP exception thrown: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Request method failure captured: Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 HTTP/1.1 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBRIjxdmItq3MuY5nDh2SGuqsnWPeObm4UJQicDN10uUTzRmJfaAJo2fAL6QHCGyrV5lJms58P8M5yiXLZtOvRuuERuZ67gcnl9VBaeUL4hBE8D-_Px-jzmm49dvU031bjfc0Vbr0MiKGfKFdF8s1uYrMJvTPBSEquYBl18L8ptO6-c Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_826a9134c65f4fda991182b92eb57365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/826a9134c65f4fda991182b92eb57365"}]}] Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 7fb5241c84dc4aa69417d467ac7972bb Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '3ba683a7-7aed-41c9-b80a-f8df12270432'} Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:42.816164 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.820606 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:42.820606 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:42.820606 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:42.820606 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:42.820606 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:42.820606 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.820606 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.822962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Returning 404 to user: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:42.828544 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1cb29a6d-8b9d-46d3-ab89-ec60e3116118 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 404 len: 111 microversion: 2.1 time: 0.112963 Oct 04 11:09:42.830201 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1223/2470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:42 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:42.849857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1523498879", "metadata": {"image_type": "test"}}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:42.864311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:42.883467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:42.893239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:42.895744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:42.899448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:42.901244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:42.904688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:42.962449 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] HTTP exception thrown: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Request method failure captured: Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432/action HTTP/1.1 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 112 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBRIjxdmItq3MuY5nDh2SGuqsnWPeObm4UJQicDN10uUTzRmJfaAJo2fAL6QHCGyrV5lJms58P8M5yiXLZtOvRuuERuZ67gcnl9VBaeUL4hBE8D-_Px-jzmm49dvU031bjfc0Vbr0MiKGfKFdF8s1uYrMJvTPBSEquYBl18L8ptO6-c Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_826a9134c65f4fda991182b92eb57365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/826a9134c65f4fda991182b92eb57365"}]}] Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 7fb5241c84dc4aa69417d467ac7972bb Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1523498879", "metadata": {"image_type": "test"}}} Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '3ba683a7-7aed-41c9-b80a-f8df12270432', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1523498879', 'metadata': {'image_type': 'test'}}}} Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 11:09:42.969532 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:42.973188 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:42.976570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Returning 404 to user: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:42.980329 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76fdffca-72cc-4cc4-9df3-b063f7f50fae tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "POST /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432/action" status: 404 len: 111 microversion: 2.1 time: 0.141361 Oct 04 11:09:42.982511 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1224/2471] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Oct 4 11:09:42 2022] POST /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432/action => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:42.994952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:42.999951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-333fdf76-a6c1-411b-b529-b852e69a4a38 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d45a0280>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:43.012446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:43.015471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:43.020535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b294a04a-e6cb-4eb6-a415-2da2e98942e9 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 2099 microversion: 2.42 time: 0.513008 Oct 04 11:09:43.038476 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1248/2472] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:42 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 2099 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:43.062882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92e39e62-3665-4a0d-9942-956a9f93fb7f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-812044063", "metadata": {"image_type": "test"}}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:43.081237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92e39e62-3665-4a0d-9942-956a9f93fb7f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Failed to fetch instance by id tempest-invalid-1421225638 {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 11:09:43.083865 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-92e39e62-3665-4a0d-9942-956a9f93fb7f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] HTTP exception thrown: Instance tempest-invalid-1421225638 could not be found. Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92e39e62-3665-4a0d-9942-956a9f93fb7f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Request method failure captured: Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/tempest-invalid-1421225638/action HTTP/1.1 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 111 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBRIjxdmItq3MuY5nDh2SGuqsnWPeObm4UJQicDN10uUTzRmJfaAJo2fAL6QHCGyrV5lJms58P8M5yiXLZtOvRuuERuZ67gcnl9VBaeUL4hBE8D-_Px-jzmm49dvU031bjfc0Vbr0MiKGfKFdF8s1uYrMJvTPBSEquYBl18L8ptO6-c Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_826a9134c65f4fda991182b92eb57365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/826a9134c65f4fda991182b92eb57365"}]}] Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 7fb5241c84dc4aa69417d467ac7972bb Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-812044063", "metadata": {"image_type": "test"}}} Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance tempest-invalid-1421225638 could not be found. Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'tempest-invalid-1421225638', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-812044063', 'metadata': {'image_type': 'test'}}}} Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1421225638 could not be found. Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:43.092226 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1421225638 could not be found. Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1421225638 could not be found. Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92e39e62-3665-4a0d-9942-956a9f93fb7f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Returning 404 to user: Instance tempest-invalid-1421225638 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:43.097549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92e39e62-3665-4a0d-9942-956a9f93fb7f tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-1421225638/action" status: 404 len: 101 microversion: 2.1 time: 0.055353 Oct 04 11:09:43.104214 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1249/2473] 10.222.0.23 () {60 vars in 1249 bytes} [Tue Oct 4 11:09:43 2022] POST /compute/v2.1/servers/tempest-invalid-1421225638/action => generated 101 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:43.115487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c921d85c-c983-4715-97f2-2f4dff772934 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1940429260"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:43.117854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c921d85c-c983-4715-97f2-2f4dff772934 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 11:09:43.122890 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c921d85c-c983-4715-97f2-2f4dff772934 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c921d85c-c983-4715-97f2-2f4dff772934 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Request method failure captured: Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 57 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBRIjxdmItq3MuY5nDh2SGuqsnWPeObm4UJQicDN10uUTzRmJfaAJo2fAL6QHCGyrV5lJms58P8M5yiXLZtOvRuuERuZ67gcnl9VBaeUL4hBE8D-_Px-jzmm49dvU031bjfc0Vbr0MiKGfKFdF8s1uYrMJvTPBSEquYBl18L8ptO6-c Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_826a9134c65f4fda991182b92eb57365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/826a9134c65f4fda991182b92eb57365"}]}] Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 7fb5241c84dc4aa69417d467ac7972bb Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: {"createImage": {"name": "tempest-test-snap-1940429260"}} Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1940429260'}}} Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.128144 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c921d85c-c983-4715-97f2-2f4dff772934 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:43.133976 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c921d85c-c983-4715-97f2-2f4dff772934 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.023588 Oct 04 11:09:43.137750 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1250/2474] 10.222.0.23 () {60 vars in 1275 bytes} [Tue Oct 4 11:09:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:43.157760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef6b6c26-4dbe-4a1c-ba54-a75f35f8dd99 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1601178930"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:43.160084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ef6b6c26-4dbe-4a1c-ba54-a75f35f8dd99 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 11:09:43.160598 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ef6b6c26-4dbe-4a1c-ba54-a75f35f8dd99 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef6b6c26-4dbe-4a1c-ba54-a75f35f8dd99 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Request method failure captured: Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 57 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBRIjxdmItq3MuY5nDh2SGuqsnWPeObm4UJQicDN10uUTzRmJfaAJo2fAL6QHCGyrV5lJms58P8M5yiXLZtOvRuuERuZ67gcnl9VBaeUL4hBE8D-_Px-jzmm49dvU031bjfc0Vbr0MiKGfKFdF8s1uYrMJvTPBSEquYBl18L8ptO6-c Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_826a9134c65f4fda991182b92eb57365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/826a9134c65f4fda991182b92eb57365"}]}] Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 7fb5241c84dc4aa69417d467ac7972bb Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: {"createImage": {"name": "tempest-test-snap-1601178930"}} Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1601178930'}}} Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.170805 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef6b6c26-4dbe-4a1c-ba54-a75f35f8dd99 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:43.174368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ef6b6c26-4dbe-4a1c-ba54-a75f35f8dd99 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.029150 Oct 04 11:09:43.175509 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-333fdf76-a6c1-411b-b529-b852e69a4a38 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.189983 Oct 04 11:09:43.184415 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1225/2475] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:42 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:43.187111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1251/2476] 10.222.0.23 () {60 vars in 1281 bytes} [Tue Oct 4 11:09:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:43.194609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:43.195115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:43.206204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:43.206852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] [instance: 1976caef-e757-4301-a92b-66d06d09fc3b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:43.220918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:43.225688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:43.226201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:43.228597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:43.229145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:43.230930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:43.232449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:43.232713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:43.233256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:43.236527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:43.237008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:43.237509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:43.271606 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] HTTP exception thrown: Instance 1976caef-e757-4301-a92b-66d06d09fc3b could not be found. Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Request method failure captured: Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b HTTP/1.1 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBOE7i53fZwQDTjfY9ZSyTRKb_ULWkjhExJkrx8N3__n_riOZD5HMnT56o7Xj5qnqcGrvnO-1ecShxCljMm6yp6Ld5crD6aqCTHWnOG7-BD4-9t604gGVS5q4-1jaaz-6gxHJ99A7AMUjglx25aB9BeQgXmiJGHgIbT2hL94ng6WLGE Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bf100271e41c4475835267bcaf15c0b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bf100271e41c4475835267bcaf15c0b3"}]}] Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bf100271e41c4475835267bcaf15c0b3 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-599270578 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5797d5cb0e13468585a42a3e909c1165 Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersOnMultiNodesTest-599270578-project Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1976caef-e757-4301-a92b-66d06d09fc3b could not be found. Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1976caef-e757-4301-a92b-66d06d09fc3b'} Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1976caef-e757-4301-a92b-66d06d09fc3b could not be found. Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1976caef-e757-4301-a92b-66d06d09fc3b could not be found. Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.277868 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.282489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.282489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.282489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.282489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:43.282489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:43.282489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1976caef-e757-4301-a92b-66d06d09fc3b could not be found. Oct 04 11:09:43.282489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.284429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] Returning 404 to user: Instance 1976caef-e757-4301-a92b-66d06d09fc3b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:43.288185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ab4fbe9-0f98-463f-862f-03b5f0194edc tempest-ServersOnMultiNodesTest-599270578 tempest-ServersOnMultiNodesTest-599270578-project] 10.222.0.23 "GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b" status: 404 len: 111 microversion: 2.1 time: 0.098826 Oct 04 11:09:43.288822 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1252/2477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:43 2022] GET /compute/v2.1/servers/1976caef-e757-4301-a92b-66d06d09fc3b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:43.302135 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] HTTP exception thrown: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Request method failure captured: Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 HTTP/1.1 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBRIjxdmItq3MuY5nDh2SGuqsnWPeObm4UJQicDN10uUTzRmJfaAJo2fAL6QHCGyrV5lJms58P8M5yiXLZtOvRuuERuZ67gcnl9VBaeUL4hBE8D-_Px-jzmm49dvU031bjfc0Vbr0MiKGfKFdF8s1uYrMJvTPBSEquYBl18L8ptO6-c Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_826a9134c65f4fda991182b92eb57365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/826a9134c65f4fda991182b92eb57365"}]}] Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 7fb5241c84dc4aa69417d467ac7972bb Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '3ba683a7-7aed-41c9-b80a-f8df12270432'} Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:43.306178 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Returning 404 to user: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:43.309714 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7ff03c8-14d9-4b23-8ee6-6dcafe9c2701 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 404 len: 111 microversion: 2.1 time: 0.123560 Oct 04 11:09:43.317763 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1226/2478] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:09:43 2022] DELETE /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:43.318686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:43.319514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] [instance: 3ba683a7-7aed-41c9-b80a-f8df12270432] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:43.346726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:43.350725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:43.354557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:43.360369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:43.362715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:43.365307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:43.411307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] HTTP exception thrown: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Request method failure captured: Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 HTTP/1.1 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBRIjxdmItq3MuY5nDh2SGuqsnWPeObm4UJQicDN10uUTzRmJfaAJo2fAL6QHCGyrV5lJms58P8M5yiXLZtOvRuuERuZ67gcnl9VBaeUL4hBE8D-_Px-jzmm49dvU031bjfc0Vbr0MiKGfKFdF8s1uYrMJvTPBSEquYBl18L8ptO6-c Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_826a9134c65f4fda991182b92eb57365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/826a9134c65f4fda991182b92eb57365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/826a9134c65f4fda991182b92eb57365"}]}] Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 826a9134c65f4fda991182b92eb57365 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1225669043 Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 7fb5241c84dc4aa69417d467ac7972bb Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesNegativeTestJSON-1225669043-project Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '3ba683a7-7aed-41c9-b80a-f8df12270432'} Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:09:43.416454 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.420834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:09:43.420834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:09:43.420834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:09:43.420834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:09:43.420834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:09:43.420834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. Oct 04 11:09:43.420834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:09:43.420834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] Returning 404 to user: Instance 3ba683a7-7aed-41c9-b80a-f8df12270432 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:09:43.421596 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-66e86d21-9d89-4b92-8008-3e5ffbeccf36 tempest-ImagesNegativeTestJSON-1225669043 tempest-ImagesNegativeTestJSON-1225669043-project] 10.222.0.23 "GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432" status: 404 len: 111 microversion: 2.1 time: 0.107699 Oct 04 11:09:43.424020 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1253/2479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:09:43 2022] GET /compute/v2.1/servers/3ba683a7-7aed-41c9-b80a-f8df12270432 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:09:44.054305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:44.056106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:44.065086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:44.066015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:44.066804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:44.067957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:44.068621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:44.069394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:44.191587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7192bcff-a014-4eb7-adab-a347e7801d0c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d437b820>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:44.207881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:44.270775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:44.275475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:44.301189 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7192bcff-a014-4eb7-adab-a347e7801d0c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.113689 Oct 04 11:09:44.302467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:44.304500 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1254/2480] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:44 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:44.309802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:44.314746 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-500af779-a977-4d43-b50b-06e3cfa9718e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.264684 Oct 04 11:09:44.319585 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1227/2481] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:44 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:44.585779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-22697cd1-0ce2-4f4a-839c-37d5d64d581d req-6ea5cbb3-5a8b-41bd-b089-4a60ab878995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f5083c-2e63-41ad-bb6b-8ba579c57dc5", "name": "network-vif-deleted", "tag": "b3a2f117-dbc4-4c90-9ddf-05e06c43e6b6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:44.625142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22697cd1-0ce2-4f4a-839c-37d5d64d581d req-6ea5cbb3-5a8b-41bd-b089-4a60ab878995 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:44.629059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22697cd1-0ce2-4f4a-839c-37d5d64d581d req-6ea5cbb3-5a8b-41bd-b089-4a60ab878995 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:44.630477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22697cd1-0ce2-4f4a-839c-37d5d64d581d req-6ea5cbb3-5a8b-41bd-b089-4a60ab878995 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:44.694685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-22697cd1-0ce2-4f4a-839c-37d5d64d581d req-6ea5cbb3-5a8b-41bd-b089-4a60ab878995 service nova] Creating event network-vif-deleted:b3a2f117-dbc4-4c90-9ddf-05e06c43e6b6 for instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 on n-h2-791135-8 Oct 04 11:09:44.720679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-22697cd1-0ce2-4f4a-839c-37d5d64d581d req-6ea5cbb3-5a8b-41bd-b089-4a60ab878995 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134929 Oct 04 11:09:44.724255 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1255/2482] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:45.318592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e805b191-e322-407d-8f98-752c7374755d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4555160>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:45.350957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:45.351719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:45.395444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:45.395992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:45.396604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:45.397366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:45.404176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:45.404823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:45.425081 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e805b191-e322-407d-8f98-752c7374755d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.110352 Oct 04 11:09:45.427366 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1228/2483] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:45 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:45.765138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:45.780358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:45.789838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:45.796989 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5d45d5c-6bce-470e-89e6-e3131c72b91d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.448839 Oct 04 11:09:45.801290 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1256/2484] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:45 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:46.443699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-905f59da-64a9-424b-b1fb-acdb75381189 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d88b5700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:46.523945 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-905f59da-64a9-424b-b1fb-acdb75381189 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.083933 Oct 04 11:09:46.533315 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1229/2485] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:46 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:46.830706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:46.831233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:46.841445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:46.844487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:46.853483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:46.856431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:46.859450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:46.860072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:47.191799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0fc67e40-3358-42bd-b3b4-01cd2354e8a8 req-6d6108f3-8a6c-4d5c-b957-7bfefda56d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964982db-00fc-459f-ab6f-c1dab81e9c49", "name": "network-vif-plugged", "status": "completed", "tag": "b59d1369-05c7-4f30-a1b1-2f6d74013825"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:47.207885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:47.245554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:47.246844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0fc67e40-3358-42bd-b3b4-01cd2354e8a8 req-6d6108f3-8a6c-4d5c-b957-7bfefda56d70 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:47.253846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0fc67e40-3358-42bd-b3b4-01cd2354e8a8 req-6d6108f3-8a6c-4d5c-b957-7bfefda56d70 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:47.254995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0fc67e40-3358-42bd-b3b4-01cd2354e8a8 req-6d6108f3-8a6c-4d5c-b957-7bfefda56d70 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:47.257509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:47.259595 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fad1a5a9-91e1-4820-89a0-dfcd5ac54c3d tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.433046 Oct 04 11:09:47.266458 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1230/2486] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:46 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:47.312810 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0fc67e40-3358-42bd-b3b4-01cd2354e8a8 req-6d6108f3-8a6c-4d5c-b957-7bfefda56d70 service nova] Creating event network-vif-plugged:b59d1369-05c7-4f30-a1b1-2f6d74013825 for instance 964982db-00fc-459f-ab6f-c1dab81e9c49 on n-h1-791135-8 Oct 04 11:09:47.336760 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0fc67e40-3358-42bd-b3b4-01cd2354e8a8 req-6d6108f3-8a6c-4d5c-b957-7bfefda56d70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.614246 Oct 04 11:09:47.343280 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1257/2487] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:09:47.540861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5878b97-c5f4-4920-8906-5fe0662e7b5d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d88b5550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:47.638296 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5878b97-c5f4-4920-8906-5fe0662e7b5d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.101621 Oct 04 11:09:47.642978 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1231/2488] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:47 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:48.297648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:48.298326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:48.330014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:48.330885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:48.347163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:48.351003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:48.354992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:48.360197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:48.656240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d7ab3c9-7b54-4c37-a28e-32437a07c451 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4288ee0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:48.775627 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d7ab3c9-7b54-4c37-a28e-32437a07c451 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.124809 Oct 04 11:09:48.776229 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1232/2489] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:48 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:49.682717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:49.695068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:49.720177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:49.728428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b1da65da-11dd-4ff9-8e66-8a98bce3e00b tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 1.434258 Oct 04 11:09:49.730602 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1258/2490] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:48 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:49.793038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6c549dc4-fbfd-4e8a-bae5-168ec7e81056 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d461c700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:49.883232 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6c549dc4-fbfd-4e8a-bae5-168ec7e81056 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.095863 Oct 04 11:09:49.884422 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1233/2491] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:49 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:50.760297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:50.761004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:50.781037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:50.785645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:50.787274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:50.788958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:50.794203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:50.795592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:50.902771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2049907a-0ecc-488d-afd5-c3aba2930c99 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4555f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:50.999825 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2049907a-0ecc-488d-afd5-c3aba2930c99 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.104225 Oct 04 11:09:51.001441 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1234/2492] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:50 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:09:51.323681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:51.353744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:51.358173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:51.368124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-779e0e87-776a-48fb-9dc7-a50509ba0370 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.613033 Oct 04 11:09:51.383245 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1259/2493] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:50 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:51.636142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64dc1213-a6fd-4ae7-8c90-84ac4e43b63d tempest-TenantUsagesTestJSON-534289306 tempest-TenantUsagesTestJSON-534289306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2034971562", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:51.765341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-64dc1213-a6fd-4ae7-8c90-84ac4e43b63d tempest-TenantUsagesTestJSON-534289306 tempest-TenantUsagesTestJSON-534289306-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:09:52.016135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e2696f6a-99d1-4bdb-b99d-f642e3293571 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d448bc10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:52.128925 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e2696f6a-99d1-4bdb-b99d-f642e3293571 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.116915 Oct 04 11:09:52.140420 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1260/2494] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:52 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:52.412175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:52.413419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:52.430301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:52.436704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:52.438273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:52.439908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:52.445293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:52.448187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:53.877622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:53.897592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:53.903259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:53.909027 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3e80ccb-5a2a-412b-a752-b63d331aa8a1 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 1.501723 Oct 04 11:09:53.925921 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1261/2495] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:52 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:09:53.932347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f32e30f0-2150-4a2b-aaa2-a68d7f12923a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4284820>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:54.062056 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f32e30f0-2150-4a2b-aaa2-a68d7f12923a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.143998 Oct 04 11:09:54.063608 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1262/2496] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:53 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:54.943963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:54.945618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:55.000334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:55.004525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:55.006010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:55.007588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:55.011785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:55.020654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:55.364043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:55.381691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:55.383248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:55.384536 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b81fb167-7752-4b3e-a4b2-b3c4e72271d4 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.445726 Oct 04 11:09:55.401388 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1263/2497] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:54 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:09:55.401388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5089dde-f682-4fc8-9c76-be74fde9aebf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4586e50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:55.487349 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5089dde-f682-4fc8-9c76-be74fde9aebf tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.096955 Oct 04 11:09:55.487985 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1264/2498] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:55 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:56.420852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:56.421507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:56.440224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:56.444893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:56.448582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:56.449497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:56.449992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:56.450439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:56.675030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:56.700924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:56.701600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:56.702819 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-153b8651-358d-4be0-b10e-e3fc91350690 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.288202 Oct 04 11:09:56.719214 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1265/2499] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:56 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:09:56.725382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1cb1f7eb-2701-456d-9b00-2ed595385b55 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d450d040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:56.895065 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1cb1f7eb-2701-456d-9b00-2ed595385b55 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.173384 Oct 04 11:09:56.902028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1266/2500] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:56 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:57.216931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:09:57.729095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:57.729763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:09:57.746498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:57.747016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:57.750253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:57.762162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:09:57.762862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:09:57.763504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:09:58.048753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:58.058097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:58.059529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:09:58.060713 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5221380d-88d5-46eb-987f-6fa1643a1d1f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.336496 Oct 04 11:09:58.061277 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1267/2501] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:09:57 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:09:58.084480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2a8147c-2a46-4d05-9edd-46068bf964fb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d450db80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:09:58.206351 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2a8147c-2a46-4d05-9edd-46068bf964fb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.125357 Oct 04 11:09:58.207426 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1268/2502] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:09:58 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:09:58.917694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1225253363", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "bbdfe2c9-8fba-4fa5-b6a6-141ddb8fbbec"}, {"uuid": "d2735055-a3bf-47fc-8635-a5b7ae0db8d2"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:09:59.080269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] validate_networks() for [('bbdfe2c9-8fba-4fa5-b6a6-141ddb8fbbec', None, None, None, None, None), ('d2735055-a3bf-47fc-8635-a5b7ae0db8d2', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:10:01.651048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:02.344549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:10:02.345110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:10:02.345456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:10:02.345872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:10:02.346283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:10:02.373546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:02.374037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:02.374476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:02.375197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:02.375649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:02.376072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:02.454457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Getting quotas for project b5c1dad20fdd43cdbab89cd4f79fbed6. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:02.459881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Getting quotas for user 14277c6865464b2ea0e881d88b516f8f and project b5c1dad20fdd43cdbab89cd4f79fbed6. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:02.489620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:10:02.496029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:10:02.662812 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9db74338-9b77-417e-8ac0-c107526192c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.749357 Oct 04 11:10:02.663487 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1269/2503] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:10:02.693150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:02.697004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:02.727730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:02.729670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:02.734627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:02.735735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:02.736352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:02.737199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:03.010517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:03.026981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:03.036968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:03.038294 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1e9844f5-10be-448c-bd98-fd08e0c74496 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.358926 Oct 04 11:10:03.044519 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1270/2504] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:02 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:03.049540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2697b7ef-da5b-4b71-a90d-a1e4cee363a1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d450df70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:03.192487 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2697b7ef-da5b-4b71-a90d-a1e4cee363a1 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.146778 Oct 04 11:10:03.193091 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1271/2505] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:03 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:03.670761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4352ac5-b504-4633-b0cb-5685ee8dc853 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Action: 'create', calling method: .version_select at 0x7f71d437b8b0>, body: {"keypair": {"name": "tempest-keypair-942112456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6toMAAYLA6JkD4o2c/r2ohOCXql5QIXFFx9rVx4tgyEf7qzplqMzBkQXA3r14cm4cYLh6ATAKh5qp0vi9m/Ogp82nDc/jcYA3nRC73zgwXOw87OoOaZelGGrUohh0sPQ=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:03.732453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f4352ac5-b504-4633-b0cb-5685ee8dc853 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:03.745624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f4352ac5-b504-4633-b0cb-5685ee8dc853 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:03.792645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:03.803766 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4352ac5-b504-4633-b0cb-5685ee8dc853 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.606939 Oct 04 11:10:03.813769 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1272/2506] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Oct 4 11:10:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 619 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:10:03.832527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ae84e10-0fbe-4f5d-9ca7-e889fcd8593f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:03.834244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ae84e10-0fbe-4f5d-9ca7-e889fcd8593f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:04.003905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ae84e10-0fbe-4f5d-9ca7-e889fcd8593f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:04.027415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ae84e10-0fbe-4f5d-9ca7-e889fcd8593f tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1213 microversion: 2.1 time: 0.208287 Oct 04 11:10:04.031233 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1273/2507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:03 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1213 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:04.045924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-566d81de-59d9-4037-94f4-2623ddecf77e tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d44d4f70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:04.074782 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-566d81de-59d9-4037-94f4-2623ddecf77e tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-942112456" status: 200 len: 512 microversion: 2.2 time: 0.042405 Oct 04 11:10:04.087428 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1274/2508] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Oct 4 11:10:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-942112456 => generated 512 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:04.100780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:04.101698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:04.123073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:04.124322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:04.126974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:04.129472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:04.131670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:04.132642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:04.426462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:04.479291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:04.480912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:04.482177 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c865c602-5ac1-4188-bcde-b609718d737e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.392815 Oct 04 11:10:04.482826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1275/2509] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:04 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:04.526638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab70c505-fa84-4584-b926-4d19f2af7c37 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d4284ca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:04.592441 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab70c505-fa84-4584-b926-4d19f2af7c37 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942112456" status: 204 len: 0 microversion: 2.2 time: 0.108002 Oct 04 11:10:04.606187 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1276/2510] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Oct 4 11:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942112456 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:04.621440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c670712-2097-4291-bf43-cd584560ffe3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d440ed30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:04.789826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c670712-2097-4291-bf43-cd584560ffe3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.182113 Oct 04 11:10:04.795460 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1277/2511] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:04 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:04.811498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca4883bd-b4f4-4e11-b680-9d68c417a365 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Action: 'create', calling method: .version_select at 0x7f71d450eb80>, body: {"keypair": {"name": "tempest-keypair-1731826052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhC6AcJAzw6LnILcfrL/UJVIwG0c5+06cxMpYVLJdLGNWMkEyO1QjxVfh0Odd0HuZ7flUO2CMPtvG4sh6p/f6bXtk3LP+iCTmku7/zrwcLxWLBGupKvB0UU1Lhzj0rk2Q=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:04.883937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ca4883bd-b4f4-4e11-b680-9d68c417a365 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:04.904112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ca4883bd-b4f4-4e11-b680-9d68c417a365 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:04.983733 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca4883bd-b4f4-4e11-b680-9d68c417a365 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.185817 Oct 04 11:10:04.985265 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1278/2512] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Oct 4 11:10:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:10:05.001794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3559bcd4-58d6-46ea-a583-c076193d5d77 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d4284c10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:05.065512 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3559bcd4-58d6-46ea-a583-c076193d5d77 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731826052" status: 204 len: 0 microversion: 2.2 time: 0.073000 Oct 04 11:10:05.067337 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1279/2513] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Oct 4 11:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731826052 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:10:05.084331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:05.087441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:05.112301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:05.114132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:05.115604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:05.120864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:05.122988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:05.125337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:05.462927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:05.479678 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-007ddfb4-a0e1-4280-9598-d0efe878cd15 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1265 microversion: 2.1 time: 0.410818 Oct 04 11:10:05.483505 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1280/2514] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:05 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:05.495708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-746ffb2a-53fb-4565-b039-464dd525568d tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Action: 'create', calling method: .version_select at 0x7f71d4421940>, body: {"keypair": {"name": "tempest-keypair-119227058", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:05.584225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-746ffb2a-53fb-4565-b039-464dd525568d tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:05.593075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-746ffb2a-53fb-4565-b039-464dd525568d tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:05.652766 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-746ffb2a-53fb-4565-b039-464dd525568d tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.167947 Oct 04 11:10:05.655011 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1281/2515] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Oct 4 11:10:05 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:10:05.669056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:05.676044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:05.683796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:05.706442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:05.706932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:05.707781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:05.708280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:05.708722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:05.964495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:05.987540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:06.004005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:06.011529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:06.018643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f6abb1d3-424d-4772-b39a-b74e6d02511c tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.356638 Oct 04 11:10:06.019830 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1282/2516] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:05 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:06.035780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ad288af-f395-47a6-9575-59b5336e105a tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d4284700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:06.108548 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ad288af-f395-47a6-9575-59b5336e105a tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-119227058" status: 204 len: 0 microversion: 2.2 time: 0.085905 Oct 04 11:10:06.110554 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1283/2517] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Oct 4 11:10:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-119227058 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:06.129582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a1815f4-1ccf-42ab-802c-ca122e477749 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4421670>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:06.220299 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a1815f4-1ccf-42ab-802c-ca122e477749 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.095393 Oct 04 11:10:06.225429 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1284/2518] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:06 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:06.230902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e2ad13b5-d03f-4343-bfc9-f863bf9c14e9 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Action: 'create', calling method: .version_select at 0x7f71d43c1790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-614763534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnLssUmmU5rQvHND6UHLWz9ENGVjZSxoFb937mSxMnm8iMn2WxVF/2wTCvHI4I/BBSqvA64Uy8bV5M/JFAGYsccAOct+oPH219somFTuSDBFuVjlzUI2EzXhHcodmvr5w=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:06.262928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e2ad13b5-d03f-4343-bfc9-f863bf9c14e9 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:06.269681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e2ad13b5-d03f-4343-bfc9-f863bf9c14e9 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:06.305228 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e2ad13b5-d03f-4343-bfc9-f863bf9c14e9 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.081223 Oct 04 11:10:06.308300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1285/2519] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Oct 4 11:10:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:10:06.325795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-623bb8e8-5462-4235-971d-14fca0901ff4 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Action: 'create', calling method: .version_select at 0x7f71d435fd30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1303334756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXToSqUaX0/8PaH0WCFwIpSJXyVQ4IUPExYPk+UEDnDbBog5nZIolfFaqTTOhvETN93qbYNAM2oCsdigCFX1Du/w5nxEFSMXST7KEBqlydF4/AL+Cth1L8b30lIg1YV8Q=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:06.352525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-623bb8e8-5462-4235-971d-14fca0901ff4 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:06.356765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-623bb8e8-5462-4235-971d-14fca0901ff4 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:06.403887 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-623bb8e8-5462-4235-971d-14fca0901ff4 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.083328 Oct 04 11:10:06.415747 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1286/2520] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Oct 4 11:10:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:10:06.430810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b1b8dcb-c7f0-41cf-a933-dc1920b4c35f tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Action: 'create', calling method: .version_select at 0x7f71d429d550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-240772866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmDq5LINZ0MnpxkcAuFxNUpLJXKfXY0Q+Fh6AyCzizLnhLAiZI/5iQXdlxMz0BSOsu59j+PGGkmpFLjBOGr3fWMyc4mZoE1oDtT8o/t+YhdqzTJwDlmcZv9Yxcr0tac5w=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:06.482001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-6b1b8dcb-c7f0-41cf-a933-dc1920b4c35f tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:06.486688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-6b1b8dcb-c7f0-41cf-a933-dc1920b4c35f tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:06.540269 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b1b8dcb-c7f0-41cf-a933-dc1920b4c35f tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.121409 Oct 04 11:10:06.540884 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1287/2521] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Oct 4 11:10:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:10:06.552574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:06.553190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:06.560097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:06.560585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:06.561023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:06.570347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:06.571426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:06.571876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:06.857727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:06.869428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a1f1612-300f-40ad-a899-3d49645e091b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1271 microversion: 2.1 time: 0.327386 Oct 04 11:10:06.870025 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1288/2522] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:06 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1271 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:06.875079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb6ead96-3d39-4b5f-ac66-7786ddc238e7 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d4414b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:06.890242 n-d-791135-8 devstack@n-api.service[122409]: WARNING oslo_db.sqlalchemy.utils [None req-cb6ead96-3d39-4b5f-ac66-7786ddc238e7 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 11:10:06.905040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cb6ead96-3d39-4b5f-ac66-7786ddc238e7 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.033376 Oct 04 11:10:06.906059 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1289/2523] 10.222.0.23 () {60 vars in 1177 bytes} [Tue Oct 4 11:10:06 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:06.918385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ab5637d-ced0-4a97-b691-962f96cc484b tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d41d0f70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:06.953807 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ab5637d-ced0-4a97-b691-962f96cc484b tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-240772866" status: 204 len: 0 microversion: 2.2 time: 0.039274 Oct 04 11:10:06.954492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1290/2524] 10.222.0.23 () {60 vars in 1318 bytes} [Tue Oct 4 11:10:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-240772866 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:10:06.963780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b507a85f-9009-4d0d-9572-b53e402dfadb tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d440e1f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:07.011741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b507a85f-9009-4d0d-9572-b53e402dfadb tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1303334756" status: 204 len: 0 microversion: 2.2 time: 0.052634 Oct 04 11:10:07.013758 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1291/2525] 10.222.0.23 () {60 vars in 1321 bytes} [Tue Oct 4 11:10:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1303334756 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:10:07.024165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a988964-2bd1-4503-856a-95255244a5a2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d44215e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:07.056511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=89,nova_api:DELETE=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:07.072162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a988964-2bd1-4503-856a-95255244a5a2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-614763534" status: 204 len: 0 microversion: 2.2 time: 0.054000 Oct 04 11:10:07.075341 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1292/2526] 10.222.0.23 () {60 vars in 1318 bytes} [Tue Oct 4 11:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-614763534 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:07.090623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:07.092431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:07.105079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:07.117105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:07.118366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:07.119285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:07.119905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:07.120486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:07.973884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:07.997444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:08.014942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:08.016217 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b7935f94-2f10-43a6-890e-154c6a1be351 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.939241 Oct 04 11:10:08.034027 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1293/2527] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:07 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:08.050377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95dc5648-ccd2-46cf-b74e-ec48f72e2f83 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Action: 'create', calling method: .version_select at 0x7f71d429de50>, body: {"keypair": {"name": "tempest-keypair-1376174852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx4sq9uo2akVdAl9KALXLbXE67mPz1dbvidkjYT6arKUWR3W1uuiXjeZU4O4rq6M0lDl46LZaMi2y1yiCYhLe0nqwc0X+/Uy9AwLQkahKGBRkTjFdpKMfwZMJ8A4s8cwQ=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:08.099472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-95dc5648-ccd2-46cf-b74e-ec48f72e2f83 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:08.114178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-95dc5648-ccd2-46cf-b74e-ec48f72e2f83 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:08.233308 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95dc5648-ccd2-46cf-b74e-ec48f72e2f83 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.197832 Oct 04 11:10:08.237060 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1294/2528] 10.222.0.23 () {62 vars in 1199 bytes} [Tue Oct 4 11:10:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:10:08.250601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b414d664-1a21-4e9e-8450-d2803b42f15d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d435adc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:08.352875 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b414d664-1a21-4e9e-8450-d2803b42f15d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.112807 Oct 04 11:10:08.361296 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1295/2529] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:08 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:08.366166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:08.366792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:08.401711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:08.402214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:08.402658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:08.403392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:08.403855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:08.419788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:09.682530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:09.712819 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e51fe685-38a6-4955-9bb5-36b3a86b1300 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1313 microversion: 2.1 time: 1.347080 Oct 04 11:10:09.713487 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1296/2530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:08 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1313 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:09.732855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f48a9b33-bc40-48ca-907d-e5a9115048ee tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d4421670>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:09.760180 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f48a9b33-bc40-48ca-907d-e5a9115048ee tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1376174852" status: 200 len: 513 microversion: 2.2 time: 0.045606 Oct 04 11:10:09.765999 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1297/2531] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Oct 4 11:10:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1376174852 => generated 513 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:09.781155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:09.782113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:09.802797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:09.803507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:09.808750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:09.809806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:09.810433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:09.811013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:10.464072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:10.487174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:10.503066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:10.510123 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-545be674-4835-4796-9b3d-bf172e7de760 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.742435 Oct 04 11:10:10.519774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1298/2532] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:09 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:10.542172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31462464-c9ca-4fa2-a142-f64ba2552cb6 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4284670>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:10.702805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31462464-c9ca-4fa2-a142-f64ba2552cb6 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.180859 Oct 04 11:10:10.704618 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1299/2533] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:10 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:10.714271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76d9ec31-8ac3-4165-ad54-8be742dfe821 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d41d0af0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:10.733420 n-d-791135-8 devstack@n-api.service[122409]: WARNING oslo_db.sqlalchemy.utils [None req-76d9ec31-8ac3-4165-ad54-8be742dfe821 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 11:10:10.765211 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76d9ec31-8ac3-4165-ad54-8be742dfe821 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.058931 Oct 04 11:10:10.775308 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1300/2534] 10.222.0.23 () {60 vars in 1177 bytes} [Tue Oct 4 11:10:10 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:10.803658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:10.804512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:10.833029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:10.840966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:10.841735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:10.843485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:10.844136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:10.844948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:11.505889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:11.514094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d83bb442-d1b2-4fb9-b73f-450ab1fe0fc1 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1313 microversion: 2.1 time: 0.737605 Oct 04 11:10:11.515012 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1301/2535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:10 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:11.523933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5257c087-f1f1-4b5c-b922-f58feac172a5 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d4421af0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:11.587691 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5257c087-f1f1-4b5c-b922-f58feac172a5 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376174852" status: 204 len: 0 microversion: 2.2 time: 0.071553 Oct 04 11:10:11.594339 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1302/2536] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Oct 4 11:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376174852 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:11.594339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:11.594339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:11.612479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:11.613041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:11.613566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:11.614249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:11.614769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:11.615213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:11.870151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:11.883424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:11.902499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:11.915127 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e0b51ab-cc3c-41d1-9a22-fb7566b617c0 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.325385 Oct 04 11:10:11.916289 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1303/2537] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:11 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:11.929479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Action: 'create', calling method: .version_select at 0x7f71d435fb80>, body: {"keypair": {"name": "tempest-keypair-951967118", "type": "x509"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:11.982818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:12.012656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:12.076216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.processutils [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpr0a3i_ki/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpr0a3i_ki/temp.key -subj /CN=694b3b94b3dc405f96cfd37b986e5c28 -extensions v3_req_client {{(pid=122409) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 11:10:12.395823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.processutils [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpr0a3i_ki/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpr0a3i_ki/temp.key -subj /CN=694b3b94b3dc405f96cfd37b986e5c28 -extensions v3_req_client" returned: 0 in 0.325s {{(pid=122409) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 11:10:12.397843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.processutils [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpr0a3i_ki/temp.key -password pass: {{(pid=122409) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 11:10:12.451034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:12.508509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.processutils [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpr0a3i_ki/temp.key -password pass:" returned: 0 in 0.110s {{(pid=122409) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 11:10:12.606729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:12.614147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Getting quotas for user 694b3b94b3dc405f96cfd37b986e5c28 and project 67c4bbeb98c544e4a4bf954c77e236cd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:12.643536 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb637ad8-49ef-4082-8f65-ec2f0ad869d2 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.724856 Oct 04 11:10:12.657431 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1304/2538] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Oct 4 11:10:11 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 737 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:12.662454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-713ad294-0a60-4508-8f57-e68147d8a6fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d429df70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:12.741195 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-713ad294-0a60-4508-8f57-e68147d8a6fe tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.084074 Oct 04 11:10:12.743677 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1305/2539] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:12 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:12.752927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:12.754353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:12.763795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:12.764746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:12.765498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:12.766833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:12.767515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:12.768411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:13.490682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:13.499832 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6034736e-fe32-435a-b261-956bd453fe79 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1334 microversion: 2.1 time: 0.754403 Oct 04 11:10:13.505695 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1306/2540] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:12 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1334 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:13.520684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dec517dd-9d05-495a-8e7d-f33a58646099 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d435fe50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:13.559113 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dec517dd-9d05-495a-8e7d-f33a58646099 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-951967118" status: 200 len: 1533 microversion: 2.2 time: 0.052220 Oct 04 11:10:13.559910 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1307/2541] 10.222.0.23 () {60 vars in 1255 bytes} [Tue Oct 4 11:10:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-951967118 => generated 1533 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:13.575136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:13.577540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:13.597734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:13.598242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:13.602376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:13.603274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:13.607264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:13.609446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:14.001898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:14.023701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:14.034208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:14.035644 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84c3431f-4878-456a-937f-7e6cf835fe8e tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.474891 Oct 04 11:10:14.043257 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1308/2542] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:13 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:14.059404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82bf5226-ce05-4586-9372-e9d7c54168e1 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d4493b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:14.075841 n-d-791135-8 devstack@n-api.service[122409]: WARNING oslo_db.sqlalchemy.utils [None req-82bf5226-ce05-4586-9372-e9d7c54168e1 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 11:10:14.094644 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82bf5226-ce05-4586-9372-e9d7c54168e1 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.050095 Oct 04 11:10:14.098818 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1309/2543] 10.222.0.23 () {60 vars in 1177 bytes} [Tue Oct 4 11:10:14 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:14.112176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-329d9e15-22b7-4705-8902-3e8f2da7e6c5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d429dd30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:14.195827 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-329d9e15-22b7-4705-8902-3e8f2da7e6c5 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.095144 Oct 04 11:10:14.200074 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1310/2544] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:14 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:14.207827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4888aea8-1796-42bf-8aa1-a67add932248 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] Calling method '.version_select at 0x7f71d435adc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:14.419581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4888aea8-1796-42bf-8aa1-a67add932248 tempest-KeyPairsV22TestJSON-899776825 tempest-KeyPairsV22TestJSON-899776825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-951967118" status: 204 len: 0 microversion: 2.2 time: 0.217978 Oct 04 11:10:14.420617 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1311/2545] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Oct 4 11:10:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-951967118 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:14.522984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:14.524164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:14.534763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:14.535277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:14.535725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:14.536459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:14.536923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:14.537704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:15.299028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:15.310297 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d78bed39-4eba-4f0a-a36f-367823c3cf01 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1334 microversion: 2.1 time: 0.791570 Oct 04 11:10:15.315060 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1312/2546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:14 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1334 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:10:15.332957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:15.334180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:15.345480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:15.346270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:15.346883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:15.354735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:15.355625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:15.356238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:15.495999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:15.514552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:15.518465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb7fadf5ab3b465d9fcf0e04aa3ebe84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5a71c4dee44e4a726208c616433a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:15.521998 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00d0907c-4d8e-46cc-b054-20c0b4976460 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 200 len: 1604 microversion: 2.42 time: 0.204875 Oct 04 11:10:15.526129 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1313/2547] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:15 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:15.533734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-100da75d-4354-4ec6-a89b-fa031196233f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d440e310>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:15.634296 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-100da75d-4354-4ec6-a89b-fa031196233f tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1437 microversion: 2.1 time: 0.105361 Oct 04 11:10:15.635603 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1314/2548] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:15 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:16.236182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-178820947", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "999d214d-a128-4728-9cd3-99390decb15f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:16.338807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] validate_networks() for [('999d214d-a128-4728-9cd3-99390decb15f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:10:18.474669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:10:18.477142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:10:18.478079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:10:18.478834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:10:18.481832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:10:18.508844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:18.509797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:18.510789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:18.511962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:18.512762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:18.513474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:18.600199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:18.614427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:18.667834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:10:18.673286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:10:18.790783 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c8e2b44-bde8-4705-8db9-898adfe25df8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.762673 Oct 04 11:10:18.800542 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1315/2549] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:10:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:10:18.811134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:18.815042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:18.839875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:18.840392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:18.842460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:18.847206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:18.848018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:18.849248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:20.181995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:20.191150 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-542b7790-0293-45c7-8b62-ff8ef8824aae tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1334 microversion: 2.1 time: 1.389319 Oct 04 11:10:20.195298 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1316/2550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:18 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1334 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:20.221764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:20.223207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:20.231157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:20.232128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:20.232756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:20.233731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:20.234382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:20.235088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:20.252975 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] HTTP exception thrown: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Request method failure captured: Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 HTTP/1.1 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBL0Q1Ii_TKjbUz-_KKA9kgRU5H2EFXD7f5RmfdMXPtB040RuDqLAx2ioMZzcXrHVAAX7IgCANcOUqsWf707lmUOsQhoExK5AMP5ou5_IjL_4GT25UGQfrJ0Exj8-yR4dRdzW_58Kec7HKPVgqiGWEqRTb6NPfucqHBesuYvw4niNeY Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 01c5a71c4dee44e4a726208c616433a6 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/01c5a71c4dee44e4a726208c616433a6"}]}] Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 01c5a71c4dee44e4a726208c616433a6 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TaggedBootDevicesTest_v242-1957326435-project Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: cb7fadf5ab3b465d9fcf0e04aa3ebe84 Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1957326435-project Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '76f5083c-2e63-41ad-bb6b-8ba579c57dc5'} Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:20.255985 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:20.260578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:20.260578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:20.260578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:20.260578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:20.260578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:10:20.260578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:10:20.260578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:20.260578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:20.264754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Returning 404 to user: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:10:20.265959 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93874e2b-36d3-4b01-98e9-2ef562c16975 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 404 len: 111 microversion: 2.42 time: 0.069079 Oct 04 11:10:20.267071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1317/2551] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:20 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:10:20.281694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba40aa63-ea41-4701-9a80-a1a5421fff75 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d43c15e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:20.354142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba40aa63-ea41-4701-9a80-a1a5421fff75 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1446 microversion: 2.1 time: 0.085754 Oct 04 11:10:20.363898 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1318/2552] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:20 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1446 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:20.367650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:20.368272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:20.376124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:20.377059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:20.377524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:20.378239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:20.378699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:20.379192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:20.884929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:20.895357 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f1c8ca7-678c-490b-8585-646844080605 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 200 len: 1244 microversion: 2.1 time: 0.539462 Oct 04 11:10:20.910890 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1319/2553] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:20 2022] GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 1244 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:20.916535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3eec3d85-e468-4a22-ac94-f4c797c6c42c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Action: 'create', calling method: .version_select at 0x7f71d49fadc0>, body: {"keypair": {"name": "tempest-keypair-822941176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwehkGqIqgvQONRJFFbMc8Rr+5ZFhUbCLDJ6ZAuoOLxtXv06cFDPF3R9yIfXG/q/9nUtOBVRTgXOZOwJi1pz92RqdSvbAIgrILENkAE6uUPlL9dWdd3w4HmUTaL2fkaug=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:20.971948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3eec3d85-e468-4a22-ac94-f4c797c6c42c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Getting quotas for project 1df6182d03a546539effc445c7d02041. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:20.979073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3eec3d85-e468-4a22-ac94-f4c797c6c42c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Getting quotas for user 63b8bbdea0c144d6b76d6a85bb1f1964 and project 1df6182d03a546539effc445c7d02041. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:21.006761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=92,nova_api:INSERT=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:21.028341 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3eec3d85-e468-4a22-ac94-f4c797c6c42c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.123178 Oct 04 11:10:21.033337 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1320/2554] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:10:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:10:21.258285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-edc43206-9886-4bf9-b543-64eca392cb46 req-a92042cc-1572-4d73-89fc-7443bcf15945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b347c7-d891-4452-befb-e6d7e3eb1af1", "tag": "aaf3bf6c-3927-45d5-842a-072033a5aa89"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:21.270593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-edc43206-9886-4bf9-b543-64eca392cb46 req-a92042cc-1572-4d73-89fc-7443bcf15945 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:21.271410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-edc43206-9886-4bf9-b543-64eca392cb46 req-a92042cc-1572-4d73-89fc-7443bcf15945 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:21.272051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-edc43206-9886-4bf9-b543-64eca392cb46 req-a92042cc-1572-4d73-89fc-7443bcf15945 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:21.285218 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-edc43206-9886-4bf9-b543-64eca392cb46 req-a92042cc-1572-4d73-89fc-7443bcf15945 service nova] Creating event network-changed:aaf3bf6c-3927-45d5-842a-072033a5aa89 for instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 on n-h2-791135-8 Oct 04 11:10:21.291898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-edc43206-9886-4bf9-b543-64eca392cb46 req-a92042cc-1572-4d73-89fc-7443bcf15945 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256887 Oct 04 11:10:21.293233 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1321/2555] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:21.299144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11cc6824-f893-4653-8c13-4582229c79e6 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '.version_select at 0x7f71d429dd30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:21.340491 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11cc6824-f893-4653-8c13-4582229c79e6 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618137327" status: 204 len: 0 microversion: 2.42 time: 0.044882 Oct 04 11:10:21.345309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1322/2556] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Oct 4 11:10:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618137327 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:10:21.350348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1c59111-a6c0-4f4f-af9c-29afc9cc693a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4284dc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:21.410983 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1c59111-a6c0-4f4f-af9c-29afc9cc693a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 200 len: 1446 microversion: 2.1 time: 0.064461 Oct 04 11:10:21.411720 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1323/2557] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:21 2022] GET /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 1446 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:21.517538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-739849863", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "973c00bd-0fce-4cb1-a025-a2c2987cef21"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:21.627594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] validate_networks() for [('973c00bd-0fce-4cb1-a025-a2c2987cef21', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:10:22.754604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:10:22.756150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:10:22.756852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:10:22.757747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:10:22.758380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:10:22.774885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:22.779712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:22.781298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:22.782790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:22.783492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:22.785585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:22.854829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for project d8213366237849c5bd0db518c55bc288. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:22.860853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for user 8f8c67a2ba884edbb978a166d91294d7 and project d8213366237849c5bd0db518c55bc288. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:22.877461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:10:22.880274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:10:22.969773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45832c60-ef76-451f-9ae9-99dc07a14e29 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.556830 Oct 04 11:10:22.971914 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1324/2558] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:10:22.981823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:22.988437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:22.996832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:22.997591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:22.998273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:23.000084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:23.000883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:23.004839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:23.338491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:23.350588 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1d8dced-01da-4adb-af17-8739d2d9ffb2 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1334 microversion: 2.1 time: 0.377337 Oct 04 11:10:23.352335 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1325/2559] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:22 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1334 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:23.369933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28f033d0-7bc6-430c-a920-61ae8ab9160d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d429d0d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:24.460861 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28f033d0-7bc6-430c-a920-61ae8ab9160d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 204 len: 0 microversion: 2.1 time: 1.106023 Oct 04 11:10:24.461550 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1326/2560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:23 2022] DELETE /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 0 bytes in 1109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:24.466876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-39490072-e8b1-4a57-9031-8f362e1dc504 req-5dba168e-bbb1-4b20-a6c8-cd662e546d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964982db-00fc-459f-ab6f-c1dab81e9c49", "name": "network-vif-unplugged", "status": "completed", "tag": "b59d1369-05c7-4f30-a1b1-2f6d74013825"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:24.486369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-39490072-e8b1-4a57-9031-8f362e1dc504 req-5dba168e-bbb1-4b20-a6c8-cd662e546d9c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:24.487213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-39490072-e8b1-4a57-9031-8f362e1dc504 req-5dba168e-bbb1-4b20-a6c8-cd662e546d9c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:24.487814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-39490072-e8b1-4a57-9031-8f362e1dc504 req-5dba168e-bbb1-4b20-a6c8-cd662e546d9c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:24.533241 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-39490072-e8b1-4a57-9031-8f362e1dc504 req-5dba168e-bbb1-4b20-a6c8-cd662e546d9c service nova] Creating event network-vif-unplugged:b59d1369-05c7-4f30-a1b1-2f6d74013825 for instance 964982db-00fc-459f-ab6f-c1dab81e9c49 on n-h1-791135-8 Oct 04 11:10:24.543372 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-39490072-e8b1-4a57-9031-8f362e1dc504 req-5dba168e-bbb1-4b20-a6c8-cd662e546d9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080421 Oct 04 11:10:24.544675 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1327/2561] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:24.551739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:24.552899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:24.561836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:24.562711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:24.563521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:24.564468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:24.565146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:24.565753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:25.235648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:25.246459 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7cd70a8-d0c1-44b0-9fe9-ad3b0e397308 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 200 len: 1292 microversion: 2.1 time: 0.700332 Oct 04 11:10:25.247313 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1328/2562] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:24 2022] GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 1292 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:25.265248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:25.266092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:25.283264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:25.283786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:25.284387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:25.285255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:25.285886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:25.286489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:25.538456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:25.544488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:25.587020 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b2719d2f-9988-4cff-9b52-426ee3448e28 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1268 microversion: 2.1 time: 0.332624 Oct 04 11:10:25.587863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1329/2563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:25 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1268 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:25.597930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b48fbee1-2e5a-4832-9c3f-8bc95511a1d3 req-52539c1d-5a0c-432c-959c-470eaf8a9aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b347c7-d891-4452-befb-e6d7e3eb1af1", "tag": "4d7f10f4-09f2-49ed-981e-efe57ff8e615"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:25.631787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b48fbee1-2e5a-4832-9c3f-8bc95511a1d3 req-52539c1d-5a0c-432c-959c-470eaf8a9aca service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:25.633269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b48fbee1-2e5a-4832-9c3f-8bc95511a1d3 req-52539c1d-5a0c-432c-959c-470eaf8a9aca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:25.638217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b48fbee1-2e5a-4832-9c3f-8bc95511a1d3 req-52539c1d-5a0c-432c-959c-470eaf8a9aca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:25.671398 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b48fbee1-2e5a-4832-9c3f-8bc95511a1d3 req-52539c1d-5a0c-432c-959c-470eaf8a9aca service nova] Creating event network-changed:4d7f10f4-09f2-49ed-981e-efe57ff8e615 for instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 on n-h2-791135-8 Oct 04 11:10:25.692186 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b48fbee1-2e5a-4832-9c3f-8bc95511a1d3 req-52539c1d-5a0c-432c-959c-470eaf8a9aca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101080 Oct 04 11:10:25.693994 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1330/2564] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:25.703376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:25.704843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:25.725429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:25.726216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:25.730388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:25.731257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:25.731755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:25.732205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:26.381961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:26.395987 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-767a0556-51f6-46d2-bf7a-9d9657ea44c9 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1334 microversion: 2.1 time: 0.699298 Oct 04 11:10:26.397136 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1331/2565] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:25 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1334 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:26.427254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:26.428006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:26.436633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:26.441125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:26.441918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:26.443461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:26.444094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:26.444961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:26.510350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:10:26.676327 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8524615-14d8-4459-9b21-cbcc5e5fdc2a tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 204 len: 0 microversion: 2.1 time: 0.269006 Oct 04 11:10:26.677257 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1332/2566] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:10:26 2022] DELETE /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:26.701631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:26.702572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:26.712175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:26.719378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:26.720063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:26.721628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:26.722294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:26.723096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:27.089075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:27.105279 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab62d283-1e81-4580-b94d-1221ede9c443 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 200 len: 1292 microversion: 2.1 time: 0.424922 Oct 04 11:10:27.106013 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1333/2567] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:26 2022] GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 1292 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:27.134289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2c754d64-a5d0-4b94-b189-8bad98a49ca6 req-717ef67b-ba54-44b7-8994-5bada8d5a7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e5a084-0715-4974-afee-615b911a7431", "tag": "7754a394-96de-4897-a004-0548fa843b5e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:27.148370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c754d64-a5d0-4b94-b189-8bad98a49ca6 req-717ef67b-ba54-44b7-8994-5bada8d5a7f6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:27.149312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c754d64-a5d0-4b94-b189-8bad98a49ca6 req-717ef67b-ba54-44b7-8994-5bada8d5a7f6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:27.150074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c754d64-a5d0-4b94-b189-8bad98a49ca6 req-717ef67b-ba54-44b7-8994-5bada8d5a7f6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:27.171664 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2c754d64-a5d0-4b94-b189-8bad98a49ca6 req-717ef67b-ba54-44b7-8994-5bada8d5a7f6 service nova] Creating event network-changed:7754a394-96de-4897-a004-0548fa843b5e for instance a4e5a084-0715-4974-afee-615b911a7431 on n-h1-791135-8 Oct 04 11:10:27.178242 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2c754d64-a5d0-4b94-b189-8bad98a49ca6 req-717ef67b-ba54-44b7-8994-5bada8d5a7f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069754 Oct 04 11:10:27.180050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1334/2568] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:27.188228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:27.189120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:27.198715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:27.200153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:27.200916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:27.202906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:27.204006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:27.204652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:27.454288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:27.463391 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-106bb188-307f-4b13-85ec-06a5d3544ddf tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1268 microversion: 2.1 time: 0.281893 Oct 04 11:10:27.478135 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1335/2569] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:27 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1268 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:27.485161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-741872271", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e3e416ac-c329-4dac-b9be-2ab1fb5ccb82"}, {"port": "a7932ed8-b8f4-40f5-bf96-846abf9c6b0b", "tag": "port-1"}, {"port": "6365b2cf-b61a-408e-a6b0-79f4a014c87a", "tag": "port-2"}, {"uuid": "917f77e6-fc4e-45da-b7f5-0033ddcff0e4", "tag": "net-1"}, {"uuid": "917f77e6-fc4e-45da-b7f5-0033ddcff0e4"}, {"uuid": "a866b709-dd1f-4509-8f67-24a1bd2ebb9f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a866b709-dd1f-4509-8f67-24a1bd2ebb9f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a73f48de-e437-4200-b020-4481a6a5652f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "da6a386a-228d-4c97-9af4-06cf5a24f5f6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7ab20f79-ad7f-4ece-9f09-2e7d93683e2c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--702067641"}], "key_name": "tempest-keypair-822941176", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:27.697731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] validate_networks() for [('e3e416ac-c329-4dac-b9be-2ab1fb5ccb82', None, None, None, None, None), (None, None, 'a7932ed8-b8f4-40f5-bf96-846abf9c6b0b', None, None, None), (None, None, '6365b2cf-b61a-408e-a6b0-79f4a014c87a', None, None, None), ('917f77e6-fc4e-45da-b7f5-0033ddcff0e4', None, None, None, None, None), ('917f77e6-fc4e-45da-b7f5-0033ddcff0e4', None, None, None, None, None), ('a866b709-dd1f-4509-8f67-24a1bd2ebb9f', '10.2.2.100', None, None, None, None), ('a866b709-dd1f-4509-8f67-24a1bd2ebb9f', '10.2.2.200', None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:10:32.808236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:32.871336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=60 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:34.035918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:10:34.036617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:10:34.037543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:10:34.038447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:10:34.039081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:10:34.050110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:34.050868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:34.051519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:34.052478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:34.053297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:34.054534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:34.077654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Getting quotas for project 1df6182d03a546539effc445c7d02041. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:34.082507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Getting quotas for user 63b8bbdea0c144d6b76d6a85bb1f1964 and project 1df6182d03a546539effc445c7d02041. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:34.299141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:10:34.302460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a73f48de-e437-4200-b020-4481a6a5652f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='da6a386a-228d-4c97-9af4-06cf5a24f5f6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ab20f79-ad7f-4ece-9f09-2e7d93683e2c',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:10:34.813236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7516c9ae-eb2b-4ec5-83c1-8596f8bbd6a4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.333695 Oct 04 11:10:34.814314 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1336/2570] 10.222.0.23 () {62 vars in 1189 bytes} [Tue Oct 4 11:10:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 7335 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:10:34.820777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-675329263", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "fe42e5c1-b0b0-4c86-b1a2-ac753c58d8e1"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:34.943135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] validate_networks() for [('fe42e5c1-b0b0-4c86-b1a2-ac753c58d8e1', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:10:35.461634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:10:35.463081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:10:35.463863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:10:35.464444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:10:35.464863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:10:35.476525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:35.477244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:35.477768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:35.478684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:35.479510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:35.480357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:35.501627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Getting quotas for project ee7bbcbc81f547c0b5982b0f1efc54cc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:35.507144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Getting quotas for user 4dbb699b24b3432e9adc7b6d869e4744 and project ee7bbcbc81f547c0b5982b0f1efc54cc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:35.541232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:10:35.544515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:10:35.605688 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eda0dc76-2e5a-4ebd-b0ae-f6fabb7d8667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789822 Oct 04 11:10:35.606662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1337/2571] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:10:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:10:35.612094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:35.612753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:35.620348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:35.621252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:35.621925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:35.622847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:35.623512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:35.624150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:35.890693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:35.899355 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d087be91-3280-4d6c-b04e-6beda6f851ea tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1334 microversion: 2.1 time: 0.291377 Oct 04 11:10:35.900323 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1338/2572] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:35 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1334 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:35.905230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:35.906050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:35.919044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:35.919533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:35.919965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:35.920666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:35.921170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:35.921636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:36.114474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:36.125330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb572907-fac0-4b9d-9be3-c4e6686cc4ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 200 len: 1292 microversion: 2.1 time: 0.223760 Oct 04 11:10:36.125957 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1339/2573] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:35 2022] GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 1292 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:36.156103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:36.157015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:36.165520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:36.166130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:36.166668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:36.167473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:36.168054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:36.168551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:36.314728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:36.322847 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f8b72cd-ba6c-463b-ac25-71153b24bd7b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1310 microversion: 2.1 time: 0.177304 Oct 04 11:10:36.323445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1340/2574] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:36 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1310 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:36.328079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7873ea88-1519-4fc4-82a3-52bd7baee4f1 req-d5a61348-bd39-4eb8-af4a-19f58dfbd861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964982db-00fc-459f-ab6f-c1dab81e9c49", "name": "network-vif-deleted", "tag": "b59d1369-05c7-4f30-a1b1-2f6d74013825"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:36.338092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7873ea88-1519-4fc4-82a3-52bd7baee4f1 req-d5a61348-bd39-4eb8-af4a-19f58dfbd861 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:36.338575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7873ea88-1519-4fc4-82a3-52bd7baee4f1 req-d5a61348-bd39-4eb8-af4a-19f58dfbd861 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:36.339011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7873ea88-1519-4fc4-82a3-52bd7baee4f1 req-d5a61348-bd39-4eb8-af4a-19f58dfbd861 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:36.351159 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7873ea88-1519-4fc4-82a3-52bd7baee4f1 req-d5a61348-bd39-4eb8-af4a-19f58dfbd861 service nova] Creating event network-vif-deleted:b59d1369-05c7-4f30-a1b1-2f6d74013825 for instance 964982db-00fc-459f-ab6f-c1dab81e9c49 on n-h1-791135-8 Oct 04 11:10:36.355941 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7873ea88-1519-4fc4-82a3-52bd7baee4f1 req-d5a61348-bd39-4eb8-af4a-19f58dfbd861 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031148 Oct 04 11:10:36.356839 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1341/2575] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:36.363949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-77c62f8b-69c5-4b30-ae8e-77aa15ba5d71 req-d303e855-4e22-4e26-a27f-9bd43d3e8bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce89cc9a-b946-425d-9da9-1df8bc6fbe14", "tag": "c14ec83b-22fc-4601-b016-91807e8a04cb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:36.374976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77c62f8b-69c5-4b30-ae8e-77aa15ba5d71 req-d303e855-4e22-4e26-a27f-9bd43d3e8bce service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:36.375463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77c62f8b-69c5-4b30-ae8e-77aa15ba5d71 req-d303e855-4e22-4e26-a27f-9bd43d3e8bce service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:36.375904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77c62f8b-69c5-4b30-ae8e-77aa15ba5d71 req-d303e855-4e22-4e26-a27f-9bd43d3e8bce service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:36.387318 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-77c62f8b-69c5-4b30-ae8e-77aa15ba5d71 req-d303e855-4e22-4e26-a27f-9bd43d3e8bce service nova] Creating event network-changed:c14ec83b-22fc-4601-b016-91807e8a04cb for instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 on n-h2-791135-8 Oct 04 11:10:36.392046 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-77c62f8b-69c5-4b30-ae8e-77aa15ba5d71 req-d303e855-4e22-4e26-a27f-9bd43d3e8bce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033467 Oct 04 11:10:36.392638 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1342/2576] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:36.447434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d600f089-7339-4360-bea9-02ea75a26ad7 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d4227700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-400457448", "description": "tempest-description-714727664"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:36.818189 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d600f089-7339-4360-bea9-02ea75a26ad7 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.424317 Oct 04 11:10:36.819125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1343/2577] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:10:36 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:36.824231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:36.824843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:36.840458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:36.841107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:36.841585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:36.842292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:36.842752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:36.843176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:36.882787 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] HTTP exception thrown: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Request method failure captured: Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 HTTP/1.1 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBL0Q1Ii_TKjbUz-_KKA9kgRU5H2EFXD7f5RmfdMXPtB040RuDqLAx2ioMZzcXrHVAAX7IgCANcOUqsWf707lmUOsQhoExK5AMP5ou5_IjL_4GT25UGQfrJ0Exj8-yR4dRdzW_58Kec7HKPVgqiGWEqRTb6NPfucqHBesuYvw4niNeY Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 01c5a71c4dee44e4a726208c616433a6 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/01c5a71c4dee44e4a726208c616433a6"}]}] Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 01c5a71c4dee44e4a726208c616433a6 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TaggedBootDevicesTest_v242-1957326435-project Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: cb7fadf5ab3b465d9fcf0e04aa3ebe84 Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1957326435-project Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '76f5083c-2e63-41ad-bb6b-8ba579c57dc5'} Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:10:36.885439 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:36.889212 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:36.891317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Returning 404 to user: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:10:36.892191 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3a45337-ccf9-4d73-9bcf-12cd765c4f81 tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 404 len: 111 microversion: 2.42 time: 0.072121 Oct 04 11:10:36.893165 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1344/2578] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:10:36 2022] DELETE /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:10:36.909245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e30b20e2-ced4-4b9a-b4b2-c62c94e69fbc req-16de6e3b-1c64-49f6-bbbe-866b7a7912b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e5a084-0715-4974-afee-615b911a7431", "name": "network-vif-plugged", "status": "completed", "tag": "7754a394-96de-4897-a004-0548fa843b5e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:36.939321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e30b20e2-ced4-4b9a-b4b2-c62c94e69fbc req-16de6e3b-1c64-49f6-bbbe-866b7a7912b8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:36.939804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e30b20e2-ced4-4b9a-b4b2-c62c94e69fbc req-16de6e3b-1c64-49f6-bbbe-866b7a7912b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:36.960183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e30b20e2-ced4-4b9a-b4b2-c62c94e69fbc req-16de6e3b-1c64-49f6-bbbe-866b7a7912b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:37.000835 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e30b20e2-ced4-4b9a-b4b2-c62c94e69fbc req-16de6e3b-1c64-49f6-bbbe-866b7a7912b8 service nova] Creating event network-vif-plugged:7754a394-96de-4897-a004-0548fa843b5e for instance a4e5a084-0715-4974-afee-615b911a7431 on n-h1-791135-8 Oct 04 11:10:37.013177 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e30b20e2-ced4-4b9a-b4b2-c62c94e69fbc req-16de6e3b-1c64-49f6-bbbe-866b7a7912b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117669 Oct 04 11:10:37.016821 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1345/2579] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:37.023824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:37.025330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:37.031251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:37.032832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:37.034568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:37.035017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:37.035898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:37.036525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:37.037109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:37.200420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:37.214307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:37.217873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:37.219179 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7816b28d-3a07-40e1-8134-b0db636c6ca2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1592 microversion: 2.32 time: 0.200795 Oct 04 11:10:37.223676 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1346/2580] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:37 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1592 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:37.248060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:37.249836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:37.261928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:37.262612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:37.263415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:37.265628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:37.266323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:37.266926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:37.395873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:37.406097 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d931262-2b0b-473f-8cde-921f8b4ae342 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1267 microversion: 2.1 time: 0.181217 Oct 04 11:10:37.406609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1347/2581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:37 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:37.441530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc9dcacd-6b04-4793-9e67-7a1debc0063f tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d42278b0>, body: {"security_group_rule": {"parent_group_id": "d4d2ad8c-179a-42e4-bb37-38727157a8a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:37.742082 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc9dcacd-6b04-4793-9e67-7a1debc0063f tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.309069 Oct 04 11:10:37.743119 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1348/2582] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:10:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:37.748372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:37.750719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] [instance: 76f5083c-2e63-41ad-bb6b-8ba579c57dc5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:37.769851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:37.771214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:37.774167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:37.775120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:37.775727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:37.776398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:37.795021 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] HTTP exception thrown: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Request method failure captured: Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 HTTP/1.1 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBL0Q1Ii_TKjbUz-_KKA9kgRU5H2EFXD7f5RmfdMXPtB040RuDqLAx2ioMZzcXrHVAAX7IgCANcOUqsWf707lmUOsQhoExK5AMP5ou5_IjL_4GT25UGQfrJ0Exj8-yR4dRdzW_58Kec7HKPVgqiGWEqRTb6NPfucqHBesuYvw4niNeY Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 01c5a71c4dee44e4a726208c616433a6 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01c5a71c4dee44e4a726208c616433a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/01c5a71c4dee44e4a726208c616433a6"}]}] Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 01c5a71c4dee44e4a726208c616433a6 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1957326435 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TaggedBootDevicesTest_v242-1957326435-project Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: cb7fadf5ab3b465d9fcf0e04aa3ebe84 Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1957326435-project Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '76f5083c-2e63-41ad-bb6b-8ba579c57dc5'} Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:37.806750 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:37.810704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:37.810704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:37.810704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:37.810704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:37.810704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:10:37.810704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:10:37.810704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. Oct 04 11:10:37.810704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:37.815126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] Returning 404 to user: Instance 76f5083c-2e63-41ad-bb6b-8ba579c57dc5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:10:37.816032 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8945346-1d22-43ef-a937-3da7c0e8e27f tempest-TaggedBootDevicesTest_v242-1957326435 tempest-TaggedBootDevicesTest_v242-1957326435-project] 10.222.0.23 "GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5" status: 404 len: 111 microversion: 2.42 time: 0.071521 Oct 04 11:10:37.817055 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1349/2583] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:37 2022] GET /compute/v2.1/servers/76f5083c-2e63-41ad-bb6b-8ba579c57dc5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:10:37.839282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:37.842643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:37.860025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:37.863496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:37.864111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:37.867278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:37.867945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:37.869617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:38.090247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:38.105845 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a81a5638-b595-436a-8f79-0de631ba7657 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1334 microversion: 2.1 time: 0.287299 Oct 04 11:10:38.107260 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1350/2584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:37 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1334 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:38.117690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:38.118469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:38.125784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:38.126549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:38.126990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:38.127725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:38.128188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:38.128617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:38.309537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:38.321970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ed12196a-4cf4-49f9-ac08-f03ddda88414 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 200 len: 1292 microversion: 2.1 time: 0.213319 Oct 04 11:10:38.322929 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1351/2585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:38 2022] GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 1292 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:38.329990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:38.330926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:38.344059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:38.344600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:38.345044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:38.345900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:38.346471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:38.346905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:38.503826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:38.509623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:38.516957 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b3f61d5-192d-4ea4-ac98-ecd68f7b2060 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1310 microversion: 2.1 time: 0.191613 Oct 04 11:10:38.518715 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1352/2586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:38 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1310 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:38.527398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1bf3f35-5e1e-4c6c-8374-878c0e9949da tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d440ea60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1345604332", "description": "tempest-description-555475617"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:38.754945 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1bf3f35-5e1e-4c6c-8374-878c0e9949da tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.234382 Oct 04 11:10:38.756175 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1353/2587] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:10:38 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:38.794449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:38.795175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:38.807247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:38.809723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:38.810525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:38.811446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:38.812946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:38.814237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:39.106010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:39.127702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:39.131569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:39.136238 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7441aa9-3ba8-4f59-b5eb-79143bba32da tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1659 microversion: 2.32 time: 0.360220 Oct 04 11:10:39.139525 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1354/2588] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:38 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1659 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:39.156594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:39.158391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:39.172341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:39.175366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:39.176027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:39.177965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:39.180069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:39.180915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:39.377673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:39.387081 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c89d9d41-1d95-4a47-bb38-3ac3111a9667 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1307 microversion: 2.1 time: 0.245461 Oct 04 11:10:39.387975 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1355/2589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:39 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:39.393318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e102958c-377b-464d-bba0-995ba96325b7 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d41d0af0>, body: {"security_group_rule": {"parent_group_id": "1b8f01cd-f611-4ece-86d3-6242cac01790", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:39.658863 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e102958c-377b-464d-bba0-995ba96325b7 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.269381 Oct 04 11:10:39.659895 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1356/2590] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:10:39 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:39.664909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:39.665827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:39.674446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:39.675230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:39.675941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:39.676858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:39.678195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:39.679029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:39.870607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:39.884751 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f74bf544-f1f2-4a00-ad9a-d016a02132ff tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1334 microversion: 2.1 time: 0.223483 Oct 04 11:10:39.887118 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1357/2591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:39 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1334 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:39.892912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2f77367f-9a07-4966-b2cb-e9437416798a req-b92f9e0c-5572-48b2-a743-71d627cdf56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b347c7-d891-4452-befb-e6d7e3eb1af1", "name": "network-vif-plugged", "status": "completed", "tag": "aaf3bf6c-3927-45d5-842a-072033a5aa89"}, {"server_uuid": "f8b347c7-d891-4452-befb-e6d7e3eb1af1", "name": "network-vif-plugged", "status": "completed", "tag": "4d7f10f4-09f2-49ed-981e-efe57ff8e615"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:39.907128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2f77367f-9a07-4966-b2cb-e9437416798a req-b92f9e0c-5572-48b2-a743-71d627cdf56b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:39.907944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2f77367f-9a07-4966-b2cb-e9437416798a req-b92f9e0c-5572-48b2-a743-71d627cdf56b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:39.908603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2f77367f-9a07-4966-b2cb-e9437416798a req-b92f9e0c-5572-48b2-a743-71d627cdf56b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:39.924786 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2f77367f-9a07-4966-b2cb-e9437416798a req-b92f9e0c-5572-48b2-a743-71d627cdf56b service nova] Creating event network-vif-plugged:aaf3bf6c-3927-45d5-842a-072033a5aa89 for instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 on n-h2-791135-8 Oct 04 11:10:39.925408 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2f77367f-9a07-4966-b2cb-e9437416798a req-b92f9e0c-5572-48b2-a743-71d627cdf56b service nova] Creating event network-vif-plugged:4d7f10f4-09f2-49ed-981e-efe57ff8e615 for instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 on n-h2-791135-8 Oct 04 11:10:39.932955 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2f77367f-9a07-4966-b2cb-e9437416798a req-b92f9e0c-5572-48b2-a743-71d627cdf56b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044394 Oct 04 11:10:39.934020 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1358/2592] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:39.940237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:39.941008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:39.948750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:39.949381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:39.949869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:39.951187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:39.951187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:39.951721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:40.249414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:40.266461 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1a84031-c925-4d5a-b930-e7031b2fa8a5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 200 len: 1474 microversion: 2.1 time: 0.331304 Oct 04 11:10:40.267317 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1359/2593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:39 2022] GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 1474 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:40.272287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:40.280151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:40.291103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:40.291844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:40.292463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:40.293387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:40.294003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:40.294586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:40.499667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:40.510364 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37a464f1-9a79-4ac0-81fd-d97b3e8d15f2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1310 microversion: 2.1 time: 0.241848 Oct 04 11:10:40.511138 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1360/2594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:40 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1310 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:40.516081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8657fae-5d8e-437c-acb8-4769e81dc851 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d41db310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1210743040", "description": "tempest-description-996491871"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:40.859807 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8657fae-5d8e-437c-acb8-4769e81dc851 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.347348 Oct 04 11:10:40.863192 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1361/2595] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:10:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:40.869053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:40.869970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:40.880036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:40.881194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:40.881934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:40.882874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:40.883538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:40.884171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:41.171175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:41.183876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:41.185913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:41.188933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5ebc6b9d-4ff2-4b2d-a64e-f7a79024d4be tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1705 microversion: 2.32 time: 0.322951 Oct 04 11:10:41.190602 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1362/2596] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:40 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1705 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:41.195830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:41.196639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:41.203870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:41.204677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:41.205259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:41.206157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:41.206772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:41.208146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:41.391111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:41.406672 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ba2105c-8a7a-4cce-adfc-9533c5ade8d2 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1307 microversion: 2.1 time: 0.214573 Oct 04 11:10:41.407186 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1363/2597] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:41 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:41.411857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-36607fb6-9f50-463e-bdf8-231541c0e80e req-0973c8ee-eb70-48c7-8ce6-de73a6e017ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "106f6348-858a-40f0-b720-ddf960f7e43e", "tag": "a886901d-45a1-43b4-819e-d97fca48e2fb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:41.434469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-36607fb6-9f50-463e-bdf8-231541c0e80e req-0973c8ee-eb70-48c7-8ce6-de73a6e017ed service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:41.434965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-36607fb6-9f50-463e-bdf8-231541c0e80e req-0973c8ee-eb70-48c7-8ce6-de73a6e017ed service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:41.436815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-36607fb6-9f50-463e-bdf8-231541c0e80e req-0973c8ee-eb70-48c7-8ce6-de73a6e017ed service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:41.470102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-36607fb6-9f50-463e-bdf8-231541c0e80e req-0973c8ee-eb70-48c7-8ce6-de73a6e017ed service nova] Creating event network-changed:a886901d-45a1-43b4-819e-d97fca48e2fb for instance 106f6348-858a-40f0-b720-ddf960f7e43e on n-h1-791135-8 Oct 04 11:10:41.478422 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-36607fb6-9f50-463e-bdf8-231541c0e80e req-0973c8ee-eb70-48c7-8ce6-de73a6e017ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069964 Oct 04 11:10:41.482753 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1364/2598] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:41.488635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-128662823", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:41.582252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] validate_networks() for [('999d214d-a128-4728-9cd3-99390decb15f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:10:42.220390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:10:42.221012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:10:42.221886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:10:42.222650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:10:42.223224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:10:42.234751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:42.235700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:42.236317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:42.237243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:42.238075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:42.238671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:42.268443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:42.278334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:42.291773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:10:42.294399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 6a260641-f3a6-4dbb-9be0-6980d44a0fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:10:42.355543 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45672a4b-ed1d-463d-a360-130af738e444 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871357 Oct 04 11:10:42.356210 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1365/2599] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:10:42.361144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ccf8f85-993a-49d8-8ba6-d0ec8d97d07d tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d4227280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1514824363", "description": "tempest-description-580631341"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:42.585679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ccf8f85-993a-49d8-8ba6-d0ec8d97d07d tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.227906 Oct 04 11:10:42.586592 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1366/2600] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:10:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:42.591342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:42.591963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:42.622227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:42.624449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:42.627076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:42.628065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:42.631114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:42.633342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:42.966862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:42.976445 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ef12843-e3ec-4c00-acbd-aac775da0844 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1668 microversion: 2.1 time: 0.388770 Oct 04 11:10:42.978680 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1367/2601] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:42 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1668 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:42.984101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:42.984991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:42.994032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:42.994827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:42.995479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:42.996407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:42.997118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:42.997977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:43.152635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:43.162056 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13dec72c-48c0-412e-95bc-336124ce7069 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1310 microversion: 2.1 time: 0.181761 Oct 04 11:10:43.162904 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1368/2602] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:42 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1310 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:43.167532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-85af0a0f-64c5-4e29-a190-7473b9eff5d8 req-3aeab2a3-4c47-429b-93e2-7ac5ac3e7178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce89cc9a-b946-425d-9da9-1df8bc6fbe14", "name": "network-vif-plugged", "status": "completed", "tag": "c14ec83b-22fc-4601-b016-91807e8a04cb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:43.191887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-85af0a0f-64c5-4e29-a190-7473b9eff5d8 req-3aeab2a3-4c47-429b-93e2-7ac5ac3e7178 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:43.192311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-85af0a0f-64c5-4e29-a190-7473b9eff5d8 req-3aeab2a3-4c47-429b-93e2-7ac5ac3e7178 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:43.192756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-85af0a0f-64c5-4e29-a190-7473b9eff5d8 req-3aeab2a3-4c47-429b-93e2-7ac5ac3e7178 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:43.220263 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-85af0a0f-64c5-4e29-a190-7473b9eff5d8 req-3aeab2a3-4c47-429b-93e2-7ac5ac3e7178 service nova] Creating event network-vif-plugged:c14ec83b-22fc-4601-b016-91807e8a04cb for instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 on n-h2-791135-8 Oct 04 11:10:43.228075 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-85af0a0f-64c5-4e29-a190-7473b9eff5d8 req-3aeab2a3-4c47-429b-93e2-7ac5ac3e7178 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063235 Oct 04 11:10:43.228838 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1369/2603] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:43.235958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:43.236769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:43.244122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:43.244709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:43.245246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:43.246168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:43.246676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:43.247201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:43.564548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:43.583005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:43.594605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:43.597017 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76b270c1-efd8-4639-9d29-d50a345e6a23 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1751 microversion: 2.32 time: 0.366309 Oct 04 11:10:43.598901 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1370/2604] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:43 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1751 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:43.606748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:43.607836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 6a260641-f3a6-4dbb-9be0-6980d44a0fd8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:43.617066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:43.617860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:43.618557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:43.619542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:43.620410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:43.621391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:43.663920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 6a260641-f3a6-4dbb-9be0-6980d44a0fd8] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:10:43.783163 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00c4dcef-7c75-4ee3-afb5-9bebff2965ae tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8" status: 204 len: 0 microversion: 2.1 time: 0.182669 Oct 04 11:10:43.784198 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1371/2605] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:10:43 2022] DELETE /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:43.790517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:43.791529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:43.798120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:43.798809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:43.799568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:43.801559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:43.802908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:43.804046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:43.986632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:44.005943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff8845f6-3da1-445a-bea6-d7ef108de30e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1307 microversion: 2.1 time: 0.220193 Oct 04 11:10:44.021575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1372/2606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:43 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:44.028346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc4270b0-780b-4d9d-8318-9cf36cb9525f tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d4251dc0>, body: {"security_group_rule": {"parent_group_id": "56c44e4c-824e-4e52-b109-7db9e51c6343", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2c50100d-99bd-46b6-beff-5791693004ac"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:44.345582 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc4270b0-780b-4d9d-8318-9cf36cb9525f tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.322434 Oct 04 11:10:44.346396 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1373/2607] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:10:44 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:44.353777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:44.355061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:44.371396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:44.372349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:44.373096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:44.374104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:44.374794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:44.375587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:44.444558 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a1b8383-1cd9-4a21-9b3a-770bb6ade1d8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1/ips" status: 200 len: 178 microversion: 2.1 time: 0.096238 Oct 04 11:10:44.453832 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1374/2608] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:10:44 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1/ips => generated 178 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:44.476906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:44.478126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 6a260641-f3a6-4dbb-9be0-6980d44a0fd8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:44.493696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:44.495160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:44.496854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:44.498353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:44.500030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:44.501795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:44.630469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:44.637802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:44.642562 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc8bfabb-daba-408b-8538-178002e95b2b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8" status: 200 len: 1266 microversion: 2.1 time: 0.187147 Oct 04 11:10:44.645704 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1375/2609] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:44 2022] GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:44.658644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:44.662387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:44.691092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:44.691599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:44.692371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:44.693254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:44.694443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:44.695029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:44.938902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:44.952043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-56baabb1-e3e2-4552-b691-39af59562c61 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1310 microversion: 2.1 time: 0.302593 Oct 04 11:10:44.954849 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1376/2610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:44 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:44.967868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fcde5b58-9ca5-4270-b31c-85907006b289 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d8716ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1144179178", "description": "tempest-description-1391386062"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:45.293627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fcde5b58-9ca5-4270-b31c-85907006b289 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.335799 Oct 04 11:10:45.314771 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1377/2611] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:10:44 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:45.328148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:45.329955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:45.351335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:45.355441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:45.358006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:45.358904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:45.360503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:45.361561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:45.422939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:10:45.583941 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b835033-b864-45e0-9e70-3bd8516d51f8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 204 len: 0 microversion: 2.1 time: 0.267178 Oct 04 11:10:45.589981 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1378/2612] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:10:45 2022] DELETE /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:10:45.635874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:45.636612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:45.645306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:45.645974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:45.646425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:45.647735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:45.648364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:45.649121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:45.940976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:45.972033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:45.973913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:45.976764 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80c24b17-eb6a-4639-9868-d1359e85014d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1843 microversion: 2.32 time: 0.385103 Oct 04 11:10:45.977879 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1379/2613] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:45 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1843 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:45.983822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:45.984659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:45.992073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:45.992782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:45.993444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:45.994340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:45.994961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:45.995778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:46.155548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:46.166180 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10705342-5553-4154-ad89-61f37cfdc744 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1307 microversion: 2.1 time: 0.186902 Oct 04 11:10:46.177427 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1380/2614] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:45 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1307 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:46.177427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72715341-c9e1-4f41-a6cd-0522ba7e1bc5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d4251430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1607722205", "description": "tempest-description-1021464581"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:46.414974 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72715341-c9e1-4f41-a6cd-0522ba7e1bc5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.245648 Oct 04 11:10:46.415616 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1381/2615] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:10:46 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:46.420243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:46.421021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:46.441417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:46.444729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:46.445212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:46.446340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:46.447441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:46.449558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:46.775562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:46.785469 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c40f9a09-e332-426c-b46c-16f44d07d665 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1674 microversion: 2.1 time: 0.368593 Oct 04 11:10:46.798281 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1382/2616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:46 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1674 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:46.808565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:46.809657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 6a260641-f3a6-4dbb-9be0-6980d44a0fd8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:46.816186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:46.817032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:46.817733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:46.819316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:46.820025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:46.820678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:46.916893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:46.929753 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-263530bc-551f-4e94-946e-486eb0407374 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8" status: 200 len: 1210 microversion: 2.1 time: 0.130047 Oct 04 11:10:46.932732 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1383/2617] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:46 2022] GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:46.955928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:46.956929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:46.966566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:46.967111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:46.967868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:46.968647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:46.969110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:46.971385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:47.240294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:47.252084 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc45b7a8-9f59-4194-9f84-639ae3fd54ee tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1494 microversion: 2.1 time: 0.300270 Oct 04 11:10:47.255679 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1384/2618] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:46 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1494 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:47.266816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f76eebe2-61ec-4510-be10-f72e49c74f42 req-c59264d3-0058-4ea7-bb93-17b696154862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "tag": "91e8e93c-e545-42c5-a472-0e7ec77847ed"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:47.289566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f76eebe2-61ec-4510-be10-f72e49c74f42 req-c59264d3-0058-4ea7-bb93-17b696154862 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:47.295002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f76eebe2-61ec-4510-be10-f72e49c74f42 req-c59264d3-0058-4ea7-bb93-17b696154862 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:47.296353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f76eebe2-61ec-4510-be10-f72e49c74f42 req-c59264d3-0058-4ea7-bb93-17b696154862 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:47.317705 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f76eebe2-61ec-4510-be10-f72e49c74f42 req-c59264d3-0058-4ea7-bb93-17b696154862 service nova] Creating event network-changed:91e8e93c-e545-42c5-a472-0e7ec77847ed for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:10:47.323685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f76eebe2-61ec-4510-be10-f72e49c74f42 req-c59264d3-0058-4ea7-bb93-17b696154862 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064667 Oct 04 11:10:47.329292 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1385/2619] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:47.342603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51d1ea7b-d061-4e23-9f91-8c0ba04aa38b tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d87160d0>, body: {"security_group_rule": {"parent_group_id": "c70d8106-b7d1-4a6b-9c24-6c42c9dfd8b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "de12c76d-6978-4e01-ae5c-27c0d006de32"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:47.895627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51d1ea7b-d061-4e23-9f91-8c0ba04aa38b tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.557270 Oct 04 11:10:47.903112 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1386/2620] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:10:47 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:47.908145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-39387bc8-3dc5-4faa-a5e2-9dd09caf44f4 req-08c92981-621b-4c4d-bb64-b5b78b18c796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106f6348-858a-40f0-b720-ddf960f7e43e", "name": "network-vif-plugged", "status": "completed", "tag": "a886901d-45a1-43b4-819e-d97fca48e2fb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:47.942875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-39387bc8-3dc5-4faa-a5e2-9dd09caf44f4 req-08c92981-621b-4c4d-bb64-b5b78b18c796 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:47.943561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-39387bc8-3dc5-4faa-a5e2-9dd09caf44f4 req-08c92981-621b-4c4d-bb64-b5b78b18c796 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:47.945158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-39387bc8-3dc5-4faa-a5e2-9dd09caf44f4 req-08c92981-621b-4c4d-bb64-b5b78b18c796 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:47.963369 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-39387bc8-3dc5-4faa-a5e2-9dd09caf44f4 req-08c92981-621b-4c4d-bb64-b5b78b18c796 service nova] Creating event network-vif-plugged:a886901d-45a1-43b4-819e-d97fca48e2fb for instance 106f6348-858a-40f0-b720-ddf960f7e43e on n-h1-791135-8 Oct 04 11:10:47.970367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-39387bc8-3dc5-4faa-a5e2-9dd09caf44f4 req-08c92981-621b-4c4d-bb64-b5b78b18c796 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065623 Oct 04 11:10:47.976955 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1387/2621] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:48.008479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:48.009210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:48.028354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:48.033918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:48.036722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:48.037748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:48.039548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:48.040681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:48.779973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:48.796233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:48.798070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:48.799486 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc6d46fd-1a77-419f-b7dd-f2440461ee8e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1864 microversion: 2.32 time: 0.821049 Oct 04 11:10:48.803574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1388/2622] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:47 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1864 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:48.813227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:48.815148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:48.828720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:48.829496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:48.831610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:48.832511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:48.833266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:48.836654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:49.061452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:49.072099 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-478e37e8-55e3-4d15-bc8f-65e89240b0c0 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1307 microversion: 2.1 time: 0.267192 Oct 04 11:10:49.075307 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1389/2623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:48 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1307 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:49.172006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:49.174209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:49.189339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:49.190383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:49.190972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:49.191984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:49.192586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:49.193178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:49.510954 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7830943f-e6c8-4f68-80b4-3b9b1925ad61 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1645 microversion: 2.1 time: 0.431374 Oct 04 11:10:49.511920 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1390/2624] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:49 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1645 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:49.518568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:49.519691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:49.531432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:49.531973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:49.532416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:49.533435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:49.533910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:49.534343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:49.758005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14277c6865464b2ea0e881d88b516f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c1dad20fdd43cdbab89cd4f79fbed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:49.770850 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ad7b2980-9d37-4ae2-bd0e-b43eeb0f4af8 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 200 len: 1653 microversion: 2.1 time: 0.256046 Oct 04 11:10:49.786600 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1391/2625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:49 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 1653 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:49.793851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d99ac083-49f4-4d3d-b225-08e8709acf8c tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d4284dc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:50.076247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d99ac083-49f4-4d3d-b225-08e8709acf8c tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/de12c76d-6978-4e01-ae5c-27c0d006de32" status: 202 len: 0 microversion: 2.1 time: 0.286216 Oct 04 11:10:50.078390 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1392/2626] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:10:49 2022] DELETE /compute/v2.1/os-security-groups/de12c76d-6978-4e01-ae5c-27c0d006de32 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:10:50.084162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:50.085778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 6a260641-f3a6-4dbb-9be0-6980d44a0fd8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:50.093716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:50.104024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.107753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.109127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.111949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.112816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.114900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.169988 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 HTTP/1.1 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '6a260641-f3a6-4dbb-9be0-6980d44a0fd8'} Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:50.171752 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:50.179122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:50.179122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:50.179122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:10:50.179122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:10:50.179122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:10:50.179122 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:50.179122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:10:50.179122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1659b4e-169b-43a1-98d3-42179d376ca1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8" status: 404 len: 111 microversion: 2.1 time: 0.093487 Oct 04 11:10:50.184983 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1393/2627] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:50 2022] GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:10:50.191888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ee6f3d67-f50b-43e6-9080-2d82a123f258 req-058f7fff-3b2c-4531-8071-1a854d57b361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "tag": "a7932ed8-b8f4-40f5-bf96-846abf9c6b0b"}, {"server_uuid": "f8b347c7-d891-4452-befb-e6d7e3eb1af1", "name": "network-vif-deleted", "tag": "4d7f10f4-09f2-49ed-981e-efe57ff8e615"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:50.205317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ee6f3d67-f50b-43e6-9080-2d82a123f258 req-058f7fff-3b2c-4531-8071-1a854d57b361 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.206118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ee6f3d67-f50b-43e6-9080-2d82a123f258 req-058f7fff-3b2c-4531-8071-1a854d57b361 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.206736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ee6f3d67-f50b-43e6-9080-2d82a123f258 req-058f7fff-3b2c-4531-8071-1a854d57b361 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.222992 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ee6f3d67-f50b-43e6-9080-2d82a123f258 req-058f7fff-3b2c-4531-8071-1a854d57b361 service nova] Creating event network-changed:a7932ed8-b8f4-40f5-bf96-846abf9c6b0b for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:10:50.223788 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ee6f3d67-f50b-43e6-9080-2d82a123f258 req-058f7fff-3b2c-4531-8071-1a854d57b361 service nova] Creating event network-vif-deleted:4d7f10f4-09f2-49ed-981e-efe57ff8e615 for instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 on n-h2-791135-8 Oct 04 11:10:50.238724 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ee6f3d67-f50b-43e6-9080-2d82a123f258 req-058f7fff-3b2c-4531-8071-1a854d57b361 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051019 Oct 04 11:10:50.244998 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1394/2628] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:50.250537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:50.251795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:50.260062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.262778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.265914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.267461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.268094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.268690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.384308 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:10:50.384840 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:10:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:10:50.459943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-926526dc-3f0e-487b-a4e9-6ed0ab80a724 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1645 microversion: 2.1 time: 0.211876 Oct 04 11:10:50.461197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1395/2629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:50 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1645 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:50.466417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:50.467478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:50.475614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.476541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.477096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.478221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.478795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.479525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.805039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:50.822557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:50.824013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:50.825217 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b076708-243e-4425-9e8e-80c0b4262897 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1885 microversion: 2.32 time: 0.362784 Oct 04 11:10:50.836884 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1396/2630] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:50 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1885 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:50.842368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1c30697-ecc1-4a02-b148-77524225021d tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d4251a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:50.906592 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1c30697-ecc1-4a02-b148-77524225021d tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/c70d8106-b7d1-4a6b-9c24-6c42c9dfd8b6" status: 200 len: 248 microversion: 2.1 time: 0.068426 Oct 04 11:10:50.917202 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1397/2631] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:10:50 2022] GET /compute/v2.1/os-security-groups/c70d8106-b7d1-4a6b-9c24-6c42c9dfd8b6 => generated 248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:50.922932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:50.923659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:50.939246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.944146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.944742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.945663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:50.946208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:50.947889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:50.996466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:51.165056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:51.176535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6440a2c5-a1d6-4cb6-998d-66f185b68d0d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1487 microversion: 2.1 time: 0.257663 Oct 04 11:10:51.178088 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1398/2632] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:50 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1487 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:51.183528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-480105596", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "999d214d-a128-4728-9cd3-99390decb15f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:51.255247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] validate_networks() for [('999d214d-a128-4728-9cd3-99390decb15f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:10:52.238865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:10:52.239482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:10:52.239857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:10:52.240683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:10:52.241942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:10:52.254759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:10:52.265995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:52.267197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:52.268048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:52.269241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:52.270121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:52.270841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:52.307269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:10:52.313934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:10:52.330086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:10:52.340759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:10:52.440769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-33d9a3a1-8734-4297-afc6-55f4f5db4c0f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261277 Oct 04 11:10:52.441574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1399/2633] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:10:52.447059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d6984b1-74a7-4b65-8ab6-26a5ccc5b14a tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:52.455536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6984b1-74a7-4b65-8ab6-26a5ccc5b14a tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:52.461864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6984b1-74a7-4b65-8ab6-26a5ccc5b14a tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:52.462748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6984b1-74a7-4b65-8ab6-26a5ccc5b14a tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:52.463698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6984b1-74a7-4b65-8ab6-26a5ccc5b14a tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:52.464164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6984b1-74a7-4b65-8ab6-26a5ccc5b14a tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:52.468273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d6984b1-74a7-4b65-8ab6-26a5ccc5b14a tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:52.526729 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d6984b1-74a7-4b65-8ab6-26a5ccc5b14a tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083696 Oct 04 11:10:52.527662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1400/2634] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 11:10:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:52.539211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:52.539860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:52.558092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:52.558584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:52.559021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:52.559728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:52.560180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:52.560605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:52.594915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] HTTP exception thrown: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Request method failure captured: Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 HTTP/1.1 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQiY0SBdbPveGiv7ET-2I1g1Yj1qutc-3109CSN4-gtnnNOewTCwYzVjyuT-kjCgCT-BokIytj8HT_bipPu7az6N1rgvpKabFkXP3MWHRP5g8Gx0R7q2-O7T31yKYtLcTC2a9VCeFTFyP5Elxni_KBscXZwOxUpLtEI4ndk-38wRCc Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}] Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestMultiNic-1250698670 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 14277c6865464b2ea0e881d88b516f8f Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f8b347c7-d891-4452-befb-e6d7e3eb1af1'} Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:10:52.598804 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Returning 404 to user: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-90015f98-617d-4297-a1e8-d80fc1ff269b tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 404 len: 111 microversion: 2.1 time: 0.067966 Oct 04 11:10:52.605127 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1401/2635] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:52 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:10:52.612841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8569eddf-dde8-472e-b8d1-53d7ece31bda tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d87160d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-859475923", "description": "tempest-description-2035662956"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:53.271216 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8569eddf-dde8-472e-b8d1-53d7ece31bda tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.662213 Oct 04 11:10:53.281014 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1402/2636] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:10:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:53.286274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2015220581"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:53.293812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:53.313182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:53.313714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:53.314709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:53.314846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:53.318078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:53.319550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:53.668269 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd2fc6ab-7b09-420a-9e1d-19dd65b4e360 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "POST /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e/action" status: 202 len: 0 microversion: 2.1 time: 0.385667 Oct 04 11:10:53.669436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1403/2637] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:10:53 2022] POST /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:10:53.700387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:53.704326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:53.724219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:53.727953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:53.730043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:53.733051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:53.733580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:53.736805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:54.234888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:54.263224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:54.268995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:54.272375 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ddae52d2-2099-427c-a378-7711d5787ecc tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1885 microversion: 2.32 time: 0.599049 Oct 04 11:10:54.287823 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1404/2638] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:53 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1885 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:54.303111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e68fec86-9b21-44e0-a507-95dada94cd5b req-09517826-fdef-4f34-b7c2-9422e1c2435b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b347c7-d891-4452-befb-e6d7e3eb1af1", "name": "network-vif-deleted", "tag": "aaf3bf6c-3927-45d5-842a-072033a5aa89"}, {"name": "network-changed", "server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "tag": "6365b2cf-b61a-408e-a6b0-79f4a014c87a"}, {"name": "network-changed", "server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "tag": "1fd6aa11-1a36-4cb6-bc83-1c8b8e59925d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:54.315636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e68fec86-9b21-44e0-a507-95dada94cd5b req-09517826-fdef-4f34-b7c2-9422e1c2435b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:54.316913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e68fec86-9b21-44e0-a507-95dada94cd5b req-09517826-fdef-4f34-b7c2-9422e1c2435b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:54.317566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e68fec86-9b21-44e0-a507-95dada94cd5b req-09517826-fdef-4f34-b7c2-9422e1c2435b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:54.363148 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e68fec86-9b21-44e0-a507-95dada94cd5b req-09517826-fdef-4f34-b7c2-9422e1c2435b service nova] Creating event network-vif-deleted:aaf3bf6c-3927-45d5-842a-072033a5aa89 for instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 on n-h2-791135-8 Oct 04 11:10:54.367460 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e68fec86-9b21-44e0-a507-95dada94cd5b req-09517826-fdef-4f34-b7c2-9422e1c2435b service nova] Creating event network-changed:6365b2cf-b61a-408e-a6b0-79f4a014c87a for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:10:54.368186 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e68fec86-9b21-44e0-a507-95dada94cd5b req-09517826-fdef-4f34-b7c2-9422e1c2435b service nova] Creating event network-changed:1fd6aa11-1a36-4cb6-bc83-1c8b8e59925d for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:10:54.399898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e68fec86-9b21-44e0-a507-95dada94cd5b req-09517826-fdef-4f34-b7c2-9422e1c2435b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.110390 Oct 04 11:10:54.407903 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1405/2639] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:54.422058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:54.426113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:54.440751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:54.441526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:54.442122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:54.444483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:54.449517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:54.450382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:54.622575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:54.634987 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8447833-b94e-4142-9651-86bb8f8e03bf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1272 microversion: 2.1 time: 0.225604 Oct 04 11:10:54.635905 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1406/2640] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:54 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:54.641259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-791135-8", "block_migration": true, "disk_over_commit": false}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:54.644222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:54.652597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:54.653375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:54.653993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:54.655074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:54.655700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:54.656297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:54.739878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lazy-loading 'flavor' on Instance uuid ce89cc9a-b946-425d-9da9-1df8bc6fbe14 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:10:54.778045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Going to try to live migrate instance to n-h1-791135-8 {{(pid=122409) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:10:58.467935 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-30e277e9-7292-4d1f-8d7e-d69170865ff2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14/action" status: 202 len: 0 microversion: 2.1 time: 3.830163 Oct 04 11:10:58.469479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1407/2641] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:10:54 2022] POST /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14/action => generated 0 bytes in 3833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:10:58.498955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0c5c9e5-9cd5-4750-9564-7c741612c5ec tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d402e820>, body: {"security_group_rule": {"parent_group_id": "eee3615c-0bc5-4489-8b14-57fdb79ae468", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:10:59.354508 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0c5c9e5-9cd5-4750-9564-7c741612c5ec tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.883481 Oct 04 11:10:59.356131 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1408/2642] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:10:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:10:59.363494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52e87ddf-c552-4e14-ae8e-eaa46046a147 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4251790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:59.484609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52e87ddf-c552-4e14-ae8e-eaa46046a147 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3" status: 200 len: 1412 microversion: 2.1 time: 0.124542 Oct 04 11:10:59.496803 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1409/2643] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:10:59 2022] GET /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:10:59.503885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:59.504801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:59.515396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:59.516159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:59.518526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:59.519483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:59.520466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:59.521216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:59.831655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:59.845850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:59.848878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:10:59.851884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99f2de40-eb27-4f97-b80e-7f0ddfb1280b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1885 microversion: 2.32 time: 0.353532 Oct 04 11:10:59.857769 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1410/2644] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:10:59 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1885 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:10:59.878274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:10:59.880161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:10:59.896283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:59.897138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:59.897932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:10:59.899363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:10:59.900161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:10:59.900840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:00.146871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:00.164505 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd8c7b0d-848c-470b-a607-7e35a01b8fdf tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1320 microversion: 2.1 time: 0.303985 Oct 04 11:11:00.169566 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1411/2645] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:10:59 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:00.179830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3c98fc8f-93d8-43c0-a164-f33e920bf47c req-d6906344-db60-451e-ac66-ee4b576246b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "tag": "6cee2a64-e738-4a11-b292-980ede0a7155"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:00.206603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3c98fc8f-93d8-43c0-a164-f33e920bf47c req-d6906344-db60-451e-ac66-ee4b576246b3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:00.207460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3c98fc8f-93d8-43c0-a164-f33e920bf47c req-d6906344-db60-451e-ac66-ee4b576246b3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:00.208114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3c98fc8f-93d8-43c0-a164-f33e920bf47c req-d6906344-db60-451e-ac66-ee4b576246b3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:00.223831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3c98fc8f-93d8-43c0-a164-f33e920bf47c req-d6906344-db60-451e-ac66-ee4b576246b3 service nova] Creating event network-changed:6cee2a64-e738-4a11-b292-980ede0a7155 for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:00.230550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3c98fc8f-93d8-43c0-a164-f33e920bf47c req-d6906344-db60-451e-ac66-ee4b576246b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059662 Oct 04 11:11:00.232133 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1412/2646] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:00.257286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:00.259678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:00.290070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:00.291172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:00.291840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:00.292794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:00.293513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:00.294683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:00.620695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:00.636352 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aec02b4a-f57f-4ff0-9042-4c88652bc0c4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1504 microversion: 2.1 time: 0.402258 Oct 04 11:11:00.638333 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1413/2647] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:00 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:00.657671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-755d7d7d-be36-4a69-8cfb-dd8d3741a62a tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Action: 'create', calling method: .version_select at 0x7f71d402e4c0>, body: {"security_group_rule": {"parent_group_id": "eee3615c-0bc5-4489-8b14-57fdb79ae468", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:01.457634 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-755d7d7d-be36-4a69-8cfb-dd8d3741a62a tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.817897 Oct 04 11:11:01.459067 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1414/2648] 10.222.0.23 () {60 vars in 1195 bytes} [Tue Oct 4 11:11:00 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:01.464073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:01.464749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:01.490472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:01.500480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:01.501497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:01.504462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:01.505866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:01.511139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:01.565383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] HTTP exception thrown: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Request method failure captured: Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 HTTP/1.1 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQiY0SBdbPveGiv7ET-2I1g1Yj1qutc-3109CSN4-gtnnNOewTCwYzVjyuT-kjCgCT-BokIytj8HT_bipPu7az6N1rgvpKabFkXP3MWHRP5g8Gx0R7q2-O7T31yKYtLcTC2a9VCeFTFyP5Elxni_KBscXZwOxUpLtEI4ndk-38wRCc Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}] Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 14277c6865464b2ea0e881d88b516f8f Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f8b347c7-d891-4452-befb-e6d7e3eb1af1'} Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:01.567334 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:01.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:01.574388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Returning 404 to user: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:01.578186 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-350097a1-c942-49da-b4d4-4566bc4466c4 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 404 len: 111 microversion: 2.1 time: 0.117751 Oct 04 11:11:01.582980 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1415/2649] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:11:01 2022] DELETE /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:01.592934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e11406c7-5401-4986-a4b9-ecf8c0fc85ab req-e5513e2c-5021-4f29-b8bf-d7f0f6420b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106f6348-858a-40f0-b720-ddf960f7e43e", "name": "network-vif-plugged", "status": "completed", "tag": "a886901d-45a1-43b4-819e-d97fca48e2fb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:01.620150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e11406c7-5401-4986-a4b9-ecf8c0fc85ab req-e5513e2c-5021-4f29-b8bf-d7f0f6420b2b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:01.622000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e11406c7-5401-4986-a4b9-ecf8c0fc85ab req-e5513e2c-5021-4f29-b8bf-d7f0f6420b2b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:01.624413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e11406c7-5401-4986-a4b9-ecf8c0fc85ab req-e5513e2c-5021-4f29-b8bf-d7f0f6420b2b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:01.662084 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e11406c7-5401-4986-a4b9-ecf8c0fc85ab req-e5513e2c-5021-4f29-b8bf-d7f0f6420b2b service nova] Creating event network-vif-plugged:a886901d-45a1-43b4-819e-d97fca48e2fb for instance 106f6348-858a-40f0-b720-ddf960f7e43e on n-h1-791135-8 Oct 04 11:11:01.675283 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e11406c7-5401-4986-a4b9-ecf8c0fc85ab req-e5513e2c-5021-4f29-b8bf-d7f0f6420b2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088663 Oct 04 11:11:01.681419 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1416/2650] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:01.695185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b09fbcc-d0cb-4cca-b66d-2e6f901c9467 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4093160>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:01.766051 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b09fbcc-d0cb-4cca-b66d-2e6f901c9467 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3" status: 200 len: 1412 microversion: 2.1 time: 0.082158 Oct 04 11:11:01.766650 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1417/2651] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:11:01 2022] GET /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:01.787931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:01.788937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:01.801948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:01.803315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:01.803937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:01.805820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:01.806478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:01.807074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:02.264733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:02.278717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:02.280171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:02.284423 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3b9b8ff-a068-4c01-8859-0e9bafa58b53 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1885 microversion: 2.32 time: 0.498037 Oct 04 11:11:02.298398 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1418/2652] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:01 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1885 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:02.298398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:02.298398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:02.307417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:02.307417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:02.307417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:02.307417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:02.315984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:02.316483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:02.331081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=24 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:02.483181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:02.690886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:02.701276 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a12894d-752d-4db2-8681-889b8ed1aa0a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1320 microversion: 2.1 time: 0.413199 Oct 04 11:11:02.702469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1419/2653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:02 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:02.731188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-634e62f2-9f86-4cf4-9a09-477a18e0ec98 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d402e9d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:02.852463 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-634e62f2-9f86-4cf4-9a09-477a18e0ec98 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/eee3615c-0bc5-4489-8b14-57fdb79ae468" status: 200 len: 664 microversion: 2.1 time: 0.130959 Oct 04 11:11:02.853056 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1420/2654] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:11:02 2022] GET /compute/v2.1/os-security-groups/eee3615c-0bc5-4489-8b14-57fdb79ae468 => generated 664 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:02.876991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:02.879262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: f8b347c7-d891-4452-befb-e6d7e3eb1af1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:02.904057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:02.907631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:02.910866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:02.914178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:02.914848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:02.915736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:02.960238 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] HTTP exception thrown: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Request method failure captured: Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 HTTP/1.1 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQiY0SBdbPveGiv7ET-2I1g1Yj1qutc-3109CSN4-gtnnNOewTCwYzVjyuT-kjCgCT-BokIytj8HT_bipPu7az6N1rgvpKabFkXP3MWHRP5g8Gx0R7q2-O7T31yKYtLcTC2a9VCeFTFyP5Elxni_KBscXZwOxUpLtEI4ndk-38wRCc Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}] Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 14277c6865464b2ea0e881d88b516f8f Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f8b347c7-d891-4452-befb-e6d7e3eb1af1'} Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:02.977020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:02.981589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:02.981589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:02.981589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:02.981589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:02.981589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:02.981589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. Oct 04 11:11:02.981589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:02.984748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Returning 404 to user: Instance f8b347c7-d891-4452-befb-e6d7e3eb1af1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:02.991068 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7fe011e0-91b5-403b-b147-f4dd60776085 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1" status: 404 len: 111 microversion: 2.1 time: 0.130508 Oct 04 11:11:02.996219 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1421/2655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:02 2022] GET /compute/v2.1/servers/f8b347c7-d891-4452-befb-e6d7e3eb1af1 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:03.016518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:03.017383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:03.031471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:03.032126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:03.032567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:03.033284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:03.035689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:03.036151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:03.420345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:03.428550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-654609e0-ea3a-48a5-a626-9b262c6ae73d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1504 microversion: 2.1 time: 0.431027 Oct 04 11:11:03.429136 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1422/2656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:02 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:03.452617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-119db6fd-1167-4dd7-8d6c-68bf3fc1ebcc tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d402e8b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:03.737453 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-119db6fd-1167-4dd7-8d6c-68bf3fc1ebcc tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3" status: 204 len: 0 microversion: 2.1 time: 0.307125 Oct 04 11:11:03.738024 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1423/2657] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:03 2022] DELETE /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:11:03.747288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bdc21ac9-d40d-4604-a939-cdc5e6fa7741 req-a649181f-cd03-44c5-bc49-b1c1edb7792c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "tag": "f5229279-5aae-4110-b650-3053d2901abf"}, {"name": "network-changed", "server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "tag": "1e9950d3-05db-4d70-91e8-ee743c2d5efb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:03.757819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bdc21ac9-d40d-4604-a939-cdc5e6fa7741 req-a649181f-cd03-44c5-bc49-b1c1edb7792c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:03.758289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bdc21ac9-d40d-4604-a939-cdc5e6fa7741 req-a649181f-cd03-44c5-bc49-b1c1edb7792c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:03.758904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bdc21ac9-d40d-4604-a939-cdc5e6fa7741 req-a649181f-cd03-44c5-bc49-b1c1edb7792c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:03.770528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:03.773646 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bdc21ac9-d40d-4604-a939-cdc5e6fa7741 req-a649181f-cd03-44c5-bc49-b1c1edb7792c service nova] Creating event network-changed:f5229279-5aae-4110-b650-3053d2901abf for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:03.774506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bdc21ac9-d40d-4604-a939-cdc5e6fa7741 req-a649181f-cd03-44c5-bc49-b1c1edb7792c service nova] Creating event network-changed:1e9950d3-05db-4d70-91e8-ee743c2d5efb for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:03.780192 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bdc21ac9-d40d-4604-a939-cdc5e6fa7741 req-a649181f-cd03-44c5-bc49-b1c1edb7792c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037347 Oct 04 11:11:03.781682 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1424/2658] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:03.788219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5cfac14-6175-44e7-81c1-6acec16a2c98 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d41d0940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:04.417858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5cfac14-6175-44e7-81c1-6acec16a2c98 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/e8fcfa01-981d-4b96-b317-84fc43f493aa" status: 202 len: 0 microversion: 2.1 time: 0.634626 Oct 04 11:11:04.418816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1425/2659] 10.222.0.23 () {58 vars in 1287 bytes} [Tue Oct 4 11:11:03 2022] DELETE /compute/v2.1/os-security-group-rules/e8fcfa01-981d-4b96-b317-84fc43f493aa => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:11:04.424088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:04.424838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:04.446708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:04.448048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:04.449144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:04.451972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:04.456549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:04.457776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:04.496456 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] HTTP exception thrown: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Request method failure captured: Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 HTTP/1.1 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQiY0SBdbPveGiv7ET-2I1g1Yj1qutc-3109CSN4-gtnnNOewTCwYzVjyuT-kjCgCT-BokIytj8HT_bipPu7az6N1rgvpKabFkXP3MWHRP5g8Gx0R7q2-O7T31yKYtLcTC2a9VCeFTFyP5Elxni_KBscXZwOxUpLtEI4ndk-38wRCc Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}] Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 14277c6865464b2ea0e881d88b516f8f Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a8bd608a-e699-4be9-a701-121633db69c4'} Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:04.498616 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:04.502782 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:04.504515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Returning 404 to user: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:04.506206 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e8aad62-27bc-4427-90a9-770389faa092 tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 404 len: 111 microversion: 2.1 time: 0.086228 Oct 04 11:11:04.507393 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1426/2660] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:11:04 2022] DELETE /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:04.513004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:04.514106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:04.520930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:04.521727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:04.522512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:04.525311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:04.527512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:04.528191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:05.065190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:05.077581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:05.087866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:05.096046 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b15c813-92b6-48b1-a477-bcd75e294e6c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1885 microversion: 2.32 time: 0.587312 Oct 04 11:11:05.097722 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1427/2661] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:04 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1885 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:05.106875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:05.118307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:05.138419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:05.139379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:05.141902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:05.143336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:05.149245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:05.149919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:05.578447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:05.590937 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13f0f637-b280-4ea6-ac08-959231c322e9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1320 microversion: 2.1 time: 0.488395 Oct 04 11:11:05.594343 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1428/2662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:05 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:05.610054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a79cda02-ba35-4ebc-863b-829f74201483 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d4032280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:05.646058 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a79cda02-ba35-4ebc-863b-829f74201483 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Image not found. Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a79cda02-ba35-4ebc-863b-829f74201483 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3 HTTP/1.1 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8b16b769-99ee-4a09-9517-fe09502a82e3'} Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8b16b769-99ee-4a09-9517-fe09502a82e3 Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:11:05.648411 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b16b769-99ee-4a09-9517-fe09502a82e3 could not be found. Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a79cda02-ba35-4ebc-863b-829f74201483 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:05.652981 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a79cda02-ba35-4ebc-863b-829f74201483 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3" status: 404 len: 62 microversion: 2.1 time: 0.052061 Oct 04 11:11:05.659440 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1429/2663] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:11:05 2022] GET /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:11:05.664837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4bf2f6a8-c9a4-4c26-b3f9-bdc7723008b8 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d429d5e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:06.205149 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4bf2f6a8-c9a4-4c26-b3f9-bdc7723008b8 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/eee3615c-0bc5-4489-8b14-57fdb79ae468" status: 202 len: 0 microversion: 2.1 time: 0.544346 Oct 04 11:11:06.207477 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1430/2664] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:11:05 2022] DELETE /compute/v2.1/os-security-groups/eee3615c-0bc5-4489-8b14-57fdb79ae468 => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:11:06.215761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:06.218046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:06.231333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:06.232130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:06.233223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:06.234225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:06.235075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:06.235696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:06.594513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:06.606204 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-59dbb627-06a1-47f8-a1e1-ee7120406690 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1504 microversion: 2.1 time: 0.395372 Oct 04 11:11:06.607957 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1431/2665] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:06 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:06.613994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:06.616886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] [instance: a8bd608a-e699-4be9-a701-121633db69c4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:06.627208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:06.628104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:06.629747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:06.631698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:06.632313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:06.632954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:06.652853 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] HTTP exception thrown: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Request method failure captured: Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 HTTP/1.1 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBQiY0SBdbPveGiv7ET-2I1g1Yj1qutc-3109CSN4-gtnnNOewTCwYzVjyuT-kjCgCT-BokIytj8HT_bipPu7az6N1rgvpKabFkXP3MWHRP5g8Gx0R7q2-O7T31yKYtLcTC2a9VCeFTFyP5Elxni_KBscXZwOxUpLtEI4ndk-38wRCc Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b5c1dad20fdd43cdbab89cd4f79fbed6"}]}] Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: b5c1dad20fdd43cdbab89cd4f79fbed6 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestMultiNic-1250698670 Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 14277c6865464b2ea0e881d88b516f8f Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestMultiNic-1250698670-project Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a8bd608a-e699-4be9-a701-121633db69c4'} Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:06.656563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] Returning 404 to user: Instance a8bd608a-e699-4be9-a701-121633db69c4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:06.661900 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-760964cf-886a-4ab3-964f-aad1095701ef tempest-ServersTestMultiNic-1250698670 tempest-ServersTestMultiNic-1250698670-project] 10.222.0.23 "GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4" status: 404 len: 111 microversion: 2.1 time: 0.047754 Oct 04 11:11:06.663518 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1432/2666] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:06 2022] GET /compute/v2.1/servers/a8bd608a-e699-4be9-a701-121633db69c4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:06.668953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:06.669755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:06.676337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:06.677224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:06.677871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:06.679175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:06.679794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:06.680376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:07.424588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:07.432597 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11e3e68c-06c1-4ad6-bd6d-ad0262ec4a2c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1500 microversion: 2.1 time: 0.767871 Oct 04 11:11:07.433172 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1433/2667] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:06 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1500 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:07.446217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-16f44c21-75d6-45a1-b4b5-21e39d1ebfc6 req-59614eed-0c6c-4dd8-98e2-88b23bc75a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a84e23-3478-4a9a-822a-45920bd38647", "tag": "2b0052d6-2a33-4bfe-94e8-c84034afc433"}, {"server_uuid": "ce89cc9a-b946-425d-9da9-1df8bc6fbe14", "name": "network-vif-unplugged", "status": "completed", "tag": "c14ec83b-22fc-4601-b016-91807e8a04cb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:07.465781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-16f44c21-75d6-45a1-b4b5-21e39d1ebfc6 req-59614eed-0c6c-4dd8-98e2-88b23bc75a50 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:07.466318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-16f44c21-75d6-45a1-b4b5-21e39d1ebfc6 req-59614eed-0c6c-4dd8-98e2-88b23bc75a50 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:07.466746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-16f44c21-75d6-45a1-b4b5-21e39d1ebfc6 req-59614eed-0c6c-4dd8-98e2-88b23bc75a50 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:07.516341 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-16f44c21-75d6-45a1-b4b5-21e39d1ebfc6 req-59614eed-0c6c-4dd8-98e2-88b23bc75a50 service nova] Creating event network-changed:2b0052d6-2a33-4bfe-94e8-c84034afc433 for instance 52a84e23-3478-4a9a-822a-45920bd38647 on n-h1-791135-8 Oct 04 11:11:07.518076 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-16f44c21-75d6-45a1-b4b5-21e39d1ebfc6 req-59614eed-0c6c-4dd8-98e2-88b23bc75a50 service nova] Creating event network-vif-unplugged:c14ec83b-22fc-4601-b016-91807e8a04cb for instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 on n-h2-791135-8 Oct 04 11:11:07.539033 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-16f44c21-75d6-45a1-b4b5-21e39d1ebfc6 req-59614eed-0c6c-4dd8-98e2-88b23bc75a50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.104601 Oct 04 11:11:07.542208 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1434/2668] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:07.548673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:07.549663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:07.557395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:07.558099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:07.558697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:07.559560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:07.560173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:07.560793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:08.340919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:08.355681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:08.365556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:08.373301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b531992-0ab7-424b-b919-c81560891644 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.828842 Oct 04 11:11:08.374237 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1435/2669] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:07 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:08.379270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3792f5f-45c7-4153-8319-f606703a21a5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d4251790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:08.470315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-c3792f5f-45c7-4153-8319-f606703a21a5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group de12c76d-6978-4e01-ae5c-27c0d006de32 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:11:08.473785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-c3792f5f-45c7-4153-8319-f606703a21a5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Neutron security group de12c76d-6978-4e01-ae5c-27c0d006de32 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:11:08.475109 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c3792f5f-45c7-4153-8319-f606703a21a5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] HTTP exception thrown: Security group de12c76d-6978-4e01-ae5c-27c0d006de32 does not exist Oct 04 11:11:08.475109 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-52312249-8029-423b-9d91-ad36bd5575d5'] Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3792f5f-45c7-4153-8319-f606703a21a5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Request method failure captured: Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/de12c76d-6978-4e01-ae5c-27c0d006de32 HTTP/1.1 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSpik7BYv7nEOMTr5HyYLnFORxx5KpfyxuBBQu7oRZIK1g-INWTIlVZyjVJdkwmLKeX2Jj-xH5TsO4Lq0q7SFJsY5bl3M3sbKmEG30z0M6_k5YS45Ev2p0CA0igzfyNJtQGnspqiXm5dYkEYrfqXKAzU_6vrF5Npa7hsn38ZyVvig8 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 5cf6fe15e4c245f8afe15130c6fe070d Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1294277294 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5cf6fe15e4c245f8afe15130c6fe070d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cf6fe15e4c245f8afe15130c6fe070d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5cf6fe15e4c245f8afe15130c6fe070d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5cf6fe15e4c245f8afe15130c6fe070d"}]}] Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1294277294 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 5cf6fe15e4c245f8afe15130c6fe070d Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1294277294 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupRulesTestJSON-1294277294-project Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: a5f5bf30c10a45c39078762437e56477 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1294277294-project Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group de12c76d-6978-4e01-ae5c-27c0d006de32 does not exist Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-52312249-8029-423b-9d91-ad36bd5575d5'] Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'de12c76d-6978-4e01-ae5c-27c0d006de32'} Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:11:08.479188 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group de12c76d-6978-4e01-ae5c-27c0d006de32 does not exist Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52312249-8029-423b-9d91-ad36bd5575d5'] Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group de12c76d-6978-4e01-ae5c-27c0d006de32 does not exist Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52312249-8029-423b-9d91-ad36bd5575d5'] Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group de12c76d-6978-4e01-ae5c-27c0d006de32 does not exist Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52312249-8029-423b-9d91-ad36bd5575d5'] Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group de12c76d-6978-4e01-ae5c-27c0d006de32 does not exist Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52312249-8029-423b-9d91-ad36bd5575d5'] Oct 04 11:11:08.482959 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:08.488333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3792f5f-45c7-4153-8319-f606703a21a5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Returning 404 to user: Security group de12c76d-6978-4e01-ae5c-27c0d006de32 does not exist Oct 04 11:11:08.488333 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-52312249-8029-423b-9d91-ad36bd5575d5'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:08.489744 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c3792f5f-45c7-4153-8319-f606703a21a5 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/de12c76d-6978-4e01-ae5c-27c0d006de32" status: 404 len: 194 microversion: 2.1 time: 0.114221 Oct 04 11:11:08.491141 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1436/2670] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:11:08 2022] DELETE /compute/v2.1/os-security-groups/de12c76d-6978-4e01-ae5c-27c0d006de32 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:08.505818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:08.506847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:08.521743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:08.528681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:08.537847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:08.539306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:08.540115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:08.540828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:09.453153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:09.474872 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3acbd4d-d665-4789-b0f7-8f6aa4f49bad tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1320 microversion: 2.1 time: 0.982222 Oct 04 11:11:09.476522 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1437/2671] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:08 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1320 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:09.483937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:09.484797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:09.495497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:09.496394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:09.497011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:09.498510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:09.500266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:09.501222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:09.858767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:09.872510 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a4e35a6-8fb4-4c71-84ff-f44557e34096 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1504 microversion: 2.1 time: 0.392024 Oct 04 11:11:09.885415 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1438/2672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:09 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:09.885415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:09.885415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:09.909143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:09.909743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:09.910922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:09.911675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:09.912155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:09.912663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:10.298837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:10.318545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a6cd73d5-bf2b-4496-8555-13699522a26c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1500 microversion: 2.1 time: 0.439354 Oct 04 11:11:10.319449 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1439/2673] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:09 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1500 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:10.324080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fb186f4-769c-4c27-ad6c-a5c985c10172 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d40dad30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:12.838183 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7fb186f4-769c-4c27-ad6c-a5c985c10172 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c70d8106-b7d1-4a6b-9c24-6c42c9dfd8b6" status: 202 len: 0 microversion: 2.1 time: 2.517567 Oct 04 11:11:12.842007 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1440/2674] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:11:10 2022] DELETE /compute/v2.1/os-security-groups/c70d8106-b7d1-4a6b-9c24-6c42c9dfd8b6 => generated 0 bytes in 2522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:11:12.847148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:12.848532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:12.863301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:12.864914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:12.866440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:12.870256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:12.871045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:12.871701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:13.467228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:13.483178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:13.487077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:13.492266 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e4b8d84-d4af-40a6-8e0f-47c927f1a366 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.647685 Oct 04 11:11:13.507193 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1441/2675] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:12 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:13.520903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-299838b1-af1c-4cc5-8181-2b82061733c1 req-be3d3ded-733c-430d-b4d9-602fd4437d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce89cc9a-b946-425d-9da9-1df8bc6fbe14", "tag": "c14ec83b-22fc-4601-b016-91807e8a04cb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:13.572740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-299838b1-af1c-4cc5-8181-2b82061733c1 req-be3d3ded-733c-430d-b4d9-602fd4437d32 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:13.573219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-299838b1-af1c-4cc5-8181-2b82061733c1 req-be3d3ded-733c-430d-b4d9-602fd4437d32 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:13.573693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-299838b1-af1c-4cc5-8181-2b82061733c1 req-be3d3ded-733c-430d-b4d9-602fd4437d32 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:13.602249 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-299838b1-af1c-4cc5-8181-2b82061733c1 req-be3d3ded-733c-430d-b4d9-602fd4437d32 service nova] Creating event network-changed:c14ec83b-22fc-4601-b016-91807e8a04cb for instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 on n-h2-791135-8 Oct 04 11:11:13.622423 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-299838b1-af1c-4cc5-8181-2b82061733c1 req-be3d3ded-733c-430d-b4d9-602fd4437d32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112813 Oct 04 11:11:13.623668 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1442/2676] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:13.630295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:13.631210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:13.645938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:13.646618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:13.647615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:13.650106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:13.651166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:13.654975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:14.565679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:14.576446 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f56bd7ae-a790-4f97-87d2-f06609823d66 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1320 microversion: 2.1 time: 0.951058 Oct 04 11:11:14.577995 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1443/2677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:13 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1320 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:14.585916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:14.618213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:14.638750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:14.639635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:14.640332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:14.643518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:14.644299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:14.646489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:15.123077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:15.133107 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5b19aab-0fab-493b-b7d9-f0196a489967 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1504 microversion: 2.1 time: 0.552409 Oct 04 11:11:15.149779 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1444/2678] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:14 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:15.162886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:15.164406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:15.176931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:15.178872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:15.179472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:15.180903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:15.184846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:15.185329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:15.848687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:15.857317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63cea472-dbf1-4c66-b4d2-05f715155716 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1500 microversion: 2.1 time: 0.706140 Oct 04 11:11:15.862127 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1445/2679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:15 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1500 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:15.873128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b79a82cc-4b9f-4dab-8e13-0a716860ed9a tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d41dbb80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:16.930326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b79a82cc-4b9f-4dab-8e13-0a716860ed9a tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/2c50100d-99bd-46b6-beff-5791693004ac" status: 202 len: 0 microversion: 2.1 time: 1.066944 Oct 04 11:11:16.936324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1446/2680] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:11:15 2022] DELETE /compute/v2.1/os-security-groups/2c50100d-99bd-46b6-beff-5791693004ac => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:11:16.941455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:16.942928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:16.950455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:16.951182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:16.951785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:16.952688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:16.953330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:16.953988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:17.432724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:17.476548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:17.485665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:17.487060 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b599800-769c-4d6e-a111-df8fb6feb948 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.549544 Oct 04 11:11:17.502907 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1447/2681] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:16 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:17.516828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bfc72e6a-cde2-402d-af22-fbace8320cb6 req-c75c9de6-eeea-40fc-9303-b37992398eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a84e23-3478-4a9a-822a-45920bd38647", "name": "network-vif-plugged", "status": "completed", "tag": "2b0052d6-2a33-4bfe-94e8-c84034afc433"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:17.527162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:17.556172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bfc72e6a-cde2-402d-af22-fbace8320cb6 req-c75c9de6-eeea-40fc-9303-b37992398eb5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:17.557211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bfc72e6a-cde2-402d-af22-fbace8320cb6 req-c75c9de6-eeea-40fc-9303-b37992398eb5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:17.560408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bfc72e6a-cde2-402d-af22-fbace8320cb6 req-c75c9de6-eeea-40fc-9303-b37992398eb5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:17.587815 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bfc72e6a-cde2-402d-af22-fbace8320cb6 req-c75c9de6-eeea-40fc-9303-b37992398eb5 service nova] Creating event network-vif-plugged:2b0052d6-2a33-4bfe-94e8-c84034afc433 for instance 52a84e23-3478-4a9a-822a-45920bd38647 on n-h1-791135-8 Oct 04 11:11:17.595977 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bfc72e6a-cde2-402d-af22-fbace8320cb6 req-c75c9de6-eeea-40fc-9303-b37992398eb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091459 Oct 04 11:11:17.597184 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1448/2682] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:18.289216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-34568997", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "d89c023d-fd84-4abe-9619-32582459875d"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:18.462891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] validate_networks() for [('d89c023d-fd84-4abe-9619-32582459875d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:11:19.546576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:11:19.562022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:11:19.563423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:11:19.565676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:11:19.573722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:11:19.591872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:19.592370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:19.592824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:19.593693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:19.594046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:19.594853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:19.614709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Getting quotas for project e168534b1f7144cf97c9166ef50e170b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:11:19.619092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Getting quotas for user abecb85b41d846e0a2b0bfc7010031c9 and project e168534b1f7144cf97c9166ef50e170b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:11:19.637835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:11:19.640273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:11:19.752440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a02636a1-d63c-4a42-9099-6701410c3243 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.153759 Oct 04 11:11:19.759724 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1449/2683] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:11:19.766003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:19.767074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:19.775172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:19.776112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:19.776771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:19.777787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:19.778464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:19.779129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:20.165815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:20.178559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af466aba-5a85-49fa-ab0c-05e377b2d37f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1502 microversion: 2.1 time: 0.417087 Oct 04 11:11:20.180658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1450/2684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:19 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1502 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:20.196370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:20.200812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:20.219863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:20.220536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:20.221137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:20.221879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:20.222336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:20.229607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:20.276969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:20.512290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:20.523369 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c816150d-8bc2-4d6b-aff1-6d1a8e788c3c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1494 microversion: 2.1 time: 0.337600 Oct 04 11:11:20.539682 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1451/2685] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:20 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1494 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:20.549959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:20.551922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:20.560378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:20.561054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:20.561853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:20.562725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:20.563996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:20.563996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:20.779670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:20.803927 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5522ae81-2d83-4336-b896-7eaf88b47850 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1500 microversion: 2.1 time: 0.262436 Oct 04 11:11:20.810068 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1452/2686] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:20 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1500 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:20.823917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8689cd0-0110-457e-81eb-9ff8ce36e109 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d405d700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:21.250856 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8689cd0-0110-457e-81eb-9ff8ce36e109 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/56c44e4c-824e-4e52-b109-7db9e51c6343" status: 202 len: 0 microversion: 2.1 time: 0.439028 Oct 04 11:11:21.254683 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1453/2687] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:11:20 2022] DELETE /compute/v2.1/os-security-groups/56c44e4c-824e-4e52-b109-7db9e51c6343 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:11:21.262458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:21.263046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:21.280957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:21.281515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:21.287605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:21.289940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:21.309475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:21.313824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:21.744523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:21.754187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:21.755657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:21.756823 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0f1ffa6-59c1-4fc5-acf4-5f02f2a1fea1 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.501991 Oct 04 11:11:21.757410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1454/2688] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:21 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:21.762217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:21.762827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:21.768892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:21.769391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:21.769834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:21.771053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:21.771507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:21.771930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:21.891853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:21.899413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dac10c06-e0ca-4656-93b6-f281ac3923a1 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1282 microversion: 2.1 time: 0.141019 Oct 04 11:11:21.899984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1455/2689] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:21 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1282 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:21.904547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:21.905148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:21.918570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:21.919411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:21.919849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:21.920552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:21.921040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:21.921501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:22.200395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:22.222615 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b218dcb-fbdf-4212-ab6d-9eef84dc38c8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1502 microversion: 2.1 time: 0.321571 Oct 04 11:11:22.226703 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1456/2690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:21 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1502 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:22.233468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af555a9c-dc9a-4e66-aa65-f6161e98d253 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '.version_select at 0x7f71d44215e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:22.237341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af555a9c-dc9a-4e66-aa65-f6161e98d253 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:22.237891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af555a9c-dc9a-4e66-aa65-f6161e98d253 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:22.238337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af555a9c-dc9a-4e66-aa65-f6161e98d253 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:22.253874 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af555a9c-dc9a-4e66-aa65-f6161e98d253 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.023810 Oct 04 11:11:22.254846 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1457/2691] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 11:11:22 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:22.259547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7d90acb-106c-418f-a25c-22de25758f99 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d405ab80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:23.023917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7d90acb-106c-418f-a25c-22de25758f99 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1b8f01cd-f611-4ece-86d3-6242cac01790" status: 202 len: 0 microversion: 2.1 time: 0.767724 Oct 04 11:11:23.024553 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1458/2692] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:11:22 2022] DELETE /compute/v2.1/os-security-groups/1b8f01cd-f611-4ece-86d3-6242cac01790 => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:11:23.029566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:23.030201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:23.044899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:23.045807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:23.047340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:23.050886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:23.052214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:23.053440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:23.488451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbb699b24b3432e9adc7b6d869e4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7bbcbc81f547c0b5982b0f1efc54cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:23.498889 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5f2b6d6-a699-4ca4-8d39-e77f0598d45d tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 200 len: 1487 microversion: 2.1 time: 0.473288 Oct 04 11:11:23.500739 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1459/2693] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:23 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 1487 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:23.506158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:23.506856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:23.513246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:23.513763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:23.514197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:23.514885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:23.515334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:23.515756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:23.568212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:11:23.720975 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab33bade-3389-42dd-98a6-640463b0b92d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 204 len: 0 microversion: 2.1 time: 0.217759 Oct 04 11:11:23.721656 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1460/2694] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:11:23 2022] DELETE /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:11:23.730385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:23.732275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:23.748952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:23.749624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:23.750168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:23.751420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:23.751905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:23.752624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:24.305226 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14dcba32-1748-4868-b3bd-5a3869b6a1d7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1645 microversion: 2.1 time: 0.582147 Oct 04 11:11:24.307288 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1461/2695] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:23 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1645 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:24.312650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:24.313744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:24.320663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:24.321669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:24.322326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:24.323232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:24.323881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:24.324499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:24.952223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:24.964736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:24.966220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:24.967405 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-568c5b7b-96b1-44c3-8607-ca43123fa71e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.658938 Oct 04 11:11:24.967977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1462/2696] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:24 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:24.977961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:24.986545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:25.004152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:25.005529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:25.006149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:25.007666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:25.014204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:25.025179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:26.121391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:26.132430 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e942dbb9-bace-4ffc-ad16-0921c0b734cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 1.158590 Oct 04 11:11:26.135618 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1463/2697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:24 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:26.145945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aab2c60f-37c8-4da3-83b6-7d4064e79ac4 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] Calling method '.version_select at 0x7f71d405d8b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:26.739523 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aab2c60f-37c8-4da3-83b6-7d4064e79ac4 tempest-SecurityGroupRulesTestJSON-1294277294 tempest-SecurityGroupRulesTestJSON-1294277294-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d4d2ad8c-179a-42e4-bb37-38727157a8a1" status: 202 len: 0 microversion: 2.1 time: 0.602011 Oct 04 11:11:26.740108 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1464/2698] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:11:26 2022] DELETE /compute/v2.1/os-security-groups/d4d2ad8c-179a-42e4-bb37-38727157a8a1 => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:11:26.747405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:26.748012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:26.762476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:26.764768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:26.765308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:26.767031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:26.770800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:26.771328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:26.825985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:11:27.042086 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5f01daf-06b3-499c-aae3-adf021fd4bdd tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 204 len: 0 microversion: 2.1 time: 0.300246 Oct 04 11:11:27.043137 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1465/2699] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:11:26 2022] DELETE /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:11:27.049003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:27.049746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:27.067614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:27.068723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:27.069409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:27.085191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:27.087447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:27.087901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:27.307769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:27.318535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-518d3beb-4ef8-4668-a31a-8030ca4cce1d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 200 len: 1466 microversion: 2.1 time: 0.273879 Oct 04 11:11:27.337843 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1466/2700] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:27 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 1466 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:27.350606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1906479984", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "973c00bd-0fce-4cb1-a025-a2c2987cef21"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:27.445056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] validate_networks() for [('973c00bd-0fce-4cb1-a025-a2c2987cef21', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:11:28.599158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:11:28.599738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:11:28.600048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:11:28.600457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:11:28.601305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:11:28.622596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:28.624701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:28.625755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:28.628313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:28.629083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:28.629913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:28.663929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for project d8213366237849c5bd0db518c55bc288. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:11:28.672881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for user 8f8c67a2ba884edbb978a166d91294d7 and project d8213366237849c5bd0db518c55bc288. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:11:28.732866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:11:28.739438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:11:28.929653 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d994eb2e-c9d2-4c45-a96e-b2c1491a955c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.581125 Oct 04 11:11:28.936850 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1467/2701] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:11:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:11:28.951252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5ac0036d-73a4-4d83-a88e-a90751f29a68 req-bbaeae03-682f-4ca9-8730-b02a8a206068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106f6348-858a-40f0-b720-ddf960f7e43e", "name": "network-vif-unplugged", "status": "completed", "tag": "a886901d-45a1-43b4-819e-d97fca48e2fb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:28.980156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ac0036d-73a4-4d83-a88e-a90751f29a68 req-bbaeae03-682f-4ca9-8730-b02a8a206068 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:28.980892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ac0036d-73a4-4d83-a88e-a90751f29a68 req-bbaeae03-682f-4ca9-8730-b02a8a206068 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:28.981629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ac0036d-73a4-4d83-a88e-a90751f29a68 req-bbaeae03-682f-4ca9-8730-b02a8a206068 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:29.024377 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5ac0036d-73a4-4d83-a88e-a90751f29a68 req-bbaeae03-682f-4ca9-8730-b02a8a206068 service nova] Creating event network-vif-unplugged:a886901d-45a1-43b4-819e-d97fca48e2fb for instance 106f6348-858a-40f0-b720-ddf960f7e43e on n-h1-791135-8 Oct 04 11:11:29.049275 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5ac0036d-73a4-4d83-a88e-a90751f29a68 req-bbaeae03-682f-4ca9-8730-b02a8a206068 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107685 Oct 04 11:11:29.050410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1468/2702] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:29.074736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:29.075438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:29.109296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:29.110439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:29.111574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:29.117533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:29.118256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:29.120055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:29.517595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:29.521923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:29.531561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:29.538462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:29.541885 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f652f8ab-6933-4833-b805-c511a7638b35 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.489197 Oct 04 11:11:29.554444 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1469/2703] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:29 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:29.571751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f8f79d3-4fd0-452f-961f-4bb6afbf6042 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d405ab80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:29.665220 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8f8f79d3-4fd0-452f-961f-4bb6afbf6042 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Image not found. Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f8f79d3-4fd0-452f-961f-4bb6afbf6042 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3 HTTP/1.1 Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8b16b769-99ee-4a09-9517-fe09502a82e3'} Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8b16b769-99ee-4a09-9517-fe09502a82e3 to delete Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b16b769-99ee-4a09-9517-fe09502a82e3 could not be found. Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:29.667523 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f8f79d3-4fd0-452f-961f-4bb6afbf6042 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f8f79d3-4fd0-452f-961f-4bb6afbf6042 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3" status: 404 len: 62 microversion: 2.1 time: 0.105709 Oct 04 11:11:29.671967 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1470/2704] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:29 2022] DELETE /compute/v2.1/images/8b16b769-99ee-4a09-9517-fe09502a82e3 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:11:29.684140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8fa06328-6cf0-4e65-80cc-06804a05200e req-7abf58f8-7752-4617-aef5-54191a81428f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a84e23-3478-4a9a-822a-45920bd38647", "name": "network-vif-deleted", "tag": "2b0052d6-2a33-4bfe-94e8-c84034afc433"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:29.717089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8fa06328-6cf0-4e65-80cc-06804a05200e req-7abf58f8-7752-4617-aef5-54191a81428f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:29.718154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8fa06328-6cf0-4e65-80cc-06804a05200e req-7abf58f8-7752-4617-aef5-54191a81428f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:29.718604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8fa06328-6cf0-4e65-80cc-06804a05200e req-7abf58f8-7752-4617-aef5-54191a81428f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:29.765980 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8fa06328-6cf0-4e65-80cc-06804a05200e req-7abf58f8-7752-4617-aef5-54191a81428f service nova] Creating event network-vif-deleted:2b0052d6-2a33-4bfe-94e8-c84034afc433 for instance 52a84e23-3478-4a9a-822a-45920bd38647 on n-h1-791135-8 Oct 04 11:11:29.779545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8fa06328-6cf0-4e65-80cc-06804a05200e req-7abf58f8-7752-4617-aef5-54191a81428f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107980 Oct 04 11:11:29.780723 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1471/2705] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:29.797658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:29.798926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:29.818016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:29.820232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:29.820700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:29.821480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:29.825538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:29.826034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:30.780858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:30.795586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70ab59fd-7a66-48b0-a484-156bb1cd3c99 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 1.012613 Oct 04 11:11:30.796402 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1472/2706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:29 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:30.831735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0f44cd39-b356-48be-b68e-8108fe4bc4cf req-a79785f8-f0ba-4b45-821f-9ecf02f68fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1390bbe7-06c0-4706-8110-387e3431360a", "tag": "0c48a4f1-88c5-4f28-bf44-e70647fc0c20"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:30.861254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0f44cd39-b356-48be-b68e-8108fe4bc4cf req-a79785f8-f0ba-4b45-821f-9ecf02f68fbf service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:30.869250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0f44cd39-b356-48be-b68e-8108fe4bc4cf req-a79785f8-f0ba-4b45-821f-9ecf02f68fbf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:30.869757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0f44cd39-b356-48be-b68e-8108fe4bc4cf req-a79785f8-f0ba-4b45-821f-9ecf02f68fbf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:30.903920 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0f44cd39-b356-48be-b68e-8108fe4bc4cf req-a79785f8-f0ba-4b45-821f-9ecf02f68fbf service nova] Creating event network-changed:0c48a4f1-88c5-4f28-bf44-e70647fc0c20 for instance 1390bbe7-06c0-4706-8110-387e3431360a on n-h1-791135-8 Oct 04 11:11:30.925489 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0f44cd39-b356-48be-b68e-8108fe4bc4cf req-a79785f8-f0ba-4b45-821f-9ecf02f68fbf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103433 Oct 04 11:11:30.952196 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1473/2707] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:30.958498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:30.973862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:30.981701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:30.986024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:30.986475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:30.987225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:30.987683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:30.988106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:31.064836 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 HTTP/1.1 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '52a84e23-3478-4a9a-822a-45920bd38647'} Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:31.068081 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:31.072529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:31.072529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:31.072529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:31.072529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:31.072529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:11:31.072529 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:31.084294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:31.085205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf851980-5994-43b1-bc6f-97af32b174e6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 404 len: 111 microversion: 2.1 time: 0.131536 Oct 04 11:11:31.085823 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1474/2708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:30 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:31.093232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:31.103256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:31.119204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:31.122297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:31.130869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:31.140408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:31.143553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:31.145489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:31.364701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:31.374686 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-562c2018-cc56-4644-b758-91085a8f2b51 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1271 microversion: 2.1 time: 0.284978 Oct 04 11:11:31.396786 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1475/2709] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:31 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:31.579091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb7a26e8-f0da-4274-9989-32d51ab8484a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'create', calling method: .version_select at 0x7f71cfa90af0>, body: {"keypair": {"name": "tempest-keypair-2114889091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsjqva8A6lV0Ago+xLxthDGqxYuK+H1AdzEY5SXj6R9Z8ukHflsoaYdBTA/PckKKRG2OYceU7j+t73Z/NmTAF9SSOuZTOJM5Ni4+60Fv3tcSGZWyKal/kxZ7CjK8suMow=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:31.617607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-fb7a26e8-f0da-4274-9989-32d51ab8484a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for project df60449892d147adb43f4750c9b584d3. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:11:31.628454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-fb7a26e8-f0da-4274-9989-32d51ab8484a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for user 2e4e772e6a5b41a0b0f836b374bc69b4 and project df60449892d147adb43f4750c9b584d3. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:11:31.679033 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb7a26e8-f0da-4274-9989-32d51ab8484a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.275264 Oct 04 11:11:31.680104 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1476/2710] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:11:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:31.875912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:31.877064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:31.891537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:31.892286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:31.893114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:31.894274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:31.895014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:31.895640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:31.940220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:11:32.011366 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.api [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Instance is already in deleting state, ignoring this request Oct 04 11:11:32.012461 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-766d7fb0-9910-4180-82a3-ff7d6d8d9c7c tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 204 len: 0 microversion: 2.1 time: 0.331029 Oct 04 11:11:32.013789 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1477/2711] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:11:31 2022] DELETE /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:11:32.023155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:32.025378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:32.029027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:32.043733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:32.044714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:32.045340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:32.046376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:32.046997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:32.047619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:32.894467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:32.923527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:32.929884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:32.931364 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f64eb32-c37b-4d0f-bacc-37d21581061b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.916350 Oct 04 11:11:32.935112 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1478/2712] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:32 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:32.948727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b718d098-1cf2-431f-81ac-cc936d1eb986 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: .version_select at 0x7f71d40dad30>, body: {"keypair": {"name": "tempest-key-1828475752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK+nEp66+S28lj2Dy1qTY0oK6/PKiJpThZ1Ph7twEgto5Va3ifeGswlttSMyps7OrKP0krU5Z9QG8W7cJOS0TA0/6wjUXaDSUxdjkt4fYPO78s6e8ePLVDIADz4f17D4Q=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:33.016696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b718d098-1cf2-431f-81ac-cc936d1eb986 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:11:33.030521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b718d098-1cf2-431f-81ac-cc936d1eb986 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:11:33.132554 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b718d098-1cf2-431f-81ac-cc936d1eb986 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.195835 Oct 04 11:11:33.133165 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1479/2713] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:11:32 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:33.162582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:33.169734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:33.195911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:33.196905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:33.197662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:33.199183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:33.199911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:33.200452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:33.835690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:33.850894 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-202da6dc-bdde-4b40-a4b5-33079324cd37 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 0.704065 Oct 04 11:11:33.852668 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1480/2714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:33 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:33.861491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6d09329b-caae-403d-90d0-6f467507b053 req-70385e57-6141-4f10-90ca-0a38ba0c2123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "106f6348-858a-40f0-b720-ddf960f7e43e", "name": "network-vif-deleted", "tag": "a886901d-45a1-43b4-819e-d97fca48e2fb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:33.903924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d09329b-caae-403d-90d0-6f467507b053 req-70385e57-6141-4f10-90ca-0a38ba0c2123 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:33.904660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d09329b-caae-403d-90d0-6f467507b053 req-70385e57-6141-4f10-90ca-0a38ba0c2123 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:33.904891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d09329b-caae-403d-90d0-6f467507b053 req-70385e57-6141-4f10-90ca-0a38ba0c2123 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:33.936505 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6d09329b-caae-403d-90d0-6f467507b053 req-70385e57-6141-4f10-90ca-0a38ba0c2123 service nova] Creating event network-vif-deleted:a886901d-45a1-43b4-819e-d97fca48e2fb for instance 106f6348-858a-40f0-b720-ddf960f7e43e on n-h1-791135-8 Oct 04 11:11:33.955545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6d09329b-caae-403d-90d0-6f467507b053 req-70385e57-6141-4f10-90ca-0a38ba0c2123 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100355 Oct 04 11:11:33.961277 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1481/2715] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:33.975035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:33.975962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 106f6348-858a-40f0-b720-ddf960f7e43e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:33.995114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:33.995892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:33.996734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:33.998819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:33.999610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:34.002752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:34.042680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Instance 106f6348-858a-40f0-b720-ddf960f7e43e could not be found. Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e HTTP/1.1 Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 106f6348-858a-40f0-b720-ddf960f7e43e could not be found. Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '106f6348-858a-40f0-b720-ddf960f7e43e'} Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 106f6348-858a-40f0-b720-ddf960f7e43e could not be found. Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 106f6348-858a-40f0-b720-ddf960f7e43e could not be found. Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:34.047777 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 106f6348-858a-40f0-b720-ddf960f7e43e could not be found. Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Instance 106f6348-858a-40f0-b720-ddf960f7e43e could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31b89830-01e4-4302-ac38-76dc02e05779 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e" status: 404 len: 111 microversion: 2.1 time: 0.086120 Oct 04 11:11:34.051711 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1482/2716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:33 2022] GET /compute/v2.1/servers/106f6348-858a-40f0-b720-ddf960f7e43e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:34.064505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:34.065132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:34.080103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:34.083392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:34.084985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:34.085786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:34.086259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:34.086688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:34.417655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:34.430889 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7b9f3ad-f4b5-4bc5-b0a0-33323c59fba0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1269 microversion: 2.1 time: 0.377092 Oct 04 11:11:34.431867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1483/2717] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:34 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1269 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:34.443272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0dffd2f9-26d9-463b-95bf-a49feb9ee6bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '.version_select at 0x7f71d4065a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:34.454508 n-d-791135-8 devstack@n-api.service[122409]: WARNING oslo_db.sqlalchemy.utils [None req-0dffd2f9-26d9-463b-95bf-a49feb9ee6bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 11:11:34.469089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0dffd2f9-26d9-463b-95bf-a49feb9ee6bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.035952 Oct 04 11:11:34.472063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1484/2718] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:11:34 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:34.492577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:34.493484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:34.501853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:34.502583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:34.503185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:34.505377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:34.506211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:34.507190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:35.068849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:35.090069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:35.093624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:35.095553 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d18e2634-d4b5-493e-8971-34fbeac889cd tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.609597 Oct 04 11:11:35.116263 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1485/2719] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:34 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:35.127895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29ccdad3-6fbc-402e-aff5-ab6499184177 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d405d700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:35.170428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-29ccdad3-6fbc-402e-aff5-ab6499184177 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Image not found. Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29ccdad3-6fbc-402e-aff5-ab6499184177 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd HTTP/1.1 Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'd96e598d-c19f-4f2b-8066-2cfb636a8bdd'} Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d96e598d-c19f-4f2b-8066-2cfb636a8bdd to delete Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d96e598d-c19f-4f2b-8066-2cfb636a8bdd could not be found. Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:35.172767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29ccdad3-6fbc-402e-aff5-ab6499184177 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:35.177940 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29ccdad3-6fbc-402e-aff5-ab6499184177 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd" status: 404 len: 62 microversion: 2.1 time: 0.055355 Oct 04 11:11:35.179487 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1486/2720] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:35 2022] DELETE /compute/v2.1/images/d96e598d-c19f-4f2b-8066-2cfb636a8bdd => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:11:35.573314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2130248178", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "6b4dab77-5fb2-41c5-b218-32bef025eb00"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:35.676457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] validate_networks() for [('6b4dab77-5fb2-41c5-b218-32bef025eb00', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:11:37.237752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:11:37.239721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:11:37.240373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:11:37.240943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:11:37.241665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:11:37.259440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:37.263593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:37.264870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:37.266229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:37.268729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:37.269480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:37.313464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Getting quotas for project e9861897c397454abb4c88a3bc2d1556. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:11:37.318675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Getting quotas for user e1d44464a682444b8d63e230ff11e921 and project e9861897c397454abb4c88a3bc2d1556. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:11:37.332178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:11:37.334902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:11:37.398175 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-65842a4d-d371-454e-89ef-ec123eca587b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218304 Oct 04 11:11:37.405976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1487/2721] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:11:37.413161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-549959107", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-key-1828475752", "networks": [{"uuid": "999d214d-a128-4728-9cd3-99390decb15f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:37.519016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] validate_networks() for [('999d214d-a128-4728-9cd3-99390decb15f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:11:38.574297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:11:38.575580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:11:38.576362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:11:38.576971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:11:38.577645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:11:38.612652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:38.613183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:38.619423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:38.620289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:38.620782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:38.621225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:38.683190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:11:38.698100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:11:38.738553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:11:38.741870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:11:38.870186 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d20b495-8ab9-438f-b284-1e0d446596da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462561 Oct 04 11:11:38.872731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1488/2722] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:11:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:11:38.895270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:38.896099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:38.904960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:38.905627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:38.906178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:38.906979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:38.907530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:38.908845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.094113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:39.103274 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b4b8ca0-e769-4f32-9406-c0441d2f02a8 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 0.223132 Oct 04 11:11:39.103805 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1489/2723] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:38 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:39.121606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:39.122677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:39.132131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:39.132804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:39.133448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.134432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:39.135348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:39.135928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.154069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 HTTP/1.1 Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '964982db-00fc-459f-ab6f-c1dab81e9c49'} Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:39.155857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:39.159832 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:39.173118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:39.175814 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd118543-dc56-45d8-853a-dfaaeec26d0e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 404 len: 111 microversion: 2.1 time: 0.070557 Oct 04 11:11:39.177962 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1490/2724] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:11:39 2022] DELETE /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:39.187179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:39.188001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:39.194824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:39.195631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:39.196364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.197257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:39.197915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:39.199109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.458890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:39.468063 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cff30805-6461-4429-ac7e-62eec8507ef5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1311 microversion: 2.1 time: 0.289018 Oct 04 11:11:39.469453 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1491/2725] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:39 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:39.475018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:39.475925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:39.482759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:39.483550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:39.484199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.484919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:39.485415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:39.485855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.763612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:39.775068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:39.776547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:39.777782 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8428c3f6-aea2-40ae-9143-1bfbdd26e45b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.307023 Oct 04 11:11:39.778360 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1492/2726] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:39 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:39.782955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:39.784060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:39.791226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:39.792000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:39.792667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.793623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:39.794299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:39.794960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:39.928616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:39.940572 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a40dd283-45da-413d-bc7f-209b8957e958 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1277 microversion: 2.1 time: 0.160963 Oct 04 11:11:39.941958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1493/2727] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:39 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:39.947526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1183414496", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad"}], "security_groups": [{"name": "tempest-securitygroup--169104319"}], "key_name": "tempest-keypair-2114889091", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:40.071773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] validate_networks() for [('b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:11:40.887964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:11:40.888532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:11:40.889198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:11:40.889924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:11:40.890505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:11:40.904770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:40.909175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:40.910874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:40.911741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:40.912223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:40.914729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:40.980028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:11:40.989891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for user 2e4e772e6a5b41a0b0f836b374bc69b4 and project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:11:41.022143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:11:41.026857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:11:41.123137 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f734e126-a79f-4f9a-8c3c-c1ac0605f79b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.179862 Oct 04 11:11:41.124563 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1494/2728] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:11:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:11:41.131281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8200240e-7769-4195-b9da-bc547a18d8e4 req-57e2e59e-56c3-414e-94a0-0aa4de8c8c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e87860-71dc-4a7f-960f-6e847fb70876", "tag": "dfb592c5-f413-48a2-a005-bbba21115474"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:41.150850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8200240e-7769-4195-b9da-bc547a18d8e4 req-57e2e59e-56c3-414e-94a0-0aa4de8c8c30 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:41.151359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8200240e-7769-4195-b9da-bc547a18d8e4 req-57e2e59e-56c3-414e-94a0-0aa4de8c8c30 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:41.152445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8200240e-7769-4195-b9da-bc547a18d8e4 req-57e2e59e-56c3-414e-94a0-0aa4de8c8c30 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:41.165122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8200240e-7769-4195-b9da-bc547a18d8e4 req-57e2e59e-56c3-414e-94a0-0aa4de8c8c30 service nova] Creating event network-changed:dfb592c5-f413-48a2-a005-bbba21115474 for instance 36e87860-71dc-4a7f-960f-6e847fb70876 on n-h1-791135-8 Oct 04 11:11:41.170522 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8200240e-7769-4195-b9da-bc547a18d8e4 req-57e2e59e-56c3-414e-94a0-0aa4de8c8c30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043819 Oct 04 11:11:41.171351 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1495/2729] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:41.177201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:41.177962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:41.187182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:41.188315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:41.188904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:41.190216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:41.190704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:41.191374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:41.362568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:41.372412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:41.375951 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69d42c98-28ee-4f28-9308-dbb8e9d13d85 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1298 microversion: 2.1 time: 0.203016 Oct 04 11:11:41.376661 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1496/2730] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:41 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1298 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:41.381709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:41.382323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 964982db-00fc-459f-ab6f-c1dab81e9c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:41.388752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:41.389380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:41.390054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:41.390757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:41.391212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:41.391657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:41.409459 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 HTTP/1.1 Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '964982db-00fc-459f-ab6f-c1dab81e9c49'} Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:41.412013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Instance 964982db-00fc-459f-ab6f-c1dab81e9c49 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32ce2a2e-66fe-4bad-89a9-a3b7d607e6b3 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49" status: 404 len: 111 microversion: 2.1 time: 0.036014 Oct 04 11:11:41.418569 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1497/2731] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:41 2022] GET /compute/v2.1/servers/964982db-00fc-459f-ab6f-c1dab81e9c49 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:41.422427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:41.425567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:41.441935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:41.442438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:41.442882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:41.443592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:41.445368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:41.446641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:42.054574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:42.064708 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-307d4fac-96d8-4df8-be1e-8717e2a180df tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 0.649732 Oct 04 11:11:42.070557 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1498/2732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:41 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:42.076895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:42.085985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:42.105188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:42.118235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:42.119648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:42.121264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:42.130221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:42.132531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:42.565465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:42.573980 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8443b7bd-a300-410b-bf1a-2667d1b910e5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1311 microversion: 2.1 time: 0.500777 Oct 04 11:11:42.591265 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1499/2733] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:42 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1311 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:42.599300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:42.600272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:42.608004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:42.609498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:42.610172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:42.611341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:42.612068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:42.614116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:42.951850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:42.964577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:42.968646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:42.969889 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fbe48e31-e3ac-4c0b-bf9b-0c494d87af29 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.377195 Oct 04 11:11:42.970472 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1500/2734] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:42 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:42.974991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:42.975604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:42.995662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:42.996862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:42.999099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:42.999099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:42.999099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:42.999099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:42.999702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:43.722043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:43.732469 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-635bc1d5-c6d6-4a3b-afc2-8e39d690f3c7 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1317 microversion: 2.1 time: 0.760939 Oct 04 11:11:43.733052 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1501/2735] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:42 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1317 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:43.742255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:43.743062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:43.749486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:43.750562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:43.751275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:43.752120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:43.752641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:43.753154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:43.865720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:43.879667 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-16931fb3-5098-4bd0-9dec-87858914b7e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1297 microversion: 2.1 time: 0.140854 Oct 04 11:11:43.887972 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1502/2736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:43 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1297 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:43.897171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5764994-3f1c-48d1-8649-aa91889dc79e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71cfa90790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:43.937877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a5764994-3f1c-48d1-8649-aa91889dc79e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Image not found. Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5764994-3f1c-48d1-8649-aa91889dc79e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f HTTP/1.1 Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c56f6f28-3919-4e43-a9e9-bbc1c2aca45f'} Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c56f6f28-3919-4e43-a9e9-bbc1c2aca45f to delete Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c56f6f28-3919-4e43-a9e9-bbc1c2aca45f could not be found. Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:43.941413 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5764994-3f1c-48d1-8649-aa91889dc79e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5764994-3f1c-48d1-8649-aa91889dc79e tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f" status: 404 len: 62 microversion: 2.1 time: 0.053694 Oct 04 11:11:43.946006 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1503/2737] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:43 2022] DELETE /compute/v2.1/images/c56f6f28-3919-4e43-a9e9-bbc1c2aca45f => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:11:43.951621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:43.952246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:43.966459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:43.966856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:43.967308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:43.968030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:43.968491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:43.969253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:44.226058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:44.241818 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63bcce91-428b-47b5-b78e-f075b1342ef0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1328 microversion: 2.1 time: 0.294405 Oct 04 11:11:44.242987 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1504/2738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:43 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1328 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:44.248676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-90fbe5f6-0589-4eea-94da-c83a2d8f2c84 req-d0cf4635-0e62-45e3-b6cc-9e571814f897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-plugged", "status": "completed", "tag": "1fd6aa11-1a36-4cb6-bc83-1c8b8e59925d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:44.260931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-90fbe5f6-0589-4eea-94da-c83a2d8f2c84 req-d0cf4635-0e62-45e3-b6cc-9e571814f897 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:44.261943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-90fbe5f6-0589-4eea-94da-c83a2d8f2c84 req-d0cf4635-0e62-45e3-b6cc-9e571814f897 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:44.263147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-90fbe5f6-0589-4eea-94da-c83a2d8f2c84 req-d0cf4635-0e62-45e3-b6cc-9e571814f897 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:44.282837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-90fbe5f6-0589-4eea-94da-c83a2d8f2c84 req-d0cf4635-0e62-45e3-b6cc-9e571814f897 service nova] Creating event network-vif-plugged:1fd6aa11-1a36-4cb6-bc83-1c8b8e59925d for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:44.291258 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-90fbe5f6-0589-4eea-94da-c83a2d8f2c84 req-d0cf4635-0e62-45e3-b6cc-9e571814f897 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045927 Oct 04 11:11:44.292789 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1505/2739] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:44.303848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:44.304976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:44.331183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:44.332852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:44.335012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:44.336041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:44.340422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:44.341185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:44.646568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:44.657575 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-822d4961-f8a4-43f2-b48a-ee73e5f0236e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 0.362635 Oct 04 11:11:44.658866 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1506/2740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:44 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:44.664746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:44.668079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:44.674841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:44.676825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:44.677801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:44.678790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:44.679469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:44.680116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.028918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:45.040585 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a3ad00f-8ed9-4810-91f3-d4b90654b724 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1311 microversion: 2.1 time: 0.379749 Oct 04 11:11:45.041189 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1507/2741] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:44 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1311 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:45.053372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:45.053888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:45.069293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.069840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.070325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.071057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.071519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.071951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.092684 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 HTTP/1.1 Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53e6ec01-e1fa-4fff-b376-721ca1d75b44'} Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:45.099349 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80e9bd6f-879e-4adb-ad57-626e3b4ab214 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 404 len: 111 microversion: 2.1 time: 0.058692 Oct 04 11:11:45.103956 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1508/2742] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:11:45 2022] DELETE /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:45.113551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:45.114383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:45.121657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.122166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.122612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.123335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.123791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.124386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.418257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:45.428264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:45.429715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:45.430885 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7cff3e0-fd0d-4526-ba6f-e856ef250eec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.321909 Oct 04 11:11:45.434021 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1509/2743] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:45 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:45.449421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4aa469c5-639c-4a48-8aed-1f1c81ad113c req-b6fbbcf3-afdd-40e5-a23a-ea44106efb5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a", "tag": "b649942d-35b7-49e8-bb0a-5c67c8a80dca"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:45.472825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4aa469c5-639c-4a48-8aed-1f1c81ad113c req-b6fbbcf3-afdd-40e5-a23a-ea44106efb5a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.473334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4aa469c5-639c-4a48-8aed-1f1c81ad113c req-b6fbbcf3-afdd-40e5-a23a-ea44106efb5a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.480753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4aa469c5-639c-4a48-8aed-1f1c81ad113c req-b6fbbcf3-afdd-40e5-a23a-ea44106efb5a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.492883 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4aa469c5-639c-4a48-8aed-1f1c81ad113c req-b6fbbcf3-afdd-40e5-a23a-ea44106efb5a service nova] Creating event network-changed:b649942d-35b7-49e8-bb0a-5c67c8a80dca for instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a on n-h1-791135-8 Oct 04 11:11:45.502488 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4aa469c5-639c-4a48-8aed-1f1c81ad113c req-b6fbbcf3-afdd-40e5-a23a-ea44106efb5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067054 Oct 04 11:11:45.504322 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1510/2744] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:45.526580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:45.530756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:45.544348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.544995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.545586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.546417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.547127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.547792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.830740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:45.840884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9cd9b27f-f3f6-4903-b88a-d8fff85c57cf tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1317 microversion: 2.1 time: 0.335163 Oct 04 11:11:45.844390 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1511/2745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:45 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:45.865583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:45.866813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:45.883356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.884188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.884859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:45.885886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:45.886752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:45.887534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:46.094592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:46.110352 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff9353e1-a14c-4a6c-9fc5-2fcceaabc7eb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1364 microversion: 2.1 time: 0.262461 Oct 04 11:11:46.113427 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1512/2746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:45 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:46.124042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:46.126208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: 53e6ec01-e1fa-4fff-b376-721ca1d75b44] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:46.138461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:46.139302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:46.139907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:46.140775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:46.141431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:46.142154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:46.161174 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 HTTP/1.1 Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53e6ec01-e1fa-4fff-b376-721ca1d75b44'} Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:46.164180 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:46.169184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:46.169184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:46.169184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:46.169184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:46.169184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. Oct 04 11:11:46.169184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:46.171790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Instance 53e6ec01-e1fa-4fff-b376-721ca1d75b44 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:46.172774 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-85462925-58f2-4c29-88c4-48791f1a3226 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44" status: 404 len: 111 microversion: 2.1 time: 0.058032 Oct 04 11:11:46.175675 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1513/2747] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:46 2022] GET /compute/v2.1/servers/53e6ec01-e1fa-4fff-b376-721ca1d75b44 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:46.188260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:46.189117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:46.203115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:46.203996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:46.204976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:46.206608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:46.207241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:46.208026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:46.607659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:46.616272 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cb7773c0-285d-4193-90c7-002b35e217cc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1328 microversion: 2.1 time: 0.439294 Oct 04 11:11:46.616841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1514/2748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:46 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1328 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:46.624681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:46.625564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:46.635272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:46.635985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:46.636581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:46.637505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:46.638123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:46.638703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:46.894995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:46.908841 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f59a0a79-825b-42e3-a606-910860564263 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 0.287719 Oct 04 11:11:46.922036 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1515/2749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:46 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:46.929446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:46.929446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:46.948173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:46.948862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:46.949502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:46.950417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:46.950993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:46.951528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:47.166533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:47.176821 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57796049-3a4e-4f4f-af76-761641f64848 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1311 microversion: 2.1 time: 0.260921 Oct 04 11:11:47.178020 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1516/2750] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:46 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1311 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:47.183902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b373788-cd92-4a2e-8a91-6792532bd8cb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '.version_select at 0x7f71d87163a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:47.216867 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4b373788-cd92-4a2e-8a91-6792532bd8cb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Image not found. Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b373788-cd92-4a2e-8a91-6792532bd8cb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb HTTP/1.1 Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '41b4f3a8-ae00-4726-8ddd-0c74ce063bdb'} Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 41b4f3a8-ae00-4726-8ddd-0c74ce063bdb to delete Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41b4f3a8-ae00-4726-8ddd-0c74ce063bdb could not be found. Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:47.219011 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:11:47.223689 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:47.226955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b373788-cd92-4a2e-8a91-6792532bd8cb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:47.227991 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b373788-cd92-4a2e-8a91-6792532bd8cb tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb" status: 404 len: 62 microversion: 2.1 time: 0.048301 Oct 04 11:11:47.228698 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1517/2751] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:47 2022] DELETE /compute/v2.1/images/41b4f3a8-ae00-4726-8ddd-0c74ce063bdb => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:11:47.234484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1ad1d5fb-5e27-4736-89d1-5ad2df34231e req-93dd500b-fc42-4080-b5e4-086833ae24f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e36650-3d63-4ce5-9045-f07a07011621", "tag": "5163ebf5-9943-415a-89bb-911437bbd82c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:47.247512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1ad1d5fb-5e27-4736-89d1-5ad2df34231e req-93dd500b-fc42-4080-b5e4-086833ae24f4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:47.248194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1ad1d5fb-5e27-4736-89d1-5ad2df34231e req-93dd500b-fc42-4080-b5e4-086833ae24f4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:47.248791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1ad1d5fb-5e27-4736-89d1-5ad2df34231e req-93dd500b-fc42-4080-b5e4-086833ae24f4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:47.261673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1ad1d5fb-5e27-4736-89d1-5ad2df34231e req-93dd500b-fc42-4080-b5e4-086833ae24f4 service nova] Creating event network-changed:5163ebf5-9943-415a-89bb-911437bbd82c for instance 49e36650-3d63-4ce5-9045-f07a07011621 on n-h1-791135-8 Oct 04 11:11:47.267524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1ad1d5fb-5e27-4736-89d1-5ad2df34231e req-93dd500b-fc42-4080-b5e4-086833ae24f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037112 Oct 04 11:11:47.269454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1518/2752] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:47.280312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-plugged", "status": "completed", "tag": "91e8e93c-e545-42c5-a472-0e7ec77847ed"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-plugged", "status": "completed", "tag": "6cee2a64-e738-4a11-b292-980ede0a7155"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-plugged", "status": "completed", "tag": "1e9950d3-05db-4d70-91e8-ee743c2d5efb"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-plugged", "status": "completed", "tag": "f5229279-5aae-4110-b650-3053d2901abf"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:47.293536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:47.294440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:47.295387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:47.309988 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] Creating event network-vif-plugged:91e8e93c-e545-42c5-a472-0e7ec77847ed for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:47.310781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] Creating event network-vif-plugged:6cee2a64-e738-4a11-b292-980ede0a7155 for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:47.311444 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] Creating event network-vif-plugged:1e9950d3-05db-4d70-91e8-ee743c2d5efb for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:47.312104 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] Creating event network-vif-plugged:f5229279-5aae-4110-b650-3053d2901abf for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:47.319455 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-92e1e1f3-1bb9-4842-9c37-7af3d3928b1a req-4a98846f-3de4-4940-a4a3-19fe41f3a8df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.048185 Oct 04 11:11:47.321335 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1519/2753] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:47.481674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63f4253a-2f7e-45ab-b48c-bf42a2a66e06 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71d87161f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-707162462", "description": "tempest-description-1787996207"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:47.729251 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63f4253a-2f7e-45ab-b48c-bf42a2a66e06 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.406355 Oct 04 11:11:47.730301 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1520/2754] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:11:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:47.735533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:47.736659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:47.745689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:47.746707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:47.748004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:47.749229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:47.749861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:47.751048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:47.757844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:47.964373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:47.978225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:47.979898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:47.981191 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9583e80d-eaf0-447f-8059-dc75075d71df tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.249654 Oct 04 11:11:47.985932 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1521/2755] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:47 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:47.987036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:47.988325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:47.994940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:47.995517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:47.996235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:47.996897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:47.997513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:47.998021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:48.219342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:48.228129 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6e93fae-3e0b-48c6-8255-05b2920f3440 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1317 microversion: 2.1 time: 0.244797 Oct 04 11:11:48.245700 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1522/2756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:47 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:48.251577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:48.252389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:48.259786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:48.260530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:48.260959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:48.261851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:48.262457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:48.263037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:48.508726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:48.519534 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d26e49ad-9364-4a2e-a2ea-8847a541097f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1364 microversion: 2.1 time: 0.272098 Oct 04 11:11:48.520782 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1523/2757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:48 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:48.539216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:48.539723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:48.552241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:48.553096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:48.553766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:48.554678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:48.563648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:48.564308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:48.580452 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc HTTP/1.1 Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b343130c-9edd-4145-a732-d5730ffc7edc'} Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:48.582660 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:48.587347 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:48.588721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:48.589764 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12abc9c1-8e90-4ccf-8783-f0773c672ed4 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 404 len: 111 microversion: 2.1 time: 0.067765 Oct 04 11:11:48.590806 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1524/2758] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:11:48 2022] DELETE /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:48.595732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:48.596546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:48.603545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:48.604267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:48.604875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:48.605799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:48.606446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:48.607084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:48.782737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:48.791378 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f8d5023-a189-4eb8-a2d0-436212b0512d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1328 microversion: 2.1 time: 0.199281 Oct 04 11:11:48.797437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1525/2759] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:48 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1328 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:48.797437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1e7cbb7e-39b4-4915-a6c1-7d59b2b9a9db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71cfa90790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-896617357", "description": "tempest-description-627724348"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:48.951939 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1e7cbb7e-39b4-4915-a6c1-7d59b2b9a9db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.158283 Oct 04 11:11:48.958618 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1526/2760] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:11:48 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:48.964267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:48.964884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:48.972496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:48.972987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:48.973456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:48.974182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:48.974633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:48.976205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:49.132211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:49.140889 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02f3b136-098f-43ca-9556-59a884bdd79c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 0.180876 Oct 04 11:11:49.156562 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1527/2761] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:48 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:49.161721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:49.162328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:49.168370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:49.168852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:49.169706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:49.170089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:49.170474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:49.170913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:49.358513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:49.369529 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69a85e20-b20b-42d4-83bd-e1872347efb4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1311 microversion: 2.1 time: 0.212034 Oct 04 11:11:49.370122 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1528/2762] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:49 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:49.374653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:49.380353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] [instance: b343130c-9edd-4145-a732-d5730ffc7edc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:49.386788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:49.387282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:49.387962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:49.388681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:49.389391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:49.390016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:49.407785 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] HTTP exception thrown: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Request method failure captured: Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc HTTP/1.1 Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBO2DNzcfQGbPbKWHt6x-jwdoJFaFwelBJ9d2I2sqiyLg9UOmfrrfytcnh3nSlCtGG3cqbvHIee7BFg89KvrPdMbKU_ZbQgJ2bMgl5GuD0PA8GMLYdbjXZ7_iPIRsC8P4Hiz88eV4krv9g-DlyznBoimXqT-s7d8-LNhQXHJMWgzuGI Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ee7bbcbc81f547c0b5982b0f1efc54cc"}]}] Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesTestJSON-168684915 Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ee7bbcbc81f547c0b5982b0f1efc54cc Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesTestJSON-168684915 Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4dbb699b24b3432e9adc7b6d869e4744 Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesTestJSON-168684915-project Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b343130c-9edd-4145-a732-d5730ffc7edc'} Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:49.410018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] Returning 404 to user: Instance b343130c-9edd-4145-a732-d5730ffc7edc could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-486273f8-0fee-4e44-9a89-3ca174244858 tempest-ImagesTestJSON-168684915 tempest-ImagesTestJSON-168684915-project] 10.222.0.23 "GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc" status: 404 len: 111 microversion: 2.1 time: 0.041832 Oct 04 11:11:49.415923 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1529/2763] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:49 2022] GET /compute/v2.1/servers/b343130c-9edd-4145-a732-d5730ffc7edc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:11:49.421570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:49.422192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:49.429054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:49.429586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:49.430225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:49.431106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:49.431738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:49.432326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:49.670797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:49.681382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:49.682824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:49.684010 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f23bcf9-b4b6-467c-93a0-0a4ad7612e08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.268325 Oct 04 11:11:49.684764 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1530/2764] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:49 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:49.689520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-417718846", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "3f8d8716-703d-415c-b2e1-0152257a1bca"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:49.789473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] validate_networks() for [('3f8d8716-703d-415c-b2e1-0152257a1bca', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:11:50.272906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:11:50.273332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:11:50.273831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:11:50.274240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:11:50.274851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:11:50.284677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=39 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:50.288694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:50.289188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:50.289713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:50.290436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:50.290896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:50.291336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:50.297712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=11 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:50.317534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Getting quotas for project 9ced2f5082a74f07aa11508bad977313. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:11:50.321651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Getting quotas for user 1b5ae872f1bb4ff484eaeab1aa266b82 and project 9ced2f5082a74f07aa11508bad977313. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:11:50.333719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:11:50.336034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:11:50.388908 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-216c8ebd-e9e8-4b1e-b826-c30f0b4ceb60 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702879 Oct 04 11:11:50.390446 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1531/2765] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:11:50.395533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:50.396689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:50.403104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:50.403693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:50.404188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:50.404946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:50.405493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:50.405983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:50.563773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:50.576784 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94e65ed9-9754-497c-a934-bf3ed0d6bb48 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1317 microversion: 2.1 time: 0.185049 Oct 04 11:11:50.577531 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1532/2766] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:50 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:50.594767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e26f6b60-73a1-4b05-9477-7eb3b0f7f992 req-eb175516-3a54-478a-9786-aac3ffbf0af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:50.605067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e26f6b60-73a1-4b05-9477-7eb3b0f7f992 req-eb175516-3a54-478a-9786-aac3ffbf0af1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:50.605521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e26f6b60-73a1-4b05-9477-7eb3b0f7f992 req-eb175516-3a54-478a-9786-aac3ffbf0af1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:50.606161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e26f6b60-73a1-4b05-9477-7eb3b0f7f992 req-eb175516-3a54-478a-9786-aac3ffbf0af1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:50.619529 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e26f6b60-73a1-4b05-9477-7eb3b0f7f992 req-eb175516-3a54-478a-9786-aac3ffbf0af1 service nova] Creating event network-changed:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:11:50.628285 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e26f6b60-73a1-4b05-9477-7eb3b0f7f992 req-eb175516-3a54-478a-9786-aac3ffbf0af1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048424 Oct 04 11:11:50.633635 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1533/2767] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:50.640296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-plugged", "status": "completed", "tag": "6365b2cf-b61a-408e-a6b0-79f4a014c87a"}, {"server_uuid": "1390bbe7-06c0-4706-8110-387e3431360a", "name": "network-vif-plugged", "status": "completed", "tag": "0c48a4f1-88c5-4f28-bf44-e70647fc0c20"}, {"server_uuid": "36e87860-71dc-4a7f-960f-6e847fb70876", "name": "network-vif-plugged", "status": "completed", "tag": "dfb592c5-f413-48a2-a005-bbba21115474"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-plugged", "status": "completed", "tag": "a7932ed8-b8f4-40f5-bf96-846abf9c6b0b"}, {"server_uuid": "a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a", "name": "network-vif-plugged", "status": "completed", "tag": "b649942d-35b7-49e8-bb0a-5c67c8a80dca"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:50.654812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:50.655297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:50.655738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:50.682358 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Creating event network-vif-plugged:6365b2cf-b61a-408e-a6b0-79f4a014c87a for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:50.683647 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Creating event network-vif-plugged:0c48a4f1-88c5-4f28-bf44-e70647fc0c20 for instance 1390bbe7-06c0-4706-8110-387e3431360a on n-h1-791135-8 Oct 04 11:11:50.684357 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Creating event network-vif-plugged:dfb592c5-f413-48a2-a005-bbba21115474 for instance 36e87860-71dc-4a7f-960f-6e847fb70876 on n-h1-791135-8 Oct 04 11:11:50.685031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Creating event network-vif-plugged:a7932ed8-b8f4-40f5-bf96-846abf9c6b0b for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:11:50.686106 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] Creating event network-vif-plugged:b649942d-35b7-49e8-bb0a-5c67c8a80dca for instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a on n-h1-791135-8 Oct 04 11:11:50.702287 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-78d70972-7d69-4a6f-ab1f-b34b28d05efd req-1d3f4da1-448b-4672-bf19-c0540e5271c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.066442 Oct 04 11:11:50.703485 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1534/2768] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:50.713333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:50.714293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:50.723174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:50.723917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:50.725602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:50.727633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:50.728335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:50.728994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.078128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:51.089251 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d63dfaed-3a09-44bc-a377-a4d6e11fc609 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1364 microversion: 2.1 time: 0.384090 Oct 04 11:11:51.093403 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1535/2769] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:50 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1364 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:51.095314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:51.095917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:51.102882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.103369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.103799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.104499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.104949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.105389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.241832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:51.251253 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c47d9919-5de0-40ad-b8b0-0941dfe88786 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1328 microversion: 2.1 time: 0.159863 Oct 04 11:11:51.263678 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1536/2770] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:51 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:51.263678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:51.263678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:51.267178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.267753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.269376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.270195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.270734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.271423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.416936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:51.425114 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-86955f6c-4c6b-4a05-8728-266775057dcf tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 0.171945 Oct 04 11:11:51.425727 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1537/2771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:51 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:51.430304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:51.430934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:51.437160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.437694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.438413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.439402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.440052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.441232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.616504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:51.626952 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8bfdb321-3412-4814-971c-a1d47a227c55 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1311 microversion: 2.1 time: 0.200023 Oct 04 11:11:51.627533 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1538/2772] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:51 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:51.635904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:51.636748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:51.647198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.647950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.648575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.649291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.650083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.650764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.729683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:51.738590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fe4f7cc-c1dc-4a6c-ace8-50ddae99b3c4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1219 microversion: 2.1 time: 0.109812 Oct 04 11:11:51.742083 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1539/2773] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:51 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:51.746855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:51.747469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:51.753866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.754565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.755164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.756187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.756806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.757418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.961431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:51.972969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:51.974640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:51.975693 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c134c3a2-bcdb-4d5b-8891-b979601d8641 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.235594 Oct 04 11:11:51.976449 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1540/2774] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:51 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:51.981078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:51.982143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:51.988498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.988988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.990166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:51.990166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:51.990584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:51.991011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.133578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:52.147663 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02b4723b-c7c4-4088-a7b1-8ceb493e47ed tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1317 microversion: 2.1 time: 0.168624 Oct 04 11:11:52.164870 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1541/2775] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:51 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:52.164870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:52.165437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:52.172892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.172892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.172892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.173305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.173731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.174082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.180582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:52.317334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:52.326317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-738fcb3b-de55-4ebf-9151-b91fc867eb5e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1364 microversion: 2.1 time: 0.170341 Oct 04 11:11:52.341627 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1542/2776] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:52 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:52.348350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:52.349226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:52.356294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.356792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.357228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.357976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.358471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.358897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.503787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:52.513401 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d85bec77-6392-4cbd-8105-fee6b0044854 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1328 microversion: 2.1 time: 0.169305 Oct 04 11:11:52.515916 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1543/2777] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:52 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1328 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:52.522177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:52.522847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:52.529223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.529831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.530333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.531113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.531715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.532318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.678462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:52.686854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-467fd51c-4728-44cd-ab81-b12a5037b47e tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1330 microversion: 2.1 time: 0.169780 Oct 04 11:11:52.687436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1544/2778] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:52 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1330 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:52.692111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:52.692710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:52.698504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.699104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.699543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.700234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.700737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.701235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.911058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:52.920337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5a25dcf-4bed-4bc6-b5a6-dd04e6681578 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1495 microversion: 2.1 time: 0.231852 Oct 04 11:11:52.920933 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1545/2779] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:52 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1495 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:52.929097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5eed0665-9431-4be3-968b-911f8d0038ff req-9249b0f7-8248-44bd-9dbf-6fd10dd9c309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e36650-3d63-4ce5-9045-f07a07011621", "name": "network-vif-plugged", "status": "completed", "tag": "5163ebf5-9943-415a-89bb-911437bbd82c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:52.944285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5eed0665-9431-4be3-968b-911f8d0038ff req-9249b0f7-8248-44bd-9dbf-6fd10dd9c309 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.944873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5eed0665-9431-4be3-968b-911f8d0038ff req-9249b0f7-8248-44bd-9dbf-6fd10dd9c309 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.945406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5eed0665-9431-4be3-968b-911f8d0038ff req-9249b0f7-8248-44bd-9dbf-6fd10dd9c309 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.957662 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5eed0665-9431-4be3-968b-911f8d0038ff req-9249b0f7-8248-44bd-9dbf-6fd10dd9c309 service nova] Creating event network-vif-plugged:5163ebf5-9943-415a-89bb-911437bbd82c for instance 49e36650-3d63-4ce5-9045-f07a07011621 on n-h1-791135-8 Oct 04 11:11:52.962571 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5eed0665-9431-4be3-968b-911f8d0038ff req-9249b0f7-8248-44bd-9dbf-6fd10dd9c309 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040395 Oct 04 11:11:52.963171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1546/2780] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:52.968218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:52.968919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:52.975613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.976101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.976539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:52.977236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:52.977723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:52.978151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.050250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:53.058839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-27a57eea-ee1a-4492-814c-775cbf2191b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1211 microversion: 2.1 time: 0.094507 Oct 04 11:11:53.059432 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1547/2781] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:52 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:53.073640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:53.074411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:53.077465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:53.080900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.082110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.082550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.083253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.083712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.084143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.260247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3958dc0-9f20-41b9-b54f-6940e0569b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1646 microversion: 2.1 time: 0.188441 Oct 04 11:11:53.277420 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1548/2782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:53 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1646 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:53.292070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:53.292832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:53.320693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.321199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.324258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.326171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.326943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.328625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.558165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:53.573069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:53.575201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:53.577153 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-83ea9552-478a-429a-a4c2-b7c6f8b9fc93 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1873 microversion: 2.32 time: 0.305570 Oct 04 11:11:53.578638 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1549/2783] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:53 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1873 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:53.589856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:53.591618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:53.606231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.606736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.607341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.608291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.608758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.609100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.766548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:53.775754 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-df7a777c-c667-4b83-92d9-e1d346f221a2 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1317 microversion: 2.1 time: 0.195886 Oct 04 11:11:53.776439 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1550/2784] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:53 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:53.787773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:53.788718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:53.796776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.797327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.797797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.799303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.799962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.800599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.979837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22e20ef9-6c23-4c7e-a620-722b89bb1b4f tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1646 microversion: 2.1 time: 0.202340 Oct 04 11:11:53.980445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1551/2785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:53 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1646 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:53.986739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:53.987888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:53.995061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.995556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.995998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:53.997156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:53.997652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:53.998173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.147186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:54.155601 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82be6025-b23b-45ec-903e-1a9cdec8d03e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1364 microversion: 2.1 time: 0.174058 Oct 04 11:11:54.156121 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1552/2786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:53 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:54.160901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:54.161538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:54.167321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:54.167815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:54.168263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.168960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:54.169448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:54.170638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.669431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:54.679830 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-723fd26e-1875-4ff1-8903-da9dc00ec909 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1328 microversion: 2.1 time: 0.522640 Oct 04 11:11:54.681573 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1553/2787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:54 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1328 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:54.686308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:54.686924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:54.697747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:54.698678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:54.699288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.700079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:54.700765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:54.701325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.841994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:54.850435 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10c292eb-9e1f-44de-8989-b7a776c3a3ef tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1535 microversion: 2.1 time: 0.167748 Oct 04 11:11:54.861420 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1554/2788] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:54 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1535 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:54.861420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f04e1cd-ebad-438b-a8ef-acf28dc4b26b tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:54.861420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04e1cd-ebad-438b-a8ef-acf28dc4b26b tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:54.861884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04e1cd-ebad-438b-a8ef-acf28dc4b26b tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:54.862128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04e1cd-ebad-438b-a8ef-acf28dc4b26b tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.862811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04e1cd-ebad-438b-a8ef-acf28dc4b26b tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:54.863266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04e1cd-ebad-438b-a8ef-acf28dc4b26b tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:54.863700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f04e1cd-ebad-438b-a8ef-acf28dc4b26b tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.888330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f04e1cd-ebad-438b-a8ef-acf28dc4b26b tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035797 Oct 04 11:11:54.888960 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1555/2789] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 11:11:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:54.898213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:54.899145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:54.906638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:54.907349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:54.907951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.908775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:54.909979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:54.910417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:54.984349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:54.992272 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b250b40-d9d7-4e0f-9ac7-f40b28b15734 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1267 microversion: 2.1 time: 0.102185 Oct 04 11:11:54.992898 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1556/2790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:54 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:55.005575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:55.005575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:55.005575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:55.005575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:55.005575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:55.006058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:55.006151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:55.006555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:55.192782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:55.201974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:55.203445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:55.204678 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3fec0476-c10e-43a5-9cfc-358b6b5e77d9 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 2827 microversion: 2.32 time: 0.210817 Oct 04 11:11:55.205237 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1557/2791] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:11:54 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 2827 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:55.210115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:55.210714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:55.216189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:55.216662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:55.217092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:55.217797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:55.218247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:55.218668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:55.345104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:55.352834 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-65fb8213-8237-44d8-818a-b0a2f9732328 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1506 microversion: 2.1 time: 0.146645 Oct 04 11:11:55.353445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1558/2792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:55 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:55.357756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c732042-26f1-4a7d-9702-6ea3322cb337 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'create', calling method: .version_select at 0x7f71d42270d0>, body: {"pool": "afa91231-c695-414b-8934-c531a3447aaa"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:56.592839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c732042-26f1-4a7d-9702-6ea3322cb337 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.238344 Oct 04 11:11:56.600670 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1559/2793] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:11:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:56.600670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:56.600670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:56.605780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:56.606362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:56.606874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:56.607582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:56.608043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:56.608476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:56.651519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:11:56.682287 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c77bbfa-8f78-4e2b-aea4-5b48a9b8e2da tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876/action" status: 202 len: 0 microversion: 2.1 time: 0.087058 Oct 04 11:11:56.685852 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1560/2794] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:11:56 2022] POST /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:11:56.819277 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d51dce8-0f0c-4656-ba57-bebb03cd3eed tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.135098 Oct 04 11:11:56.819883 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1561/2795] 10.222.0.23 () {58 vars in 1128 bytes} [Tue Oct 4 11:11:56 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 11:11:56.824573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:56.825294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:56.831791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:56.832277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:56.832710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:56.833434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:56.833896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:56.834322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:56.998538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:57.006684 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ad12d4d-b977-4053-b8ca-f1d66d6a67d1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1364 microversion: 2.1 time: 0.185747 Oct 04 11:11:57.007639 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1562/2796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:56 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:57.012494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:57.013006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:57.019620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.020175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.020553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.021875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.021875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.022316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.151825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3774c48e-5067-439c-ae09-d1d34e59c784 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.142985 Oct 04 11:11:57.152973 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1563/2797] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Oct 4 11:11:57 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4/os-interface => generated 1832 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:11:57.169696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:57.170478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:57.192475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.192979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.193453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.194168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.194629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.195061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.251362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:57.252380 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e46676a-bffa-4d44-99e2-30828f82670c tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a/os-instance-actions/req-65842a4d-d371-454e-89ef-ec123eca587b" status: 200 len: 313 microversion: 2.1 time: 0.089808 Oct 04 11:11:57.253396 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1564/2798] 10.222.0.23 () {58 vars in 1419 bytes} [Tue Oct 4 11:11:57 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a/os-instance-actions/req-65842a4d-d371-454e-89ef-ec123eca587b => generated 313 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:57.258013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-49c638e2-0846-4be9-b1e6-07f7fb818140 req-8531c85d-d9b9-4de5-9b87-a59b0ad7f1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "name": "network-vif-plugged", "status": "completed", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:57.267832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-49c638e2-0846-4be9-b1e6-07f7fb818140 req-8531c85d-d9b9-4de5-9b87-a59b0ad7f1f8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.268869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-49c638e2-0846-4be9-b1e6-07f7fb818140 req-8531c85d-d9b9-4de5-9b87-a59b0ad7f1f8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.269308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-49c638e2-0846-4be9-b1e6-07f7fb818140 req-8531c85d-d9b9-4de5-9b87-a59b0ad7f1f8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.281743 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-49c638e2-0846-4be9-b1e6-07f7fb818140 req-8531c85d-d9b9-4de5-9b87-a59b0ad7f1f8 service nova] Creating event network-vif-plugged:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:11:57.287189 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-49c638e2-0846-4be9-b1e6-07f7fb818140 req-8531c85d-d9b9-4de5-9b87-a59b0ad7f1f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Oct 04 11:11:57.288113 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1565/2799] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:11:57.293244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:57.293987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:57.300356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.300850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.301299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.302058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.302517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.303379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.553650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:57.565670 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f30e038b-a124-45d3-bf65-894c2a538447 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1510 microversion: 2.1 time: 0.275794 Oct 04 11:11:57.577409 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1566/2800] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:57 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:57.577409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:11:57.577409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:57.585741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.586749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.587200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.587922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.588393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.588841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.869533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:11:57.878325 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06bed00e-1076-4d46-98c3-24db60ee709b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1315 microversion: 2.1 time: 0.310569 Oct 04 11:11:57.879148 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1567/2801] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:11:57 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:11:57.898359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.69"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:11:57.901108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:11:57.908212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.910065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.910749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.911714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:11:57.912395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:11:57.913067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:11:57.942496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:11:57.943205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquired lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:11:59.591094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Building network info cache for instance {{(pid=122409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:12:00.152046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Updating instance_info_cache with network_info: [{"id": "0c48a4f1-88c5-4f28-bf44-e70647fc0c20", "address": "fa:16:3e:5b:67:1f", "network": {"id": "d89c023d-fd84-4abe-9619-32582459875d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1890675234-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e168534b1f7144cf97c9166ef50e170b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0c48a4f1-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:12:00.166396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Releasing lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:12:00.167697 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a99ecc9-688d-4c53-995d-f640c41faa38 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action" status: 202 len: 0 microversion: 2.1 time: 2.287233 Oct 04 11:12:00.168323 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1568/2802] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:11:57 2022] POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action => generated 0 bytes in 2289 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:12:00.176395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:00.176959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:00.183140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.183633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.184066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.184769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.185220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.185668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.323004 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d662c481-52db-48af-9e7d-02ac5b530cb5 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1631 microversion: 2.1 time: 0.153628 Oct 04 11:12:00.323572 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1569/2803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:00 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1631 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:00.328618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b839dfc-2527-4f43-8581-d046843a2eb6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Calling method '.version_select at 0x7f71d437bf70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:00.335586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:00.353591 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-3b839dfc-2527-4f43-8581-d046843a2eb6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] HTTP exception thrown: Image not found. Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b839dfc-2527-4f43-8581-d046843a2eb6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Request method failure captured: Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBT7cZVWfHWi--53t61-MmDbQ1S519z_qwXCvWZw3Xr2kUln6nRIJXjN93ruyOk_wyTvW6fdWVNh_3xt1iW3JY43VUtHnvSjdVtqhHUWPMnUDxJJAU2TIfqYJorwmjb1xWOl26-gyzjI94MGL_e2_Wsdf1HfcwHz7wW4ivPVJTeBpJc Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/149da239e64f4dc29c712dbadc2047e9"}]}] Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 755c1115b91d4c4e8e8ed8035616f151 Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '-1'} Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:00.355551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b839dfc-2527-4f43-8581-d046843a2eb6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b839dfc-2527-4f43-8581-d046843a2eb6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.032366 Oct 04 11:12:00.359671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1570/2804] 10.222.0.23 () {58 vars in 1134 bytes} [Tue Oct 4 11:12:00 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:12:00.366256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:00.368576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:00.376150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.376639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.377094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.378395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.378849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.379269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.455311 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8cbf0d94-08c6-41d2-95aa-d6a439af5d01 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "POST /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.096256 Oct 04 11:12:00.459111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1571/2805] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:00 2022] POST /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:00.461183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:00.461929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:00.468348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.469016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.469269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.470064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.470517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.470940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.622685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:00.634868 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ed4969f2-c268-40ff-b04a-dc6f769fb237 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1510 microversion: 2.1 time: 0.177067 Oct 04 11:12:00.635664 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1572/2806] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:00 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:00.640187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a2770273-8f03-4264-a2f7-4db286a839f6 req-56d77eaa-8ff8-4853-babb-37c95311e431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca8e390-46b1-4ecd-89e7-c3e7f4881df6", "tag": "d35b883a-eff3-4486-a332-0d7e53fcd167"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:00.652508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a2770273-8f03-4264-a2f7-4db286a839f6 req-56d77eaa-8ff8-4853-babb-37c95311e431 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.653018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a2770273-8f03-4264-a2f7-4db286a839f6 req-56d77eaa-8ff8-4853-babb-37c95311e431 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.653510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a2770273-8f03-4264-a2f7-4db286a839f6 req-56d77eaa-8ff8-4853-babb-37c95311e431 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.666850 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a2770273-8f03-4264-a2f7-4db286a839f6 req-56d77eaa-8ff8-4853-babb-37c95311e431 service nova] Creating event network-changed:d35b883a-eff3-4486-a332-0d7e53fcd167 for instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 on n-h1-791135-8 Oct 04 11:12:00.671797 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a2770273-8f03-4264-a2f7-4db286a839f6 req-56d77eaa-8ff8-4853-babb-37c95311e431 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035107 Oct 04 11:12:00.672942 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1573/2807] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:00.678912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:00.679628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:00.686986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.687488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.687942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.688657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.689121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.689588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.847681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:00.855506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-500ccc0d-794f-41d9-a808-ac32eb6d86c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1552 microversion: 2.1 time: 0.181402 Oct 04 11:12:00.856084 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1574/2808] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:00 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:00.860931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:00.862443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:00.868174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.868669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.869113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:00.869849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:00.870313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:00.870746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:01.004631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:01.012518 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b0b0bb0-42e6-4f88-b1db-508540e5a3b8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1315 microversion: 2.1 time: 0.155353 Oct 04 11:12:01.013087 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1575/2809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:00 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:01.024928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-aa1b66fe-4180-4ca8-942a-a9899d351e78 req-48a9cf78-2569-4987-a293-44dbd679a22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "tag": "91e8e93c-e545-42c5-a472-0e7ec77847ed"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:01.036714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aa1b66fe-4180-4ca8-942a-a9899d351e78 req-48a9cf78-2569-4987-a293-44dbd679a22b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:01.037446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aa1b66fe-4180-4ca8-942a-a9899d351e78 req-48a9cf78-2569-4987-a293-44dbd679a22b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:01.037673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aa1b66fe-4180-4ca8-942a-a9899d351e78 req-48a9cf78-2569-4987-a293-44dbd679a22b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:01.049714 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-aa1b66fe-4180-4ca8-942a-a9899d351e78 req-48a9cf78-2569-4987-a293-44dbd679a22b service nova] Creating event network-changed:91e8e93c-e545-42c5-a472-0e7ec77847ed for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:12:01.055400 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-aa1b66fe-4180-4ca8-942a-a9899d351e78 req-48a9cf78-2569-4987-a293-44dbd679a22b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040980 Oct 04 11:12:01.055991 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1576/2810] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:01.063269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f25dc27d-ab05-4112-8bd4-799122265817 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'create', calling method: .version_select at 0x7f71d4421b80>, body: {"pool": "afa91231-c695-414b-8934-c531a3447aaa"} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:02.243483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f25dc27d-ab05-4112-8bd4-799122265817 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 1.184580 Oct 04 11:12:02.244413 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1577/2811] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:12:01 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:02.249085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-791135-8", "block_migration": true, "disk_over_commit": false}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:02.252000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:02.258649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:02.259137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:02.259571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:02.260273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:02.260727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:02.261151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:02.286953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lazy-loading 'flavor' on Instance uuid 36e87860-71dc-4a7f-960f-6e847fb70876 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:12:02.298904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Going to try to live migrate instance to n-h2-791135-8 {{(pid=122409) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:12:02.346184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:03.604047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-495e59ba-7e30-4aa2-a557-a5361d780d37 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876/action" status: 202 len: 0 microversion: 2.1 time: 1.358403 Oct 04 11:12:03.607885 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1578/2812] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:02 2022] POST /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876/action => generated 0 bytes in 1363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:03.613754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2bf9dbae-e6c9-47c9-aa6d-4d05440f3fba tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Calling method '.version_select at 0x7f71d42279d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:03.640856 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-2bf9dbae-e6c9-47c9-aa6d-4d05440f3fba tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] HTTP exception thrown: Image not found. Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2bf9dbae-e6c9-47c9-aa6d-4d05440f3fba tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Request method failure captured: Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/48a88a06-05c3-49b7-80f1-7cc6b967b1ej HTTP/1.1 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBT7cZVWfHWi--53t61-MmDbQ1S519z_qwXCvWZw3Xr2kUln6nRIJXjN93ruyOk_wyTvW6fdWVNh_3xt1iW3JY43VUtHnvSjdVtqhHUWPMnUDxJJAU2TIfqYJorwmjb1xWOl26-gyzjI94MGL_e2_Wsdf1HfcwHz7wW4ivPVJTeBpJc Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/149da239e64f4dc29c712dbadc2047e9"}]}] Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 755c1115b91d4c4e8e8ed8035616f151 Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '48a88a06-05c3-49b7-80f1-7cc6b967b1ej'} Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 48a88a06-05c3-49b7-80f1-7cc6b967b1ej to delete Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48a88a06-05c3-49b7-80f1-7cc6b967b1ej could not be found. Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:03.643271 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2bf9dbae-e6c9-47c9-aa6d-4d05440f3fba tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:03.647691 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2bf9dbae-e6c9-47c9-aa6d-4d05440f3fba tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] 10.222.0.23 "DELETE /compute/v2.1/images/48a88a06-05c3-49b7-80f1-7cc6b967b1ej" status: 404 len: 62 microversion: 2.1 time: 0.037804 Oct 04 11:12:03.650753 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1579/2813] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:03 2022] DELETE /compute/v2.1/images/48a88a06-05c3-49b7-80f1-7cc6b967b1ej => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:12:03.655881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:03.656516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:03.664026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:03.664530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:03.665088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:03.665726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:03.666216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:03.666836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:03.834905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:03.843752 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6475ea8-925c-4ce3-9245-1f526039ceb5 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1506 microversion: 2.1 time: 0.192418 Oct 04 11:12:03.844625 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1580/2814] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:03 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:03.850370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:03.851048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:03.857278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:03.858006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:03.858796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:03.859520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:03.859970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:03.860393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:03.894374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:12:03.972890 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-829d4e6e-b625-4c51-ac45-1f7f2a3f7296 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 204 len: 0 microversion: 2.1 time: 0.126812 Oct 04 11:12:03.973573 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1581/2815] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:12:03 2022] DELETE /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:12:03.979068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:03.979798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:03.985999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:03.986554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:03.987049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:03.987744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:03.988203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:03.988624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:04.083817 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e03ff52e-64fc-450b-ab48-3c6f323ef1ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108721 Oct 04 11:12:04.084563 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1582/2816] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:12:03 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:04.089517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:04.090071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:04.096983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:04.097500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:04.097935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:04.098634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:04.099086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:04.099629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:04.345441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:04.354081 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e9094a3-74cd-48e5-b826-aba9f3ed696a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1315 microversion: 2.1 time: 0.268397 Oct 04 11:12:04.365555 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1583/2817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:04 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:04.365555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.3"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:04.365555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:04.370443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:04.370443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:04.370443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:04.370443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:04.370443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:04.370443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:04.398476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:12:04.398966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquired lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:12:04.872975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:05.273474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.3 (eba54e0d-03a5-4487-b8b0-425e4265e2fa) with port 0c48a4f1-88c5-4f28-bf44-e70647fc0c20 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network afa91231-c695-414b-8934-c531a3447aaa.", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:12:05.274542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Releasing lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:12:05.275584 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.3 (eba54e0d-03a5-4487-b8b0-425e4265e2fa) with port 0c48a4f1-88c5-4f28-bf44-e70647fc0c20 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network afa91231-c695-414b-8934-c531a3447aaa. Oct 04 11:12:05.275584 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-91e66be6-82d2-48b0-874d-54d71520210a'] Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Request method failure captured: Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action HTTP/1.1 Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 44 Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTTEAjI8LJVkT9-0c3cwb3FvWdWrBCslQH3yGcgrxGxvNtNoclH14uZLzReOegVciw0xZEcMtW7hQFW0eB8mmXW-7K5s4Svy0xSRMs_mXVLtJA2XoJk0TZdZjp_WojllHJG8-iG6jPQ0AVdLfc65FrL6NopED7H0pz-aF6IQ4i51gc Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e168534b1f7144cf97c9166ef50e170b"}]}] Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: abecb85b41d846e0a2b0bfc7010031c9 Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: {"addFloatingIp": {"address": "172.25.1.3"}} Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot associate floating IP 172.25.1.3 (eba54e0d-03a5-4487-b8b0-425e4265e2fa) with port 0c48a4f1-88c5-4f28-bf44-e70647fc0c20 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network afa91231-c695-414b-8934-c531a3447aaa. Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-91e66be6-82d2-48b0-874d-54d71520210a'] Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1390bbe7-06c0-4706-8110-387e3431360a', 'body': {'addFloatingIp': {'address': '172.25.1.3'}}} Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:12:05.278503 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.3 (eba54e0d-03a5-4487-b8b0-425e4265e2fa) with port 0c48a4f1-88c5-4f28-bf44-e70647fc0c20 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network afa91231-c695-414b-8934-c531a3447aaa. Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91e66be6-82d2-48b0-874d-54d71520210a'] Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.3 (eba54e0d-03a5-4487-b8b0-425e4265e2fa) with port 0c48a4f1-88c5-4f28-bf44-e70647fc0c20 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network afa91231-c695-414b-8934-c531a3447aaa. Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91e66be6-82d2-48b0-874d-54d71520210a'] Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.3 (eba54e0d-03a5-4487-b8b0-425e4265e2fa) with port 0c48a4f1-88c5-4f28-bf44-e70647fc0c20 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network afa91231-c695-414b-8934-c531a3447aaa. Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91e66be6-82d2-48b0-874d-54d71520210a'] Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.3 (eba54e0d-03a5-4487-b8b0-425e4265e2fa) with port 0c48a4f1-88c5-4f28-bf44-e70647fc0c20 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network afa91231-c695-414b-8934-c531a3447aaa. Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91e66be6-82d2-48b0-874d-54d71520210a'] Oct 04 11:12:05.282612 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.286273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Returning 400 to user: Cannot associate floating IP 172.25.1.3 (eba54e0d-03a5-4487-b8b0-425e4265e2fa) with port 0c48a4f1-88c5-4f28-bf44-e70647fc0c20 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network afa91231-c695-414b-8934-c531a3447aaa. Oct 04 11:12:05.286273 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-91e66be6-82d2-48b0-874d-54d71520210a'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:05.286273 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbe31cbd-c4a2-4dae-ba3a-fb987a68960c tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action" status: 400 len: 380 microversion: 2.1 time: 0.925087 Oct 04 11:12:05.287316 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1584/2818] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:04 2022] POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action => generated 380 bytes in 932 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:12:05.292189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e14da848-b877-4520-a3dc-9becf9d5261d req-20657e5d-8e78-47fa-bbe4-2d1adbdb96c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1390bbe7-06c0-4706-8110-387e3431360a", "tag": "0c48a4f1-88c5-4f28-bf44-e70647fc0c20"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:05.302933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e14da848-b877-4520-a3dc-9becf9d5261d req-20657e5d-8e78-47fa-bbe4-2d1adbdb96c6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:05.303542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e14da848-b877-4520-a3dc-9becf9d5261d req-20657e5d-8e78-47fa-bbe4-2d1adbdb96c6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:05.304096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e14da848-b877-4520-a3dc-9becf9d5261d req-20657e5d-8e78-47fa-bbe4-2d1adbdb96c6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:05.315378 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e14da848-b877-4520-a3dc-9becf9d5261d req-20657e5d-8e78-47fa-bbe4-2d1adbdb96c6 service nova] Creating event network-changed:0c48a4f1-88c5-4f28-bf44-e70647fc0c20 for instance 1390bbe7-06c0-4706-8110-387e3431360a on n-h1-791135-8 Oct 04 11:12:05.320638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e14da848-b877-4520-a3dc-9becf9d5261d req-20657e5d-8e78-47fa-bbe4-2d1adbdb96c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031992 Oct 04 11:12:05.321465 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1585/2819] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:05.326814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:05.327828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:05.336036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:05.336036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:05.336274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:05.337073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:05.337774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:05.338321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:05.600783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:05.615940 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3793343f-a04e-4e24-8b8d-e67610c9e167 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1505 microversion: 2.1 time: 0.293266 Oct 04 11:12:05.618879 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1586/2820] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:05 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:05.638544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04860221-664e-4afb-9271-d6791dfab1e6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Calling method '.version_select at 0x7f71d437d1f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:05.669185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-04860221-664e-4afb-9271-d6791dfab1e6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] HTTP exception thrown: Image not found. Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04860221-664e-4afb-9271-d6791dfab1e6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Request method failure captured: Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/b56f758b-1a18-444b-86b5-f535830a7ac51 HTTP/1.1 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBT7cZVWfHWi--53t61-MmDbQ1S519z_qwXCvWZw3Xr2kUln6nRIJXjN93ruyOk_wyTvW6fdWVNh_3xt1iW3JY43VUtHnvSjdVtqhHUWPMnUDxJJAU2TIfqYJorwmjb1xWOl26-gyzjI94MGL_e2_Wsdf1HfcwHz7wW4ivPVJTeBpJc Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/149da239e64f4dc29c712dbadc2047e9"}]}] Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 755c1115b91d4c4e8e8ed8035616f151 Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b56f758b-1a18-444b-86b5-f535830a7ac51'} Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b56f758b-1a18-444b-86b5-f535830a7ac51 to delete Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b56f758b-1a18-444b-86b5-f535830a7ac51 could not be found. Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:05.672389 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:12:05.677179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:05.680082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04860221-664e-4afb-9271-d6791dfab1e6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:05.681589 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-04860221-664e-4afb-9271-d6791dfab1e6 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] 10.222.0.23 "DELETE /compute/v2.1/images/b56f758b-1a18-444b-86b5-f535830a7ac51" status: 404 len: 62 microversion: 2.1 time: 0.061486 Oct 04 11:12:05.682415 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1587/2821] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:12:05 2022] DELETE /compute/v2.1/images/b56f758b-1a18-444b-86b5-f535830a7ac51 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:12:05.692170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4e63121e-6006-444f-9d33-746141585488 req-72bc76d4-7dc7-41a2-bc19-2d765149056e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca8e390-46b1-4ecd-89e7-c3e7f4881df6", "name": "network-vif-plugged", "status": "completed", "tag": "d35b883a-eff3-4486-a332-0d7e53fcd167"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:05.706327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4e63121e-6006-444f-9d33-746141585488 req-72bc76d4-7dc7-41a2-bc19-2d765149056e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:05.707200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4e63121e-6006-444f-9d33-746141585488 req-72bc76d4-7dc7-41a2-bc19-2d765149056e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:05.707778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4e63121e-6006-444f-9d33-746141585488 req-72bc76d4-7dc7-41a2-bc19-2d765149056e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:05.732803 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4e63121e-6006-444f-9d33-746141585488 req-72bc76d4-7dc7-41a2-bc19-2d765149056e service nova] Creating event network-vif-plugged:d35b883a-eff3-4486-a332-0d7e53fcd167 for instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 on n-h1-791135-8 Oct 04 11:12:05.739234 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4e63121e-6006-444f-9d33-746141585488 req-72bc76d4-7dc7-41a2-bc19-2d765149056e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055494 Oct 04 11:12:05.743836 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1588/2822] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:05.751559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '.version_select at 0x7f71d43c1a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:05.752418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:05.759599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:05.760256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:05.760791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:05.761773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:05.762342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:05.762857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:05.805313 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c7bd66d-6923-4e44-93c2-bbdc08819876 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.059987 Oct 04 11:12:05.806233 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1589/2823] 10.222.0.23 () {58 vars in 1296 bytes} [Tue Oct 4 11:12:05 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a/os-instance-actions => generated 611 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:05.816038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:05.817046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:05.824654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:05.825442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:05.826310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:05.827241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:05.827893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:05.828525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:06.047979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:06.057141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ccc5211-6426-48cf-8db8-22ac685c3d1b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1516 microversion: 2.1 time: 0.249316 Oct 04 11:12:06.057999 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1590/2824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:05 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:06.063118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-395759af-f5ce-4830-95e7-123ce1349493 req-08880fea-c582-4614-a3f4-e325e3697824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:06.077716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-395759af-f5ce-4830-95e7-123ce1349493 req-08880fea-c582-4614-a3f4-e325e3697824 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:06.078691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-395759af-f5ce-4830-95e7-123ce1349493 req-08880fea-c582-4614-a3f4-e325e3697824 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:06.079201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-395759af-f5ce-4830-95e7-123ce1349493 req-08880fea-c582-4614-a3f4-e325e3697824 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:06.095357 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-395759af-f5ce-4830-95e7-123ce1349493 req-08880fea-c582-4614-a3f4-e325e3697824 service nova] Creating event network-changed:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:12:06.102038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-395759af-f5ce-4830-95e7-123ce1349493 req-08880fea-c582-4614-a3f4-e325e3697824 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042603 Oct 04 11:12:06.103329 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1591/2825] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:06.108807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06d30393-9a22-4100-80aa-5ee8b827b2bc tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '.version_select at 0x7f71d4287ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:06.904381 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06d30393-9a22-4100-80aa-5ee8b827b2bc tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/eba54e0d-03a5-4487-b8b0-425e4265e2fa" status: 202 len: 0 microversion: 2.1 time: 0.799450 Oct 04 11:12:06.905020 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1592/2826] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:12:06 2022] DELETE /compute/v2.1/os-floating-ips/eba54e0d-03a5-4487-b8b0-425e4265e2fa => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:06.910624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:06.911361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:06.918200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:06.918681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:06.919116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:06.919854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:06.920276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:06.920704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:07.048749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:07.056361 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf0a33bb-0304-4de1-9487-ffced2475d7d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1315 microversion: 2.1 time: 0.150271 Oct 04 11:12:07.056922 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1593/2827] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:06 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:07.061207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbcfd28b-e27c-431e-b318-0cda042f77f2 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Calling method '.version_select at 0x7f71d437b430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:07.083020 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-cbcfd28b-e27c-431e-b318-0cda042f77f2 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] HTTP exception thrown: Image not found. Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbcfd28b-e27c-431e-b318-0cda042f77f2 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Request method failure captured: Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/tempest-invalid-2077729016 HTTP/1.1 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBT7cZVWfHWi--53t61-MmDbQ1S519z_qwXCvWZw3Xr2kUln6nRIJXjN93ruyOk_wyTvW6fdWVNh_3xt1iW3JY43VUtHnvSjdVtqhHUWPMnUDxJJAU2TIfqYJorwmjb1xWOl26-gyzjI94MGL_e2_Wsdf1HfcwHz7wW4ivPVJTeBpJc Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/149da239e64f4dc29c712dbadc2047e9"}]}] Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 755c1115b91d4c4e8e8ed8035616f151 Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'tempest-invalid-2077729016'} Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2077729016 to delete Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2077729016 could not be found. Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:07.085095 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbcfd28b-e27c-431e-b318-0cda042f77f2 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbcfd28b-e27c-431e-b318-0cda042f77f2 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-2077729016" status: 404 len: 62 microversion: 2.1 time: 0.028638 Oct 04 11:12:07.089451 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1594/2828] 10.222.0.23 () {58 vars in 1206 bytes} [Tue Oct 4 11:12:07 2022] DELETE /compute/v2.1/images/tempest-invalid-2077729016 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:12:07.091468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:07.091960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:07.099428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:07.099912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:07.100345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:07.101043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:07.101519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:07.101946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:07.126174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:12:07.199632 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d2727469-322b-4e92-a9a1-9518582a816b tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 204 len: 0 microversion: 2.1 time: 0.111408 Oct 04 11:12:07.200206 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1595/2829] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:12:07 2022] DELETE /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:12:07.206087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:07.207806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:07.213911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:07.214392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:07.214827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:07.215524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:07.215974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:07.216515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:07.374288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:07.382752 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a3057a1-1b7e-4fb2-9d49-e138b400c149 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1505 microversion: 2.1 time: 0.181441 Oct 04 11:12:07.383632 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1596/2830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:07 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:07.389822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.69"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:07.532391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:07.538533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:07.539012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:07.539463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:07.540139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:07.540589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:07.541010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:07.738355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:12:07.738766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquired lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:12:08.366679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Building network info cache for instance {{(pid=122409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:12:08.862596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Updating instance_info_cache with network_info: [{"id": "0c48a4f1-88c5-4f28-bf44-e70647fc0c20", "address": "fa:16:3e:5b:67:1f", "network": {"id": "d89c023d-fd84-4abe-9619-32582459875d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1890675234-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e168534b1f7144cf97c9166ef50e170b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0c48a4f1-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:12:08.868570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=2,nova_cell1:SAVEPOINT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:08.878099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Releasing lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:12:08.879077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-148a6af0-9643-4983-ade3-d22346dfb154 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action" status: 202 len: 0 microversion: 2.1 time: 1.494736 Oct 04 11:12:08.882805 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1597/2831] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:07 2022] POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action => generated 0 bytes in 1496 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:12:08.885706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:08.886636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:08.888372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:08.896114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:08.896759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:08.897313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:08.898149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:08.898614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:08.899047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:08.933034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:08.933977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:08.933977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:08.934448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lazy-loading 'fault' on Instance uuid 49e36650-3d63-4ce5-9045-f07a07011621 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:12:08.984963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:08.996820 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f344c9ce-a357-4e21-a5da-bb5038fa622f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 200 len: 1318 microversion: 2.1 time: 0.115085 Oct 04 11:12:09.009100 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1598/2832] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:08 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:09.015010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ec7b5af-b3f7-48c3-95cb-93c2370a8726 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Calling method '.version_select at 0x7f71d4729a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:09.041933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1ec7b5af-b3f7-48c3-95cb-93c2370a8726 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] HTTP exception thrown: Image not found. Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ec7b5af-b3f7-48c3-95cb-93c2370a8726 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Request method failure captured: Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/996c6d6a-55c5-4fc2-95a0-850f21a53e56 HTTP/1.1 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBT7cZVWfHWi--53t61-MmDbQ1S519z_qwXCvWZw3Xr2kUln6nRIJXjN93ruyOk_wyTvW6fdWVNh_3xt1iW3JY43VUtHnvSjdVtqhHUWPMnUDxJJAU2TIfqYJorwmjb1xWOl26-gyzjI94MGL_e2_Wsdf1HfcwHz7wW4ivPVJTeBpJc Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/149da239e64f4dc29c712dbadc2047e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/149da239e64f4dc29c712dbadc2047e9"}]}] Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 149da239e64f4dc29c712dbadc2047e9 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-112235205 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 755c1115b91d4c4e8e8ed8035616f151 Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-112235205-project Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '996c6d6a-55c5-4fc2-95a0-850f21a53e56'} Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 996c6d6a-55c5-4fc2-95a0-850f21a53e56 to delete Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 996c6d6a-55c5-4fc2-95a0-850f21a53e56 could not be found. Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:09.044105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ec7b5af-b3f7-48c3-95cb-93c2370a8726 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ec7b5af-b3f7-48c3-95cb-93c2370a8726 tempest-ImagesDeleteNegativeTestJSON-112235205 tempest-ImagesDeleteNegativeTestJSON-112235205-project] 10.222.0.23 "DELETE /compute/v2.1/images/996c6d6a-55c5-4fc2-95a0-850f21a53e56" status: 404 len: 62 microversion: 2.1 time: 0.046981 Oct 04 11:12:09.049154 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1599/2833] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:08 2022] DELETE /compute/v2.1/images/996c6d6a-55c5-4fc2-95a0-850f21a53e56 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:12:09.054614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:09.055217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:09.065128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:09.065674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:09.066113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:09.066823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:09.067279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:09.068010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:09.291710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:09.302688 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02a0251e-589d-4a15-ab16-d609fa7c600a tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1512 microversion: 2.1 time: 0.252207 Oct 04 11:12:09.303392 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1600/2834] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:09 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:09.308681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-14bb20ec-f24a-4ccb-81cd-3ebc4a742b88 req-a628533d-62f1-4d93-9d29-eef38b402aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e87860-71dc-4a7f-960f-6e847fb70876", "name": "network-vif-unplugged", "status": "completed", "tag": "dfb592c5-f413-48a2-a005-bbba21115474"}, {"name": "network-changed", "server_uuid": "36e87860-71dc-4a7f-960f-6e847fb70876", "tag": "dfb592c5-f413-48a2-a005-bbba21115474"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:09.320213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-14bb20ec-f24a-4ccb-81cd-3ebc4a742b88 req-a628533d-62f1-4d93-9d29-eef38b402aa1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:09.321163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-14bb20ec-f24a-4ccb-81cd-3ebc4a742b88 req-a628533d-62f1-4d93-9d29-eef38b402aa1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:09.321791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-14bb20ec-f24a-4ccb-81cd-3ebc4a742b88 req-a628533d-62f1-4d93-9d29-eef38b402aa1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:09.339011 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-14bb20ec-f24a-4ccb-81cd-3ebc4a742b88 req-a628533d-62f1-4d93-9d29-eef38b402aa1 service nova] Creating event network-vif-unplugged:dfb592c5-f413-48a2-a005-bbba21115474 for instance 36e87860-71dc-4a7f-960f-6e847fb70876 on n-h1-791135-8 Oct 04 11:12:09.339608 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-14bb20ec-f24a-4ccb-81cd-3ebc4a742b88 req-a628533d-62f1-4d93-9d29-eef38b402aa1 service nova] Creating event network-changed:dfb592c5-f413-48a2-a005-bbba21115474 for instance 36e87860-71dc-4a7f-960f-6e847fb70876 on n-h1-791135-8 Oct 04 11:12:09.348016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-14bb20ec-f24a-4ccb-81cd-3ebc4a742b88 req-a628533d-62f1-4d93-9d29-eef38b402aa1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.043355 Oct 04 11:12:09.349019 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1601/2835] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:09.354853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:09.355560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:09.365554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:09.366058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:09.366500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:09.367407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:09.368063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:09.368634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:09.562640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:09.576627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34766104-ae60-49c2-b711-c3ee1b9c6f9c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1503 microversion: 2.1 time: 0.222879 Oct 04 11:12:09.588678 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1602/2836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:09 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:09.603075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c8133c52-b0d9-4f8c-b028-89e01ee2e7e7 req-8067b38e-0fc6-44fc-bde3-49bad4e43639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e36650-3d63-4ce5-9045-f07a07011621", "name": "network-vif-deleted", "tag": "5163ebf5-9943-415a-89bb-911437bbd82c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:09.615390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c8133c52-b0d9-4f8c-b028-89e01ee2e7e7 req-8067b38e-0fc6-44fc-bde3-49bad4e43639 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:09.615944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c8133c52-b0d9-4f8c-b028-89e01ee2e7e7 req-8067b38e-0fc6-44fc-bde3-49bad4e43639 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:09.616380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c8133c52-b0d9-4f8c-b028-89e01ee2e7e7 req-8067b38e-0fc6-44fc-bde3-49bad4e43639 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:09.629141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c8133c52-b0d9-4f8c-b028-89e01ee2e7e7 req-8067b38e-0fc6-44fc-bde3-49bad4e43639 service nova] Creating event network-vif-deleted:5163ebf5-9943-415a-89bb-911437bbd82c for instance 49e36650-3d63-4ce5-9045-f07a07011621 on n-h1-791135-8 Oct 04 11:12:09.635612 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c8133c52-b0d9-4f8c-b028-89e01ee2e7e7 req-8067b38e-0fc6-44fc-bde3-49bad4e43639 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036848 Oct 04 11:12:09.640275 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1603/2837] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:09.654791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:09.656913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:09.679184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:09.683326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:09.683953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:09.687033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:09.687712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:09.688371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:09.937677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:09.953698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45154444-451a-4935-a7b2-625e89cd773d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1505 microversion: 2.1 time: 0.311712 Oct 04 11:12:09.974038 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1604/2838] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:09 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:09.979810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af2dcf7f-22ac-499d-a44d-21e1e89328cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '.version_select at 0x7f71d42115e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:10.825680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af2dcf7f-22ac-499d-a44d-21e1e89328cb tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/e6e8e7cf-865b-4b8d-8485-159f8df09213" status: 202 len: 0 microversion: 2.1 time: 0.849596 Oct 04 11:12:10.827726 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1605/2839] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:12:09 2022] DELETE /compute/v2.1/os-floating-ips/e6e8e7cf-865b-4b8d-8485-159f8df09213 => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:10.838886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-707162462"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:10.841556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:10.856127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:10.859938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:10.863641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:10.864551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:10.866917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:10.867598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.087236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.security_group_api [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Adding security group c7bb1e13-7b83-4341-93a3-6aacff0c3cd6 to port d35b883a-eff3-4486-a332-0d7e53fcd167 Oct 04 11:12:11.533031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6d66fe4-eb2a-4b8d-ac13-f407e2dea0e8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6/action" status: 202 len: 0 microversion: 2.1 time: 0.704011 Oct 04 11:12:11.534272 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1606/2840] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:10 2022] POST /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:11.540902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:11.541542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:11.547858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.548353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.548825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.549750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.550374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.550959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.571081 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 HTTP/1.1 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '49e36650-3d63-4ce5-9045-f07a07011621'} Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.572954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:11.577521 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:11.577521 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:11.577521 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:11.577521 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:11.577521 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:12:11.577521 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.579354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:11.580760 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f50bfbb4-983d-4079-b56f-ae0ae9037c4f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 404 len: 111 microversion: 2.1 time: 0.044569 Oct 04 11:12:11.581523 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1607/2841] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:11 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:12:11.586643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:11.587474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:11.593976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.594583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.595124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.596543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.597227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.597984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.632077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.632561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.633072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.633572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lazy-loading 'fault' on Instance uuid a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:12:11.682495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d44464a682444b8d63e230ff11e921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9861897c397454abb4c88a3bc2d1556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:11.692351 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4e161a0-db2e-4214-bbe1-8b4ed8d163f3 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 200 len: 1307 microversion: 2.1 time: 0.109576 Oct 04 11:12:11.692949 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1608/2842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:11 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:11.698234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbdad462-694c-4231-8a1d-867571493d57 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbdad462-694c-4231-8a1d-867571493d57 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Request method failure captured: Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action HTTP/1.1 Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 34 Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTTEAjI8LJVkT9-0c3cwb3FvWdWrBCslQH3yGcgrxGxvNtNoclH14uZLzReOegVciw0xZEcMtW7hQFW0eB8mmXW-7K5s4Svy0xSRMs_mXVLtJA2XoJk0TZdZjp_WojllHJG8-iG6jPQ0AVdLfc65FrL6NopED7H0pz-aF6IQ4i51gc Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e168534b1f7144cf97c9166ef50e170b"}]}] Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: abecb85b41d846e0a2b0bfc7010031c9 Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: {"addFloatingIp": {"address": ""}} Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1390bbe7-06c0-4706-8110-387e3431360a', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '' Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:12:11.703257 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbdad462-694c-4231-8a1d-867571493d57 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:11.708096 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbdad462-694c-4231-8a1d-867571493d57 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action" status: 400 len: 142 microversion: 2.1 time: 0.010550 Oct 04 11:12:11.713527 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1609/2843] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:11 2022] POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:12:11.718439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:11.719266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:11.728920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.729633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.730286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.731495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.732121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.732902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.881177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:11.898784 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46815406-4540-40cf-8876-1c27f13001d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1505 microversion: 2.1 time: 0.184072 Oct 04 11:12:11.899792 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1610/2844] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:11 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:11.905142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0de675cf-12ab-48cf-b1ce-6faf55dd20cf req-9d02d4b2-fa4b-4949-bb60-8d551f50936d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1390bbe7-06c0-4706-8110-387e3431360a", "tag": "0c48a4f1-88c5-4f28-bf44-e70647fc0c20"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:11.915590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0de675cf-12ab-48cf-b1ce-6faf55dd20cf req-9d02d4b2-fa4b-4949-bb60-8d551f50936d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.916208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0de675cf-12ab-48cf-b1ce-6faf55dd20cf req-9d02d4b2-fa4b-4949-bb60-8d551f50936d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.916724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0de675cf-12ab-48cf-b1ce-6faf55dd20cf req-9d02d4b2-fa4b-4949-bb60-8d551f50936d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.928498 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0de675cf-12ab-48cf-b1ce-6faf55dd20cf req-9d02d4b2-fa4b-4949-bb60-8d551f50936d service nova] Creating event network-changed:0c48a4f1-88c5-4f28-bf44-e70647fc0c20 for instance 1390bbe7-06c0-4706-8110-387e3431360a on n-h1-791135-8 Oct 04 11:12:11.933559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0de675cf-12ab-48cf-b1ce-6faf55dd20cf req-9d02d4b2-fa4b-4949-bb60-8d551f50936d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032497 Oct 04 11:12:11.934581 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1611/2845] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:11.940408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-896617357"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:11.941034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:11.947462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.947953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.948389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:11.949248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:11.949550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:11.949983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:12.082240 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.security_group_api [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Adding security group 0f62661e-76e3-42bc-87d2-06e6741a96f7 to port d35b883a-eff3-4486-a332-0d7e53fcd167 Oct 04 11:12:12.417444 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-533064cc-f5ad-4929-83c0-8b6f363d301f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6/action" status: 202 len: 0 microversion: 2.1 time: 0.481705 Oct 04 11:12:12.418200 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1612/2846] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:11 2022] POST /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:12.427138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-889900d5-4e41-4dc8-9ea2-ab545ec00b26 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '.version_select at 0x7f71d44970d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:12.474718 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-889900d5-4e41-4dc8-9ea2-ab545ec00b26 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-1828475752" status: 202 len: 0 microversion: 2.1 time: 0.051435 Oct 04 11:12:12.475621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1613/2847] 10.222.0.23 () {58 vars in 1209 bytes} [Tue Oct 4 11:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1828475752 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:12.483089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:12.485599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:12.501414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:12.502535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:12.502535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:12.502954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:12.503434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:12.503917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:12.578103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:12:12.584570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquired lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:12:12.718660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Releasing lock "refresh_cache-1390bbe7-06c0-4706-8110-387e3431360a" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:12:12.719223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] HTTP exception thrown: floating IP not found Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Request method failure captured: Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action HTTP/1.1 Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 41 Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTTEAjI8LJVkT9-0c3cwb3FvWdWrBCslQH3yGcgrxGxvNtNoclH14uZLzReOegVciw0xZEcMtW7hQFW0eB8mmXW-7K5s4Svy0xSRMs_mXVLtJA2XoJk0TZdZjp_WojllHJG8-iG6jPQ0AVdLfc65FrL6NopED7H0pz-aF6IQ4i51gc Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e168534b1f7144cf97c9166ef50e170b"}]}] Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: abecb85b41d846e0a2b0bfc7010031c9 Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: exception: floating IP not found Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1390bbe7-06c0-4706-8110-387e3431360a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 11:12:12.722139 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Returning 404 to user: floating IP not found {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8887fc67-7382-4e6e-a437-575f6fbb7317 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action" status: 404 len: 67 microversion: 2.1 time: 0.246601 Oct 04 11:12:12.727730 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1614/2848] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:12 2022] POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action => generated 67 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:12:12.731505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6584fa03-91f2-4194-9729-1d847a28567a req-78ff6a61-c823-4e07-ae60-bbcf9ecf350d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a", "name": "network-vif-deleted", "tag": "b649942d-35b7-49e8-bb0a-5c67c8a80dca"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:12.743205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6584fa03-91f2-4194-9729-1d847a28567a req-78ff6a61-c823-4e07-ae60-bbcf9ecf350d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:12.744015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6584fa03-91f2-4194-9729-1d847a28567a req-78ff6a61-c823-4e07-ae60-bbcf9ecf350d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:12.744445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6584fa03-91f2-4194-9729-1d847a28567a req-78ff6a61-c823-4e07-ae60-bbcf9ecf350d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:12.756556 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6584fa03-91f2-4194-9729-1d847a28567a req-78ff6a61-c823-4e07-ae60-bbcf9ecf350d service nova] Creating event network-vif-deleted:b649942d-35b7-49e8-bb0a-5c67c8a80dca for instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a on n-h1-791135-8 Oct 04 11:12:12.761932 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6584fa03-91f2-4194-9729-1d847a28567a req-78ff6a61-c823-4e07-ae60-bbcf9ecf350d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036178 Oct 04 11:12:12.762869 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1615/2849] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:12.939766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13ad1810-081b-4c78-b7fd-cbb1e8ad63c4 tempest-ListImageFiltersNegativeTestJSON-348464020 tempest-ListImageFiltersNegativeTestJSON-348464020-project] Calling method '.version_select at 0x7f71cfad01f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:12.961736 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-13ad1810-081b-4c78-b7fd-cbb1e8ad63c4 tempest-ListImageFiltersNegativeTestJSON-348464020 tempest-ListImageFiltersNegativeTestJSON-348464020-project] HTTP exception thrown: Image not found. Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13ad1810-081b-4c78-b7fd-cbb1e8ad63c4 tempest-ListImageFiltersNegativeTestJSON-348464020 tempest-ListImageFiltersNegativeTestJSON-348464020-project] Request method failure captured: Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/images/9178953a-ed8b-42ba-9c96-ef4413bb19a3 HTTP/1.1 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBULc58_rQhZexLP6zrT-ggB0r5EGwlJ5Uu0cycUmSmDaokceQA3x09Cb7Jaa-11wPmxkOMiUN_XznEsR1RDJuE0B7KmmtxpUYe_RJqqJZ4MJSNl_hAVCr8UuynvGkS-N7WxQsbmJO_cQSR0-d4FXiUgDDWwe-NZcJI-IWbxgMyVbvI Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fc1d77dc951b46c4ac85668436831d52 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-348464020 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc1d77dc951b46c4ac85668436831d52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc1d77dc951b46c4ac85668436831d52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc1d77dc951b46c4ac85668436831d52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc1d77dc951b46c4ac85668436831d52"}]}] Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-348464020 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fc1d77dc951b46c4ac85668436831d52 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-348464020 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListImageFiltersNegativeTestJSON-348464020-project Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 20ef901e63774247bf1c877272e50250 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-348464020-project Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '9178953a-ed8b-42ba-9c96-ef4413bb19a3'} Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9178953a-ed8b-42ba-9c96-ef4413bb19a3 Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:12:12.963848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9178953a-ed8b-42ba-9c96-ef4413bb19a3 could not be found. Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:12:12.968538 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:12.974287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13ad1810-081b-4c78-b7fd-cbb1e8ad63c4 tempest-ListImageFiltersNegativeTestJSON-348464020 tempest-ListImageFiltersNegativeTestJSON-348464020-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:12.975614 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13ad1810-081b-4c78-b7fd-cbb1e8ad63c4 tempest-ListImageFiltersNegativeTestJSON-348464020 tempest-ListImageFiltersNegativeTestJSON-348464020-project] 10.222.0.23 "GET /compute/v2.1/images/9178953a-ed8b-42ba-9c96-ef4413bb19a3" status: 404 len: 62 microversion: 2.1 time: 0.211644 Oct 04 11:12:12.976187 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1616/2850] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:12:12 2022] GET /compute/v2.1/images/9178953a-ed8b-42ba-9c96-ef4413bb19a3 => generated 62 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:12:12.981956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:12.982767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:12.990834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:12.991216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:12.991849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:12.992547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:12.993000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:12.994286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:13.154350 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cee05844-161e-4708-a1de-ba4c18dd0c8b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.176885 Oct 04 11:12:13.155256 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1617/2851] 10.222.0.23 () {58 vars in 1293 bytes} [Tue Oct 4 11:12:12 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6/os-security-groups => generated 1156 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:13.161222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-895997840", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "999d214d-a128-4728-9cd3-99390decb15f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:13.228355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] validate_networks() for [('999d214d-a128-4728-9cd3-99390decb15f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:12:14.196705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:12:14.197840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:12:14.198471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:12:14.198956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:12:14.199443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:12:14.210475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:14.211191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:14.211843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:14.212782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:14.213419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:14.213849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:14.231063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:14.235741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:14.248832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:12:14.251462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:12:14.317579 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-56e5ba66-64b8-4fea-86c2-98828eccedb6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160360 Oct 04 11:12:14.318723 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1618/2852] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:12:14.327060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:14.328128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] [instance: a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:14.338180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:14.339855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:14.340557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:14.341638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:14.342811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:14.343404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:14.364138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] HTTP exception thrown: Instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a could not be found. Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Request method failure captured: Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a HTTP/1.1 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTlyOB8-rRdQ5V1B2ozt3ee_pvA7nsSxdiALguy6rgXA8wXNVNG-luMH5925qneMXVgGPbJY99lbjI_lyiDCfHiSDUJJ6RoKk9veFjjAYHl03Qj10Eq7ymw4VIKWGDz6IDT6VCNXB9hbhIjjgll0YcyHvDa8IXy8XUOxZGSr7JrOXg Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e9861897c397454abb4c88a3bc2d1556 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceActionsTestJSON-534922308 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e9861897c397454abb4c88a3bc2d1556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9861897c397454abb4c88a3bc2d1556"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e9861897c397454abb4c88a3bc2d1556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e9861897c397454abb4c88a3bc2d1556"}]}] Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceActionsTestJSON-534922308 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e9861897c397454abb4c88a3bc2d1556 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceActionsTestJSON-534922308 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceActionsTestJSON-534922308-project Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e1d44464a682444b8d63e230ff11e921 Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceActionsTestJSON-534922308-project Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a could not be found. Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a'} Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a could not be found. Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a could not be found. Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:14.366105 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.371312 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:14.371312 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:14.371312 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:14.371312 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:14.371312 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:14.371312 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a could not be found. Oct 04 11:12:14.371312 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.374166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] Returning 404 to user: Instance a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:14.375550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d55e20b-0820-4cb5-af23-de4722471f83 tempest-InstanceActionsTestJSON-534922308 tempest-InstanceActionsTestJSON-534922308-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a" status: 404 len: 111 microversion: 2.1 time: 0.054462 Oct 04 11:12:14.376128 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1619/2853] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:14 2022] GET /compute/v2.1/servers/a4dbfa2f-57b6-436a-a0af-dfcf02f54a3a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:12:14.389220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4188148-d1c4-42b0-8bbc-43182fae2372 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:14.524003 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b4188148-d1c4-42b0-8bbc-43182fae2372 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4188148-d1c4-42b0-8bbc-43182fae2372 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Request method failure captured: Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action HTTP/1.1 Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 44 Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTTEAjI8LJVkT9-0c3cwb3FvWdWrBCslQH3yGcgrxGxvNtNoclH14uZLzReOegVciw0xZEcMtW7hQFW0eB8mmXW-7K5s4Svy0xSRMs_mXVLtJA2XoJk0TZdZjp_WojllHJG8-iG6jPQ0AVdLfc65FrL6NopED7H0pz-aF6IQ4i51gc Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e168534b1f7144cf97c9166ef50e170b"}]}] Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: abecb85b41d846e0a2b0bfc7010031c9 Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: exception: Floating IP not found for address 0.0.0.0. Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1390bbe7-06c0-4706-8110-387e3431360a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 11:12:14.526639 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 11:12:14.531019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:14.533336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4188148-d1c4-42b0-8bbc-43182fae2372 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:14.534373 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4188148-d1c4-42b0-8bbc-43182fae2372 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action" status: 404 len: 88 microversion: 2.1 time: 0.156516 Oct 04 11:12:14.535597 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1620/2854] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:14 2022] POST /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a/action => generated 88 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:12:14.542145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:14.546305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:14.575249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:14.575807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:14.576314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:14.577083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:14.577609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:14.579661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:14.864914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:14.874769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-abc315fe-54ed-42d9-a9e3-8700be7f02c9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1505 microversion: 2.1 time: 0.337731 Oct 04 11:12:14.885487 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1621/2855] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:14 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:14.885487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e666013-a74a-435a-9e30-0c657da2ac6b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71d437b5e0>, body: {"security_group": {"name": " tempest-securitygroup -263892854 ", "description": "tempest-description-1360712815"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:15.124468 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e666013-a74a-435a-9e30-0c657da2ac6b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.247339 Oct 04 11:12:15.125415 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1622/2856] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:12:14 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:15.138109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-912c2b04-13e0-4703-bd73-6776b4470db9 req-e2cddf94-916d-4b2d-ad32-974dc9c0e7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca8e390-46b1-4ecd-89e7-c3e7f4881df6", "tag": "d35b883a-eff3-4486-a332-0d7e53fcd167"}, {"name": "network-changed", "server_uuid": "cca8e390-46b1-4ecd-89e7-c3e7f4881df6", "tag": "d35b883a-eff3-4486-a332-0d7e53fcd167"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:15.160810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-912c2b04-13e0-4703-bd73-6776b4470db9 req-e2cddf94-916d-4b2d-ad32-974dc9c0e7e1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:15.161583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-912c2b04-13e0-4703-bd73-6776b4470db9 req-e2cddf94-916d-4b2d-ad32-974dc9c0e7e1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:15.162188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-912c2b04-13e0-4703-bd73-6776b4470db9 req-e2cddf94-916d-4b2d-ad32-974dc9c0e7e1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:15.178488 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-912c2b04-13e0-4703-bd73-6776b4470db9 req-e2cddf94-916d-4b2d-ad32-974dc9c0e7e1 service nova] Creating event network-changed:d35b883a-eff3-4486-a332-0d7e53fcd167 for instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 on n-h1-791135-8 Oct 04 11:12:15.180091 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-912c2b04-13e0-4703-bd73-6776b4470db9 req-e2cddf94-916d-4b2d-ad32-974dc9c0e7e1 service nova] Creating event network-changed:d35b883a-eff3-4486-a332-0d7e53fcd167 for instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 on n-h1-791135-8 Oct 04 11:12:15.187468 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-912c2b04-13e0-4703-bd73-6776b4470db9 req-e2cddf94-916d-4b2d-ad32-974dc9c0e7e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052672 Oct 04 11:12:15.188305 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1623/2857] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:15.213536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:15.215540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:15.223841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:15.224959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:15.225607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:15.227165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:15.227999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:15.228902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:15.335368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:15.344301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-50b6c4f7-6a78-4ef4-a8cb-0257a9831be0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1204 microversion: 2.1 time: 0.154590 Oct 04 11:12:15.363342 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1624/2858] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:15 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1204 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:15.370147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:15.370880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:15.378993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:15.380214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:15.380855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:15.382166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:15.382647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:15.383479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:15.416980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:12:15.478654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:SELECT=97 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:15.523192 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64513ba7-4925-4c45-a6e5-777a9042697f tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 204 len: 0 microversion: 2.1 time: 0.158009 Oct 04 11:12:15.523784 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1625/2859] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:12:15 2022] DELETE /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:12:15.533210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5e454e0-9bd0-440b-a4b0-cbf96b731c6f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d437b430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:15.611762 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5e454e0-9bd0-440b-a4b0-cbf96b731c6f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284" status: 200 len: 223 microversion: 2.1 time: 0.085249 Oct 04 11:12:15.612890 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1626/2860] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:12:15 2022] GET /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284 => generated 223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:15.742306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc985e93-d005-44f3-9f95-dc5e49db43ad tempest-ListImagesTestJSON-1372395820 tempest-ListImagesTestJSON-1372395820-project] Calling method '.version_select at 0x7f71d428c1f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:15.788449 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc985e93-d005-44f3-9f95-dc5e49db43ad tempest-ListImagesTestJSON-1372395820 tempest-ListImagesTestJSON-1372395820-project] 10.222.0.23 "GET /compute/v2.1/images/c5abc5b2-fab0-47a3-992d-153996b39244" status: 200 len: 784 microversion: 2.1 time: 0.166714 Oct 04 11:12:15.789175 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1627/2861] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:12:15 2022] GET /compute/v2.1/images/c5abc5b2-fab0-47a3-992d-153996b39244 => generated 784 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:15.799086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:15.799086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:15.801599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:15.802166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:15.802684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:15.803451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:15.803977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:15.804475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:15.954123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:15.962813 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd1814dd-4d14-4389-a593-57a4ecdf0dae tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1541 microversion: 2.1 time: 0.172574 Oct 04 11:12:15.963997 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1628/2862] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:15 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1541 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:15.968938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e73e8d52-eb97-407e-822d-0f87a5d0b6f1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d448b310>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:16.143758 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e73e8d52-eb97-407e-822d-0f87a5d0b6f1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284" status: 202 len: 0 microversion: 2.1 time: 0.178480 Oct 04 11:12:16.144444 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1629/2863] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:12:15 2022] DELETE /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:16.149957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-614ded88-e5b5-4d43-958d-4a86fba2a022 tempest-ListImagesTestJSON-1372395820 tempest-ListImagesTestJSON-1372395820-project] Calling method '.version_select at 0x7f71d448bc10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:16.228591 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-614ded88-e5b5-4d43-958d-4a86fba2a022 tempest-ListImagesTestJSON-1372395820 tempest-ListImagesTestJSON-1372395820-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.083012 Oct 04 11:12:16.236862 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1630/2864] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 11:12:16 2022] GET /compute/v2.1/images => generated 445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:16.236862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:16.236862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:16.242356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:16.242853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:16.243471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:16.244174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:16.244634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:16.245069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:16.384329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:16.393066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aaddff5d-623c-49e7-bad4-6a24e9747c8f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1480 microversion: 2.1 time: 0.161902 Oct 04 11:12:16.393613 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1631/2865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:16 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1480 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:16.398362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cdeac67-bfc6-4899-bb67-c710cfc6f631 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d448b040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:16.421585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-3cdeac67-bfc6-4899-bb67-c710cfc6f631 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:12:16.422208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-3cdeac67-bfc6-4899-bb67-c710cfc6f631 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group fe038d75-d8b7-465b-a784-e93708d0a284 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:12:16.422743 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-3cdeac67-bfc6-4899-bb67-c710cfc6f631 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:12:16.422743 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-57764774-ca97-4556-97fb-920a1232b86c'] Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cdeac67-bfc6-4899-bb67-c710cfc6f631 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284 HTTP/1.1 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-57764774-ca97-4556-97fb-920a1232b86c'] Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'fe038d75-d8b7-465b-a784-e93708d0a284'} Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:12:16.424810 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57764774-ca97-4556-97fb-920a1232b86c'] Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57764774-ca97-4556-97fb-920a1232b86c'] Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57764774-ca97-4556-97fb-920a1232b86c'] Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57764774-ca97-4556-97fb-920a1232b86c'] Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cdeac67-bfc6-4899-bb67-c710cfc6f631 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-57764774-ca97-4556-97fb-920a1232b86c'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cdeac67-bfc6-4899-bb67-c710cfc6f631 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284" status: 404 len: 194 microversion: 2.1 time: 0.031878 Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1632/2866] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:12:16 2022] GET /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:12:16.433676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0c4fd35-c32e-42a3-8ebe-1a4f7e923ff0 tempest-ListImagesTestJSON-1372395820 tempest-ListImagesTestJSON-1372395820-project] Calling method '.version_select at 0x7f71d435fe50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:16.483645 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0c4fd35-c32e-42a3-8ebe-1a4f7e923ff0 tempest-ListImagesTestJSON-1372395820 tempest-ListImagesTestJSON-1372395820-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.055045 Oct 04 11:12:16.484222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1633/2867] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 11:12:16 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:16.489384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:16.489991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:16.497178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:16.497876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:16.498201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:16.498915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:16.499446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:16.499871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:16.574121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:16.588273 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8fe897e1-9240-4446-b4e1-cf54dbd919f1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1260 microversion: 2.1 time: 0.102939 Oct 04 11:12:16.589335 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1634/2868] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:16 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1260 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:16.594070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f95f799-837a-4dfe-b621-b7fe612f5a62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '.version_select at 0x7f71d48cbca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:16.597924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f95f799-837a-4dfe-b621-b7fe612f5a62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:16.598413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f95f799-837a-4dfe-b621-b7fe612f5a62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:16.598878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f95f799-837a-4dfe-b621-b7fe612f5a62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:16.606801 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f95f799-837a-4dfe-b621-b7fe612f5a62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.016457 Oct 04 11:12:16.607564 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1635/2869] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 11:12:16 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:16.621056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-20303cb4-a112-4090-b805-720e54a2e1f7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71d448b700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-286370579", "description": "tempest-description-338978661"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:16.925207 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-20303cb4-a112-4090-b805-720e54a2e1f7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.307835 Oct 04 11:12:16.926395 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1636/2870] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:12:16 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:16.931379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:16.932316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:16.950472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:16.951047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:16.951546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:16.952376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:16.953037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:16.953687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:17.228334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b5a826d-bf24-442c-ac6a-88b339f9ffec tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1631 microversion: 2.1 time: 0.300148 Oct 04 11:12:17.229732 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1637/2871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:16 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1631 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:17.235991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8cb8f61e-b748-4603-9175-ca90a224366e tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71d5e5ea60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1935368999", "description": "tempest-description-808448358"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:17.541534 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8cb8f61e-b748-4603-9175-ca90a224366e tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.309634 Oct 04 11:12:17.542603 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1638/2872] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:12:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:17.551514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:17.551514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:17.560352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:17.560352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:17.560352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:17.560352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:17.560352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:17.560352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:17.952521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:17.961860 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-58dee93c-2693-42c0-8cb1-688648a6a773 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1541 microversion: 2.1 time: 0.418416 Oct 04 11:12:17.973869 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1639/2873] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:17 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1541 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:17.983303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94f388c3-791e-4d80-8d08-b4c471120540 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Action: 'create', calling method: .version_select at 0x7f71d428c940>, body: {"keypair": {"name": "tempest-keypair-82662962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjJK9CspYec5gH+YjyYwDyz7qWaCsnhAJwrRroMv2tk7nOx7qGxnDy7WGcMEcQ3DLaCWcXxxiXqi0TpnU4sCAn0zqPBl3PvXK6J372f5kKUp1YVRfsT6p8cLdSf0JXGnQ=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:18.000963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-94f388c3-791e-4d80-8d08-b4c471120540 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for project d8213366237849c5bd0db518c55bc288. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:18.005948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-94f388c3-791e-4d80-8d08-b4c471120540 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for user 8f8c67a2ba884edbb978a166d91294d7 and project d8213366237849c5bd0db518c55bc288. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:18.031632 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94f388c3-791e-4d80-8d08-b4c471120540 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.056532 Oct 04 11:12:18.032340 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1640/2874] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:12:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:18.037850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fbe440d5-3f9f-46f3-ba6c-92312afdb342 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71d4414820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1264761864", "description": "tempest-description-723259492"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:18.521383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fbe440d5-3f9f-46f3-ba6c-92312afdb342 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.487055 Oct 04 11:12:18.522672 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1641/2875] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:12:18 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:18.534115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:18.535669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:18.548714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:18.549567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:18.551272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:18.552397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:18.555103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:18.555824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:18.732447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:18.741897 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b5ee62a-51e4-41db-90be-95dbeddfb6fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1266 microversion: 2.1 time: 0.217604 Oct 04 11:12:18.753948 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1642/2876] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:18 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:18.764785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25e3a040-9419-484c-b360-8787b4c370f7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d448bca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:19.284704 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25e3a040-9419-484c-b360-8787b4c370f7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.529528 Oct 04 11:12:19.286041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1643/2877] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 11:12:18 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:19.468751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2439e4c1-9b07-473c-8869-58bf6c9a274d tempest-AbsoluteLimitsTestJSON-57766627 tempest-AbsoluteLimitsTestJSON-57766627-project] Calling method '.version_select at 0x7f71d435fe50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:19.487961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2439e4c1-9b07-473c-8869-58bf6c9a274d tempest-AbsoluteLimitsTestJSON-57766627 tempest-AbsoluteLimitsTestJSON-57766627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:19.488486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2439e4c1-9b07-473c-8869-58bf6c9a274d tempest-AbsoluteLimitsTestJSON-57766627 tempest-AbsoluteLimitsTestJSON-57766627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:19.488964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2439e4c1-9b07-473c-8869-58bf6c9a274d tempest-AbsoluteLimitsTestJSON-57766627 tempest-AbsoluteLimitsTestJSON-57766627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:19.489835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2439e4c1-9b07-473c-8869-58bf6c9a274d tempest-AbsoluteLimitsTestJSON-57766627 tempest-AbsoluteLimitsTestJSON-57766627-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:19.490176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2439e4c1-9b07-473c-8869-58bf6c9a274d tempest-AbsoluteLimitsTestJSON-57766627 tempest-AbsoluteLimitsTestJSON-57766627-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:19.490982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2439e4c1-9b07-473c-8869-58bf6c9a274d tempest-AbsoluteLimitsTestJSON-57766627 tempest-AbsoluteLimitsTestJSON-57766627-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:19.512594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2439e4c1-9b07-473c-8869-58bf6c9a274d tempest-AbsoluteLimitsTestJSON-57766627 tempest-AbsoluteLimitsTestJSON-57766627-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.225238 Oct 04 11:12:19.513185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1644/2878] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Oct 4 11:12:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:19.529460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:19.530721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:19.534817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:19.538549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:19.539217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:19.539842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:19.540738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:19.541414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:19.542008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:19.713719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abecb85b41d846e0a2b0bfc7010031c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e168534b1f7144cf97c9166ef50e170b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:19.723371 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a762f47f-7e35-4f12-9374-7f846886b99b tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 200 len: 1499 microversion: 2.1 time: 0.198209 Oct 04 11:12:19.746048 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1645/2879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:19 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 1499 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:19.781396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-afa2b41c-f07c-46c6-91ad-1504a4c31b98 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d44149d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:20.567293 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-afa2b41c-f07c-46c6-91ad-1504a4c31b98 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/28e47ff5-bbb9-47d2-9a29-357ea34ec121" status: 202 len: 0 microversion: 2.1 time: 0.825897 Oct 04 11:12:20.568043 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1646/2880] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:12:19 2022] DELETE /compute/v2.1/os-security-groups/28e47ff5-bbb9-47d2-9a29-357ea34ec121 => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:20.573634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ad855bc5-b867-4212-95bc-eea08d216c02 req-52c8071b-5d11-49eb-9592-63864412d3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1390bbe7-06c0-4706-8110-387e3431360a", "name": "network-vif-deleted", "tag": "0c48a4f1-88c5-4f28-bf44-e70647fc0c20"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:20.587013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ad855bc5-b867-4212-95bc-eea08d216c02 req-52c8071b-5d11-49eb-9592-63864412d3a1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:20.588372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ad855bc5-b867-4212-95bc-eea08d216c02 req-52c8071b-5d11-49eb-9592-63864412d3a1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:20.588985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ad855bc5-b867-4212-95bc-eea08d216c02 req-52c8071b-5d11-49eb-9592-63864412d3a1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:20.604549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ad855bc5-b867-4212-95bc-eea08d216c02 req-52c8071b-5d11-49eb-9592-63864412d3a1 service nova] Creating event network-vif-deleted:0c48a4f1-88c5-4f28-bf44-e70647fc0c20 for instance 1390bbe7-06c0-4706-8110-387e3431360a on n-h1-791135-8 Oct 04 11:12:20.611582 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ad855bc5-b867-4212-95bc-eea08d216c02 req-52c8071b-5d11-49eb-9592-63864412d3a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040655 Oct 04 11:12:20.612717 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1647/2881] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:20.619388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:20.620466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:20.642236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:20.645310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:20.646124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:20.647111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:20.649505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:20.650965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:20.959428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:20.971617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b186403-343d-43fe-b793-a22d32a326ac tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1308 microversion: 2.1 time: 0.357260 Oct 04 11:12:20.973337 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1648/2882] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:20 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:20.978180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb5a2cac-d6de-4b82-8745-f958752e19aa tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d450e5e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:21.020012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-eb5a2cac-d6de-4b82-8745-f958752e19aa tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:12:21.020925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-eb5a2cac-d6de-4b82-8745-f958752e19aa tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:12:21.022031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-eb5a2cac-d6de-4b82-8745-f958752e19aa tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:12:21.022031 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-07a8342c-2314-4af0-9240-68db4a4a0c7c'] Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb5a2cac-d6de-4b82-8745-f958752e19aa tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-security-groups/28e47ff5-bbb9-47d2-9a29-357ea34ec121 HTTP/1.1 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-07a8342c-2314-4af0-9240-68db4a4a0c7c'] Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '28e47ff5-bbb9-47d2-9a29-357ea34ec121'} Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:12:21.024528 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07a8342c-2314-4af0-9240-68db4a4a0c7c'] Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07a8342c-2314-4af0-9240-68db4a4a0c7c'] Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07a8342c-2314-4af0-9240-68db4a4a0c7c'] Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07a8342c-2314-4af0-9240-68db4a4a0c7c'] Oct 04 11:12:21.028724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.036364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb5a2cac-d6de-4b82-8745-f958752e19aa tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:12:21.036364 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-07a8342c-2314-4af0-9240-68db4a4a0c7c'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:21.038857 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb5a2cac-d6de-4b82-8745-f958752e19aa tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/28e47ff5-bbb9-47d2-9a29-357ea34ec121" status: 404 len: 194 microversion: 2.1 time: 0.064051 Oct 04 11:12:21.040253 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1649/2883] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:12:20 2022] GET /compute/v2.1/os-security-groups/28e47ff5-bbb9-47d2-9a29-357ea34ec121 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:12:21.045849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:21.046772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] [instance: 1390bbe7-06c0-4706-8110-387e3431360a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:21.054803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:21.056920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:21.057610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:21.058900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:21.060061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:21.061133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:21.079001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] HTTP exception thrown: Instance 1390bbe7-06c0-4706-8110-387e3431360a could not be found. Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Request method failure captured: Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a HTTP/1.1 Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTTEAjI8LJVkT9-0c3cwb3FvWdWrBCslQH3yGcgrxGxvNtNoclH14uZLzReOegVciw0xZEcMtW7hQFW0eB8mmXW-7K5s4Svy0xSRMs_mXVLtJA2XoJk0TZdZjp_WojllHJG8-iG6jPQ0AVdLfc65FrL6NopED7H0pz-aF6IQ4i51gc Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e168534b1f7144cf97c9166ef50e170b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e168534b1f7144cf97c9166ef50e170b"}]}] Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e168534b1f7144cf97c9166ef50e170b Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: abecb85b41d846e0a2b0bfc7010031c9 Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1390bbe7-06c0-4706-8110-387e3431360a could not be found. Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1390bbe7-06c0-4706-8110-387e3431360a'} Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1390bbe7-06c0-4706-8110-387e3431360a could not be found. Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1390bbe7-06c0-4706-8110-387e3431360a could not be found. Oct 04 11:12:21.081954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1390bbe7-06c0-4706-8110-387e3431360a could not be found. Oct 04 11:12:21.086019 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:21.088811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] Returning 404 to user: Instance 1390bbe7-06c0-4706-8110-387e3431360a could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:21.090173 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35e2a9d6-9a7a-4efb-8683-1d1a8d8de3e6 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119 tempest-FloatingIPsAssociationNegativeTestJSON-1378232119-project] 10.222.0.23 "GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a" status: 404 len: 111 microversion: 2.1 time: 0.048482 Oct 04 11:12:21.095197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1650/2884] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:21 2022] GET /compute/v2.1/servers/1390bbe7-06c0-4706-8110-387e3431360a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:12:21.102481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be7f3953-07c1-408b-940a-7d9ac45ca9dd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71cfad01f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:22.000415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be7f3953-07c1-408b-940a-7d9ac45ca9dd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9d79e477-bd78-4df0-bf14-9aaa0ffac728" status: 202 len: 0 microversion: 2.1 time: 0.903037 Oct 04 11:12:22.001303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1651/2885] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:12:21 2022] DELETE /compute/v2.1/os-security-groups/9d79e477-bd78-4df0-bf14-9aaa0ffac728 => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:22.006748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:22.007367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:22.023064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:22.023555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:22.023999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:22.024673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:22.025107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:22.025571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:22.229725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:22.246331 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e5dc683e-0249-424e-8fff-fcbf92f50006 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1308 microversion: 2.1 time: 0.243295 Oct 04 11:12:22.248372 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1652/2886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:22 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:22.256578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1123a2a6-99e7-4281-8eb0-f640d14085b7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d44140d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:22.296104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-1123a2a6-99e7-4281-8eb0-f640d14085b7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:12:22.298200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-1123a2a6-99e7-4281-8eb0-f640d14085b7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:12:22.301634 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1123a2a6-99e7-4281-8eb0-f640d14085b7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:12:22.301634 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4a0f3a43-4595-4b37-8743-97729ede4b32'] Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1123a2a6-99e7-4281-8eb0-f640d14085b7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-security-groups/9d79e477-bd78-4df0-bf14-9aaa0ffac728 HTTP/1.1 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4a0f3a43-4595-4b37-8743-97729ede4b32'] Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '9d79e477-bd78-4df0-bf14-9aaa0ffac728'} Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:12:22.309142 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a0f3a43-4595-4b37-8743-97729ede4b32'] Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a0f3a43-4595-4b37-8743-97729ede4b32'] Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a0f3a43-4595-4b37-8743-97729ede4b32'] Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a0f3a43-4595-4b37-8743-97729ede4b32'] Oct 04 11:12:22.313289 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:22.324169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1123a2a6-99e7-4281-8eb0-f640d14085b7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:12:22.324169 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4a0f3a43-4595-4b37-8743-97729ede4b32'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:22.325805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1123a2a6-99e7-4281-8eb0-f640d14085b7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/9d79e477-bd78-4df0-bf14-9aaa0ffac728" status: 404 len: 194 microversion: 2.1 time: 0.075565 Oct 04 11:12:22.328092 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1653/2887] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:12:22 2022] GET /compute/v2.1/os-security-groups/9d79e477-bd78-4df0-bf14-9aaa0ffac728 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:12:22.336490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1998273591", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "973c00bd-0fce-4cb1-a025-a2c2987cef21"}], "security_groups": [{"name": "tempest-securitygroup--1118778779"}], "key_name": "tempest-keypair-82662962", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:22.546187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] validate_networks() for [('973c00bd-0fce-4cb1-a025-a2c2987cef21', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:12:23.501128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:12:23.502527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:12:23.503494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:12:23.504062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:12:23.504905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:12:23.521562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:23.523247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:23.523854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:23.525438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:23.526067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:23.526661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:23.569068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for project d8213366237849c5bd0db518c55bc288. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:23.575714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for user 8f8c67a2ba884edbb978a166d91294d7 and project d8213366237849c5bd0db518c55bc288. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:23.590552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:12:23.593336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:12:23.687288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-231ced47-38b0-4c18-93cd-5527f78e9217 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.357683 Oct 04 11:12:23.691070 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1654/2888] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:12:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:12:23.705962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-564fcede-3586-4169-8f76-b655b888f31b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71cfad01f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:23.978968 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-564fcede-3586-4169-8f76-b655b888f31b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/83748a70-2723-4f62-b39f-4f8ad1368819" status: 202 len: 0 microversion: 2.1 time: 0.285434 Oct 04 11:12:23.980196 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1655/2889] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:12:23 2022] DELETE /compute/v2.1/os-security-groups/83748a70-2723-4f62-b39f-4f8ad1368819 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:23.986760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-404f73a0-3cdc-4185-9364-883adefd8c6b req-5fc20e44-2f24-419f-8774-095b8188c906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7425e6f-ad86-45e6-87ca-80082bfa0e04", "tag": "547702c1-3c13-4ecb-954d-4515d0c6e0b0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:24.001163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-404f73a0-3cdc-4185-9364-883adefd8c6b req-5fc20e44-2f24-419f-8774-095b8188c906 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:24.003099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-404f73a0-3cdc-4185-9364-883adefd8c6b req-5fc20e44-2f24-419f-8774-095b8188c906 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:24.003557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-404f73a0-3cdc-4185-9364-883adefd8c6b req-5fc20e44-2f24-419f-8774-095b8188c906 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:24.016797 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-404f73a0-3cdc-4185-9364-883adefd8c6b req-5fc20e44-2f24-419f-8774-095b8188c906 service nova] Creating event network-changed:547702c1-3c13-4ecb-954d-4515d0c6e0b0 for instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 on n-h1-791135-8 Oct 04 11:12:24.022997 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-404f73a0-3cdc-4185-9364-883adefd8c6b req-5fc20e44-2f24-419f-8774-095b8188c906 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042029 Oct 04 11:12:24.023735 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1656/2890] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:24.050990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:24.054681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:24.061341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:24.061941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:24.062379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:24.063088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:24.063549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:24.064540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:24.255128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:24.267692 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b336832d-cf2b-47b5-9ca8-ab01695d4de6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1308 microversion: 2.1 time: 0.242429 Oct 04 11:12:24.278112 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1657/2891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:24 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:24.286868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:24.287939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:24.295626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:24.296911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:24.297578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:24.299270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:24.299895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:24.301203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:24.379849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:24.389126 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c9224aba-32cb-4db8-ab58-c97cdd765f8e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1237 microversion: 2.1 time: 0.109424 Oct 04 11:12:24.390356 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1658/2892] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:24 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:24.573517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-386169906", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "f07f420a-1588-41a6-956a-33df1c14bb0c"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:24.653209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] validate_networks() for [('f07f420a-1588-41a6-956a-33df1c14bb0c', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:12:25.179504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:12:25.180393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:12:25.187871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:12:25.188450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:12:25.189131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:12:25.207755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:25.208497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:25.209239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:25.210216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:25.210921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:25.211637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:25.244844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Getting quotas for project fb37a21f84fd4716b3be0319be618722. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:25.261030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Getting quotas for user 3a7eff353d84426c845837195ecf9f50 and project fb37a21f84fd4716b3be0319be618722. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:25.274699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:12:25.277211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:12:25.356111 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4492530-ef66-467c-908d-889d6ee17080 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964418 Oct 04 11:12:25.356774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1659/2893] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:12:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:12:25.365636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0338f3ef-9262-4162-ac57-2ce82576dad7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d437bdc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:25.420323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-0338f3ef-9262-4162-ac57-2ce82576dad7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:12:25.421001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-0338f3ef-9262-4162-ac57-2ce82576dad7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group 83748a70-2723-4f62-b39f-4f8ad1368819 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:12:25.421581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0338f3ef-9262-4162-ac57-2ce82576dad7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:12:25.421581 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-34700bd5-ce5e-4b73-8735-923f1013022e'] Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0338f3ef-9262-4162-ac57-2ce82576dad7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-security-groups/83748a70-2723-4f62-b39f-4f8ad1368819 HTTP/1.1 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-34700bd5-ce5e-4b73-8735-923f1013022e'] Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '83748a70-2723-4f62-b39f-4f8ad1368819'} Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:12:25.424285 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34700bd5-ce5e-4b73-8735-923f1013022e'] Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34700bd5-ce5e-4b73-8735-923f1013022e'] Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34700bd5-ce5e-4b73-8735-923f1013022e'] Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34700bd5-ce5e-4b73-8735-923f1013022e'] Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0338f3ef-9262-4162-ac57-2ce82576dad7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-34700bd5-ce5e-4b73-8735-923f1013022e'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:12:25.428792 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0338f3ef-9262-4162-ac57-2ce82576dad7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/83748a70-2723-4f62-b39f-4f8ad1368819" status: 404 len: 194 microversion: 2.1 time: 0.067761 Oct 04 11:12:25.433795 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1660/2894] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:12:25 2022] GET /compute/v2.1/os-security-groups/83748a70-2723-4f62-b39f-4f8ad1368819 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:12:25.440512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:25.441204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:25.448200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:25.448792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:25.449318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:25.450111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:25.450948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:25.451811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:25.703278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:25.722948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f674b5a-5704-446e-b887-511208583cce tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1308 microversion: 2.1 time: 0.291640 Oct 04 11:12:25.724547 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1661/2895] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:25 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:25.731022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:25.731939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:25.748919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:25.750623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:25.752363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:25.753851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:25.754787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:25.757130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:25.933446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:25.949841 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb7de9d9-d879-42ab-85f8-5e3df3257737 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1293 microversion: 2.1 time: 0.222938 Oct 04 11:12:25.971947 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1662/2896] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:25 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1293 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:25.992436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2130032476", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "f07f420a-1588-41a6-956a-33df1c14bb0c"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:26.089424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] validate_networks() for [('f07f420a-1588-41a6-956a-33df1c14bb0c', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:12:27.039172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:12:27.045584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:12:27.047352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:12:27.049011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:12:27.053326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:12:27.074364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:27.076941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:27.077711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:27.078751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:27.081097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:27.081824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:27.127427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Getting quotas for project fb37a21f84fd4716b3be0319be618722. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:27.149575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Getting quotas for user 3a7eff353d84426c845837195ecf9f50 and project fb37a21f84fd4716b3be0319be618722. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:27.187767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:12:27.206102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:12:27.303144 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e1317d7-4cf6-4bb6-836f-7fb6772c0cd5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324453 Oct 04 11:12:27.304406 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1663/2897] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:12:27.309768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae5c06d4-4429-4f5d-9cb9-e572511a0424 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d4414b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:27.803995 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae5c06d4-4429-4f5d-9cb9-e572511a0424 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.498067 Oct 04 11:12:27.805125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1664/2898] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 11:12:27 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:27.810649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:27.811518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:27.849043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:27.849595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:27.850028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:27.854565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:27.855087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:27.855545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:27.950714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:28.231626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:28.251863 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6f786e4-a7a8-46cf-9802-d03830633108 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1308 microversion: 2.1 time: 0.445188 Oct 04 11:12:28.254990 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1665/2899] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:27 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:28.268382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:28.275819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:28.287513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:28.288166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:28.288736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:28.292232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:28.292724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:28.293739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:28.421989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:28.448257 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa753894-e3cc-4bee-a3a9-81ff73ff8d2c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1291 microversion: 2.1 time: 0.191738 Oct 04 11:12:28.448846 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1666/2900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:28 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1291 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:28.460644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1536285865", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "451", "networks": [{"uuid": "f07f420a-1588-41a6-956a-33df1c14bb0c"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:28.567881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] validate_networks() for [('f07f420a-1588-41a6-956a-33df1c14bb0c', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:12:29.176939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:12:29.177663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:12:29.178999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:12:29.180238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:12:29.181147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:12:29.196019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:29.197093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:29.197800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:29.198795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:29.199476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:29.205000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:29.244474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Getting quotas for project fb37a21f84fd4716b3be0319be618722. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:29.252848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Getting quotas for user 3a7eff353d84426c845837195ecf9f50 and project fb37a21f84fd4716b3be0319be618722. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:29.285486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:12:29.288495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:12:29.355427 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ee023f7-dd43-4e80-b2a2-fff10fce935e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900486 Oct 04 11:12:29.356454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1667/2901] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:12:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:12:29.368104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5753bd18-8258-4974-8b42-2aa2230abc6c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71d4421280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1910513367", "description": "tempest-description-711211970"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:29.664960 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5753bd18-8258-4974-8b42-2aa2230abc6c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.306882 Oct 04 11:12:29.665733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1668/2902] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:12:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:29.670296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f1755ec9-51a6-44df-8b77-e9ada043736b req-cff1bcec-5532-4860-b7e0-b30b4c4bbc01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7425e6f-ad86-45e6-87ca-80082bfa0e04", "name": "network-vif-plugged", "status": "completed", "tag": "547702c1-3c13-4ecb-954d-4515d0c6e0b0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:29.722215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f1755ec9-51a6-44df-8b77-e9ada043736b req-cff1bcec-5532-4860-b7e0-b30b4c4bbc01 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:29.724800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f1755ec9-51a6-44df-8b77-e9ada043736b req-cff1bcec-5532-4860-b7e0-b30b4c4bbc01 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:29.725291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f1755ec9-51a6-44df-8b77-e9ada043736b req-cff1bcec-5532-4860-b7e0-b30b4c4bbc01 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:29.753467 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f1755ec9-51a6-44df-8b77-e9ada043736b req-cff1bcec-5532-4860-b7e0-b30b4c4bbc01 service nova] Creating event network-vif-plugged:547702c1-3c13-4ecb-954d-4515d0c6e0b0 for instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 on n-h1-791135-8 Oct 04 11:12:29.761469 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f1755ec9-51a6-44df-8b77-e9ada043736b req-cff1bcec-5532-4860-b7e0-b30b4c4bbc01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093745 Oct 04 11:12:29.763058 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1669/2903] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:29.769880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:29.770789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:29.784496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:29.785920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:29.786842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:29.788134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:29.788847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:29.789512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:30.145238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:30.159080 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17e2a7c6-fe25-4eed-a847-f2f8408756bc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1308 microversion: 2.1 time: 0.390319 Oct 04 11:12:30.160517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1670/2904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:29 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:30.168100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c810122b-c43f-4236-8797-afa0a107a302 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:30.168752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c810122b-c43f-4236-8797-afa0a107a302 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:30.253505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c810122b-c43f-4236-8797-afa0a107a302 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:30.260923 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c810122b-c43f-4236-8797-afa0a107a302 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1221 microversion: 2.1 time: 0.099222 Oct 04 11:12:30.265004 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1671/2905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:30 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:30.270865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:30.271841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:30.284538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:30.285440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:30.285926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:30.286694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:30.287356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:30.287723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:30.366555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:30.378686 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1501d5b9-2418-4255-8cec-05be841989e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1291 microversion: 2.1 time: 0.111961 Oct 04 11:12:30.380326 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1672/2906] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:30 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1291 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:30.387763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-87cfb656-2f2b-471d-af34-eccbc7043d10 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71d437dca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1619738805", "description": "tempest-description-1514752556"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:30.399934 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:12:30.400436 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:12:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:12:30.601131 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-87cfb656-2f2b-471d-af34-eccbc7043d10 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.219306 Oct 04 11:12:30.603135 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1673/2907] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:12:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:30.723825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-203992608", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "3f8d8716-703d-415c-b2e1-0152257a1bca"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:30.734942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:30.792775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] validate_networks() for [('3f8d8716-703d-415c-b2e1-0152257a1bca', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:12:31.257571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:12:31.258187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:12:31.258412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:12:31.258846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:12:31.259312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:12:31.272914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:31.273773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:31.274421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:31.275149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:31.275608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:31.276026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:31.299224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Getting quotas for project 9ced2f5082a74f07aa11508bad977313. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:31.304219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Getting quotas for user 1b5ae872f1bb4ff484eaeab1aa266b82 and project 9ced2f5082a74f07aa11508bad977313. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:31.318109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:12:31.320668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:12:31.373829 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7614da9-231e-4beb-aeec-d36b77ae7033 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655252 Oct 04 11:12:31.382166 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1674/2908] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:12:31.388641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:31.389823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:31.399716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:31.400395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:31.401207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:31.401987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:31.402488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:31.402922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:31.685239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:31.695821 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c14a37d-395c-42c7-ad9b-15854feacae6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1308 microversion: 2.1 time: 0.312301 Oct 04 11:12:31.696423 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1675/2909] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:31 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:31.701562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:31.702396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:31.709074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:31.709668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:31.710111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:31.710816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:31.711272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:31.711729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:31.817399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:31.826550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97e4d495-68a3-461e-b591-432cf29bd477 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1273 microversion: 2.1 time: 0.128896 Oct 04 11:12:31.828210 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1676/2910] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:31 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:31.833711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a0d975a-3c70-409f-a2c0-f25e518c1166 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:31.834604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a0d975a-3c70-409f-a2c0-f25e518c1166 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:31.904190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a0d975a-3c70-409f-a2c0-f25e518c1166 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:31.919616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a0d975a-3c70-409f-a2c0-f25e518c1166 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1215 microversion: 2.1 time: 0.089933 Oct 04 11:12:31.921291 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1677/2911] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:31 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:31.927352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:31.928188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:31.935835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:31.936524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:31.937155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:31.938298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:31.939181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:31.939860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:32.147055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:32.155718 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a385f97c-4124-482a-9eb7-616ed69006e7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.233060 Oct 04 11:12:32.158899 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1678/2912] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:31 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:32.730222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:32.732745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:32.752552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:32.754642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:32.755363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:32.757678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:32.761939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:32.762699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:32.935099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:32.946842 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c82e5e1c-0484-4346-b70c-f71ff9d70560 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1489 microversion: 2.1 time: 0.229966 Oct 04 11:12:32.947958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1679/2913] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:32 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1489 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:32.954252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:32.954999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:32.965539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:32.966371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:32.966823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:32.967851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:32.968324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:32.968763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:33.136731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:33.150815 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-348aaa27-c31f-4efd-aca4-4bc065d6144c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1279 microversion: 2.1 time: 0.199244 Oct 04 11:12:33.155956 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1680/2914] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:32 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:33.175704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:33.178348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:33.200131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:33.201673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:33.202495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:33.203386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:33.212479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:33.215108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:33.525384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:33.541115 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-467d10a6-4a0a-4d9c-8a91-5c270f0aa411 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1267 microversion: 2.1 time: 0.383868 Oct 04 11:12:33.544156 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1681/2915] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:33 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:33.551773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:33.552820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:33.573932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:33.577260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:33.578598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:33.580225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:33.580915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:33.581726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:34.479884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:34.520538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35b05833-4730-4961-91bf-e7983116ed4e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.972280 Oct 04 11:12:34.525574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1682/2916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:33 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:34.554980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-895997840", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "999d214d-a128-4728-9cd3-99390decb15f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:34.640464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] validate_networks() for [('999d214d-a128-4728-9cd3-99390decb15f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:12:35.452478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:12:35.457088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:12:35.457949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:12:35.459071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:12:35.460003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:12:35.474046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:35.476158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:35.476827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:35.478473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:35.479650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:35.480366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:35.513556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=15 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:35.538495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:35.543667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:35.576957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:12:35.580011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:12:35.707578 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c2ddcbf-f27b-4cd9-b708-6fd4c9a18ef7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160284 Oct 04 11:12:35.712028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1683/2917] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:12:35.728933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:35.729837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:35.754609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:35.755563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:35.756695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:35.762713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:35.763606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:35.764917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:36.335904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:36.347673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2401db76-91f5-4887-a6b6-77f26929e397 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.634315 Oct 04 11:12:36.349282 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1684/2918] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:35 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:36.368799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-10cc41d5-557d-431b-b2c8-305089e9cb96 req-549468f8-999a-4b26-ba4f-414b0572b737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9444c1a9-b95a-4973-a2d6-e12370497909", "tag": "8fb4c923-b521-4de9-b13f-7a7861de1c64"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:36.390868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-10cc41d5-557d-431b-b2c8-305089e9cb96 req-549468f8-999a-4b26-ba4f-414b0572b737 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:36.391541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-10cc41d5-557d-431b-b2c8-305089e9cb96 req-549468f8-999a-4b26-ba4f-414b0572b737 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:36.392324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-10cc41d5-557d-431b-b2c8-305089e9cb96 req-549468f8-999a-4b26-ba4f-414b0572b737 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:36.413227 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-10cc41d5-557d-431b-b2c8-305089e9cb96 req-549468f8-999a-4b26-ba4f-414b0572b737 service nova] Creating event network-changed:8fb4c923-b521-4de9-b13f-7a7861de1c64 for instance 9444c1a9-b95a-4973-a2d6-e12370497909 on n-h1-791135-8 Oct 04 11:12:36.422565 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-10cc41d5-557d-431b-b2c8-305089e9cb96 req-549468f8-999a-4b26-ba4f-414b0572b737 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071533 Oct 04 11:12:36.424612 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1685/2919] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:36.433436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:36.434762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:36.452237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:36.452883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:36.453754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:36.455111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:36.456475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:36.457174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:36.948536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:36.957051 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9a78723-86c2-4ec6-9fb6-29accc2eaa2d tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.530968 Oct 04 11:12:36.975136 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1686/2920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:36 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:36.980379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:36.986341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:36.993797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:36.995129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:36.995568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:36.997381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:36.998894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:37.000380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:37.427848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:37.435783 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c4fc322-17fb-47dc-9f82-3be32217e26d tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.459126 Oct 04 11:12:37.436365 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1687/2921] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:36 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:37.441118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:37.441749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:37.447962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:37.448448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:37.448886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:37.449606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:37.450224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:37.450654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:37.560498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:37.580910 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d633efb-e923-43dc-98e0-c91a7be5d70c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1260 microversion: 2.1 time: 0.143263 Oct 04 11:12:37.581605 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1688/2922] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:37 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1260 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:37.588232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-15d84e8c-3208-4649-b1ec-37d9e1e9340f req-7dbd5538-c873-40f9-9b52-e23c69b4de81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51c8e34-27b9-4530-a9f2-c78c64a88a94", "tag": "64c7931a-897b-469e-a804-c92a94226730"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:37.614693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-15d84e8c-3208-4649-b1ec-37d9e1e9340f req-7dbd5538-c873-40f9-9b52-e23c69b4de81 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:37.615219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-15d84e8c-3208-4649-b1ec-37d9e1e9340f req-7dbd5538-c873-40f9-9b52-e23c69b4de81 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:37.615705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-15d84e8c-3208-4649-b1ec-37d9e1e9340f req-7dbd5538-c873-40f9-9b52-e23c69b4de81 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:37.633203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-15d84e8c-3208-4649-b1ec-37d9e1e9340f req-7dbd5538-c873-40f9-9b52-e23c69b4de81 service nova] Creating event network-changed:64c7931a-897b-469e-a804-c92a94226730 for instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 on n-h1-791135-8 Oct 04 11:12:37.639192 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-15d84e8c-3208-4649-b1ec-37d9e1e9340f req-7dbd5538-c873-40f9-9b52-e23c69b4de81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055682 Oct 04 11:12:37.640264 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1689/2923] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:37.646666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:37.647368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:37.654204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:37.655267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:37.655955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:37.657642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:37.658324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:37.658990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:37.664913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:37.929209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:37.942552 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2da22ecb-cc31-459d-b00d-e420922ecb73 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.300111 Oct 04 11:12:37.945043 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1690/2924] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:37 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:37.988271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:37.992908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:38.023297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:38.025054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:38.027888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:38.028958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:38.032769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:38.033237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:38.427712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:38.438195 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1cc1a8a-f4f5-46a0-aea1-9a9f9f662a86 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.460286 Oct 04 11:12:38.456246 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1691/2925] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:37 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:38.464425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:38.465319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:38.472697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:38.473403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:38.474007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:38.474923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:38.475546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:38.476135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:38.951235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:38.964003 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b79833cd-94be-4138-b8a8-2fe482807e24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.501649 Oct 04 11:12:38.964842 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1692/2926] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:38 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:38.972609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-db75db12-abd8-4529-acf8-5a1667fc0b91 req-d0c68f74-75cf-49d0-b49f-b6a7dcbf0252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "548509a9-b333-4743-bf83-628478ddf0b1", "tag": "cf0fbad0-1214-4d74-9dfe-ecc44005ba83"}, {"name": "network-changed", "server_uuid": "6cc5fd6c-061c-4a64-9c38-7921d05c6fa6", "tag": "39fdf6ef-7cbc-4e5a-8fbd-bec045de514e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:38.990214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db75db12-abd8-4529-acf8-5a1667fc0b91 req-d0c68f74-75cf-49d0-b49f-b6a7dcbf0252 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:38.994165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db75db12-abd8-4529-acf8-5a1667fc0b91 req-d0c68f74-75cf-49d0-b49f-b6a7dcbf0252 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:38.994893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db75db12-abd8-4529-acf8-5a1667fc0b91 req-d0c68f74-75cf-49d0-b49f-b6a7dcbf0252 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:39.011433 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-db75db12-abd8-4529-acf8-5a1667fc0b91 req-d0c68f74-75cf-49d0-b49f-b6a7dcbf0252 service nova] Creating event network-changed:cf0fbad0-1214-4d74-9dfe-ecc44005ba83 for instance 548509a9-b333-4743-bf83-628478ddf0b1 on n-h1-791135-8 Oct 04 11:12:39.012319 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-db75db12-abd8-4529-acf8-5a1667fc0b91 req-d0c68f74-75cf-49d0-b49f-b6a7dcbf0252 service nova] Creating event network-changed:39fdf6ef-7cbc-4e5a-8fbd-bec045de514e for instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 on n-h1-791135-8 Oct 04 11:12:39.020495 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-db75db12-abd8-4529-acf8-5a1667fc0b91 req-d0c68f74-75cf-49d0-b49f-b6a7dcbf0252 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052862 Oct 04 11:12:39.021890 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1693/2927] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:39.029336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:39.030828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:39.039572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:39.040296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:39.040922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:39.041929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:39.042573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:39.043185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:39.134086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:39.151468 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-41a032fa-c737-447a-a31f-eb7619ab44d0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1260 microversion: 2.1 time: 0.125196 Oct 04 11:12:39.152692 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1694/2928] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:39 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1260 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:39.165939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:39.166802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:39.185302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:39.186057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:39.186657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:39.189429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:39.189985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:39.190269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:40.028171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:40.048330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b9aabc5-2872-4619-bc32-710cce2501d3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.893684 Oct 04 11:12:40.050004 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1695/2929] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:39 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:40.055590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:40.056482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:40.064635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:40.065581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:40.066279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:40.068145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:40.070237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:40.072084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:40.746998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:40.766828 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec0d2148-4b7a-4de8-ab55-a7e57b34a3db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.714890 Oct 04 11:12:40.767711 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1696/2930] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:40 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:40.774801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b1a38903-41be-4060-ae74-8c10d8dce336 req-b370ee72-2752-4742-a865-2b3938cdbb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bab5240-2dd7-4943-8eb0-234b8021371f", "tag": "db183020-3596-479f-b435-687288d38daa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:40.802235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1a38903-41be-4060-ae74-8c10d8dce336 req-b370ee72-2752-4742-a865-2b3938cdbb4c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:40.802721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1a38903-41be-4060-ae74-8c10d8dce336 req-b370ee72-2752-4742-a865-2b3938cdbb4c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:40.803158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1a38903-41be-4060-ae74-8c10d8dce336 req-b370ee72-2752-4742-a865-2b3938cdbb4c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:40.825653 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b1a38903-41be-4060-ae74-8c10d8dce336 req-b370ee72-2752-4742-a865-2b3938cdbb4c service nova] Creating event network-changed:db183020-3596-479f-b435-687288d38daa for instance 1bab5240-2dd7-4943-8eb0-234b8021371f on n-h1-791135-8 Oct 04 11:12:40.843286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b1a38903-41be-4060-ae74-8c10d8dce336 req-b370ee72-2752-4742-a865-2b3938cdbb4c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074119 Oct 04 11:12:40.844208 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1697/2931] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:40.849506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:40.850208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:40.862212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:40.874186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:40.875168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:40.876727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:40.877385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:40.877977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:41.124596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:41.135053 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-39999ce4-6813-4a44-8f7d-0394b34401c6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.289587 Oct 04 11:12:41.137561 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1698/2932] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:40 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:41.147306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:41.148020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:41.155522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:41.156262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:41.157374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:41.158448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:41.159138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:41.160437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:41.479089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:41.492698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b9d9b23-2a09-4430-8373-c3da208a6079 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.353404 Oct 04 11:12:41.493852 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1699/2933] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:41 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:41.761022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2025445951", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "49989f52-07b9-48bb-b42a-1e9bb7c15958"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:41.843881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] validate_networks() for [('49989f52-07b9-48bb-b42a-1e9bb7c15958', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:12:42.534811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:12:42.536896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:12:42.537455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:12:42.538287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:12:42.538870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:12:42.553942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=53 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:42.557563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:42.558042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:42.558486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:42.560398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:42.560889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:42.561327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:42.589272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:12:42.596133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for user 510d473de29b4d7d8bb303f64f1e17d4 and project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:12:42.613293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:12:42.619200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:12:42.684484 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-905c719f-248c-4d6c-ab48-4410b97bbdc7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189191 Oct 04 11:12:42.692407 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1700/2934] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:12:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:12:42.697821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:42.698442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:42.706815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:42.707326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:42.707765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:42.708592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:42.709007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:42.709844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:43.049792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:43.068522 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b5427db-e5ea-48e1-9d57-9ee27b54201e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.372315 Oct 04 11:12:43.069149 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1701/2935] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:42 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:43.085417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:43.089114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:43.125825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:43.132355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:43.134650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:43.136871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:43.140614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:43.141303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:43.141955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:43.755960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:43.775764 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a050df5-95d7-4bd4-9800-8cb81ec6656a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.699024 Oct 04 11:12:43.778745 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1702/2936] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:43 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:43.801685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:43.802659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:43.818094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:43.818859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:43.819491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:43.820407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:43.823304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:43.827630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:44.225304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:44.250534 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de18e4ff-a6bb-4820-9f2e-f879e52075d4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.457696 Oct 04 11:12:44.252993 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1703/2937] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:43 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:44.276214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:44.286807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:44.301485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:44.302088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:44.302786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:44.303951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:44.304705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:44.305331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:44.520549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:44.532651 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be4e7a52-79f1-4a79-8139-b340f9c48426 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.277540 Oct 04 11:12:44.533680 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1704/2938] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:44 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:44.538740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:44.539468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:44.546669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:44.547299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:44.547848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:44.548615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:44.549430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:44.550022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:44.639235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:44.648795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f16679a-f1f3-4837-8115-1519d9076713 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1219 microversion: 2.1 time: 0.114036 Oct 04 11:12:44.650561 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1705/2939] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:44 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:44.655542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:44.656338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:44.662722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:44.663480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:44.664085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:44.664954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:44.665601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:44.666274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:44.913872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:44.926278 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-da6c01d4-b536-42b2-92a1-f016eaee00b9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.274254 Oct 04 11:12:44.937105 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1706/2940] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:44 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:44.949029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bcfd627a-4b76-4d66-9a18-2639ea5f2133 req-f02cf3ea-6717-4713-813d-0815a081ece4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ff9d7b-1e62-40ff-8770-36c69d67eea7", "tag": "7c9aa385-a4b9-411e-b82e-34115af1bfae"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:44.965600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bcfd627a-4b76-4d66-9a18-2639ea5f2133 req-f02cf3ea-6717-4713-813d-0815a081ece4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:44.970038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bcfd627a-4b76-4d66-9a18-2639ea5f2133 req-f02cf3ea-6717-4713-813d-0815a081ece4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:44.971277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bcfd627a-4b76-4d66-9a18-2639ea5f2133 req-f02cf3ea-6717-4713-813d-0815a081ece4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:44.996776 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bcfd627a-4b76-4d66-9a18-2639ea5f2133 req-f02cf3ea-6717-4713-813d-0815a081ece4 service nova] Creating event network-changed:7c9aa385-a4b9-411e-b82e-34115af1bfae for instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 on n-h1-791135-8 Oct 04 11:12:45.012057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bcfd627a-4b76-4d66-9a18-2639ea5f2133 req-f02cf3ea-6717-4713-813d-0815a081ece4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072098 Oct 04 11:12:45.013295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1707/2941] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:45.020436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:45.021146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:45.027913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:45.028452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:45.028873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:45.029770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:45.030229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:45.030657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:45.173210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:45.181714 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-552025b7-a87b-4696-8c26-3f89d6821e43 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.166800 Oct 04 11:12:45.182318 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1708/2942] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:45 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:45.240809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46d05e21-bee0-4c22-8cfd-72b32afd47ef tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Action: 'create', calling method: .version_select at 0x7f71d4580670>, body: {"pool": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:48.096048 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46d05e21-bee0-4c22-8cfd-72b32afd47ef tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.912620 Oct 04 11:12:48.097424 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1709/2943] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:12:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:48.102647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:48.103514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:48.112092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.112756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.113447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.114523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.115136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.115670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.139200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:48.349875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:48.362419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00e21513-5cfa-4d9f-909d-8377ac2afb46 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.263418 Oct 04 11:12:48.367507 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1710/2944] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:48 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:48.373530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:48.374428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:48.381787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.382591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.383350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.384283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.385034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.385561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.531707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:48.539538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af7225bc-4203-4c10-aa0e-2cbd62767d6f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.170469 Oct 04 11:12:48.540128 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1711/2945] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:48 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:48.544883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:48.545688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:48.563825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.564358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.564802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.565549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.566017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.566448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.698550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:48.707193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0d7bdfaf-8e1d-4b15-b726-81da98d2f107 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.165872 Oct 04 11:12:48.707778 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1712/2946] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:48 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:48.712321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:48.712939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:48.718674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.719421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.719857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.720783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.721245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.721701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.872695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:48.881342 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-642bef7e-52c0-4746-bbff-4c236f2b33a4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.172563 Oct 04 11:12:48.881974 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1713/2947] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:48 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:48.886516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:48.887112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:48.893023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.893635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.894004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:48.894799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:48.895466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:48.896052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:49.061144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:49.071211 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3954d418-fb73-4a5c-8069-7f5d5e3e82e0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.188188 Oct 04 11:12:49.081669 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1714/2948] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:48 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:49.081669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ab36e469-e91b-45d2-a1cc-c5ff9e99d76d req-bd566489-a9dc-4f92-b2ed-0f357a588f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548509a9-b333-4743-bf83-628478ddf0b1", "name": "network-vif-plugged", "status": "completed", "tag": "cf0fbad0-1214-4d74-9dfe-ecc44005ba83"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:49.091589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ab36e469-e91b-45d2-a1cc-c5ff9e99d76d req-bd566489-a9dc-4f92-b2ed-0f357a588f3f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:49.092170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ab36e469-e91b-45d2-a1cc-c5ff9e99d76d req-bd566489-a9dc-4f92-b2ed-0f357a588f3f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:49.092617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ab36e469-e91b-45d2-a1cc-c5ff9e99d76d req-bd566489-a9dc-4f92-b2ed-0f357a588f3f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:49.105004 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ab36e469-e91b-45d2-a1cc-c5ff9e99d76d req-bd566489-a9dc-4f92-b2ed-0f357a588f3f service nova] Creating event network-vif-plugged:cf0fbad0-1214-4d74-9dfe-ecc44005ba83 for instance 548509a9-b333-4743-bf83-628478ddf0b1 on n-h1-791135-8 Oct 04 11:12:49.111172 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ab36e469-e91b-45d2-a1cc-c5ff9e99d76d req-bd566489-a9dc-4f92-b2ed-0f357a588f3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038154 Oct 04 11:12:49.112059 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1715/2949] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:49.117867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4d841230-9f0c-471a-8d7c-e8d523b899cc tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Action: 'create', calling method: .version_select at 0x7f71d450dca0>, body: {"pool": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:51.079347 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4d841230-9f0c-471a-8d7c-e8d523b899cc tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.966236 Oct 04 11:12:51.080819 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1716/2950] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:12:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:51.090058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:51.091384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:51.107265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.108384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.109110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.110778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.111260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.111693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.262980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:51.271004 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-896d50e9-8935-4ec7-97d2-a6e42618dbcb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.186617 Oct 04 11:12:51.271684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1717/2951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:51 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:51.276329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:51.276949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:51.282986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.283676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.284303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.285184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.285872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.286509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.422779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:51.430376 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-347cd5a5-9377-4d3e-b16f-2032a6aa5cb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.157735 Oct 04 11:12:51.430955 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1718/2952] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:51 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:51.435589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:51.436193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:51.441744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.442234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.442670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.443359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.443816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.444242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.574151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:51.582205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24cf61a5-5989-4cb9-ad2c-39666dbe1b6e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.150204 Oct 04 11:12:51.582797 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1719/2953] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:51 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:51.587603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:51.588204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:51.594913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.595617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.596050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.596741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.597371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.597963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.733038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:51.741830 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5698c0e7-3757-497f-809c-9cde5c761716 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.157671 Oct 04 11:12:51.742431 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1720/2954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:51 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:51.746984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:51.747598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:51.754201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.754695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.755131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.755833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.756290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.756719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.886888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:51.895074 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec29e818-8b8b-40dd-a02f-7fdb38a4c9b6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.151690 Oct 04 11:12:51.895642 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1721/2955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:51 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:51.900085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:51.900823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:51.907211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.907696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.908130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:51.908814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:51.909264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:51.909785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:52.036144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:52.043759 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9ee56a3-4022-477d-954f-1ab97d0b252b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.147176 Oct 04 11:12:52.044322 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1722/2956] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:51 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:52.048625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bae05757-84b5-49ac-ac48-bfe912d75357 req-a9d95613-0028-4ffc-a747-9eec8438c271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf", "tag": "daf0f99a-d41b-4236-a35d-ef2019b29267"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:52.057367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bae05757-84b5-49ac-ac48-bfe912d75357 req-a9d95613-0028-4ffc-a747-9eec8438c271 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:52.057851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bae05757-84b5-49ac-ac48-bfe912d75357 req-a9d95613-0028-4ffc-a747-9eec8438c271 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:52.058280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bae05757-84b5-49ac-ac48-bfe912d75357 req-a9d95613-0028-4ffc-a747-9eec8438c271 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:52.070364 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bae05757-84b5-49ac-ac48-bfe912d75357 req-a9d95613-0028-4ffc-a747-9eec8438c271 service nova] Creating event network-changed:daf0f99a-d41b-4236-a35d-ef2019b29267 for instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf on n-h1-791135-8 Oct 04 11:12:52.075154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bae05757-84b5-49ac-ac48-bfe912d75357 req-a9d95613-0028-4ffc-a747-9eec8438c271 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029747 Oct 04 11:12:52.075721 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1723/2957] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:52.081084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e58e0b1-90f3-4990-b7c6-1fb7cbd0ec18 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Action: 'create', calling method: .version_select at 0x7f71d450d790>, body: {"pool": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:52.577721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:52.606480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:53.828079 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e58e0b1-90f3-4990-b7c6-1fb7cbd0ec18 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.751144 Oct 04 11:12:53.828843 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1724/2958] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:12:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:53.833607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-45bfa8c8-3537-46c0-aa02-30965b56c692 req-1bb5fe2a-40e1-4422-aaa7-78008aa9cd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9444c1a9-b95a-4973-a2d6-e12370497909", "name": "network-vif-plugged", "status": "completed", "tag": "8fb4c923-b521-4de9-b13f-7a7861de1c64"}, {"server_uuid": "6cc5fd6c-061c-4a64-9c38-7921d05c6fa6", "name": "network-vif-plugged", "status": "completed", "tag": "39fdf6ef-7cbc-4e5a-8fbd-bec045de514e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:53.845516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-45bfa8c8-3537-46c0-aa02-30965b56c692 req-1bb5fe2a-40e1-4422-aaa7-78008aa9cd11 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:53.845997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-45bfa8c8-3537-46c0-aa02-30965b56c692 req-1bb5fe2a-40e1-4422-aaa7-78008aa9cd11 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:53.846423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-45bfa8c8-3537-46c0-aa02-30965b56c692 req-1bb5fe2a-40e1-4422-aaa7-78008aa9cd11 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:53.858125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-45bfa8c8-3537-46c0-aa02-30965b56c692 req-1bb5fe2a-40e1-4422-aaa7-78008aa9cd11 service nova] Creating event network-vif-plugged:8fb4c923-b521-4de9-b13f-7a7861de1c64 for instance 9444c1a9-b95a-4973-a2d6-e12370497909 on n-h1-791135-8 Oct 04 11:12:53.858628 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-45bfa8c8-3537-46c0-aa02-30965b56c692 req-1bb5fe2a-40e1-4422-aaa7-78008aa9cd11 service nova] Creating event network-vif-plugged:39fdf6ef-7cbc-4e5a-8fbd-bec045de514e for instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 on n-h1-791135-8 Oct 04 11:12:53.865345 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-45bfa8c8-3537-46c0-aa02-30965b56c692 req-1bb5fe2a-40e1-4422-aaa7-78008aa9cd11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035145 Oct 04 11:12:53.865961 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1725/2959] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:53.870851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:53.871544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:53.877729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:53.878203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:53.878634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:53.879311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:53.879760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:53.880179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.052011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:54.061187 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c728c8f8-701c-457e-b86b-8291ad6fc62f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.194087 Oct 04 11:12:54.062253 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1726/2960] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:53 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:54.066821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:54.067661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:54.074095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.074582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.075070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.075705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.076350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.076988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.212683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:54.221023 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5876d9fe-0c00-481d-82ef-10ebfb77f204 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1359 microversion: 2.1 time: 0.157705 Oct 04 11:12:54.221625 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1727/2961] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:54 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:54.226059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:54.226850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:54.232537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.233011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.233549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.234545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.235176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.235601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.369466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:54.377931 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3471b17a-1cf1-4c47-bccd-f1e5164b7205 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.155336 Oct 04 11:12:54.378506 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1728/2962] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:54 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:54.382995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:54.383720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:54.389724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.390208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.390680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.391368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.391818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.392692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.532224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:54.540347 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aac91f24-71dd-49ef-85d2-8700264e6f6d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.160846 Oct 04 11:12:54.541121 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1729/2963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:54 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:54.545636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:54.549912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:54.552239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.552725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.553157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.554182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.554792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.555224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.685639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:54.699449 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db03b1eb-80bc-4482-b383-fc7f02225aee tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.157439 Oct 04 11:12:54.700044 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1730/2964] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:54 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:54.705929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:54.706543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:54.712868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.713379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.713836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.714657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:54.715238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:54.715548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:54.719797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:54.851268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:54.860296 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e18d5a39-1c15-43f1-9588-1f38c46da03a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.159228 Oct 04 11:12:54.860886 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1731/2965] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:54 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:54.867692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-23ec19be-3b79-43d3-bbba-516f36299209 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Action: 'create', calling method: .version_select at 0x7f71d4414700>, body: {"pool": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:55.942406 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-23ec19be-3b79-43d3-bbba-516f36299209 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.080348 Oct 04 11:12:55.943070 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1732/2966] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:12:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:55.947932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:55.948541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:55.954628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:55.955109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:55.955550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:55.956261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:55.956716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:55.957137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.091188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:56.099537 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ce5d1c4a-8224-4b52-a6ba-40c09a6e0018 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.155512 Oct 04 11:12:56.100117 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1733/2967] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:55 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:56.104490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:56.105098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:56.111178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.111664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.112103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.112796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.113255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.113721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.241896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:56.249940 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9c39086f-c51e-47e6-b841-1b55edadd6b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1543 microversion: 2.1 time: 0.148564 Oct 04 11:12:56.250523 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1734/2968] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:56 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1543 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:56.255006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:56.255618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:56.261638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.262156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.262601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.263295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.263835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.264298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.399107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:56.406948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c76aadb-f59d-4be0-91fa-effa048364a4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.155465 Oct 04 11:12:56.407517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1735/2969] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:56 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:56.411940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:56.412554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:56.418085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.418573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.419016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.419709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.420169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.420600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.551845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:56.559711 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14dcd04b-4242-41af-8f5c-5bcc6ce1bbed tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.151217 Oct 04 11:12:56.560479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1736/2970] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:56 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:56.564729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:56.565343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:56.571160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.571587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.572031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.572715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.573170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.573624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.713998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:56.721582 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bcf0bf17-f2ac-4034-b72f-4e42aade7318 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.160293 Oct 04 11:12:56.722163 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1737/2971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:56 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:56.726654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-9c7acb5a-dd82-424e-935c-aa52ed8fac37 req-64403f88-0716-4baa-9286-f67466c17c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bab5240-2dd7-4943-8eb0-234b8021371f", "name": "network-vif-plugged", "status": "completed", "tag": "db183020-3596-479f-b435-687288d38daa"}, {"server_uuid": "e51c8e34-27b9-4530-a9f2-c78c64a88a94", "name": "network-vif-plugged", "status": "completed", "tag": "64c7931a-897b-469e-a804-c92a94226730"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:56.736728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9c7acb5a-dd82-424e-935c-aa52ed8fac37 req-64403f88-0716-4baa-9286-f67466c17c8a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.737200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9c7acb5a-dd82-424e-935c-aa52ed8fac37 req-64403f88-0716-4baa-9286-f67466c17c8a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.737668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9c7acb5a-dd82-424e-935c-aa52ed8fac37 req-64403f88-0716-4baa-9286-f67466c17c8a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.751924 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9c7acb5a-dd82-424e-935c-aa52ed8fac37 req-64403f88-0716-4baa-9286-f67466c17c8a service nova] Creating event network-vif-plugged:db183020-3596-479f-b435-687288d38daa for instance 1bab5240-2dd7-4943-8eb0-234b8021371f on n-h1-791135-8 Oct 04 11:12:56.752431 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9c7acb5a-dd82-424e-935c-aa52ed8fac37 req-64403f88-0716-4baa-9286-f67466c17c8a service nova] Creating event network-vif-plugged:64c7931a-897b-469e-a804-c92a94226730 for instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 on n-h1-791135-8 Oct 04 11:12:56.758709 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-9c7acb5a-dd82-424e-935c-aa52ed8fac37 req-64403f88-0716-4baa-9286-f67466c17c8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035398 Oct 04 11:12:56.759308 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1738/2972] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:56.764260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:56.764959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:56.771686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.772174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.772614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.773302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:56.773786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:56.774215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:56.957758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:56.965757 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4fb738a8-3637-465e-aad8-f88c5b74456b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.205290 Oct 04 11:12:56.966538 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1739/2973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:56 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:56.970809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-342f2b88-90d1-4958-814c-2aeee9a20b28 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Calling method '.version_select at 0x7f71d457a4c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:57.158258 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-342f2b88-90d1-4958-814c-2aeee9a20b28 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/99dc32fd-e046-4646-b6e7-096b7d218e9d" status: 200 len: 141 microversion: 2.1 time: 0.190876 Oct 04 11:12:57.158846 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1740/2974] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:12:56 2022] GET /compute/v2.1/os-floating-ips/99dc32fd-e046-4646-b6e7-096b7d218e9d => generated 141 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:57.164710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1026217731"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:57.166219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:57.172679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:57.173156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:57.173615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:57.174295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:57.174745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:57.175164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:57.367393 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f47a447-f9c1-4e4f-9e03-b4942cef8817 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.207288 Oct 04 11:12:57.368377 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1741/2975] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:12:57 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 11:12:57.376450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:57.377154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:57.383806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:57.384307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:57.385122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:57.385468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:57.385933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:57.386417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:57.466532 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbaf142e-e3c8-4ad3-8378-c651c7e6a41f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096776 Oct 04 11:12:57.467167 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1742/2976] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:12:57 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:57.472259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dbe3812b-98d9-4e6e-a314-78a19523d58e tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Calling method '.version_select at 0x7f71d4414700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:58.195463 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dbe3812b-98d9-4e6e-a314-78a19523d58e tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/99dc32fd-e046-4646-b6e7-096b7d218e9d" status: 202 len: 0 microversion: 2.1 time: 0.726811 Oct 04 11:12:58.196169 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1743/2977] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:12:57 2022] DELETE /compute/v2.1/os-floating-ips/99dc32fd-e046-4646-b6e7-096b7d218e9d => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:12:58.201053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:58.201706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:58.207738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:58.208222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:58.208655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:58.209345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:58.209820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:58.210248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:58.342044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:58.351747 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3986b710-7d18-4e7c-b54f-26b34c1d65b2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.153105 Oct 04 11:12:58.352650 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1744/2978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:58 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:58.357375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:58.358161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:58.367665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:58.368424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:58.368869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:58.369733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:58.370068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:58.370503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:58.517125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:58.525068 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1cfc77ac-8082-498e-a93b-8ff2f606acf2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.171041 Oct 04 11:12:58.525743 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1745/2979] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:58 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:58.530501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:58.531880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:58.537729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:58.538326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:58.538827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:58.539610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:58.540136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:58.540667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:58.673193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:58.680874 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53208a90-084b-4a5d-995d-0778c5f99046 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1321 microversion: 2.1 time: 0.153986 Oct 04 11:12:58.681537 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1746/2980] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:58 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:58.685997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:58.686605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:58.693073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:58.693594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:58.694033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:58.694787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:58.695248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:58.695740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:58.829672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:58.837621 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5d41dc2-83b9-431b-9a79-1bf1f88a6285 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1315 microversion: 2.1 time: 0.155083 Oct 04 11:12:58.838200 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1747/2981] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:58 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:58.855231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72b7d910-92e2-4bc5-953e-82d437824432 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Calling method '.version_select at 0x7f71d4d40d30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:59.054963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72b7d910-92e2-4bc5-953e-82d437824432 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.204369 Oct 04 11:12:59.055682 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1748/2982] 10.222.0.23 () {58 vars in 1164 bytes} [Tue Oct 4 11:12:58 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:12:59.061826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-932edb0d-722f-47c9-9cdd-84e2dbddee97 req-dd407e60-6e81-4070-86af-687234417e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9444c1a9-b95a-4973-a2d6-e12370497909", "tag": "8fb4c923-b521-4de9-b13f-7a7861de1c64"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:59.075623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-932edb0d-722f-47c9-9cdd-84e2dbddee97 req-dd407e60-6e81-4070-86af-687234417e25 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:59.076379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-932edb0d-722f-47c9-9cdd-84e2dbddee97 req-dd407e60-6e81-4070-86af-687234417e25 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:59.077110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-932edb0d-722f-47c9-9cdd-84e2dbddee97 req-dd407e60-6e81-4070-86af-687234417e25 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:59.091038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-932edb0d-722f-47c9-9cdd-84e2dbddee97 req-dd407e60-6e81-4070-86af-687234417e25 service nova] Creating event network-changed:8fb4c923-b521-4de9-b13f-7a7861de1c64 for instance 9444c1a9-b95a-4973-a2d6-e12370497909 on n-h1-791135-8 Oct 04 11:12:59.096082 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-932edb0d-722f-47c9-9cdd-84e2dbddee97 req-dd407e60-6e81-4070-86af-687234417e25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039092 Oct 04 11:12:59.096865 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1749/2983] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:59.102832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8eb662cd-101c-43ab-b72a-0e0d5b1e602a req-005509f8-4ddb-4b54-9284-311a67144375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ff9d7b-1e62-40ff-8770-36c69d67eea7", "name": "network-vif-plugged", "status": "completed", "tag": "7c9aa385-a4b9-411e-b82e-34115af1bfae"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:12:59.112891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8eb662cd-101c-43ab-b72a-0e0d5b1e602a req-005509f8-4ddb-4b54-9284-311a67144375 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:59.113403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8eb662cd-101c-43ab-b72a-0e0d5b1e602a req-005509f8-4ddb-4b54-9284-311a67144375 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:59.113846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8eb662cd-101c-43ab-b72a-0e0d5b1e602a req-005509f8-4ddb-4b54-9284-311a67144375 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:59.126367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8eb662cd-101c-43ab-b72a-0e0d5b1e602a req-005509f8-4ddb-4b54-9284-311a67144375 service nova] Creating event network-vif-plugged:7c9aa385-a4b9-411e-b82e-34115af1bfae for instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 on n-h1-791135-8 Oct 04 11:12:59.131502 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8eb662cd-101c-43ab-b72a-0e0d5b1e602a req-005509f8-4ddb-4b54-9284-311a67144375 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Oct 04 11:12:59.132045 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1750/2984] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:59.138156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7af7f917-6273-4e7c-9393-36dc16a55699 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Calling method '.version_select at 0x7f71d45e5160>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:59.646768 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7af7f917-6273-4e7c-9393-36dc16a55699 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.513295 Oct 04 11:12:59.650574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1751/2985] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 11:12:59 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:12:59.656889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:59.657819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:59.664555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:59.665052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:59.665727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:59.666440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:59.666971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:59.667558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:59.824680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:59.834611 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3679252c-2495-4a2b-845a-db993fdd1729 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.182738 Oct 04 11:12:59.835619 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1752/2986] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:59 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:12:59.840534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:12:59.841853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:12:59.848940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:59.849716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:59.850195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:59.850905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:12:59.851399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:12:59.851832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:12:59.985718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:12:59.989265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:12:59.994329 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2fad4b54-c3dd-41f6-b728-fb55dd749565 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.157449 Oct 04 11:12:59.994904 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1753/2987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:12:59 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:00.000208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf3863ca-a2b9-4fad-be95-9e34c3fb6a1f tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Calling method '.version_select at 0x7f71d4635430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:00.821146 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf3863ca-a2b9-4fad-be95-9e34c3fb6a1f tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/dda31245-1177-4f27-9106-a47f2912a6a4" status: 202 len: 0 microversion: 2.1 time: 0.825160 Oct 04 11:13:00.822078 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1754/2988] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:12:59 2022] DELETE /compute/v2.1/os-floating-ips/dda31245-1177-4f27-9106-a47f2912a6a4 => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:00.826522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:00.827132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:00.833678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:00.834164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:00.834599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:00.835285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:00.835745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:00.836174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:01.020189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:01.027917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-40f8dc4c-4f88-4704-bc4b-6c7198fbf4cd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1512 microversion: 2.1 time: 0.205018 Oct 04 11:13:01.028481 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1755/2989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:00 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:01.032919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:01.034094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:01.039728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:01.040206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:01.040641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:01.041327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:01.041828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:01.042252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:01.210598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:01.218354 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-607f17f3-49a3-4e0a-a562-5ca486d804d7 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1504 microversion: 2.1 time: 0.188930 Oct 04 11:13:01.219445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1756/2990] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:01 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:01.223990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8c12fd7-ad52-4434-9a10-909291dc2884 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Calling method '.version_select at 0x7f71d465aee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:01.946911 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8c12fd7-ad52-4434-9a10-909291dc2884 tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/4ce98038-b68f-4697-b761-9fd95d9fc50d" status: 202 len: 0 microversion: 2.1 time: 0.726316 Oct 04 11:13:01.947589 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1757/2991] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:13:01 2022] DELETE /compute/v2.1/os-floating-ips/4ce98038-b68f-4697-b761-9fd95d9fc50d => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:01.953504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:01.954115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:01.960094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:01.960573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:01.961005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:01.961713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:01.962170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:01.962592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:02.108671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:02.116402 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84967687-91d0-4e64-8198-951a01b13be1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1308 microversion: 2.1 time: 0.167833 Oct 04 11:13:02.116975 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1758/2992] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:01 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:02.121431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:02.122040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:02.128448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:02.128937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:02.129396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:02.130099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:02.130558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:02.130987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:02.336432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:02.344188 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3d776753-c751-4928-a935-46dde5cfc7e3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.226195 Oct 04 11:13:02.344777 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1759/2993] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:02 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:02.349412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:02.349904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:02.355733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:02.356268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:02.356656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:02.357345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:02.357828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:02.358255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:02.491619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:02.499469 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e438e7f-4c8d-422e-8004-2feb407fa6c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1512 microversion: 2.1 time: 0.153747 Oct 04 11:13:02.500912 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1760/2994] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:02 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:02.505288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2fbb9a2a-2eec-4fc7-abfc-c1fc31805a32 req-170c0c25-c8d7-402f-9070-110a0b703f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf", "name": "network-vif-plugged", "status": "completed", "tag": "daf0f99a-d41b-4236-a35d-ef2019b29267"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:02.514496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2fbb9a2a-2eec-4fc7-abfc-c1fc31805a32 req-170c0c25-c8d7-402f-9070-110a0b703f8d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:02.514973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2fbb9a2a-2eec-4fc7-abfc-c1fc31805a32 req-170c0c25-c8d7-402f-9070-110a0b703f8d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:02.515409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2fbb9a2a-2eec-4fc7-abfc-c1fc31805a32 req-170c0c25-c8d7-402f-9070-110a0b703f8d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:02.526858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2fbb9a2a-2eec-4fc7-abfc-c1fc31805a32 req-170c0c25-c8d7-402f-9070-110a0b703f8d service nova] Creating event network-vif-plugged:daf0f99a-d41b-4236-a35d-ef2019b29267 for instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf on n-h1-791135-8 Oct 04 11:13:02.532012 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2fbb9a2a-2eec-4fc7-abfc-c1fc31805a32 req-170c0c25-c8d7-402f-9070-110a0b703f8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029958 Oct 04 11:13:02.532612 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1761/2995] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:02.537754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1910513367"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:02.538385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:02.540283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:02.545771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:02.546266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:02.547244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:02.547942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:02.548403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:02.548833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:02.704643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.security_group_api [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Adding security group 60e83c9e-ceaf-4d6a-99dd-91299387490f to port db183020-3596-479f-b435-687288d38daa Oct 04 11:13:03.063231 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-05748a71-42ce-42a8-8b7d-72427968b1a4 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f/action" status: 202 len: 0 microversion: 2.1 time: 0.529405 Oct 04 11:13:03.064193 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1762/2996] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:13:02 2022] POST /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:03.069168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3143962f-a8ba-4c35-baf0-e5f4d3bc29ae tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] Calling method '.version_select at 0x7f71d46353a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:03.859945 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3143962f-a8ba-4c35-baf0-e5f4d3bc29ae tempest-FloatingIPDetailsTestJSON-748336531 tempest-FloatingIPDetailsTestJSON-748336531-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/299e3c1a-292f-4c63-9d39-69fd5e29acb8" status: 202 len: 0 microversion: 2.1 time: 0.794644 Oct 04 11:13:03.860669 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1763/2997] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:13:03 2022] DELETE /compute/v2.1/os-floating-ips/299e3c1a-292f-4c63-9d39-69fd5e29acb8 => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:03.867081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:03.867953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:03.875019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:03.875933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:03.876558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:03.877601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:03.878072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:03.878512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.026515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:04.035785 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e8e71e0-a106-41a5-8c52-03868802a141 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6" status: 200 len: 1513 microversion: 2.1 time: 0.173798 Oct 04 11:13:04.036369 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1764/2998] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:03 2022] GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:04.040992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5ae8e5d4-e025-4e5f-96fd-31413a563572 req-e87fa35f-08ad-47bc-8b46-79e3209d64dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bab5240-2dd7-4943-8eb0-234b8021371f", "tag": "db183020-3596-479f-b435-687288d38daa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:04.050349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ae8e5d4-e025-4e5f-96fd-31413a563572 req-e87fa35f-08ad-47bc-8b46-79e3209d64dd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.050827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ae8e5d4-e025-4e5f-96fd-31413a563572 req-e87fa35f-08ad-47bc-8b46-79e3209d64dd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.051441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ae8e5d4-e025-4e5f-96fd-31413a563572 req-e87fa35f-08ad-47bc-8b46-79e3209d64dd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.063104 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5ae8e5d4-e025-4e5f-96fd-31413a563572 req-e87fa35f-08ad-47bc-8b46-79e3209d64dd service nova] Creating event network-changed:db183020-3596-479f-b435-687288d38daa for instance 1bab5240-2dd7-4943-8eb0-234b8021371f on n-h1-791135-8 Oct 04 11:13:04.068193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5ae8e5d4-e025-4e5f-96fd-31413a563572 req-e87fa35f-08ad-47bc-8b46-79e3209d64dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030700 Oct 04 11:13:04.069103 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1765/2999] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:04.074147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-338f0d47-97d8-4f5f-8d58-3fd36350cf5c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d4635280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:04.169998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-338f0d47-97d8-4f5f-8d58-3fd36350cf5c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 60e83c9e-ceaf-4d6a-99dd-91299387490f in use.", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:13:04.170700 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-338f0d47-97d8-4f5f-8d58-3fd36350cf5c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security Group 60e83c9e-ceaf-4d6a-99dd-91299387490f in use. Oct 04 11:13:04.170700 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4e8e1113-1abf-4a4f-872a-a494240c8187'] Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-338f0d47-97d8-4f5f-8d58-3fd36350cf5c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/60e83c9e-ceaf-4d6a-99dd-91299387490f HTTP/1.1 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: exception: Security Group 60e83c9e-ceaf-4d6a-99dd-91299387490f in use. Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4e8e1113-1abf-4a4f-872a-a494240c8187'] Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '60e83c9e-ceaf-4d6a-99dd-91299387490f'} Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:13:04.172769 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 60e83c9e-ceaf-4d6a-99dd-91299387490f in use. Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8e1113-1abf-4a4f-872a-a494240c8187'] Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 60e83c9e-ceaf-4d6a-99dd-91299387490f in use. Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8e1113-1abf-4a4f-872a-a494240c8187'] Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 60e83c9e-ceaf-4d6a-99dd-91299387490f in use. Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8e1113-1abf-4a4f-872a-a494240c8187'] Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 60e83c9e-ceaf-4d6a-99dd-91299387490f in use. Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8e1113-1abf-4a4f-872a-a494240c8187'] Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-338f0d47-97d8-4f5f-8d58-3fd36350cf5c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 400 to user: Security Group 60e83c9e-ceaf-4d6a-99dd-91299387490f in use. Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-4e8e1113-1abf-4a4f-872a-a494240c8187'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-338f0d47-97d8-4f5f-8d58-3fd36350cf5c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/60e83c9e-ceaf-4d6a-99dd-91299387490f" status: 400 len: 185 microversion: 2.1 time: 0.103968 Oct 04 11:13:04.178280 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1766/3000] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:04 2022] DELETE /compute/v2.1/os-security-groups/60e83c9e-ceaf-4d6a-99dd-91299387490f => generated 185 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:13:04.181418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:04.181418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:04.189962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.190452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.190892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.191590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.192053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.192481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.320060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:04.328470 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d3d955b-d787-46f7-85e3-c5699d7eb01f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1490 microversion: 2.1 time: 0.152608 Oct 04 11:13:04.329042 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1767/3001] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:04 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1490 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:04.333697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:04.334511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:04.340307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.340817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.341264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.342221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.342698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.343130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.482718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:04.493167 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fabc4fac-fe96-4a25-a4da-2fee7a981b8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.163033 Oct 04 11:13:04.494533 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1768/3002] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:04 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:04.498966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:04.500067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:04.506474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.507222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.507912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.508821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.509574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.510236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.728230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:04.741000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:04.743301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:04.744895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b8df853-4cf1-4399-9032-cf7fa6adba2d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 2945 microversion: 2.32 time: 0.249650 Oct 04 11:13:04.745671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1769/3003] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:13:04 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 2945 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:13:04.751108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:04.756482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:04.757580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:04.775236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.776052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.776834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.778044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.778515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.778942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:04.909406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:04.988277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:04.995851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:04.996343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:04.996781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.111185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf3f7c06-fbba-4e69-af0c-26440523cdf4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.364181 Oct 04 11:13:05.111826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1770/3004] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Oct 4 11:13:04 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:05.116896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:05.119171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:05.125814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.126675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.126798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.127409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.127855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.128601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.201639 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b6cbe28-0e18-4e5b-b7f9-532b8835b37c tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f/action" status: 202 len: 0 microversion: 2.1 time: 0.088378 Oct 04 11:13:05.205971 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1771/3005] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:13:05 2022] POST /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:05.207854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:05.208542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:05.214576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.215048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.215477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.216154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.216637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.217051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.350963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:05.359892 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c7d8e74-c628-4cd5-8e8a-73b005a991f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1489 microversion: 2.1 time: 0.155135 Oct 04 11:13:05.360399 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1772/3006] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:05 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1489 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:05.365171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:05.365699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:05.372152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.372678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.373116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.373862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.374320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.375764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.502495 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-120bd491-aa0e-48aa-845e-d73b204b867c tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.140982 Oct 04 11:13:05.503684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1773/3007] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Oct 4 11:13:05 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4/os-interface => generated 1832 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:13:05.509307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:05.515274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:05.516581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-386169906', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:05.523295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.523295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.523964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.524695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.525174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.525628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:05.669879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:05.695563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:05.765927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:05.772233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:05.772779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:05.773624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:06.364221 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-42c4572a-390a-42c5-8cb4-caa23c73210d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-386169906" status: 200 len: 1515 microversion: 2.1 time: 0.859060 Oct 04 11:13:06.365445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1774/3008] 10.222.0.23 () {58 vars in 1261 bytes} [Tue Oct 4 11:13:05 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-386169906 => generated 1515 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:06.370210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:06.370957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:06.378248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:06.378712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:06.379735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:06.379863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:06.380309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:06.380734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:06.647456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:06.658542 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d723706b-06ce-4edc-8b38-c3d04952629f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1575 microversion: 2.1 time: 0.291964 Oct 04 11:13:06.669841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1775/3009] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:06 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1575 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:06.679410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:06.680253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:06.688061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:06.688757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:06.689338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:06.690190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:06.690909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:06.691890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:06.946392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:06.954190 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7ef66fa-f99e-467d-8920-de257b87abd4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1490 microversion: 2.1 time: 0.283232 Oct 04 11:13:06.954980 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1776/3010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:06 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1490 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:06.960159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:06.960325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:06.967448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:06.968702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:06.970040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:06.970197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:06.970623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:06.971121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:07.222696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:07.239269 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2066673a-aa1a-45ad-9acd-390a83a31f70 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.282363 Oct 04 11:13:07.240217 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1777/3011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:06 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:07.253615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c51c52b1-eaaf-4710-bd71-7bc9a5ee608e req-86b24539-991b-4809-8a1f-7cfe644942b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "name": "network-vif-plugged", "status": "completed", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:07.264925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c51c52b1-eaaf-4710-bd71-7bc9a5ee608e req-86b24539-991b-4809-8a1f-7cfe644942b8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:07.265731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c51c52b1-eaaf-4710-bd71-7bc9a5ee608e req-86b24539-991b-4809-8a1f-7cfe644942b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:07.266340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c51c52b1-eaaf-4710-bd71-7bc9a5ee608e req-86b24539-991b-4809-8a1f-7cfe644942b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:07.279522 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c51c52b1-eaaf-4710-bd71-7bc9a5ee608e req-86b24539-991b-4809-8a1f-7cfe644942b8 service nova] Creating event network-vif-plugged:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:13:07.286213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c51c52b1-eaaf-4710-bd71-7bc9a5ee608e req-86b24539-991b-4809-8a1f-7cfe644942b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043246 Oct 04 11:13:07.287492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1778/3012] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:07.294042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:07.301723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:07.302981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:07.309629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:07.310333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:07.310972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:07.311913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:07.312545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:07.313123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:07.416199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:07.487911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:07.495847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:07.496251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:07.496694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:07.731868 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e36be37-6651-4171-a8de-61ca3b2ef73b tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.442926 Oct 04 11:13:07.732517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1779/3013] 10.222.0.23 () {58 vars in 1173 bytes} [Tue Oct 4 11:13:07 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:07.745925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:07.746753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:07.753882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:07.761292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:07.762021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:07.762521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:07.763050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:07.763744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:07.818373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:13:07.910266 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5459d7c1-d823-43df-ae0b-deec604b41e4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 204 len: 0 microversion: 2.1 time: 0.174972 Oct 04 11:13:07.911576 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1780/3014] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:07 2022] DELETE /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:13:07.921124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:07.921955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:07.929315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:07.929828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:07.930258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:07.930950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:07.931403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:07.932232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.216030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:08.230279 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a0206e17-2c66-4814-a507-c1d6df0eb0cf tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1575 microversion: 2.1 time: 0.310954 Oct 04 11:13:08.231320 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1781/3015] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:07 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1575 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:08.238654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:08.244776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:08.245315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.servers [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Removing options 'limit' from query {{(pid=122409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 11:13:08.246886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:08.253147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.253759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.254196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.254921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.255373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.255797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.290503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:08.296130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.297152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.297612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.441559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a31491a7-b44f-43e0-bc51-2882f37c8c77 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.208087 Oct 04 11:13:08.442170 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1782/3016] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 11:13:08 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:08.446724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:08.447339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:08.454875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.455661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.456389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.457161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.457737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.458221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.597515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:08.605681 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af7aeff6-2132-4b98-a88e-291c23dd0c82 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1496 microversion: 2.1 time: 0.162434 Oct 04 11:13:08.606439 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1783/3017] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:08 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:08.627275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:08.627951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:08.634038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.634646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.635336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.636164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.636753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.637266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.788262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:08.796510 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f032029-f2bb-444e-852d-a1415f088ef7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.177817 Oct 04 11:13:08.797299 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1784/3018] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:08 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:08.802119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:08.806982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:08.807591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:08.813148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.813988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.814421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.815126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.815568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.815986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.907084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:08.964799 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-737376b2-a508-4634-a8ea-e1a7e03a86d8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.166290 Oct 04 11:13:08.965403 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1785/3019] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:13:08 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:08.977817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:08.982611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:08.983053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.servers [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Removing options 'limit' from query {{(pid=122409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 11:13:08.984253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:08.989342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.989855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.990289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:08.990998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:08.991448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:08.991870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.018424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:09.046698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8bd4a613-1f29-4b11-abcf-c41f8bf02b76 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.071869 Oct 04 11:13:09.047465 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1786/3020] 10.222.0.23 () {58 vars in 1150 bytes} [Tue Oct 4 11:13:08 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:09.059169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:09.063973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:09.064620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:09.069767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.070242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.070797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.071508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.071979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.072398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.098606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:09.126944 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25ea55f3-79d3-4c57-a1f8-a3f09f21e98f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.071763 Oct 04 11:13:09.127531 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1787/3021] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:13:09 2022] GET /compute/v2.1/servers => generated 1011 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:09.140541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:09.146036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:09.146828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:09.158516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.158997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.159426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.160140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.160588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.161008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.244989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:09.249430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:09.309582 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ecbe4c6-97ae-4a0e-8b55-500f5837171d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.173133 Oct 04 11:13:09.310182 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1788/3022] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:13:09 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:13:09.314690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:09.315301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:09.321244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.321773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.322208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.322908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.323368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.323798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.471556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:09.479083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-404a2b3f-c3d8-49dc-aa0a-b80348d14dc9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1575 microversion: 2.1 time: 0.167931 Oct 04 11:13:09.479648 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1789/3023] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:09 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:09.484511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:09.489220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:09.489683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.servers [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Removing options 'limit' from query {{(pid=122409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 11:13:09.490335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:09.495197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.495721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.496103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.496804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.497248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.497694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.522318 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e37d22c3-d0d6-402e-b272-b4dd316053b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.041484 Oct 04 11:13:09.531075 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1790/3024] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Oct 4 11:13:09 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:09.535873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:09.540611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:09.541269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-386169906', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:09.547003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.547494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.548012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.548695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.549140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.549581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.633551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:09.698191 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-507018f8-f6a5-4f87-8633-f81043253705 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-386169906" status: 200 len: 345 microversion: 2.1 time: 0.166036 Oct 04 11:13:09.698782 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1791/3025] 10.222.0.23 () {58 vars in 1240 bytes} [Tue Oct 4 11:13:09 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-386169906 => generated 345 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:13:09.706580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:09.706580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:09.709967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.710443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.710881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.711561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.712014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.712438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:09.928024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:09.935839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-889f8bd7-bb8e-4616-aacf-c8a7d5ef155d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1496 microversion: 2.1 time: 0.236042 Oct 04 11:13:09.936410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1792/3026] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:09 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1496 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:09.941053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0be6249-b0ce-4e51-955c-04945539ed66 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:09.946664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0be6249-b0ce-4e51-955c-04945539ed66 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:09.947144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0be6249-b0ce-4e51-955c-04945539ed66 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:09.947574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0be6249-b0ce-4e51-955c-04945539ed66 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:10.007575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0be6249-b0ce-4e51-955c-04945539ed66 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Going to try to stop instance {{(pid=122409) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:13:10.051169 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0be6249-b0ce-4e51-955c-04945539ed66 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "POST /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1/action" status: 202 len: 0 microversion: 2.1 time: 0.113520 Oct 04 11:13:10.051775 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1793/3027] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:13:09 2022] POST /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:10.056856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:10.057571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:10.063923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:10.064410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:10.064837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:10.065561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:10.065997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:10.066416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:10.243482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:10.252749 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4514366f-56cf-4b21-be40-80bd181e2cef tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.199811 Oct 04 11:13:10.266841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1794/3028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:10 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:10.276092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:10.276762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:10.282983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:10.283467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:10.283896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:10.284583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:10.285036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:10.285485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:10.425067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:10.434099 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76468d28-52d4-4b34-bf16-b4ed89cb4754 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.165271 Oct 04 11:13:10.434796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1795/3029] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:10 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:10.504487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:10.505256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:10.511903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:10.512535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:10.513078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:10.513921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:10.514454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:10.514954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:10.675578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:10.684479 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e921dcbb-b293-40e9-b790-324a25c05c16 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1575 microversion: 2.1 time: 0.184777 Oct 04 11:13:10.685061 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1796/3030] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:10 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:10.959941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:10.961220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:10.977163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:10.977682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:10.978661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:10.979374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:10.979982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:10.980425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:11.147597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:11.161915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75b1ddb0-0c44-4857-82ab-c997d6d21892 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1496 microversion: 2.1 time: 0.206048 Oct 04 11:13:11.163087 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1797/3031] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:10 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1496 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:11.279866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:11.280565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:11.286672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:11.287222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:11.287723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:11.288474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:11.288993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:11.289544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:11.424530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:11.432372 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0daa6beb-8932-4ebc-848c-0ce9c4863ad2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.156495 Oct 04 11:13:11.432953 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1798/3032] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:11 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:11.458610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:11.459265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:11.465267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:11.465784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:11.466226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:11.466959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:11.467420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:11.467854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:11.607339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:11.616102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-040dee19-9483-4f90-9569-ce12a0f8712e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.161570 Oct 04 11:13:11.616695 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1799/3033] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:11 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:11.708037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:11.708665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:11.717062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:11.717584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:11.718796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:11.719504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:11.720007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:11.720555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:11.902124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:11.912225 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd850a6d-fcad-4312-af45-4a67ad895ecb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1575 microversion: 2.1 time: 0.207868 Oct 04 11:13:11.913296 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1800/3034] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:11 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:12.184678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:12.186291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:12.192968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:12.193780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:12.194216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:12.194914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:12.195568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:12.195998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:12.340782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:12.349383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-234f768c-25a3-4327-b9ec-59246c417158 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1496 microversion: 2.1 time: 0.168520 Oct 04 11:13:12.350213 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1801/3035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:12 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1496 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:12.458132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:12.459043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:12.468923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:12.469751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:12.470409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:12.471363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:12.472163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:12.472882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:12.617859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:12.627411 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c54eb84-34fb-4c84-b0f5-8ba4073f8d0c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.174858 Oct 04 11:13:12.628593 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1802/3036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:12 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:12.640210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:12.640847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:12.649169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:12.649890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:12.650512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:12.651678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:12.652292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:12.652868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:12.833815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:12.838835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:12.848556 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f4b79c7-7003-49c5-bbf6-98d77ff46e40 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.213252 Oct 04 11:13:12.849803 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1803/3037] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:12 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:12.936663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:12.937829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:12.945912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:12.946642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:12.947479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:12.948357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:12.949113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:12.949751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:13.106188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:13.118236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5bf3c124-400f-4712-8a76-433dc284e214 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1575 microversion: 2.1 time: 0.185796 Oct 04 11:13:13.119051 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1804/3038] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:12 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:13.373952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:13.374875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:13.377457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:13.395705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:13.396282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:13.396741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:13.398000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:13.398000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:13.406775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:13.607656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:13.638524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f75082a2-3054-4806-98cf-bbfeb6420f6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1496 microversion: 2.1 time: 0.268685 Oct 04 11:13:13.658684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1805/3039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:13 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1496 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:13.664118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:13.664687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:13.672798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:13.673204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:13.673674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:13.674411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:13.674863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:13.675292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:13.862263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:13.871986 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bcd10935-e12d-4d87-a8b0-b56394c400d1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.212003 Oct 04 11:13:13.887924 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1806/3040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:13 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:13.893614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:13.894561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:13.903471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:13.909150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:13.909779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:13.910826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:13.911889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:13.913202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:14.072303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:14.081512 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa418395-5f2a-44c3-ac9d-2436b60de681 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.192189 Oct 04 11:13:14.082300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1807/3041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:13 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:14.208839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18547146-d155-4054-88c9-11a58441ca28 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Action: 'create', calling method: .version_select at 0x7f71d4d0e940>, body: {"keypair": {"name": "tempest-keypair-470910660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn5imzqCiNTYm/oYxChiWbkvTiWX+iUGvziyDK2rOW6Uav4j2MHtyoS/+77cFudIECwQcQ/UAs0skIDxMqvqhEHSwi3MaMHf4L3koR1AUDj+nLmdLDhI+DHUuqgWKPMAg=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:14.225097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-18547146-d155-4054-88c9-11a58441ca28 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Getting quotas for project 36b769c0f7c949e6a9bcf2da47c4ba88. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:13:14.228965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-18547146-d155-4054-88c9-11a58441ca28 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Getting quotas for user bacf4d04c2754298bb4be5f2cea021e6 and project 36b769c0f7c949e6a9bcf2da47c4ba88. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:13:14.252476 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18547146-d155-4054-88c9-11a58441ca28 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169266 Oct 04 11:13:14.253084 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1808/3042] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:13:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:14.257592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:14.258211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:14.264159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:14.265164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:14.265702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:14.266392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:14.266842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:14.267265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:14.456006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:14.470115 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18d912b6-d414-4484-91a1-267382f4760f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1575 microversion: 2.1 time: 0.215909 Oct 04 11:13:14.470956 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1809/3043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:14 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:14.664116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:14.664776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:14.671805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:14.672561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:14.673151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:14.674025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:14.674631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:14.675214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:14.826201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:14.847761 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9728ae8a-5776-4c64-9e30-8234f8d8bedc tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1496 microversion: 2.1 time: 0.187328 Oct 04 11:13:14.861411 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1810/3044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:14 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1496 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:14.895542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:14.896086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:14.912564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:14.913468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:14.914118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:14.915004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:14.915666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:14.916242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:15.088394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:15.102664 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-968ba9f0-108a-49cf-b842-172398c68295 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1315 microversion: 2.1 time: 0.210948 Oct 04 11:13:15.103386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1811/3045] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:14 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:15.109049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:15.109998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:15.116682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:15.117739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:15.118512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:15.119321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:15.119887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:15.120438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:15.326276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:15.335471 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9bafe3f7-f9c7-44fa-88d4-926c3e7eccdd tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.230514 Oct 04 11:13:15.336208 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1812/3046] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:15 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:15.498133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:15.498944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:15.506250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:15.506744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:15.507388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:15.508102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:15.508601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:15.509091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:15.761337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:15.773497 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0a10de45-d8d4-4df8-92dc-fd2284b0b7b9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1575 microversion: 2.1 time: 0.279092 Oct 04 11:13:15.774736 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1813/3047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:15 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1575 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:15.873543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:15.874837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:15.883446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:15.886751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:15.888761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:15.890347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:15.893036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:15.893776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:16.197547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:16.205534 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ffad0b5b-0916-4700-be54-892565b8cd0c tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1496 microversion: 2.1 time: 0.336075 Oct 04 11:13:16.206107 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1814/3048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:15 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1496 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:16.220512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2058059338", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "244e5299-2548-4d18-a2f1-a0217c81a10f"}], "security_groups": [{"name": "tempest-securitygroup--1361606759"}], "key_name": "tempest-keypair-470910660", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:16.422942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] validate_networks() for [('244e5299-2548-4d18-a2f1-a0217c81a10f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:13:17.523184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Getting quotas for project 36b769c0f7c949e6a9bcf2da47c4ba88. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:13:17.531749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Getting quotas for user bacf4d04c2754298bb4be5f2cea021e6 and project 36b769c0f7c949e6a9bcf2da47c4ba88. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:13:17.552609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:13:17.552609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:13:17.561924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:13:17.562637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:13:17.564371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:13:17.586351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:17.587135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:17.588380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:17.589508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:17.590212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:17.590913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:17.613260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Getting quotas for project 36b769c0f7c949e6a9bcf2da47c4ba88. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:13:17.618547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Getting quotas for user bacf4d04c2754298bb4be5f2cea021e6 and project 36b769c0f7c949e6a9bcf2da47c4ba88. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:13:17.634063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:13:17.637033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:13:17.756589 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68a2569e-f104-4cab-8552-3409c897f0fb tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.549389 Oct 04 11:13:17.757565 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1815/3049] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:13:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:13:17.768746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:17.769495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:17.783566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:17.784073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:17.786166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:17.786915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:17.787389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:17.787829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:17.984590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:17.997490 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2bd9c546-6991-4523-993f-62313e522a26 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1502 microversion: 2.1 time: 0.238672 Oct 04 11:13:18.020570 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1816/3050] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:17 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:18.031855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:18.032493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:18.045395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.049518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.049999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.051920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.052439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.052890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.388363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:18.397570 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d137b198-ec86-4998-8d6b-c74b7884a317 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.375768 Oct 04 11:13:18.398170 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1817/3051] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:18 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:18.410908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:18.411537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:18.428544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.429050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.429537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.434158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.434671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.435123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.659370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:18.667973 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b08a27e2-3c7d-43b7-8059-a22e22988298 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1573 microversion: 2.1 time: 0.268564 Oct 04 11:13:18.668796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1818/3052] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:18 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1573 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:18.674713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-02c0f7b5-3bb4-49cd-9fb6-e467982cf873 req-a11764b1-85df-43f6-9c35-d67bfd4d3e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ff9d7b-1e62-40ff-8770-36c69d67eea7", "name": "network-vif-deleted", "tag": "7c9aa385-a4b9-411e-b82e-34115af1bfae"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:18.689149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02c0f7b5-3bb4-49cd-9fb6-e467982cf873 req-a11764b1-85df-43f6-9c35-d67bfd4d3e85 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.690128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02c0f7b5-3bb4-49cd-9fb6-e467982cf873 req-a11764b1-85df-43f6-9c35-d67bfd4d3e85 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.690742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02c0f7b5-3bb4-49cd-9fb6-e467982cf873 req-a11764b1-85df-43f6-9c35-d67bfd4d3e85 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.703313 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-02c0f7b5-3bb4-49cd-9fb6-e467982cf873 req-a11764b1-85df-43f6-9c35-d67bfd4d3e85 service nova] Creating event network-vif-deleted:7c9aa385-a4b9-411e-b82e-34115af1bfae for instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 on n-h1-791135-8 Oct 04 11:13:18.713381 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-02c0f7b5-3bb4-49cd-9fb6-e467982cf873 req-a11764b1-85df-43f6-9c35-d67bfd4d3e85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042740 Oct 04 11:13:18.714666 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1819/3053] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:18.733394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:18.733394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:18.747135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.747831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.748284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.749065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.749981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.750431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.793662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.794414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.795039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.795668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lazy-loading 'fault' on Instance uuid 69ff9d7b-1e62-40ff-8770-36c69d67eea7 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:18.840935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:18.850328 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-695f96c4-6344-4187-a139-1c88022ae315 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 200 len: 1298 microversion: 2.1 time: 0.134287 Oct 04 11:13:18.851239 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1820/3054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:18 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:18.870790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:18.871447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:18.881127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.881684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.882691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.883433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:18.884408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:18.884408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:18.975983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:18.986427 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-acd888b3-1a64-4b9a-8806-e43add18ab4e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1281 microversion: 2.1 time: 0.132610 Oct 04 11:13:18.987213 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1821/3055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:18 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:18.991972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:18.992526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:18.999411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:19.000185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:19.000885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:19.001859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:19.002518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:19.003143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:19.026033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:19.037070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:13:19.148460 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5264452a-4f83-4153-b255-27efe7e70f29 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 204 len: 0 microversion: 2.1 time: 0.160030 Oct 04 11:13:19.149558 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1822/3056] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:18 2022] DELETE /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:13:19.156814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1619738805"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:19.157575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:19.164475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:19.164983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:19.165458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:19.166157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:19.166605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:19.167045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:19.448483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.security_group_api [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Adding security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 to port db183020-3596-479f-b435-687288d38daa Oct 04 11:13:20.348226 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-90960f59-fec3-4aaf-a74a-3e67a086eefb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f/action" status: 202 len: 0 microversion: 2.1 time: 1.196671 Oct 04 11:13:20.353677 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1823/3057] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:13:19 2022] POST /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f/action => generated 0 bytes in 1203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:20.366418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:20.367784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:20.386397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:20.387275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:20.390560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:20.392796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:20.394039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:20.394722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:20.579211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:20.590921 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ad4db04-bf3b-4415-b1e6-427a969aa4d4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1508 microversion: 2.1 time: 0.235023 Oct 04 11:13:20.608932 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1824/3058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:20 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:20.615779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:20.617110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:20.625054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:20.625941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:20.626860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:20.627675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:20.628310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:20.628753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:20.793431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:20.802128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbe5be6f-df0a-4ff0-a6cc-d4e180624bb1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.191428 Oct 04 11:13:20.806122 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1825/3059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:20 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:20.808430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:20.808430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:20.816248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:20.817499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:20.817499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:20.817922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:20.818379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:20.818806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:20.836033 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 HTTP/1.1 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '69ff9d7b-1e62-40ff-8770-36c69d67eea7'} Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:20.838691 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b28622b9-5dae-49c8-b6e3-62e87180edd7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 404 len: 111 microversion: 2.1 time: 0.036323 Oct 04 11:13:20.843848 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1826/3060] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:20 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:20.846591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:20.847398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:20.858891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:20.860072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:20.860072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:20.864570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:20.865076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:20.866143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:20.975466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:20.984491 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-246627fb-daa0-49f3-a421-810c6963125f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1273 microversion: 2.1 time: 0.141692 Oct 04 11:13:20.989605 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1827/3061] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:20 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:20.997555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f90c4bce-b551-4d2a-8b3c-6ad9854b0922 req-52726ac3-c18f-414b-9efa-add1d629afc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bab5240-2dd7-4943-8eb0-234b8021371f", "tag": "db183020-3596-479f-b435-687288d38daa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:21.008751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f90c4bce-b551-4d2a-8b3c-6ad9854b0922 req-52726ac3-c18f-414b-9efa-add1d629afc5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.009314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f90c4bce-b551-4d2a-8b3c-6ad9854b0922 req-52726ac3-c18f-414b-9efa-add1d629afc5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.011956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f90c4bce-b551-4d2a-8b3c-6ad9854b0922 req-52726ac3-c18f-414b-9efa-add1d629afc5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.038037 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f90c4bce-b551-4d2a-8b3c-6ad9854b0922 req-52726ac3-c18f-414b-9efa-add1d629afc5 service nova] Creating event network-changed:db183020-3596-479f-b435-687288d38daa for instance 1bab5240-2dd7-4943-8eb0-234b8021371f on n-h1-791135-8 Oct 04 11:13:21.047616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f90c4bce-b551-4d2a-8b3c-6ad9854b0922 req-52726ac3-c18f-414b-9efa-add1d629afc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056733 Oct 04 11:13:21.048526 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1828/3062] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:21.054609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2c6da237-4657-4816-9c13-3cf2a8d9a5fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d4502550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:21.167007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-2c6da237-4657-4816-9c13-3cf2a8d9a5fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4db34b40-3ec2-46eb-b4ac-109b07b16872 in use.", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:13:21.167885 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-2c6da237-4657-4816-9c13-3cf2a8d9a5fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security Group 4db34b40-3ec2-46eb-b4ac-109b07b16872 in use. Oct 04 11:13:21.167885 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-1304bca0-8a2d-41d7-a531-01bbd0e19164'] Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2c6da237-4657-4816-9c13-3cf2a8d9a5fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/4db34b40-3ec2-46eb-b4ac-109b07b16872 HTTP/1.1 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: exception: Security Group 4db34b40-3ec2-46eb-b4ac-109b07b16872 in use. Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-1304bca0-8a2d-41d7-a531-01bbd0e19164'] Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '4db34b40-3ec2-46eb-b4ac-109b07b16872'} Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:13:21.169944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4db34b40-3ec2-46eb-b4ac-109b07b16872 in use. Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1304bca0-8a2d-41d7-a531-01bbd0e19164'] Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4db34b40-3ec2-46eb-b4ac-109b07b16872 in use. Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1304bca0-8a2d-41d7-a531-01bbd0e19164'] Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4db34b40-3ec2-46eb-b4ac-109b07b16872 in use. Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1304bca0-8a2d-41d7-a531-01bbd0e19164'] Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4db34b40-3ec2-46eb-b4ac-109b07b16872 in use. Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1304bca0-8a2d-41d7-a531-01bbd0e19164'] Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2c6da237-4657-4816-9c13-3cf2a8d9a5fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 400 to user: Security Group 4db34b40-3ec2-46eb-b4ac-109b07b16872 in use. Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-1304bca0-8a2d-41d7-a531-01bbd0e19164'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2c6da237-4657-4816-9c13-3cf2a8d9a5fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4db34b40-3ec2-46eb-b4ac-109b07b16872" status: 400 len: 185 microversion: 2.1 time: 0.121797 Oct 04 11:13:21.174006 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1829/3063] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:21 2022] DELETE /compute/v2.1/os-security-groups/4db34b40-3ec2-46eb-b4ac-109b07b16872 => generated 185 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:13:21.181639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:21.182626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:21.190250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.190758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.191184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.191878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.192326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.192900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.222905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:13:21.314241 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2dac528-fe17-4486-8c37-6ac99c0573ab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 204 len: 0 microversion: 2.1 time: 0.140821 Oct 04 11:13:21.315074 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1830/3064] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:21 2022] DELETE /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:13:21.320799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:21.321595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:21.328801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.329386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.330107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.330828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.331379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.331818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.360723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:13:21.440739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:21.456766 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-583953e2-50a3-4b72-afc7-2a5b6bf399fb tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 204 len: 0 microversion: 2.1 time: 0.139961 Oct 04 11:13:21.460417 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1831/3065] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:21 2022] DELETE /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:13:21.465837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:21.466694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:21.473913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.474462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.474981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.475588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.476051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.476508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.686496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:21.695108 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d2c34ee-915d-4434-bcf8-69ab0ec572ef tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1495 microversion: 2.1 time: 0.233355 Oct 04 11:13:21.696109 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1832/3066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:21 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1495 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:21.700622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:21.701300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:21.708135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.708629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.709068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.709804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.710263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.710698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.895158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:21.902271 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ee7f402-b734-4465-bb4e-a0305a7b2239 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1648 microversion: 2.1 time: 0.205090 Oct 04 11:13:21.921029 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1833/3067] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:21 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1648 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:21.926942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:21.927579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:21.934172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.934731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.935233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:21.936015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:21.936579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:21.938487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:22.102490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:22.113087 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-432e8ff0-ae7b-484e-bafb-e1a9008206cc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1508 microversion: 2.1 time: 0.190840 Oct 04 11:13:22.113708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1834/3068] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:21 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:22.118350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:22.118945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:22.131853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:22.132595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:22.133079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:22.133822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:22.134679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:22.135106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:22.289011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:22.298654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e200153a-a56c-4460-9414-23d5687f8b20 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.183795 Oct 04 11:13:22.299612 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1835/3069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:22 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:22.304316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:22.304993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:22.312154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:22.312737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:22.313243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:22.314115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:22.314731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:22.315232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:22.385992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:22.394057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:22.396535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63bd0323-46b7-4ab3-a937-be2a5554f2ec tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1273 microversion: 2.1 time: 0.095922 Oct 04 11:13:22.406790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1836/3070] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:22 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:22.725590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:22.726217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:22.733858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:22.734361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:22.734836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:22.735666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:22.736130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:22.736571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:22.890247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:22.899424 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a0d3033-0d22-4978-9b32-47cf41f8afbe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1495 microversion: 2.1 time: 0.179163 Oct 04 11:13:22.900262 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1837/3071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:22 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1495 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:22.929704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:22.930328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:22.936505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:22.936996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:22.937536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:22.939711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:22.939711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:22.939711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:23.113187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:23.121630 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac7d3bae-aacd-430b-b48a-510633a72e11 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1648 microversion: 2.1 time: 0.196267 Oct 04 11:13:23.122383 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1838/3072] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:22 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1648 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:23.143574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:23.144202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:23.150759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:23.151532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:23.152259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:23.153424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:23.154111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:23.154791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:23.315152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:23.326143 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7a7ed55-b810-42ff-b10e-10536e1f49c5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1508 microversion: 2.1 time: 0.187160 Oct 04 11:13:23.327556 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1839/3073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:23 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:23.332191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:23.332793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:23.338989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:23.339478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:23.339909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:23.340593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:23.341039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:23.341506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:23.485557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:23.493776 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92e44dc7-1a6d-44d3-918f-0b06eee26db8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.164960 Oct 04 11:13:23.494361 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1840/3074] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:23 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:23.501077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:23.501077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:23.513924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:23.514462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:23.514902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:23.515610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:23.516202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:23.516638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:23.581768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:23.590532 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a79bd2c-212f-441a-8ce5-c8ae8614b98b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1273 microversion: 2.1 time: 0.095046 Oct 04 11:13:23.591281 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1841/3075] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:23 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:23.925675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:23.926287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:23.933497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:23.933979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:23.934411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:23.935100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:23.935552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:23.935972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.094958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:24.107542 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0825ab5c-2e15-42ed-ae20-ee347d49ecb8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1495 microversion: 2.1 time: 0.185834 Oct 04 11:13:24.108942 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1842/3076] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:23 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1495 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:24.160976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:24.161529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:24.167895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:24.168620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:24.169249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.170007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:24.171228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:24.171567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.385526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:24.396092 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8dc0a946-2667-4e8c-93d4-b202fa9beb3a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1648 microversion: 2.1 time: 0.239081 Oct 04 11:13:24.396984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1843/3077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:24 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1648 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:24.401843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:24.402440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:24.409023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:24.409635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:24.410076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.410761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:24.411283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:24.411759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.574237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:24.582164 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a88c047-1fe7-4e1b-9a83-1b6dfb01a0bf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1508 microversion: 2.1 time: 0.183977 Oct 04 11:13:24.583009 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1844/3078] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:24 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:24.588152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:24.588758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:24.597549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:24.598126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:24.598591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.599294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:24.599756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:24.600190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.757848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:24.767559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7350bad2-7103-43f4-a082-b74b1826d308 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.183190 Oct 04 11:13:24.768582 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1845/3079] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:24 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:24.773669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:24.774275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:24.780980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:24.781499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:24.781933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.782618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:24.783074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:24.783493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:24.859322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:24.869991 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9496963e-48ee-4744-bbbf-305a5c20531f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1273 microversion: 2.1 time: 0.099987 Oct 04 11:13:24.870590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1846/3080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:24 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:25.131308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:25.131915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:25.138957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:25.140087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:25.140523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:25.141223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:25.141703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:25.142129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:25.391040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:25.406471 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c66ea1b-d90b-4dd4-97dc-aa14fcee2ab7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1495 microversion: 2.1 time: 0.278826 Oct 04 11:13:25.407065 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1847/3081] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:25 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1495 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:25.420345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:25.420985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:25.432670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:25.432670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:25.432670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:25.438539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:25.439366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:25.440146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:25.869886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:25.883887 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5afb21f-c85c-4e5a-8fc8-7de7bf70e035 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1648 microversion: 2.1 time: 0.466739 Oct 04 11:13:25.903538 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1848/3082] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:25 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1648 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:25.909039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:25.909727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:25.924608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:25.925114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:25.925587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:25.926305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:25.926769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:25.927203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:26.252785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:26.266554 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5da5771-e9b8-4aaf-a723-35092c6bf305 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1508 microversion: 2.1 time: 0.359661 Oct 04 11:13:26.269195 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1849/3083] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:25 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:26.307358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:26.309499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:26.321558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:26.322062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:26.324637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:26.326234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:26.327438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:26.328008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:26.770328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:26.785069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93bc6d0e-d80a-459d-98dc-ddc3eb844d3d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.509380 Oct 04 11:13:26.789743 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1850/3084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:26 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:26.799717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:26.800552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:26.823603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:26.841951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:26.844719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:26.845696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:26.846345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:26.846963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.012421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:27.025072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-faec7eca-c339-4d03-94e3-76f104aea0ea tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1329 microversion: 2.1 time: 0.234239 Oct 04 11:13:27.026914 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1851/3085] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:26 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1329 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:27.033961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6409450a-e766-4c46-a93e-6d090af1279a req-6a5373bd-cff2-41de-9ec2-865190b92ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7425e6f-ad86-45e6-87ca-80082bfa0e04", "name": "network-vif-deleted", "tag": "547702c1-3c13-4ecb-954d-4515d0c6e0b0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:27.044420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6409450a-e766-4c46-a93e-6d090af1279a req-6a5373bd-cff2-41de-9ec2-865190b92ceb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.044898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6409450a-e766-4c46-a93e-6d090af1279a req-6a5373bd-cff2-41de-9ec2-865190b92ceb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.045608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6409450a-e766-4c46-a93e-6d090af1279a req-6a5373bd-cff2-41de-9ec2-865190b92ceb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.474301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6409450a-e766-4c46-a93e-6d090af1279a req-6a5373bd-cff2-41de-9ec2-865190b92ceb service nova] Creating event network-vif-deleted:547702c1-3c13-4ecb-954d-4515d0c6e0b0 for instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 on n-h1-791135-8 Oct 04 11:13:27.480764 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6409450a-e766-4c46-a93e-6d090af1279a req-6a5373bd-cff2-41de-9ec2-865190b92ceb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.452185 Oct 04 11:13:27.482304 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1852/3086] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:27.489636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:27.490696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:27.497177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.498039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.499816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.500872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.501587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.502179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.540642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.541308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.541921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.542533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lazy-loading 'fault' on Instance uuid b7425e6f-ad86-45e6-87ca-80082bfa0e04 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:27.603503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=22 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:27.617568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:27.621049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:27.631079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=22 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:27.635243 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f9c0c051-c0b2-42e5-a018-3f02b0fcc99e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1298 microversion: 2.1 time: 0.151434 Oct 04 11:13:27.656621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1853/3087] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:27 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:27.662623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:27.663245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:27.684621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.685128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.685603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.686856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.687322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.687766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.739987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.740482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.741233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.741722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lazy-loading 'fault' on Instance uuid 1bab5240-2dd7-4943-8eb0-234b8021371f {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:27.828550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:27.839908 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c3a6d3c-7f10-4cda-baaf-9802c14be013 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1305 microversion: 2.1 time: 0.179355 Oct 04 11:13:27.840540 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1854/3088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:27 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1305 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:27.853495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:27.854156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:27.866849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.867345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.867780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.868480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.868933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.869385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.929108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:27.929738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:27.930260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:27.930796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lazy-loading 'fault' on Instance uuid 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:28.041480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:28.080290 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6232a59-b121-4137-85e9-1f6bf3f788d9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1305 microversion: 2.1 time: 0.238554 Oct 04 11:13:28.081958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1855/3089] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:27 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1305 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:28.088756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c70380a7-136e-45e3-a888-246901559260 req-5e0c4206-7972-458f-ad70-0f0308d0ba15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bab5240-2dd7-4943-8eb0-234b8021371f", "name": "network-vif-deleted", "tag": "db183020-3596-479f-b435-687288d38daa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:28.110894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c70380a7-136e-45e3-a888-246901559260 req-5e0c4206-7972-458f-ad70-0f0308d0ba15 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.110894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c70380a7-136e-45e3-a888-246901559260 req-5e0c4206-7972-458f-ad70-0f0308d0ba15 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.110894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c70380a7-136e-45e3-a888-246901559260 req-5e0c4206-7972-458f-ad70-0f0308d0ba15 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.118967 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c70380a7-136e-45e3-a888-246901559260 req-5e0c4206-7972-458f-ad70-0f0308d0ba15 service nova] Creating event network-vif-deleted:db183020-3596-479f-b435-687288d38daa for instance 1bab5240-2dd7-4943-8eb0-234b8021371f on n-h1-791135-8 Oct 04 11:13:28.124990 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c70380a7-136e-45e3-a888-246901559260 req-5e0c4206-7972-458f-ad70-0f0308d0ba15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039730 Oct 04 11:13:28.125936 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1856/3090] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:28.131318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:28.132047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:28.138290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.138772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.139489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.139921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.140507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.140794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.433005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:28.443656 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2993a65b-732d-4f75-8a12-bbca1d3877ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.316510 Oct 04 11:13:28.458239 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1857/3091] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:28 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:28.468353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:28.469270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:28.476199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.476971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.477648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.478568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.479204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.479807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.561772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:28.572184 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fe2ff9a-144b-4daa-b6e9-07f4b94f8362 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1335 microversion: 2.1 time: 0.108730 Oct 04 11:13:28.574735 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1858/3092] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:28 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1335 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:28.664210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:28.664837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:28.677289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.677834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.678288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.679018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.679483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.679919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.758275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.758766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.759236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.759695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lazy-loading 'fault' on Instance uuid b7425e6f-ad86-45e6-87ca-80082bfa0e04 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:28.830631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:28.845987 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-44a99222-6617-4c46-9515-80a9c5249cd2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 200 len: 1298 microversion: 2.1 time: 0.185317 Oct 04 11:13:28.849615 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1859/3093] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:28 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 1298 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:28.868439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:28.869277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:28.877399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.878114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.878727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.879608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.880353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.880943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.952414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:28.953341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:28.953875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:28.954642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lazy-loading 'fault' on Instance uuid 1bab5240-2dd7-4943-8eb0-234b8021371f {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:29.015947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:29.026615 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e8ab6b4-54a7-4fda-9ab6-e35588164c4f tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1305 microversion: 2.1 time: 0.161921 Oct 04 11:13:29.027520 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1860/3094] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:28 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1305 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:29.121449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:29.122081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:29.129315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:29.129839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:29.130281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:29.130982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:29.131441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:29.131871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:29.169377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:29.169825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:29.170967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:29.171363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lazy-loading 'fault' on Instance uuid 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:29.243050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:29.252056 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9bc7bda-f0b8-48be-a073-327d362f4ca4 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 200 len: 1305 microversion: 2.1 time: 0.137497 Oct 04 11:13:29.252644 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1861/3095] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:29 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:29.414416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:29.415032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:29.422191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:29.422842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:29.423346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:29.424054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:29.424511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:29.425508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:29.661600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:29.669196 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b69d55bc-671f-4f69-ab11-e97b5b049e09 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.258712 Oct 04 11:13:29.669793 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1862/3096] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:29 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:29.674842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:29.675546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:29.681414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:29.681912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:29.682344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:29.683321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:29.683978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:29.684604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:29.940422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:29.948280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-226725ad-91fd-473c-8041-f2b928a6232a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.277416 Oct 04 11:13:29.948861 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1863/3097] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:29 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:29.956663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-db0645c7-693d-45be-876f-243452258620 req-eae306ff-cf99-4439-a2c0-e8d8ac0730c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf", "name": "network-vif-deleted", "tag": "daf0f99a-d41b-4236-a35d-ef2019b29267"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:29.978310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db0645c7-693d-45be-876f-243452258620 req-eae306ff-cf99-4439-a2c0-e8d8ac0730c6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:29.978802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db0645c7-693d-45be-876f-243452258620 req-eae306ff-cf99-4439-a2c0-e8d8ac0730c6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:29.979242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db0645c7-693d-45be-876f-243452258620 req-eae306ff-cf99-4439-a2c0-e8d8ac0730c6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.005315 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-db0645c7-693d-45be-876f-243452258620 req-eae306ff-cf99-4439-a2c0-e8d8ac0730c6 service nova] Creating event network-vif-deleted:daf0f99a-d41b-4236-a35d-ef2019b29267 for instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf on n-h1-791135-8 Oct 04 11:13:30.011111 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-db0645c7-693d-45be-876f-243452258620 req-eae306ff-cf99-4439-a2c0-e8d8ac0730c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057664 Oct 04 11:13:30.011724 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1864/3098] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:30.019611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:30.020519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:30.027864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.028359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.028996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.031096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.031565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.032284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.251753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:30.262533 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa1889bc-9827-4023-9eef-e0f2d2bca2fa tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1403 microversion: 2.1 time: 0.248509 Oct 04 11:13:30.274356 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1865/3099] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:30 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1403 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:30.282470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:30.283111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:30.290581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.291421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.292027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.292931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.293484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.293861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.310118 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 HTTP/1.1 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b7425e6f-ad86-45e6-87ca-80082bfa0e04'} Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.312021 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e68b3bb3-388e-4405-b15a-a7dbd0f06b61 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 404 len: 111 microversion: 2.1 time: 0.037996 Oct 04 11:13:30.316187 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1866/3100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:30 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:30.318410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:30.319075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:30.325666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.326161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.327161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.328083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.328537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.328962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.363305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.363800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.364246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.364771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lazy-loading 'fault' on Instance uuid 1bab5240-2dd7-4943-8eb0-234b8021371f {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:30.406870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:30.414802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eaec8c6c-fe27-46e5-a1fe-f412361de560 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 200 len: 1305 microversion: 2.1 time: 0.099830 Oct 04 11:13:30.415309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1867/3101] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:30 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:30.427753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:30.428368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:30.434488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.434963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.435421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.436632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.437089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.437549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.452368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf HTTP/1.1 Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf'} Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:30.453918 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-123f60dc-c162-4d57-a54c-e9b98d40c4dc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 404 len: 111 microversion: 2.1 time: 0.039027 Oct 04 11:13:30.458381 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1868/3102] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:30 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:30.460195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3d2be591-11f1-42ca-bd65-55da1d88f4a0 req-bafe3ee5-de4d-4cda-b096-8feba962c557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2627725-9355-4894-963d-4941f7f08f2e", "tag": "a2aba20c-ac9d-4aed-bb36-8403c61bf3f1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:30.469629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d2be591-11f1-42ca-bd65-55da1d88f4a0 req-bafe3ee5-de4d-4cda-b096-8feba962c557 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:30.470437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d2be591-11f1-42ca-bd65-55da1d88f4a0 req-bafe3ee5-de4d-4cda-b096-8feba962c557 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:30.470537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d2be591-11f1-42ca-bd65-55da1d88f4a0 req-bafe3ee5-de4d-4cda-b096-8feba962c557 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:30.481841 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3d2be591-11f1-42ca-bd65-55da1d88f4a0 req-bafe3ee5-de4d-4cda-b096-8feba962c557 service nova] Creating event network-changed:a2aba20c-ac9d-4aed-bb36-8403c61bf3f1 for instance f2627725-9355-4894-963d-4941f7f08f2e on n-h1-791135-8 Oct 04 11:13:30.486524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3d2be591-11f1-42ca-bd65-55da1d88f4a0 req-bafe3ee5-de4d-4cda-b096-8feba962c557 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029544 Oct 04 11:13:30.487101 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1869/3103] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:30.492100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1701626923", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "999d214d-a128-4728-9cd3-99390decb15f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:30.546252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] validate_networks() for [('999d214d-a128-4728-9cd3-99390decb15f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:13:31.475387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:13:31.475914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:13:31.476281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:13:31.476692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:13:31.477103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:13:31.488259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:31.488757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:31.489317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:31.490091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:31.490559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:31.491029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:31.504166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:31.511736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:13:31.515923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:13:31.527174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:13:31.529603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:13:31.575145 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28910ccb-397d-4ea0-b8b4-10d434cfc437 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.086876 Oct 04 11:13:31.575794 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1870/3104] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:13:31.580350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1590115021", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "49989f52-07b9-48bb-b42a-1e9bb7c15958"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:31.634475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] validate_networks() for [('49989f52-07b9-48bb-b42a-1e9bb7c15958', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:13:32.007617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:13:32.008040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:13:32.008542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:13:32.008945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:13:32.009412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:13:32.018034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.018516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.018945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.019656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.020106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.020531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.038180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:13:32.041985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for user 510d473de29b4d7d8bb303f64f1e17d4 and project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:13:32.053149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:13:32.055281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:13:32.098394 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dde95b9e-fbe8-48fc-9bc9-e335011e901a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521515 Oct 04 11:13:32.099029 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1871/3105] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:13:32.103553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:32.104159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:32.111275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.111763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.112205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.112892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.113342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.113791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.244828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:32.253076 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c2438b1b-a4e7-4c94-a926-70de4f2d7453 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.153002 Oct 04 11:13:32.253577 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1872/3106] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:32 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:32.258109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:32.258775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:32.266574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.267071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.267653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.268402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.268868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.269297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.273762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:32.409166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:32.418099 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-20e4c440-38b1-47c0-90a3-fe450dc94eaa tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.163540 Oct 04 11:13:32.418672 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1873/3107] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:32 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:32.423365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:32.423966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:32.429770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.430258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.430698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.431391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.431848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.432278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.565906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:32.573654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbb0303a-463c-4f1a-af11-503ba0d052d4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1403 microversion: 2.1 time: 0.153754 Oct 04 11:13:32.574217 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1874/3108] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:32 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:32.579177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:32.579848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:32.585324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.585837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.586272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.586971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.587415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.587847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.601668 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f HTTP/1.1 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1bab5240-2dd7-4943-8eb0-234b8021371f'} Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:32.603248 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c36ea4d-df9f-4946-b253-ecd2a0a1e448 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 404 len: 111 microversion: 2.1 time: 0.029487 Oct 04 11:13:32.607700 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1875/3109] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:32 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:32.609877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:32.610472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:32.616301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.616816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.617253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.617961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.618416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.618842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.681978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:32.690091 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc650526-1fcf-4072-8216-17285af8fc0d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1213 microversion: 2.1 time: 0.083741 Oct 04 11:13:32.690664 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1876/3110] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:32 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:32.696181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:32.696833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:32.703348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.703991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.704274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.705003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.705856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.705999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.771386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:32.779162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8cdf4739-f7da-484e-80ed-ce30f0ce0415 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1219 microversion: 2.1 time: 0.086677 Oct 04 11:13:32.779779 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1877/3111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:32 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:32.784377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-911216328"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:32.786898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:32.792956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.793297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.793846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:32.794549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:32.795012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:32.795545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:33.036612 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7353096e-264c-4d7a-bcd4-8af6ab501bbb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.255560 Oct 04 11:13:33.037590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1878/3112] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:13:32 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 11:13:33.043021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc53d83f-7765-4465-85b2-d4fb68f93185 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d48e5430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:33.337847 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc53d83f-7765-4465-85b2-d4fb68f93185 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/60e83c9e-ceaf-4d6a-99dd-91299387490f" status: 202 len: 0 microversion: 2.1 time: 0.298682 Oct 04 11:13:33.342029 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1879/3113] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:33 2022] DELETE /compute/v2.1/os-security-groups/60e83c9e-ceaf-4d6a-99dd-91299387490f => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:33.344416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-79023478-88c1-4e69-951f-6c4840521704 req-0a601a22-6a14-41c6-97de-e6c623f89c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "name": "network-vif-unplugged", "status": "completed", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:33.354433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-79023478-88c1-4e69-951f-6c4840521704 req-0a601a22-6a14-41c6-97de-e6c623f89c14 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:33.354985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-79023478-88c1-4e69-951f-6c4840521704 req-0a601a22-6a14-41c6-97de-e6c623f89c14 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:33.355363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-79023478-88c1-4e69-951f-6c4840521704 req-0a601a22-6a14-41c6-97de-e6c623f89c14 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:33.370098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-79023478-88c1-4e69-951f-6c4840521704 req-0a601a22-6a14-41c6-97de-e6c623f89c14 service nova] Creating event network-vif-unplugged:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:13:33.376899 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-79023478-88c1-4e69-951f-6c4840521704 req-0a601a22-6a14-41c6-97de-e6c623f89c14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036197 Oct 04 11:13:33.377799 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1880/3114] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:33.383383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f3642db-9d73-440f-bd9d-c1f4a1fa32b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d43b10d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:33.709159 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f3642db-9d73-440f-bd9d-c1f4a1fa32b3 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4db34b40-3ec2-46eb-b4ac-109b07b16872" status: 202 len: 0 microversion: 2.1 time: 0.328082 Oct 04 11:13:33.710197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1881/3115] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:33 2022] DELETE /compute/v2.1/os-security-groups/4db34b40-3ec2-46eb-b4ac-109b07b16872 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:33.717761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:33.717761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:33.731200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:33.731753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:33.732198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:33.733527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:33.733987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:33.734416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:33.864040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:33.871712 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9ccd3e9-5a77-4b77-afc1-4262698e79a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.160459 Oct 04 11:13:33.872278 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1882/3116] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:33 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:33.877009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:33.877710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:33.883357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:33.883840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:33.884274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:33.884961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:33.885449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:33.885879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:34.017890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:34.026007 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7086b4a-8654-43b6-a162-3ec125b0742d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1403 microversion: 2.1 time: 0.152766 Oct 04 11:13:34.026584 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1883/3117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:33 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:34.031884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:34.032479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:34.038038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:34.038521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:34.038954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:34.039634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:34.040083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:34.040510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:34.101718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:34.110931 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d0f3da2-e180-4677-ac0d-63ce61a22c58 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1261 microversion: 2.1 time: 0.083358 Oct 04 11:13:34.111611 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1884/3118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:34 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:34.116313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1be86354-3846-41a2-b7f5-41aaa3c4316a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'create', calling method: .version_select at 0x7f71cf6f7040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-437916341", "description": "tempest-description-1419364494"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:34.351328 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1be86354-3846-41a2-b7f5-41aaa3c4316a tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.237924 Oct 04 11:13:34.356794 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1885/3119] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:13:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:34.360696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:34.361457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:34.368787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:34.369345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:34.369891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:34.370684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:34.371208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:34.371703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:34.441022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:34.448801 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-33dea5ea-ff23-46fa-adab-89bf76590e6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1267 microversion: 2.1 time: 0.094552 Oct 04 11:13:34.449559 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1886/3120] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:34 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:34.457328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc5acc84-c751-416f-9d18-2975b18eb509 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Action: 'update', calling method: .version_select at 0x7f71cf69fe50>, body: {"security_group": {"name": "tempest-sg-hth-1103330772", "description": "tempest-description-hth-1720976689"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:34.722677 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc5acc84-c751-416f-9d18-2975b18eb509 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/2656c8bc-c5bb-437f-9de4-fa20321a0bfc" status: 200 len: 218 microversion: 2.1 time: 0.271885 Oct 04 11:13:34.731128 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1887/3121] 10.222.0.23 () {60 vars in 1290 bytes} [Tue Oct 4 11:13:34 2022] PUT /compute/v2.1/os-security-groups/2656c8bc-c5bb-437f-9de4-fa20321a0bfc => generated 218 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:34.740186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f31c563f-5f14-4263-8b1d-de19a7b7047e tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71cf6f7ca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:34.862716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f31c563f-5f14-4263-8b1d-de19a7b7047e tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/2656c8bc-c5bb-437f-9de4-fa20321a0bfc" status: 200 len: 218 microversion: 2.1 time: 0.127649 Oct 04 11:13:34.872227 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1888/3122] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:13:34 2022] GET /compute/v2.1/os-security-groups/2656c8bc-c5bb-437f-9de4-fa20321a0bfc => generated 218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:13:34.878217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1ace019-95db-4cf2-a0c3-47a207f4b43b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d43b15e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:35.197195 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1ace019-95db-4cf2-a0c3-47a207f4b43b tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/2656c8bc-c5bb-437f-9de4-fa20321a0bfc" status: 202 len: 0 microversion: 2.1 time: 0.323513 Oct 04 11:13:35.198335 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1889/3123] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:34 2022] DELETE /compute/v2.1/os-security-groups/2656c8bc-c5bb-437f-9de4-fa20321a0bfc => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:35.205096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:35.205761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:35.215591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:35.216142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:35.216588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:35.217844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:35.218307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:35.218742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:35.530365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:35.545189 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f31681b8-1d48-4bc7-b1f9-d910199735e1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1522 microversion: 2.1 time: 0.345528 Oct 04 11:13:35.545940 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1890/3124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:35 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:35.553090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:35.553714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:35.562136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:35.562660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:35.563106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:35.563955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:35.564268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:35.564697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:35.851193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:35.859583 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e77e61c3-5fa8-46a9-8e09-bdf4b3c587ff tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1403 microversion: 2.1 time: 0.312272 Oct 04 11:13:35.860091 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1891/3125] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:35 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1403 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:35.864541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:35.865314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:35.871055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:35.871671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:35.872033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:35.873678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:35.873831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:35.874262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.222718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:36.230358 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a51db4d-bcbc-41c6-bcc6-d316943b22fe tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1309 microversion: 2.1 time: 0.369288 Oct 04 11:13:36.230937 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1892/3126] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:35 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:36.236236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:36.236937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:36.242963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:36.243451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:36.243889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.244582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:36.245037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:36.245491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.260524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f HTTP/1.1 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1bab5240-2dd7-4943-8eb0-234b8021371f'} Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:13:36.262243 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8bd3d5f-8378-4db0-a73a-2859dc750b53 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 404 len: 111 microversion: 2.1 time: 0.031551 Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1893/3127] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:36 2022] DELETE /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:36.269944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:36.276296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:36.276792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:36.277233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.277986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:36.278452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:36.278904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.375103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:36.383076 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8fdeaace-d639-45f6-a592-5d2a661c4033 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1273 microversion: 2.1 time: 0.117911 Oct 04 11:13:36.383659 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1894/3128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:36 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:36.399105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:36.399105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: 1bab5240-2dd7-4943-8eb0-234b8021371f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:36.399105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:36.399105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:36.399105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.399105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:36.399105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:36.399105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.412089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f HTTP/1.1 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1bab5240-2dd7-4943-8eb0-234b8021371f'} Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.413671 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Instance 1bab5240-2dd7-4943-8eb0-234b8021371f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-26f1f952-4b11-46df-be5f-327aca1d3bff tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f" status: 404 len: 111 microversion: 2.1 time: 0.030483 Oct 04 11:13:36.419384 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1895/3129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:36 2022] GET /compute/v2.1/servers/1bab5240-2dd7-4943-8eb0-234b8021371f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:36.423996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4446290b-7fb9-4cec-8855-319e8eb81372 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d41f5f70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:36.460554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-4446290b-7fb9-4cec-8855-319e8eb81372 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:13:36.461166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-4446290b-7fb9-4cec-8855-319e8eb81372 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:13:36.461722 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4446290b-7fb9-4cec-8855-319e8eb81372 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 does not exist Oct 04 11:13:36.461722 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-880ce249-f2e9-42ab-bc37-53fb7c881d9f'] Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4446290b-7fb9-4cec-8855-319e8eb81372 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/4db34b40-3ec2-46eb-b4ac-109b07b16872 HTTP/1.1 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 does not exist Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-880ce249-f2e9-42ab-bc37-53fb7c881d9f'] Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '4db34b40-3ec2-46eb-b4ac-109b07b16872'} Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:13:36.463551 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 does not exist Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-880ce249-f2e9-42ab-bc37-53fb7c881d9f'] Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 does not exist Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-880ce249-f2e9-42ab-bc37-53fb7c881d9f'] Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 does not exist Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-880ce249-f2e9-42ab-bc37-53fb7c881d9f'] Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 does not exist Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-880ce249-f2e9-42ab-bc37-53fb7c881d9f'] Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4446290b-7fb9-4cec-8855-319e8eb81372 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group 4db34b40-3ec2-46eb-b4ac-109b07b16872 does not exist Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-880ce249-f2e9-42ab-bc37-53fb7c881d9f'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4446290b-7fb9-4cec-8855-319e8eb81372 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4db34b40-3ec2-46eb-b4ac-109b07b16872" status: 404 len: 194 microversion: 2.1 time: 0.045267 Oct 04 11:13:36.468005 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1896/3130] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:36 2022] DELETE /compute/v2.1/os-security-groups/4db34b40-3ec2-46eb-b4ac-109b07b16872 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:13:36.473861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63bd0e0e-2e5a-44c2-a8cd-afef067a7834 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d43b1af0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:36.543839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-63bd0e0e-2e5a-44c2-a8cd-afef067a7834 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60e83c9e-ceaf-4d6a-99dd-91299387490f does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:13:36.544458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-63bd0e0e-2e5a-44c2-a8cd-afef067a7834 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group 60e83c9e-ceaf-4d6a-99dd-91299387490f not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:13:36.545696 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-63bd0e0e-2e5a-44c2-a8cd-afef067a7834 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group 60e83c9e-ceaf-4d6a-99dd-91299387490f does not exist Oct 04 11:13:36.545696 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-5106b9af-ba1d-4c1b-bcea-e2b43a066d92'] Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63bd0e0e-2e5a-44c2-a8cd-afef067a7834 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/60e83c9e-ceaf-4d6a-99dd-91299387490f HTTP/1.1 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 60e83c9e-ceaf-4d6a-99dd-91299387490f does not exist Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-5106b9af-ba1d-4c1b-bcea-e2b43a066d92'] Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '60e83c9e-ceaf-4d6a-99dd-91299387490f'} Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:13:36.547563 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60e83c9e-ceaf-4d6a-99dd-91299387490f does not exist Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5106b9af-ba1d-4c1b-bcea-e2b43a066d92'] Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60e83c9e-ceaf-4d6a-99dd-91299387490f does not exist Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5106b9af-ba1d-4c1b-bcea-e2b43a066d92'] Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60e83c9e-ceaf-4d6a-99dd-91299387490f does not exist Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5106b9af-ba1d-4c1b-bcea-e2b43a066d92'] Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60e83c9e-ceaf-4d6a-99dd-91299387490f does not exist Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5106b9af-ba1d-4c1b-bcea-e2b43a066d92'] Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63bd0e0e-2e5a-44c2-a8cd-afef067a7834 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group 60e83c9e-ceaf-4d6a-99dd-91299387490f does not exist Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-5106b9af-ba1d-4c1b-bcea-e2b43a066d92'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63bd0e0e-2e5a-44c2-a8cd-afef067a7834 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/60e83c9e-ceaf-4d6a-99dd-91299387490f" status: 404 len: 194 microversion: 2.1 time: 0.079367 Oct 04 11:13:36.554781 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1897/3131] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:36 2022] DELETE /compute/v2.1/os-security-groups/60e83c9e-ceaf-4d6a-99dd-91299387490f => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:13:36.558097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9af5caac-df61-4713-b18b-613ee5100ab2 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d41dbee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:36.627770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-9af5caac-df61-4713-b18b-613ee5100ab2 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:13:36.628402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-9af5caac-df61-4713-b18b-613ee5100ab2 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group 83748a70-2723-4f62-b39f-4f8ad1368819 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:13:36.628950 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9af5caac-df61-4713-b18b-613ee5100ab2 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:13:36.628950 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-8bb55bfe-efc5-4313-9d89-7dfcf0016d78'] Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9af5caac-df61-4713-b18b-613ee5100ab2 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/83748a70-2723-4f62-b39f-4f8ad1368819 HTTP/1.1 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-8bb55bfe-efc5-4313-9d89-7dfcf0016d78'] Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '83748a70-2723-4f62-b39f-4f8ad1368819'} Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:13:36.630844 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bb55bfe-efc5-4313-9d89-7dfcf0016d78'] Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bb55bfe-efc5-4313-9d89-7dfcf0016d78'] Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bb55bfe-efc5-4313-9d89-7dfcf0016d78'] Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bb55bfe-efc5-4313-9d89-7dfcf0016d78'] Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9af5caac-df61-4713-b18b-613ee5100ab2 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group 83748a70-2723-4f62-b39f-4f8ad1368819 does not exist Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-8bb55bfe-efc5-4313-9d89-7dfcf0016d78'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9af5caac-df61-4713-b18b-613ee5100ab2 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/83748a70-2723-4f62-b39f-4f8ad1368819" status: 404 len: 194 microversion: 2.1 time: 0.078187 Oct 04 11:13:36.636057 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1898/3132] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:36 2022] DELETE /compute/v2.1/os-security-groups/83748a70-2723-4f62-b39f-4f8ad1368819 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:36.640251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:36.641694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:36.647644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:36.648153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:36.648586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.649306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:36.649781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:36.650205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:36.955147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:36.970629 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2a442c9-5cfb-4a17-89d2-aff61c5197b4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1499 microversion: 2.1 time: 0.336509 Oct 04 11:13:36.971584 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1899/3133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:36 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1499 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:36.977555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a527266-8124-4bec-ad01-75a5faa222b0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d43b10d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:37.370453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-9a527266-8124-4bec-ad01-75a5faa222b0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:13:37.371094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-9a527266-8124-4bec-ad01-75a5faa222b0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:13:37.372008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9a527266-8124-4bec-ad01-75a5faa222b0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:13:37.372008 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-9cac6829-5f47-4b11-9470-c7376d47ae7b'] Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a527266-8124-4bec-ad01-75a5faa222b0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/9d79e477-bd78-4df0-bf14-9aaa0ffac728 HTTP/1.1 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-9cac6829-5f47-4b11-9470-c7376d47ae7b'] Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '9d79e477-bd78-4df0-bf14-9aaa0ffac728'} Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:13:37.373893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cac6829-5f47-4b11-9470-c7376d47ae7b'] Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cac6829-5f47-4b11-9470-c7376d47ae7b'] Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cac6829-5f47-4b11-9470-c7376d47ae7b'] Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cac6829-5f47-4b11-9470-c7376d47ae7b'] Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a527266-8124-4bec-ad01-75a5faa222b0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group 9d79e477-bd78-4df0-bf14-9aaa0ffac728 does not exist Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-9cac6829-5f47-4b11-9470-c7376d47ae7b'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9a527266-8124-4bec-ad01-75a5faa222b0 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9d79e477-bd78-4df0-bf14-9aaa0ffac728" status: 404 len: 194 microversion: 2.1 time: 0.402340 Oct 04 11:13:37.378588 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1900/3134] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:36 2022] DELETE /compute/v2.1/os-security-groups/9d79e477-bd78-4df0-bf14-9aaa0ffac728 => generated 194 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:37.381751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:37.381751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:37.388868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:37.389388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:37.389825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:37.390580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:37.390985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:37.391413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:37.395774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:37.801670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:37.809969 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eaa6ac7f-33a6-425d-b0bb-c655f8424678 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1403 microversion: 2.1 time: 0.432917 Oct 04 11:13:37.810539 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1901/3135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:37 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1403 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:37.815013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:37.819963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:37.820781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:37.827130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:37.827607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:37.828043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:37.828753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:37.829401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:37.830839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:37.859200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:37.892247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5345a7f2-1562-4898-9404-ca570d5bd6f1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.080506 Oct 04 11:13:37.893531 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1902/3136] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Oct 4 11:13:37 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:37.898617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-69a25c1e-b0a8-4cd6-97ec-084dae639492 req-cb9b29c2-2269-4535-a5dc-3a7f35424675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2627725-9355-4894-963d-4941f7f08f2e", "name": "network-vif-plugged", "status": "completed", "tag": "a2aba20c-ac9d-4aed-bb36-8403c61bf3f1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:37.909096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-69a25c1e-b0a8-4cd6-97ec-084dae639492 req-cb9b29c2-2269-4535-a5dc-3a7f35424675 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:37.909682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-69a25c1e-b0a8-4cd6-97ec-084dae639492 req-cb9b29c2-2269-4535-a5dc-3a7f35424675 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:37.910142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-69a25c1e-b0a8-4cd6-97ec-084dae639492 req-cb9b29c2-2269-4535-a5dc-3a7f35424675 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:37.923783 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-69a25c1e-b0a8-4cd6-97ec-084dae639492 req-cb9b29c2-2269-4535-a5dc-3a7f35424675 service nova] Creating event network-vif-plugged:a2aba20c-ac9d-4aed-bb36-8403c61bf3f1 for instance f2627725-9355-4894-963d-4941f7f08f2e on n-h1-791135-8 Oct 04 11:13:37.929933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-69a25c1e-b0a8-4cd6-97ec-084dae639492 req-cb9b29c2-2269-4535-a5dc-3a7f35424675 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034734 Oct 04 11:13:37.930710 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1903/3137] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:37.940332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:37.941039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:37.947181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:37.947667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:37.948108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:37.948798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:37.949258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:37.949714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:38.281781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:38.289990 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2dc672ce-8a4a-4d72-b028-75c73d532007 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1309 microversion: 2.1 time: 0.354167 Oct 04 11:13:38.290664 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1904/3138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:37 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:38.296877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7f363f2-2d25-4033-ac7e-06e317628ae6 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d4d2c0d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:38.337861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-f7f363f2-2d25-4033-ac7e-06e317628ae6 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:13:38.338786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-f7f363f2-2d25-4033-ac7e-06e317628ae6 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:13:38.339506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f7f363f2-2d25-4033-ac7e-06e317628ae6 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:13:38.339506 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-3f568235-813b-47c9-be59-4fa8dc51fa6d'] Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7f363f2-2d25-4033-ac7e-06e317628ae6 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/28e47ff5-bbb9-47d2-9a29-357ea34ec121 HTTP/1.1 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-3f568235-813b-47c9-be59-4fa8dc51fa6d'] Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '28e47ff5-bbb9-47d2-9a29-357ea34ec121'} Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:13:38.342872 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f568235-813b-47c9-be59-4fa8dc51fa6d'] Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f568235-813b-47c9-be59-4fa8dc51fa6d'] Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f568235-813b-47c9-be59-4fa8dc51fa6d'] Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f568235-813b-47c9-be59-4fa8dc51fa6d'] Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7f363f2-2d25-4033-ac7e-06e317628ae6 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group 28e47ff5-bbb9-47d2-9a29-357ea34ec121 does not exist Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-3f568235-813b-47c9-be59-4fa8dc51fa6d'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7f363f2-2d25-4033-ac7e-06e317628ae6 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/28e47ff5-bbb9-47d2-9a29-357ea34ec121" status: 404 len: 194 microversion: 2.1 time: 0.052796 Oct 04 11:13:38.351574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1905/3139] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:38 2022] DELETE /compute/v2.1/os-security-groups/28e47ff5-bbb9-47d2-9a29-357ea34ec121 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:38.357488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:38.357488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:38.362963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:38.363213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:38.363894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:38.365214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:38.365791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:38.366320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:38.655099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:38.666629 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d666a4f9-4b16-4291-8e99-b6033cdd7b3f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.319829 Oct 04 11:13:38.667734 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1906/3140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:38 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:38.672811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c459fdf1-3c5d-4814-84cd-519c08b65d01 req-01427948-0252-4789-b97e-a658ec246d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a737a39b-9ea3-47a5-bb79-75864179bab1", "tag": "5ac64f65-2be9-4b4f-ae4b-17840dafbec1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:38.687418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c459fdf1-3c5d-4814-84cd-519c08b65d01 req-01427948-0252-4789-b97e-a658ec246d7f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:38.688242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c459fdf1-3c5d-4814-84cd-519c08b65d01 req-01427948-0252-4789-b97e-a658ec246d7f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:38.688692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c459fdf1-3c5d-4814-84cd-519c08b65d01 req-01427948-0252-4789-b97e-a658ec246d7f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:38.705031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c459fdf1-3c5d-4814-84cd-519c08b65d01 req-01427948-0252-4789-b97e-a658ec246d7f service nova] Creating event network-changed:5ac64f65-2be9-4b4f-ae4b-17840dafbec1 for instance a737a39b-9ea3-47a5-bb79-75864179bab1 on n-h1-791135-8 Oct 04 11:13:38.710249 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c459fdf1-3c5d-4814-84cd-519c08b65d01 req-01427948-0252-4789-b97e-a658ec246d7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041024 Oct 04 11:13:38.711428 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1907/3141] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:38.718608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a15026a-d645-4f44-9d4d-ee73c5f36553 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:38.728730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a15026a-d645-4f44-9d4d-ee73c5f36553 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:38.729564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a15026a-d645-4f44-9d4d-ee73c5f36553 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:38.730353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a15026a-d645-4f44-9d4d-ee73c5f36553 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:38.758761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6a15026a-d645-4f44-9d4d-ee73c5f36553 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Going to try to start instance {{(pid=122409) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 11:13:38.817658 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a15026a-d645-4f44-9d4d-ee73c5f36553 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "POST /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1/action" status: 202 len: 0 microversion: 2.1 time: 0.103935 Oct 04 11:13:38.818655 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1908/3142] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:13:38 2022] POST /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:38.827835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d16bb090-dbb1-4d66-a39d-cabada2866d8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d46cf5e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:38.856864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG neutronclient.v2_0.client [None req-d16bb090-dbb1-4d66-a39d-cabada2866d8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist", "detail": ""}} {{(pid=122409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:13:38.857559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-d16bb090-dbb1-4d66-a39d-cabada2866d8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Neutron security group fe038d75-d8b7-465b-a784-e93708d0a284 not found {{(pid=122409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 11:13:38.858247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d16bb090-dbb1-4d66-a39d-cabada2866d8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:13:38.858247 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-2fbe665c-8890-4b10-a7d7-e99ba49ab174'] Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d16bb090-dbb1-4d66-a39d-cabada2866d8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284 HTTP/1.1 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: exception: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-2fbe665c-8890-4b10-a7d7-e99ba49ab174'] Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'fe038d75-d8b7-465b-a784-e93708d0a284'} Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 11:13:38.862121 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fbe665c-8890-4b10-a7d7-e99ba49ab174'] Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fbe665c-8890-4b10-a7d7-e99ba49ab174'] Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fbe665c-8890-4b10-a7d7-e99ba49ab174'] Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fbe665c-8890-4b10-a7d7-e99ba49ab174'] Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d16bb090-dbb1-4d66-a39d-cabada2866d8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Security group fe038d75-d8b7-465b-a784-e93708d0a284 does not exist Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: Neutron server returns request_ids: ['req-2fbe665c-8890-4b10-a7d7-e99ba49ab174'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:38.866881 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d16bb090-dbb1-4d66-a39d-cabada2866d8 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284" status: 404 len: 194 microversion: 2.1 time: 0.040390 Oct 04 11:13:38.870001 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1909/3143] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:38 2022] DELETE /compute/v2.1/os-security-groups/fe038d75-d8b7-465b-a784-e93708d0a284 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:38.873665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:38.874660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:38.882775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:38.883656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:38.884299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:38.885480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:38.886671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:38.887130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.048300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:39.059380 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c28b3e6e-9093-4e23-8c90-0764cd2e9185 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1508 microversion: 2.1 time: 0.190456 Oct 04 11:13:39.078098 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1910/3144] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:38 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:39.084775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:39.085601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:39.092828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.093597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.094210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.095207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.096175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.097131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.297933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:39.306215 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c416afa-953b-4fd5-8dc2-c522db7128c5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1403 microversion: 2.1 time: 0.226841 Oct 04 11:13:39.306976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1911/3145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:39 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1403 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:39.311643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:39.312154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:39.320343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.320836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.321275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.323107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.323569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.323996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.359507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:13:39.465426 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f66f7c6d-c5ee-4429-8a2d-506f38ccc959 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 204 len: 0 microversion: 2.1 time: 0.157125 Oct 04 11:13:39.467065 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1912/3146] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:39 2022] DELETE /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:13:39.474362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:39.475353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:39.483111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.483544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.484061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.485119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.485864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.486320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.641155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:39.649517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8028100-096f-45e2-97e7-6b7b8747eedd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1309 microversion: 2.1 time: 0.181016 Oct 04 11:13:39.650218 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1913/3147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:39 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1309 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:39.665141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:39.665141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:39.666638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.667317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.667931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.668726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.669276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.669898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.855848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:39.864326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f7844a6-e6c2-4cae-85e2-ec61a771f7c1 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1645 microversion: 2.1 time: 0.212888 Oct 04 11:13:39.864897 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1914/3148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:39 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1645 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:39.887581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:39.888643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:39.894746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.895241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.895677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:39.896375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:39.896827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:39.897250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.072168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:40.080777 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d43397b-5451-4f00-a969-b17be28229b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.198225 Oct 04 11:13:40.081977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1915/3149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:39 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:40.086862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:40.087685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:40.094145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.094917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.095537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.096469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.097108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.097724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.260886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:40.270362 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a220f257-fd1f-4c46-80e9-5196cda7e08e tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1508 microversion: 2.1 time: 0.187075 Oct 04 11:13:40.273390 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1916/3150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:40 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:40.337311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:40.338040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:40.340263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:40.347208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.347809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.348312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.349102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.349660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.350192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.504520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:40.514708 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a2d3e10-b91d-4c6f-a8c0-69acd83d4a9a tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1403 microversion: 2.1 time: 0.181596 Oct 04 11:13:40.515543 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1917/3151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:40 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1403 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:40.675064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:40.675980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:40.689659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.690640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.691293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.692431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.693225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.693854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.702782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:40.875335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:40.886225 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d60a36d0-af37-4249-a6e4-087591930c04 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1309 microversion: 2.1 time: 0.216727 Oct 04 11:13:40.905590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1918/3152] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:40 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:40.910520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-958bed9c-ffa0-4b08-92dd-2bc6acb47262 req-3d7928db-95f3-4151-aac9-b83b4096a412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c34390-7b46-48fa-abcd-67db6ce2a58d", "tag": "90c4d3b8-3c84-43cf-b7d7-3e4d8ca66e3f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:40.920846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-958bed9c-ffa0-4b08-92dd-2bc6acb47262 req-3d7928db-95f3-4151-aac9-b83b4096a412 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.921441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-958bed9c-ffa0-4b08-92dd-2bc6acb47262 req-3d7928db-95f3-4151-aac9-b83b4096a412 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.921985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-958bed9c-ffa0-4b08-92dd-2bc6acb47262 req-3d7928db-95f3-4151-aac9-b83b4096a412 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.937125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-958bed9c-ffa0-4b08-92dd-2bc6acb47262 req-3d7928db-95f3-4151-aac9-b83b4096a412 service nova] Creating event network-changed:90c4d3b8-3c84-43cf-b7d7-3e4d8ca66e3f for instance 53c34390-7b46-48fa-abcd-67db6ce2a58d on n-h1-791135-8 Oct 04 11:13:40.944071 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-958bed9c-ffa0-4b08-92dd-2bc6acb47262 req-3d7928db-95f3-4151-aac9-b83b4096a412 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037112 Oct 04 11:13:40.944885 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1919/3153] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:40.950784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:40.952966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:40.963491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.963994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.964434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:40.965375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:40.965791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:40.966288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.149249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:41.173453 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c5776c9-f91c-49dc-b0e8-09c976a2efcd tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1645 microversion: 2.1 time: 0.225710 Oct 04 11:13:41.178752 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1920/3154] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:40 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1645 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:41.192520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:41.193266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:41.206533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.207022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.207803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.208158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.208603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.209404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.356794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:41.366541 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96a3a7c5-8c9b-49f2-87a8-4d158aa29046 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.188232 Oct 04 11:13:41.367302 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1921/3155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:41 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:41.371565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-87c5a157-5014-4c18-96de-c9b9e9e57de4 req-74d73790-f3ca-477d-8f60-851397770c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "name": "network-vif-plugged", "status": "completed", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:41.382539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-87c5a157-5014-4c18-96de-c9b9e9e57de4 req-74d73790-f3ca-477d-8f60-851397770c1a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.383028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-87c5a157-5014-4c18-96de-c9b9e9e57de4 req-74d73790-f3ca-477d-8f60-851397770c1a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.383522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-87c5a157-5014-4c18-96de-c9b9e9e57de4 req-74d73790-f3ca-477d-8f60-851397770c1a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.396479 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-87c5a157-5014-4c18-96de-c9b9e9e57de4 req-74d73790-f3ca-477d-8f60-851397770c1a service nova] Creating event network-vif-plugged:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:13:41.402673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-87c5a157-5014-4c18-96de-c9b9e9e57de4 req-74d73790-f3ca-477d-8f60-851397770c1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034306 Oct 04 11:13:41.403364 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1922/3156] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:41.408561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:41.409246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:41.415459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.415941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.416497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.417186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.417666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.418092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.573688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:41.582830 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a0db4f7e-3051-4d0f-a453-225a1b9eb87f tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1508 microversion: 2.1 time: 0.178297 Oct 04 11:13:41.583630 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1923/3157] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:41 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:41.589001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:41.589840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:41.596636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.597314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.598958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.599888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.600536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.601141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.758668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:41.767002 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9924b4a1-4550-48ed-bd16-245c804f49e4 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1591 microversion: 2.1 time: 0.182211 Oct 04 11:13:41.781733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1924/3158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:41 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1591 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:41.790173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:41.790883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:41.798076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.798829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.799274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.800027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.800494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.800930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.889928 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a75e168a-77bb-4d42-baf6-2e8f9666409c tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103432 Oct 04 11:13:41.898872 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1925/3159] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:13:41 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:13:41.914184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:41.915049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:41.922027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.924995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.924995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:41.924995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:41.924995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:41.924995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:42.049165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:42.393376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:42.403017 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd85817e-a5a9-4ccc-8dee-1d0684cb5844 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1309 microversion: 2.1 time: 0.494014 Oct 04 11:13:42.413988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1926/3160] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:41 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1309 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:42.433206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:42.433857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:42.441585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:42.442588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:42.442706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:42.443501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:42.444038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:42.444763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:43.021733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:43.029734 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e28d4d43-f89e-4b51-afe2-8c655edb72c9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1645 microversion: 2.1 time: 0.614602 Oct 04 11:13:43.030554 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1927/3161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:42 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1645 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:43.049427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:43.050061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:43.056406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:43.056583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:43.056992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:43.057744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:43.058276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:43.058624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:43.922027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:43.930458 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cb38001c-3a9e-49d2-bab4-43ee69dbd521 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.896301 Oct 04 11:13:43.935972 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1928/3162] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:43 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:43.949713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:43.970035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:43.984855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:43.985400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:43.985837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:43.997680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:43.998218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:43.998689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:44.371049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:44.380447 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-319aee4c-d692-4715-bd3a-3e23f1e009ad tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1508 microversion: 2.1 time: 0.434454 Oct 04 11:13:44.382170 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1929/3163] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:43 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:44.387251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:44.388124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:44.395755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:44.396603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:44.397274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:44.398266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:44.398951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:44.399483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:44.644243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:44.653891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ba3093a-a003-45a7-bcc0-c786fbacd2d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1309 microversion: 2.1 time: 0.270351 Oct 04 11:13:44.654878 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1930/3164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:44 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:44.659886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d234a3f8-b831-4917-9a14-3f56fe3a6f8f req-02e9eb87-14b1-4320-a724-31a654307925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca8e390-46b1-4ecd-89e7-c3e7f4881df6", "name": "network-vif-deleted", "tag": "d35b883a-eff3-4486-a332-0d7e53fcd167"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:44.670617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d234a3f8-b831-4917-9a14-3f56fe3a6f8f req-02e9eb87-14b1-4320-a724-31a654307925 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:44.671195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d234a3f8-b831-4917-9a14-3f56fe3a6f8f req-02e9eb87-14b1-4320-a724-31a654307925 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:44.671704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d234a3f8-b831-4917-9a14-3f56fe3a6f8f req-02e9eb87-14b1-4320-a724-31a654307925 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:44.684791 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d234a3f8-b831-4917-9a14-3f56fe3a6f8f req-02e9eb87-14b1-4320-a724-31a654307925 service nova] Creating event network-vif-deleted:d35b883a-eff3-4486-a332-0d7e53fcd167 for instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 on n-h1-791135-8 Oct 04 11:13:44.720268 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d234a3f8-b831-4917-9a14-3f56fe3a6f8f req-02e9eb87-14b1-4320-a724-31a654307925 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063866 Oct 04 11:13:44.720902 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1931/3165] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:44.729857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:44.730664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:44.737387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:44.737997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:44.738515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:44.739318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:44.739856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:44.740294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:44.780400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:44.780894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:44.781335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:44.781823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lazy-loading 'fault' on Instance uuid cca8e390-46b1-4ecd-89e7-c3e7f4881df6 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:44.861034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b5ae872f1bb4ff484eaeab1aa266b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced2f5082a74f07aa11508bad977313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:44.868806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b97b5e0b-7fb5-4ea7-b9b7-a7a494d8b1b5 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 200 len: 1305 microversion: 2.1 time: 0.143491 Oct 04 11:13:44.885371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1932/3166] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:44 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 1305 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:44.895237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:44.895862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:44.902319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:44.902811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:44.903252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:44.904380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:44.904467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:44.904864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.129544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:45.141739 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7943d3cd-6f36-42f1-9141-691054836c7e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1591 microversion: 2.1 time: 0.250334 Oct 04 11:13:45.153774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1933/3167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:44 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1591 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:45.158934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ee0e065d-9744-4988-9ab3-1f5aeb6fca9b req-7d18d04c-71af-43ad-8b50-2d49c2a5dc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2627725-9355-4894-963d-4941f7f08f2e", "tag": "a2aba20c-ac9d-4aed-bb36-8403c61bf3f1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:45.173106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ee0e065d-9744-4988-9ab3-1f5aeb6fca9b req-7d18d04c-71af-43ad-8b50-2d49c2a5dc70 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.173106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ee0e065d-9744-4988-9ab3-1f5aeb6fca9b req-7d18d04c-71af-43ad-8b50-2d49c2a5dc70 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.173106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ee0e065d-9744-4988-9ab3-1f5aeb6fca9b req-7d18d04c-71af-43ad-8b50-2d49c2a5dc70 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.185229 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ee0e065d-9744-4988-9ab3-1f5aeb6fca9b req-7d18d04c-71af-43ad-8b50-2d49c2a5dc70 service nova] Creating event network-changed:a2aba20c-ac9d-4aed-bb36-8403c61bf3f1 for instance f2627725-9355-4894-963d-4941f7f08f2e on n-h1-791135-8 Oct 04 11:13:45.191269 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ee0e065d-9744-4988-9ab3-1f5aeb6fca9b req-7d18d04c-71af-43ad-8b50-2d49c2a5dc70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035830 Oct 04 11:13:45.192433 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1934/3168] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:45.200027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:45.200027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:45.205691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.206267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.206711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.207581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.207970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.208410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.383765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:45.393801 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-530e8481-f08c-4746-83e8-bd610aabf156 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.199424 Oct 04 11:13:45.394683 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1935/3169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:45 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:45.413084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:45.414042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:45.422732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.423491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.424025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.424824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.425485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.425999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.610465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:45.620904 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c339c3ff-ff91-4840-bc1f-79d2c80090d9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1512 microversion: 2.1 time: 0.214305 Oct 04 11:13:45.667386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1936/3170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:45 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:45.682425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:45.697944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:45.699491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.servers [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Removing options 'limit' from query {{(pid=122409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 11:13:45.701287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:45.702594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.703094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.703583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.704811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.705489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.706022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.709171 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d83e6280-82b3-465d-b115-08145eae7232 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.040565 Oct 04 11:13:45.719139 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1937/3171] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Oct 4 11:13:45 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:13:45.738946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:45.739564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:45.756460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.757707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.758383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.759263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:45.760379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:45.760971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:45.786942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:46.132360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:46.142523 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c3a60aa9-586f-4a71-9d42-1598c763b43e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1309 microversion: 2.1 time: 0.413459 Oct 04 11:13:46.157284 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1938/3172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:45 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:46.157284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:46.157284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:46.157284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.157284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.157284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:46.157949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.158487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.160588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:46.488100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:46.501557 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c8a221c-1af0-41a6-bb8d-3d58ec45dcfe tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1512 microversion: 2.1 time: 0.356721 Oct 04 11:13:46.517787 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1939/3173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:46 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:46.529696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:46.530930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] [instance: cca8e390-46b1-4ecd-89e7-c3e7f4881df6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:46.539072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.539582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.540180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:46.541287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.541805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.542227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:46.565895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] HTTP exception thrown: Instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 could not be found. Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Request method failure captured: Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 HTTP/1.1 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTyutlkzFun7UhNvISMO2_3gEw_lb4xfQ9oGptS9St-iaJyl4BsEHjlFhbOX9vqQ_7qLWRwXmA3gQJJufZTdVKTfqJwytjVM-7tiohk9-l0TrNB-JddTMt1oIku1Za3GWWfDFjuv-Q-aLWTBF_vQNhsaDexTsdll1-phnEUwq2cIko Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9ced2f5082a74f07aa11508bad977313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9ced2f5082a74f07aa11508bad977313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9ced2f5082a74f07aa11508bad977313"}]}] Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9ced2f5082a74f07aa11508bad977313 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1293584308 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 1b5ae872f1bb4ff484eaeab1aa266b82 Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-SecurityGroupsTestJSON-1293584308-project Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 could not be found. Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'cca8e390-46b1-4ecd-89e7-c3e7f4881df6'} Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 could not be found. Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 could not be found. Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:46.567194 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 could not be found. Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Returning 404 to user: Instance cca8e390-46b1-4ecd-89e7-c3e7f4881df6 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4763144-eace-4611-b647-c412e1868a63 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6" status: 404 len: 111 microversion: 2.1 time: 0.049355 Oct 04 11:13:46.571833 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1940/3174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:46 2022] GET /compute/v2.1/servers/cca8e390-46b1-4ecd-89e7-c3e7f4881df6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:46.575696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-af617669-cd93-4391-a1f3-26aea61916f2 req-53fcdf4d-f864-4520-9a27-7f428998f369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a737a39b-9ea3-47a5-bb79-75864179bab1", "name": "network-vif-plugged", "status": "completed", "tag": "5ac64f65-2be9-4b4f-ae4b-17840dafbec1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:46.588784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-af617669-cd93-4391-a1f3-26aea61916f2 req-53fcdf4d-f864-4520-9a27-7f428998f369 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.589280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-af617669-cd93-4391-a1f3-26aea61916f2 req-53fcdf4d-f864-4520-9a27-7f428998f369 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.589795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-af617669-cd93-4391-a1f3-26aea61916f2 req-53fcdf4d-f864-4520-9a27-7f428998f369 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:46.604283 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-af617669-cd93-4391-a1f3-26aea61916f2 req-53fcdf4d-f864-4520-9a27-7f428998f369 service nova] Creating event network-vif-plugged:5ac64f65-2be9-4b4f-ae4b-17840dafbec1 for instance a737a39b-9ea3-47a5-bb79-75864179bab1 on n-h1-791135-8 Oct 04 11:13:46.609542 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-af617669-cd93-4391-a1f3-26aea61916f2 req-53fcdf4d-f864-4520-9a27-7f428998f369 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038579 Oct 04 11:13:46.613430 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1941/3175] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:46.619312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:46.620027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:46.627643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.628248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.628709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:46.629460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.629932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.630369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:46.947854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:46.959802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8528907-9df0-4a7e-b8a7-5af5a7e49833 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.344788 Oct 04 11:13:46.961461 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1942/3176] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:46 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:46.966836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:46.967471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:46.977759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.978144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.978589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:46.979360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:46.979766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:46.980483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:47.217536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:47.230567 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-921db40f-7d81-4ef7-8126-41bdf2a703f3 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6" status: 200 len: 1513 microversion: 2.1 time: 0.268394 Oct 04 11:13:47.231478 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1943/3177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:46 2022] GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:47.237123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a2c9c2a-30cc-42e9-b310-5972866095d9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71d46cf430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:47.469138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9a2c9c2a-30cc-42e9-b310-5972866095d9 tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0f62661e-76e3-42bc-87d2-06e6741a96f7" status: 202 len: 0 microversion: 2.1 time: 0.236725 Oct 04 11:13:47.469947 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1944/3178] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:47 2022] DELETE /compute/v2.1/os-security-groups/0f62661e-76e3-42bc-87d2-06e6741a96f7 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:47.490121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:47.491440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:47.503577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:47.513996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:47.514548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:47.515368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:47.515930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:47.516424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:47.688795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:47.698311 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f31ae023-2c72-4577-bb19-7168c8ad7302 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1309 microversion: 2.1 time: 0.227167 Oct 04 11:13:47.701851 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1945/3179] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:47 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:47.717736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:47.718470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:47.725680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:47.726189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:47.726779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:47.727504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:47.727967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:47.728413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:47.837144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:47.910680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:47.922038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80755c41-c19b-4fad-a392-de6d0d5b33be tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1512 microversion: 2.1 time: 0.218815 Oct 04 11:13:47.933383 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1946/3180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:47 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:47.933383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4d9b79f6-0259-4869-8f56-c3d1d5f955db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] Calling method '.version_select at 0x7f71cf6f7dc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:48.143628 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4d9b79f6-0259-4869-8f56-c3d1d5f955db tempest-SecurityGroupsTestJSON-1293584308 tempest-SecurityGroupsTestJSON-1293584308-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c7bb1e13-7b83-4341-93a3-6aacff0c3cd6" status: 202 len: 0 microversion: 2.1 time: 0.218984 Oct 04 11:13:48.147755 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1947/3181] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:13:47 2022] DELETE /compute/v2.1/os-security-groups/c7bb1e13-7b83-4341-93a3-6aacff0c3cd6 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:13:48.158514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:48.179522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:48.180320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:48.311391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:48.312055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:48.312496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:48.313313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:48.313792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:48.314226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:48.454451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:48.531830 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe67e4a4-0809-4910-8f27-50556d3127c4 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.385541 Oct 04 11:13:48.532807 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1948/3182] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Oct 4 11:13:48 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:48.537530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:48.538161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:48.554940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:48.564339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:48.564811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:48.565608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:48.566207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:48.566645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:48.754024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:48.765219 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c2eb9fad-78eb-42de-8dae-f4fa0443cc5f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.231144 Oct 04 11:13:48.766041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1949/3183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:48 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:48.784185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:48.785165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:48.796926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:48.798055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:48.798618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:48.799455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:48.800028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:48.800571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:48.958109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:48.968366 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7242bfbd-cbb0-40d6-8e89-b10fd9fa9784 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1512 microversion: 2.1 time: 0.192946 Oct 04 11:13:48.969041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1950/3184] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:48 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:48.989228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:48.990397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:48.997005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:48.997707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:48.998339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:48.999245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.000069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.000598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.169497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:49.177748 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9fbe5bf3-b10b-474f-9919-c16c8ed51721 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1491 microversion: 2.1 time: 0.198309 Oct 04 11:13:49.188001 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1951/3185] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:48 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1491 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:49.188001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:49.188001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:49.197142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.197142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.197142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.197142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.197142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.197142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.356869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:49.366454 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0cc9279-3be2-40cd-8d99-17d712d81310 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6" status: 200 len: 1513 microversion: 2.1 time: 0.186509 Oct 04 11:13:49.377557 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1952/3186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:49 2022] GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:49.377557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:49.377557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:49.384529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.384529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.384529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.384529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.384529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.384529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.459135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45dc48ec-31e8-4b0a-ba48-9b51f35b0e63 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "PUT /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1086 microversion: 2.1 time: 0.090717 Oct 04 11:13:49.459535 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1953/3187] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:13:49 2022] PUT /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1086 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:49.464198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:49.465313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:49.471711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.472304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.472753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.473490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.473953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.474387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.614895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:49.623401 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3382bb62-eeac-45b7-b57b-b559140b6ea0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1512 microversion: 2.1 time: 0.162224 Oct 04 11:13:49.623963 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1954/3188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:49 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:49.628953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:49.629581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:49.636641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.637092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.637563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.638832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.638832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.639271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.839749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:49.848618 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8defc800-4b04-4b66-8cc2-dbdae5737df7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1512 microversion: 2.1 time: 0.223186 Oct 04 11:13:49.849545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1955/3189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:49 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:49.854254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:49.859165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:49.859911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:49.865992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.866435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.866866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.867589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.868283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.868531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.901922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:49.939314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:49.952985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:49.953505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:49.953949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:49.957314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:50.088120 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a383d7a7-05ea-42e8-812f-b698fa4433d1 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.237373 Oct 04 11:13:50.088731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1956/3190] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:13:49 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:50.093485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:50.094094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:50.100111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.100612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.101086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.101836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.102293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.102720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.233725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:50.258275 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96d94bdc-0683-4fcd-ad63-e13b1722cfc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.153502 Oct 04 11:13:50.258934 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1957/3191] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:50 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:50.270656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:50.271544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:50.278927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.279412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.279843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.280546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.280991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.281437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.430224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:50.440560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29eb4c19-804c-4aba-99ad-84c688b167b7 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.173319 Oct 04 11:13:50.441676 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1958/3192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:50 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:50.447148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:50.447832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:50.456533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.457177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.458038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.458999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.459583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.460548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.606639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:50.615554 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-994f25d9-ba23-4735-bd74-dfaab9721799 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1512 microversion: 2.1 time: 0.171808 Oct 04 11:13:50.616761 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1959/3193] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:50 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:50.639444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:50.644799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:50.645492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:50.717943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.718507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.719618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.720351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.720871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.721467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.752113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:50.782516 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-839a87f7-a07a-40a4-b772-918ee28f76f8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.147595 Oct 04 11:13:50.783442 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1960/3194] 10.222.0.23 () {58 vars in 1150 bytes} [Tue Oct 4 11:13:50 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:50.792626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1743315106"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:50.796455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:50.803423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.803916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.804356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:50.805149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:50.805629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:50.806607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:51.037519 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b4b2b4e-864a-4295-adb3-1e07255abcc3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.250713 Oct 04 11:13:51.041439 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1961/3195] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:13:50 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 11:13:51.047304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:51.048284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:51.056353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:51.057210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:51.058104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:51.059279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:51.059957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:51.060552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:51.104409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:13:51.195829 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d484b549-b538-470a-9ed1-a698cbe63828 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 204 len: 0 microversion: 2.1 time: 0.155824 Oct 04 11:13:51.200211 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1962/3196] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:51 2022] DELETE /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:13:51.206572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:51.211799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:51.212547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:51.218480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:51.218964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:51.219399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:51.220116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:51.220567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:51.220991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:51.307547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:51.366875 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-585c8085-2f80-4cd5-bc94-bf2c27eedbf8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.169206 Oct 04 11:13:51.367797 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1963/3197] 10.222.0.23 () {58 vars in 1212 bytes} [Tue Oct 4 11:13:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:51.372312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4dae5dc7-d837-4dce-82bb-1dc76b2caccb req-5741e8ab-455d-4c69-a4b2-3c5daba60913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c34390-7b46-48fa-abcd-67db6ce2a58d", "name": "network-vif-plugged", "status": "completed", "tag": "90c4d3b8-3c84-43cf-b7d7-3e4d8ca66e3f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:51.382795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4dae5dc7-d837-4dce-82bb-1dc76b2caccb req-5741e8ab-455d-4c69-a4b2-3c5daba60913 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:51.383283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4dae5dc7-d837-4dce-82bb-1dc76b2caccb req-5741e8ab-455d-4c69-a4b2-3c5daba60913 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:51.383720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4dae5dc7-d837-4dce-82bb-1dc76b2caccb req-5741e8ab-455d-4c69-a4b2-3c5daba60913 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:51.395474 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4dae5dc7-d837-4dce-82bb-1dc76b2caccb req-5741e8ab-455d-4c69-a4b2-3c5daba60913 service nova] Creating event network-vif-plugged:90c4d3b8-3c84-43cf-b7d7-3e4d8ca66e3f for instance 53c34390-7b46-48fa-abcd-67db6ce2a58d on n-h1-791135-8 Oct 04 11:13:51.400405 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4dae5dc7-d837-4dce-82bb-1dc76b2caccb req-5741e8ab-455d-4c69-a4b2-3c5daba60913 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031430 Oct 04 11:13:51.401300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1964/3198] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:51.406476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:51.407185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:51.413443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:51.413947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:51.414365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:51.415061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:51.415511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:51.415936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:51.980289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:51.991330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b56c27b-5ea4-4172-8e2e-323d758d772e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.588778 Oct 04 11:13:52.005192 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1965/3199] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:51 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:52.005192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:52.005192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:52.007732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.008680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.008680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.009548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.009834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.010260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.269573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:52.277212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ee8608ab-c334-42ca-bcb2-0f5fe0957f03 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1518 microversion: 2.1 time: 0.284181 Oct 04 11:13:52.277815 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1966/3200] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:51 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1518 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:52.282197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:52.287291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:52.288063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:52.289822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:52.294049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.294557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.294986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.295699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.296149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.296577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.386841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:52.453703 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e83af4f5-0dd4-4740-af2e-7efae43441b8 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.174705 Oct 04 11:13:52.461814 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1967/3201] 10.222.0.23 () {58 vars in 1196 bytes} [Tue Oct 4 11:13:52 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:52.461814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:52.461814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:52.465943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.467103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.467771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.468522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.469083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.469548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.612263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:52.619949 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2972fe4b-f114-45a7-b984-d18b3c4cc65f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.164760 Oct 04 11:13:52.620557 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1968/3202] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:52 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:52.625455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:52.630358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:52.631027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'name': '-386169906', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:52.635934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.636415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.636855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.637621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.638647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.639081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.730671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:52.773048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:52.789786 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ed4a2ccd-9123-4e01-91e4-877bd4412fdc tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-386169906" status: 200 len: 345 microversion: 2.1 time: 0.168005 Oct 04 11:13:52.790392 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1969/3203] 10.222.0.23 () {58 vars in 1156 bytes} [Tue Oct 4 11:13:52 2022] GET /compute/v2.1/servers?name=-386169906 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:52.803220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:52.808162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:52.808934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:52.815547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.816024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.816459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.817171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.817682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.818109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.907984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:52.965599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84d7e44e-3df9-46a6-8f92-1305d240b22d tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.166468 Oct 04 11:13:52.966233 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1970/3204] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Oct 4 11:13:52 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:52.977834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:52.983116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:52.983839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-38616990', 'deleted': False, 'project_id': 'fb37a21f84fd4716b3be0319be618722'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:13:52.988911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.989414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.989853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:52.990567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:52.991018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:52.991439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.073598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:13:53.132777 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-48dfd3f7-a4f7-41d8-ba9f-f3f095be459a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-38616990" status: 200 len: 345 microversion: 2.1 time: 0.158359 Oct 04 11:13:53.133577 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1971/3205] 10.222.0.23 () {58 vars in 1226 bytes} [Tue Oct 4 11:13:52 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-38616990 => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:13:53.142146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:53.142802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:53.148709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.149201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.149687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.150406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.150867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.151300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.301439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:53.309941 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3049216-6319-4459-a040-14323b4f50b0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.171338 Oct 04 11:13:53.310754 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1972/3206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:53 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:53.315164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:53.315887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:53.323907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.324343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.324786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.326109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.326587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.327004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.356521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:13:53.440173 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-182d8e4f-c4e3-4a6b-b1ae-ecc169196ba9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 204 len: 0 microversion: 2.1 time: 0.128218 Oct 04 11:13:53.440882 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1973/3207] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:53 2022] DELETE /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:13:53.445933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:53.446634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:53.453784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.454384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.454920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.455817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.456290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.456916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.628005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:53.635782 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8fdf193-ad1a-460a-914e-c6c4afe18bb7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1518 microversion: 2.1 time: 0.193741 Oct 04 11:13:53.637453 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1974/3208] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:53 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:53.640841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:53.641532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:53.647050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.647524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.647949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.648624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.649070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.649517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.788186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:53.796014 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73ef3872-5e23-45de-9847-ac09de5f4f9c tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1518 microversion: 2.1 time: 0.158693 Oct 04 11:13:53.796595 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1975/3209] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:53 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:53.809570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:53.810847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:53.817034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.817560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.817992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.818672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:53.819117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:53.819533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:53.974792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:53.983068 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-321766da-c393-41f9-b0de-b81b3192146b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.177204 Oct 04 11:13:53.983951 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1976/3210] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:53 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:54.332023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:54.332626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:54.338484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:54.338966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:54.339399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:54.340078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:54.340708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:54.341177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:54.484215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:54.492907 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78ec14f2-13fd-4f5b-938e-95f191967818 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1689 microversion: 2.1 time: 0.164724 Oct 04 11:13:54.497396 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1977/3211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:54 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:54.599645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b325cff4-9e17-436b-a0d9-9e2ef71c27fb req-5dc2cb0b-d890-4c56-8d42-388905a27c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "name": "network-vif-unplugged", "status": "completed", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:54.613892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b325cff4-9e17-436b-a0d9-9e2ef71c27fb req-5dc2cb0b-d890-4c56-8d42-388905a27c3e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:54.616043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b325cff4-9e17-436b-a0d9-9e2ef71c27fb req-5dc2cb0b-d890-4c56-8d42-388905a27c3e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:54.616043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b325cff4-9e17-436b-a0d9-9e2ef71c27fb req-5dc2cb0b-d890-4c56-8d42-388905a27c3e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:54.631878 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b325cff4-9e17-436b-a0d9-9e2ef71c27fb req-5dc2cb0b-d890-4c56-8d42-388905a27c3e service nova] Creating event network-vif-unplugged:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:13:54.637236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b325cff4-9e17-436b-a0d9-9e2ef71c27fb req-5dc2cb0b-d890-4c56-8d42-388905a27c3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041977 Oct 04 11:13:54.638220 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1978/3212] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:54.661523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:54.662406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:54.668632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:54.669182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:54.671221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:54.672026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:54.672444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:54.672874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:54.826405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:54.834654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7989b8de-113f-49c8-9953-73122122fee2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1518 microversion: 2.1 time: 0.177950 Oct 04 11:13:54.835326 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1979/3213] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:54 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:54.850102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:54.850724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:54.857636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:54.858170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:54.858748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:54.859683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:54.859926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:54.860356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.014388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:55.024979 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e09fb8d6-ed6d-4245-bc7f-f8970956eb26 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1518 microversion: 2.1 time: 0.180535 Oct 04 11:13:55.025605 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1980/3214] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:54 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:55.045839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:55.046527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:55.055054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.055627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.056136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.056938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.057443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.057874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.230873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:55.248438 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-169f621f-97c8-43ac-b05e-37b0a10747cf tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1315 microversion: 2.1 time: 0.210475 Oct 04 11:13:55.249938 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1981/3215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:55 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:55.271040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:55.271654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:55.278190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.279211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.279649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.280351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.280815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.281224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.413317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5bb28a5-74ef-4c2e-90f8-d9b9cf5983ea tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1812 microversion: 2.1 time: 0.147310 Oct 04 11:13:55.414234 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1982/3216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:55 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:55.436689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6556628-dbca-4670-aa6a-08b71a03e7c2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:55.440374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6556628-dbca-4670-aa6a-08b71a03e7c2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.440866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6556628-dbca-4670-aa6a-08b71a03e7c2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.441313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6556628-dbca-4670-aa6a-08b71a03e7c2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.442110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6556628-dbca-4670-aa6a-08b71a03e7c2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.442580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6556628-dbca-4670-aa6a-08b71a03e7c2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.443011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6556628-dbca-4670-aa6a-08b71a03e7c2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.469670 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c6556628-dbca-4670-aa6a-08b71a03e7c2 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036483 Oct 04 11:13:55.470457 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1983/3217] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 11:13:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:13:55.516823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:55.517609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:55.523650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.524141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.524578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.525269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.525756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.526652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.670345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:55.687225 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aceb7968-f721-4696-83f6-a1f876b37706 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1689 microversion: 2.1 time: 0.174873 Oct 04 11:13:55.696752 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1984/3218] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:55 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:13:55.860065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:55.860672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:55.873809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.874647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.875096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.879005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:55.881600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:55.882345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:55.926048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:56.739308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:56.748374 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-efd6845b-3847-4db3-bf45-790fc413e5e2 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1518 microversion: 2.1 time: 0.893639 Oct 04 11:13:56.748958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1985/3219] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:55 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1518 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:56.775685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:56.776324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:56.796166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:56.796858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:56.801402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:56.802343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:56.802959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:56.803676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:56.945206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:56.959334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51edb96c-d4e4-4056-92a8-4884351aa004 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1476 microversion: 2.1 time: 0.189708 Oct 04 11:13:56.959858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1986/3220] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:56 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1476 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:56.977480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:56.978479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:57.015449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:57.016399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:57.017937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:57.020707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:57.038979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:57.040912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:57.424796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:57.438120 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-693bf9a8-6c59-44f8-9c1d-dbad45dc0e4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1501 microversion: 2.1 time: 0.474051 Oct 04 11:13:57.438766 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1987/3221] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:56 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1501 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:57.453533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:57.454127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:57.487050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:57.487557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:57.509906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:57.512002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:57.512557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:57.514230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:57.940680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:57.953755 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e50864a4-fb03-4db4-aaf5-47432c0b5152 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1689 microversion: 2.1 time: 0.513453 Oct 04 11:13:57.954183 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1988/3222] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:57 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1689 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:57.971430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-adad1a94-51c6-45e2-b586-af1f40938c86 req-81747268-bdfb-49a3-8ccc-b777d22d0f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51c8e34-27b9-4530-a9f2-c78c64a88a94", "name": "network-vif-deleted", "tag": "64c7931a-897b-469e-a804-c92a94226730"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:58.007438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-adad1a94-51c6-45e2-b586-af1f40938c86 req-81747268-bdfb-49a3-8ccc-b777d22d0f84 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.009242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-adad1a94-51c6-45e2-b586-af1f40938c86 req-81747268-bdfb-49a3-8ccc-b777d22d0f84 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.009916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-adad1a94-51c6-45e2-b586-af1f40938c86 req-81747268-bdfb-49a3-8ccc-b777d22d0f84 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:58.047312 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-adad1a94-51c6-45e2-b586-af1f40938c86 req-81747268-bdfb-49a3-8ccc-b777d22d0f84 service nova] Creating event network-vif-deleted:64c7931a-897b-469e-a804-c92a94226730 for instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 on n-h1-791135-8 Oct 04 11:13:58.067537 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-adad1a94-51c6-45e2-b586-af1f40938c86 req-81747268-bdfb-49a3-8ccc-b777d22d0f84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107625 Oct 04 11:13:58.077543 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1989/3223] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:58.095957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:58.096702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:58.117459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.122722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.123373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:58.146432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.146930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.147375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:58.226444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.226803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.227426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:58.228049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lazy-loading 'fault' on Instance uuid a737a39b-9ea3-47a5-bb79-75864179bab1 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:58.300976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:58.308809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34d00ee9-7704-47df-b829-0c526441d5f5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1320 microversion: 2.1 time: 0.229918 Oct 04 11:13:58.329669 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1990/3224] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:58 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:58.335222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:58.336179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:58.343671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.344407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.345021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:58.345926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.346610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.347195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:58.385854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.386566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.387159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:58.388338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lazy-loading 'fault' on Instance uuid e51c8e34-27b9-4530-a9f2-c78c64a88a94 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:58.439858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:58.448848 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c4db282-802a-46ed-a998-5b2626ba5f39 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 200 len: 1311 microversion: 2.1 time: 0.117778 Oct 04 11:13:58.451692 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1991/3225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:58 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:58.471475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fac8721a-aa1f-410b-a875-fc0d0dd54b9a", "device": "/dev/xvdb"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:13:58.475717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:58.484835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.485850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.486592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:58.487771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:58.488527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:58.489318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.279293 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34ad3d99-21cf-44bb-b840-d40898caaf38 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "POST /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825345 Oct 04 11:13:59.281816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1992/3226] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:13:58 2022] POST /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:13:59.297668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:59.301985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:59.331007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.331007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.336258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.337568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.343387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.344261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.595609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:59.605324 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecf588a3-f331-44bb-8d19-ccab6f8a3d3e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.320143 Oct 04 11:13:59.605940 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1993/3227] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:59 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:59.626521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:59.628386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:59.636087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.638894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.639487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.640165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.641003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.641455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.736974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.737631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.738741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.739412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lazy-loading 'fault' on Instance uuid a737a39b-9ea3-47a5-bb79-75864179bab1 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:13:59.795980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:13:59.838683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95fb4151-4dd3-40fc-804a-0cae5f34696b tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 200 len: 1320 microversion: 2.1 time: 0.228574 Oct 04 11:13:59.841888 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1994/3228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:59 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:13:59.866410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:59.867401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: e51c8e34-27b9-4530-a9f2-c78c64a88a94] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:59.898338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.898833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.900641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.902093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.902747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.903603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.921752 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] HTTP exception thrown: Instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 could not be found. Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Request method failure captured: Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 HTTP/1.1 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUXj6F37xPcXSXnWGh065-wEOCfvzadcJEI6WXRfbJylZ-utnUbA8pvEX0QJ6IxTDGmAXQsxAEh_AnAOXZLvpW_VbKzkPqW3fHZLC42P8aiyFehz5IiFr2G5kL9RXpETscb51-Rg7CwxT3e3AdDcE6zXgDAq6URIoa53qMCCT3St6Q Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fb37a21f84fd4716b3be0319be618722 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb37a21f84fd4716b3be0319be618722"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb37a21f84fd4716b3be0319be618722"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb37a21f84fd4716b3be0319be618722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb37a21f84fd4716b3be0319be618722"}]}] Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fb37a21f84fd4716b3be0319be618722 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListServerFiltersTestJSON-1421647952-project Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3a7eff353d84426c845837195ecf9f50 Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListServerFiltersTestJSON-1421647952-project Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 could not be found. Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'e51c8e34-27b9-4530-a9f2-c78c64a88a94'} Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 could not be found. Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 could not be found. Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:13:59.923764 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:59.928733 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:13:59.928733 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:13:59.928733 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:13:59.928733 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:13:59.928733 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:13:59.928733 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 could not be found. Oct 04 11:13:59.928733 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:13:59.930446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Returning 404 to user: Instance e51c8e34-27b9-4530-a9f2-c78c64a88a94 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:13:59.932080 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6fd72ce2-3c31-4c9b-be00-164bf731d148 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94" status: 404 len: 111 microversion: 2.1 time: 0.088473 Oct 04 11:13:59.936712 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1995/3229] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:13:59 2022] GET /compute/v2.1/servers/e51c8e34-27b9-4530-a9f2-c78c64a88a94 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:13:59.942883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:13:59.943593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:13:59.949811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:13:59.952862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.956424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.957251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:13:59.958207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:13:59.959071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:13:59.959671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:00.006929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:14:00.178061 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0504a664-5dd3-4f08-ba2f-f09e4dbdd535 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6" status: 204 len: 0 microversion: 2.1 time: 0.239240 Oct 04 11:14:00.180074 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1996/3230] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:13:59 2022] DELETE /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:14:00.362275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1613547002", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "46ef5295-5c7d-4bd5-bee2-4e0ba8effdeb"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:00.446051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] validate_networks() for [('46ef5295-5c7d-4bd5-bee2-4e0ba8effdeb', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:14:01.113592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:14:01.114117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:14:01.114667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:14:01.115818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:14:01.116408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:14:01.127864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:01.128544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:01.129157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:01.130114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:01.130736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:01.131336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:01.160514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Getting quotas for project 52b172e7699d45d6b47f9bdc5a38203e. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:14:01.173511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Getting quotas for user 5d291ac2bcf94e3288c243542024c848 and project 52b172e7699d45d6b47f9bdc5a38203e. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:14:01.194936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:14:01.200945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:14:01.292255 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f413cde1-d80f-4dfe-ad2a-1ba72bc6e8a1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109593 Oct 04 11:14:01.298829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1997/3231] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:14:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:14:01.301914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f2dd3467-0057-49c4-bac4-262a86c18977 req-65f391d0-5c5e-4e2d-906d-7f455bbf235b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a737a39b-9ea3-47a5-bb79-75864179bab1", "name": "network-vif-deleted", "tag": "5ac64f65-2be9-4b4f-ae4b-17840dafbec1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:01.318011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f2dd3467-0057-49c4-bac4-262a86c18977 req-65f391d0-5c5e-4e2d-906d-7f455bbf235b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:01.318582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f2dd3467-0057-49c4-bac4-262a86c18977 req-65f391d0-5c5e-4e2d-906d-7f455bbf235b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:01.319028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f2dd3467-0057-49c4-bac4-262a86c18977 req-65f391d0-5c5e-4e2d-906d-7f455bbf235b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:01.339841 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f2dd3467-0057-49c4-bac4-262a86c18977 req-65f391d0-5c5e-4e2d-906d-7f455bbf235b service nova] Creating event network-vif-deleted:5ac64f65-2be9-4b4f-ae4b-17840dafbec1 for instance a737a39b-9ea3-47a5-bb79-75864179bab1 on n-h1-791135-8 Oct 04 11:14:01.346968 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f2dd3467-0057-49c4-bac4-262a86c18977 req-65f391d0-5c5e-4e2d-906d-7f455bbf235b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051718 Oct 04 11:14:01.361541 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1998/3232] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:01.368325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:01.369111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:01.392693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:01.394842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:01.395314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:01.396051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:01.396520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:01.397833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:01.656444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:01.666977 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1715a26b-9d1e-4c0a-b795-f5206f0c293a tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6" status: 200 len: 1519 microversion: 2.1 time: 0.303901 Oct 04 11:14:01.686111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 1999/3233] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:01 2022] GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:01.695441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:01.700758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:01.724143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:01.726071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:01.742726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:01.743357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:01.744122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:01.744632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:01.745061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:01.956581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:01.960773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:01.969368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-830accac-de91-46ee-ae79-8560ae0ba109 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.282052 Oct 04 11:14:01.989222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2000/3234] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:01 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:01.997645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eee776a-95fb-4f15-b2a8-31b73e4e004f"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:02.001594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:02.010166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:02.011455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:02.013600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:02.014781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:02.015473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:02.018863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:02.565951 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-acb13d59-cff3-4597-b3ca-3397cb020831 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572624 Oct 04 11:14:02.568618 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2001/3235] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:14:01 2022] POST /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d/os-volume_attachments => generated 194 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:02.621816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:02.625797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:02.650331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:02.651193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:02.654421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:02.656052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:02.657373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:02.658189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:02.689205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 HTTP/1.1 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a737a39b-9ea3-47a5-bb79-75864179bab1'} Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:02.691320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:02.696408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:02.696408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:02.696408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:02.696408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:02.696408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:14:02.696408 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:02.696408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:02.698230 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7ed1fde-3875-4b33-83ad-67655aa00040 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 404 len: 111 microversion: 2.1 time: 0.128199 Oct 04 11:14:02.699140 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2002/3236] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:02 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:14:02.709569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8547b8c8-0ac3-4eb5-afb0-9642e3223ac9 req-b49c38dd-428a-4622-851b-e859ebb1985a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "name": "network-vif-plugged", "status": "completed", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:02.720231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8547b8c8-0ac3-4eb5-afb0-9642e3223ac9 req-b49c38dd-428a-4622-851b-e859ebb1985a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:02.720861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8547b8c8-0ac3-4eb5-afb0-9642e3223ac9 req-b49c38dd-428a-4622-851b-e859ebb1985a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:02.722240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8547b8c8-0ac3-4eb5-afb0-9642e3223ac9 req-b49c38dd-428a-4622-851b-e859ebb1985a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:02.745672 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8547b8c8-0ac3-4eb5-afb0-9642e3223ac9 req-b49c38dd-428a-4622-851b-e859ebb1985a service nova] Creating event network-vif-plugged:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:14:02.766157 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8547b8c8-0ac3-4eb5-afb0-9642e3223ac9 req-b49c38dd-428a-4622-851b-e859ebb1985a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060866 Oct 04 11:14:02.771340 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2003/3237] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:02.793121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:02.799098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:02.816176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:02.816856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:02.817645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:02.819066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:02.819779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:02.820465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:03.016078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:03.032907 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e4857f5-4e90-41b6-aaee-0cbe12975eea tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1270 microversion: 2.1 time: 0.258743 Oct 04 11:14:03.035010 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2004/3238] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:02 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1270 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:03.040494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:03.041949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:03.074898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:03.077030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:03.082071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:03.082851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:03.084476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:03.085161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:03.383772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:03.395135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76144536-cc68-453e-b4da-255551d3a449 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6" status: 200 len: 1477 microversion: 2.1 time: 0.358305 Oct 04 11:14:03.396459 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2005/3239] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:03 2022] GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:03.404184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1054153959", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "999d214d-a128-4728-9cd3-99390decb15f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:03.483765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] validate_networks() for [('999d214d-a128-4728-9cd3-99390decb15f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:14:04.687080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:14:04.688177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:14:04.688802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:14:04.689504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:14:04.690243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:14:04.710767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:04.711608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:04.715869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:04.725710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:04.726556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:04.727191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:04.766546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:14:04.771893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Getting quotas for user 0787189ca1f844709e5f9cec124c772e and project 99c6529843094fdd90961baa8313dd87. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:14:04.788046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:14:04.791726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:14:04.907142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1cec8cb-6b87-4917-a87f-f856a789b2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509387 Oct 04 11:14:04.907809 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2006/3240] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:14:04.921165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:04.921899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:04.929193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:04.929747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:04.930197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:04.930915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:04.932007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:04.932458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:05.322029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:05.339058 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6f35b11a-cfa7-4307-8561-3058e1edc651 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.422503 Oct 04 11:14:05.341608 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2007/3241] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:04 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:05.365516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-691f9f3e-c1f8-46ec-a4c6-93776a093365 req-9cdaa802-3461-459a-84bb-c888e633fc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc5fd6c-061c-4a64-9c38-7921d05c6fa6", "name": "network-vif-deleted", "tag": "39fdf6ef-7cbc-4e5a-8fbd-bec045de514e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:05.402154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-691f9f3e-c1f8-46ec-a4c6-93776a093365 req-9cdaa802-3461-459a-84bb-c888e633fc27 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:05.404147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-691f9f3e-c1f8-46ec-a4c6-93776a093365 req-9cdaa802-3461-459a-84bb-c888e633fc27 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:05.408093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-691f9f3e-c1f8-46ec-a4c6-93776a093365 req-9cdaa802-3461-459a-84bb-c888e633fc27 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:05.443594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-691f9f3e-c1f8-46ec-a4c6-93776a093365 req-9cdaa802-3461-459a-84bb-c888e633fc27 service nova] Creating event network-vif-deleted:39fdf6ef-7cbc-4e5a-8fbd-bec045de514e for instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 on n-h1-791135-8 Oct 04 11:14:05.449081 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-691f9f3e-c1f8-46ec-a4c6-93776a093365 req-9cdaa802-3461-459a-84bb-c888e633fc27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106027 Oct 04 11:14:05.454949 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2008/3242] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:05.467966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:05.469636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:05.478073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:05.478695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:05.481502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:05.483568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:05.484431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:05.485098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:05.667838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:05.688265 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be033843-520e-49a2-a99d-55b16f4862c1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1276 microversion: 2.1 time: 0.230831 Oct 04 11:14:05.690950 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2009/3243] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:05 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:05.701333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:05.701974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:05.715114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:05.715653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:05.716093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:05.721114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:05.721581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:05.721993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:05.760272 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] HTTP exception thrown: Instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 could not be found. Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Request method failure captured: Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 HTTP/1.1 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUXj6F37xPcXSXnWGh065-wEOCfvzadcJEI6WXRfbJylZ-utnUbA8pvEX0QJ6IxTDGmAXQsxAEh_AnAOXZLvpW_VbKzkPqW3fHZLC42P8aiyFehz5IiFr2G5kL9RXpETscb51-Rg7CwxT3e3AdDcE6zXgDAq6URIoa53qMCCT3St6Q Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fb37a21f84fd4716b3be0319be618722 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb37a21f84fd4716b3be0319be618722"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb37a21f84fd4716b3be0319be618722"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb37a21f84fd4716b3be0319be618722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb37a21f84fd4716b3be0319be618722"}]}] Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fb37a21f84fd4716b3be0319be618722 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListServerFiltersTestJSON-1421647952-project Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3a7eff353d84426c845837195ecf9f50 Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListServerFiltersTestJSON-1421647952-project Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 could not be found. Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '6cc5fd6c-061c-4a64-9c38-7921d05c6fa6'} Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 could not be found. Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 could not be found. Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:05.762052 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:05.766650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:05.766650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:05.766650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:05.766650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:05.766650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:05.766650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 could not be found. Oct 04 11:14:05.766650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:05.766650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Returning 404 to user: Instance 6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:05.778681 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac76dae3-ed5b-46cd-98f9-224e468dbfe5 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6" status: 404 len: 111 microversion: 2.1 time: 0.084574 Oct 04 11:14:05.779747 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2010/3244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:05 2022] GET /compute/v2.1/servers/6cc5fd6c-061c-4a64-9c38-7921d05c6fa6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:14:05.795369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d07f93a4-2005-48c3-9f78-bbc08d0186ca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:05.796084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d07f93a4-2005-48c3-9f78-bbc08d0186ca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:05.898115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d07f93a4-2005-48c3-9f78-bbc08d0186ca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:05.912719 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d07f93a4-2005-48c3-9f78-bbc08d0186ca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1209 microversion: 2.1 time: 0.127326 Oct 04 11:14:05.914317 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2011/3245] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:05 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:05.924761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:05.926519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:05.941143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:05.945425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:05.946277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:05.948611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:05.949337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:05.950317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:06.078670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:14:06.251735 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02cf62dc-8b65-4cd5-acf3-ffa18167d0e0 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "DELETE /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 204 len: 0 microversion: 2.1 time: 0.335735 Oct 04 11:14:06.252837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2012/3246] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:14:05 2022] DELETE /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:14:06.265036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:06.265707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:06.273344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:06.273875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:06.274519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:06.275173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:06.275913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:06.276310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:06.487306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:06.502472 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-071cc2d2-edd0-4258-b035-d8dffb7b04a9 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1518 microversion: 2.1 time: 0.244165 Oct 04 11:14:06.503063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2013/3247] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:06 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1518 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:06.510146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:06.510763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:06.526827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:06.527232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:06.529123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:06.529901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:06.533441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:06.533927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:06.804259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:06.818225 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3981e83-ca0c-4a64-95b2-e0a560931b72 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.314069 Oct 04 11:14:06.819830 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2014/3248] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:06 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:06.824302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:06.824964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:06.831009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:06.831499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:06.831936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:06.832625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:06.833135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:06.833584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:07.026340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:07.036358 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f63dab04-3c4d-48b4-a66c-c0b28f207401 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.215267 Oct 04 11:14:07.045590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2015/3249] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:06 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:07.073424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:07.073424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:07.080874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:07.081519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:07.081967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:07.082710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:07.083165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:07.083589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:07.178226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:07.186599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2824c177-d09e-4fff-b9de-04370775d23e tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1261 microversion: 2.1 time: 0.147713 Oct 04 11:14:07.187190 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2016/3250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:07 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:07.527433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:07.528094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:07.535400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:07.535889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:07.536351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:07.537098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:07.537604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:07.538043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:07.848044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:07.859972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-83cc9c69-3db3-4baf-b486-7f87715fd075 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1518 microversion: 2.1 time: 0.336264 Oct 04 11:14:07.860858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2017/3251] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:07 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1518 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:07.884727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:07.894918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:07.911547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:07.913555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:07.914553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:07.916597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:07.918055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:07.920637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:08.522375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:08.530062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:08.538662 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf7427e7-0c1d-4300-9a03-bc9099c88bf7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.671373 Oct 04 11:14:08.544551 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2018/3252] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:07 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:08.551751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:08.552371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:08.572069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:08.572571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:08.574201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:08.579572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:08.580119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:08.580572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:08.943327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:08.954175 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9471202d-20e7-4d5f-97ec-c2f56ff66f56 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.406457 Oct 04 11:14:08.956864 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2019/3253] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:08 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:08.978974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:08.986372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:09.018858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:09.019352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:09.019802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:09.020531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:09.020992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:09.021521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:09.538507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:09.552140 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae2a7940-ab33-41a2-b976-552456e5fc6d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1269 microversion: 2.1 time: 0.589768 Oct 04 11:14:09.553900 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2020/3254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:08 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1269 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:09.570987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:09.571926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:09.588204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:09.589961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:09.591664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:09.594752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:09.595571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:09.597273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:10.050763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7eff353d84426c845837195ecf9f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37a21f84fd4716b3be0319be618722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:10.069319 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f370e2a-dc38-40e0-a878-af24d2547a04 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 200 len: 1476 microversion: 2.1 time: 0.505421 Oct 04 11:14:10.076333 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2021/3255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:09 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 1476 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:10.109924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:10.118396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:10.164427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:10.166110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:10.166943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:10.167946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:10.170846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:10.172466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:10.405729 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:14:10.408159 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:14:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:14:10.511246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:10.522449 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c84caf4f-9e7f-4e01-944c-bd2823ad6d77 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.442539 Oct 04 11:14:10.525211 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2022/3256] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:10 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:10.531801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:10.537489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:10.574511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:10.575064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:10.575515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:10.576234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:10.576693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:10.577319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:10.910062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:10.925538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-073132a7-5f68-40ff-9081-0a8e4ba3b7e2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.397701 Oct 04 11:14:10.926728 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2023/3257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:10 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:10.943199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-17948aaf-f06f-4d73-8915-e850f2118bc1 req-bd0f5a48-39f6-4d75-a21d-3965b4c71400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548509a9-b333-4743-bf83-628478ddf0b1", "name": "network-vif-deleted", "tag": "cf0fbad0-1214-4d74-9dfe-ecc44005ba83"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:10.966465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-17948aaf-f06f-4d73-8915-e850f2118bc1 req-bd0f5a48-39f6-4d75-a21d-3965b4c71400 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:10.968310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-17948aaf-f06f-4d73-8915-e850f2118bc1 req-bd0f5a48-39f6-4d75-a21d-3965b4c71400 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:10.969329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-17948aaf-f06f-4d73-8915-e850f2118bc1 req-bd0f5a48-39f6-4d75-a21d-3965b4c71400 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:11.022689 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-17948aaf-f06f-4d73-8915-e850f2118bc1 req-bd0f5a48-39f6-4d75-a21d-3965b4c71400 service nova] Creating event network-vif-deleted:cf0fbad0-1214-4d74-9dfe-ecc44005ba83 for instance 548509a9-b333-4743-bf83-628478ddf0b1 on n-h1-791135-8 Oct 04 11:14:11.034416 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-17948aaf-f06f-4d73-8915-e850f2118bc1 req-bd0f5a48-39f6-4d75-a21d-3965b4c71400 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103359 Oct 04 11:14:11.036235 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2024/3258] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:11.045669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:11.046819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:11.080402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:11.082085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:11.082769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:11.084167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:11.084875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:11.085527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:11.455997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:11.470558 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-50c670d2-8ba0-4dbc-b36a-d2b4ca617ae0 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.431993 Oct 04 11:14:11.473307 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2025/3259] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:11 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:11.480234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:11.482787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] [instance: 548509a9-b333-4743-bf83-628478ddf0b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:11.496029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:11.496666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:11.497399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:11.498309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:11.498879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:11.499718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:11.516837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] HTTP exception thrown: Instance 548509a9-b333-4743-bf83-628478ddf0b1 could not be found. Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Request method failure captured: Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 HTTP/1.1 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUXj6F37xPcXSXnWGh065-wEOCfvzadcJEI6WXRfbJylZ-utnUbA8pvEX0QJ6IxTDGmAXQsxAEh_AnAOXZLvpW_VbKzkPqW3fHZLC42P8aiyFehz5IiFr2G5kL9RXpETscb51-Rg7CwxT3e3AdDcE6zXgDAq6URIoa53qMCCT3St6Q Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fb37a21f84fd4716b3be0319be618722 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fb37a21f84fd4716b3be0319be618722"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb37a21f84fd4716b3be0319be618722"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fb37a21f84fd4716b3be0319be618722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fb37a21f84fd4716b3be0319be618722"}]}] Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fb37a21f84fd4716b3be0319be618722 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1421647952 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ListServerFiltersTestJSON-1421647952-project Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3a7eff353d84426c845837195ecf9f50 Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ListServerFiltersTestJSON-1421647952-project Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 548509a9-b333-4743-bf83-628478ddf0b1 could not be found. Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '548509a9-b333-4743-bf83-628478ddf0b1'} Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 548509a9-b333-4743-bf83-628478ddf0b1 could not be found. Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 548509a9-b333-4743-bf83-628478ddf0b1 could not be found. Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:11.519236 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 548509a9-b333-4743-bf83-628478ddf0b1 could not be found. Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] Returning 404 to user: Instance 548509a9-b333-4743-bf83-628478ddf0b1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:11.525437 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0b500c9-dd43-47d2-893f-a46d63911a19 tempest-ListServerFiltersTestJSON-1421647952 tempest-ListServerFiltersTestJSON-1421647952-project] 10.222.0.23 "GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1" status: 404 len: 111 microversion: 2.1 time: 0.048084 Oct 04 11:14:11.526785 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2026/3260] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:11 2022] GET /compute/v2.1/servers/548509a9-b333-4743-bf83-628478ddf0b1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:14:11.567200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:11.568261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:11.577625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:11.579102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:11.579848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:11.581129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:11.581854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:11.582956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:11.802930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:11.811922 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b40a20cc-3c3c-479b-b9cd-e31620f71f05 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.267058 Oct 04 11:14:11.817232 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2027/3261] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:11 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:11.956166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:11.956801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:11.971719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:11.977596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:11.978271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:11.979365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:11.980002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:11.980629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:12.216431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:12.229021 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f8f2777b-5346-468f-b05b-b7754235978b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.278150 Oct 04 11:14:12.230244 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2028/3262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:11 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:14:12.238702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8d63878d-170e-4ba5-8e64-c443d861fa44 req-f864cc68-123d-4327-aec6-12a2ff4348a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc74744-2d54-4822-9ef1-a4bbf68631a1", "tag": "80f2f48c-bcbb-4f85-a616-a9fa7ca9f9d0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:12.255851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d63878d-170e-4ba5-8e64-c443d861fa44 req-f864cc68-123d-4327-aec6-12a2ff4348a8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:12.256760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d63878d-170e-4ba5-8e64-c443d861fa44 req-f864cc68-123d-4327-aec6-12a2ff4348a8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:12.257465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d63878d-170e-4ba5-8e64-c443d861fa44 req-f864cc68-123d-4327-aec6-12a2ff4348a8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:12.270942 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8d63878d-170e-4ba5-8e64-c443d861fa44 req-f864cc68-123d-4327-aec6-12a2ff4348a8 service nova] Creating event network-changed:80f2f48c-bcbb-4f85-a616-a9fa7ca9f9d0 for instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 on n-h1-791135-8 Oct 04 11:14:12.277806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8d63878d-170e-4ba5-8e64-c443d861fa44 req-f864cc68-123d-4327-aec6-12a2ff4348a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045346 Oct 04 11:14:12.279092 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2029/3263] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:12.497222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:12.497439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:12.511501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:12.512007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:12.512521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:12.513244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:12.513732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:12.514578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:12.929895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:12.992956 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca5f6c77-d1be-48fe-a598-409f9c03d629 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.501203 Oct 04 11:14:12.993915 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2030/3264] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:12 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:14:12.999535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:13.000335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:13.007237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:13.008018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:13.008614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:13.009535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:13.010179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:13.010607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:13.330905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:13.345814 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7538e607-6095-4f66-9ac3-3ae73a655578 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.347203 Oct 04 11:14:13.346063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2031/3265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:12 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:13.351875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8d885ff3-805f-44e6-97fb-3f03ffdba96c req-148e1ea6-edfa-4b14-bad9-1dbc4cc2ae96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26460e6f-e9a5-4ea4-b756-53ed860dfce5", "tag": "be548080-747c-4a27-8154-3532837cc1aa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:13.370571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d885ff3-805f-44e6-97fb-3f03ffdba96c req-148e1ea6-edfa-4b14-bad9-1dbc4cc2ae96 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:13.371293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d885ff3-805f-44e6-97fb-3f03ffdba96c req-148e1ea6-edfa-4b14-bad9-1dbc4cc2ae96 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:13.373164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d885ff3-805f-44e6-97fb-3f03ffdba96c req-148e1ea6-edfa-4b14-bad9-1dbc4cc2ae96 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:13.388205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8d885ff3-805f-44e6-97fb-3f03ffdba96c req-148e1ea6-edfa-4b14-bad9-1dbc4cc2ae96 service nova] Creating event network-changed:be548080-747c-4a27-8154-3532837cc1aa for instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 on n-h1-791135-8 Oct 04 11:14:13.394310 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8d885ff3-805f-44e6-97fb-3f03ffdba96c req-148e1ea6-edfa-4b14-bad9-1dbc4cc2ae96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046867 Oct 04 11:14:13.399295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2032/3266] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:13.424480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:13.426342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:13.441010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:13.441544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:13.445451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:13.448980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:13.449550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:13.450007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:13.819762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:13.829243 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c48f2ba-3301-48df-a5e6-2431b7d3ac43 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.428447 Oct 04 11:14:13.839515 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2033/3267] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:13 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:14.019086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:14.020009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:14.031492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:14.032192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:14.032936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:14.039401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:14.040113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:14.040698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:14.290523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:14.317828 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f8aa90dc-8d66-4eab-9137-6db8d350a7a9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.302392 Oct 04 11:14:14.319626 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2034/3268] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:14 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:14.381689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:14.383074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:14.390360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:14.391305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:14.391981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:14.392989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:14.395044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:14.395749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:14.630196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:14.643050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d2cb6e8-85e8-41ce-8318-9a5dd811ce96 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.271361 Oct 04 11:14:14.644400 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2035/3269] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:14 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:14.867230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:14.867712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:14.870270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=22 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:14.890901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:14.894659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:14.896382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:14.898422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:14.899460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:14.900540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:15.287283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:15.297042 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2af763a1-bc64-41da-a5df-d6b33c655b0c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.437422 Oct 04 11:14:15.302501 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2036/3270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:14 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:14:15.348724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:15.349662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:15.362038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:15.362809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:15.363410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:15.364762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:15.365412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:15.372736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:15.909615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:15.955973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:15.976023 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4eb69328-ce75-4212-9607-50e569ddf2bb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.635314 Oct 04 11:14:15.989752 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2037/3271] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:15 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:15.997902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:15.998802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:16.005496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:16.006272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:16.006884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:16.007812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:16.008453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:16.009050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:16.013968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:16.604890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:16.625989 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-39b70cf1-da9b-4332-86e1-86c9bf153f28 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.634143 Oct 04 11:14:16.635677 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2038/3272] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:15 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:16.649660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:16.650849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:16.657588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:16.659871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:16.660769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:16.661631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:16.662561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:16.663447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:16.664046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:17.016572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:17.025282 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6c7e0b6b-495f-4b15-89d4-b9d2467f969e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.388001 Oct 04 11:14:17.041259 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2039/3273] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:16 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:17.047390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:17.048263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:17.054603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:17.055094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:17.055709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:17.056594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:17.057222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:17.057834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:17.271924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:17.281707 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dcda6651-84db-49e0-8ca0-1f0cde62bb27 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.238902 Oct 04 11:14:17.294737 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2040/3274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:17 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:17.655420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:17.656287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:17.696478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:17.697260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:17.698893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:17.703967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:17.706991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:17.708787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:18.107729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:18.116778 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51ad6671-91ad-4729-86f7-39b49a3ad767 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.466706 Oct 04 11:14:18.118581 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2041/3275] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:17 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:14:18.123887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5a006288-937f-4963-8f6d-773737ebd205 req-3a0f8fd0-4b47-4397-86b9-6fedf50d8eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26460e6f-e9a5-4ea4-b756-53ed860dfce5", "name": "network-vif-plugged", "status": "completed", "tag": "be548080-747c-4a27-8154-3532837cc1aa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:18.135154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5a006288-937f-4963-8f6d-773737ebd205 req-3a0f8fd0-4b47-4397-86b9-6fedf50d8eae service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:18.135837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5a006288-937f-4963-8f6d-773737ebd205 req-3a0f8fd0-4b47-4397-86b9-6fedf50d8eae service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:18.136467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5a006288-937f-4963-8f6d-773737ebd205 req-3a0f8fd0-4b47-4397-86b9-6fedf50d8eae service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:18.151257 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5a006288-937f-4963-8f6d-773737ebd205 req-3a0f8fd0-4b47-4397-86b9-6fedf50d8eae service nova] Creating event network-vif-plugged:be548080-747c-4a27-8154-3532837cc1aa for instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 on n-h1-791135-8 Oct 04 11:14:18.167725 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5a006288-937f-4963-8f6d-773737ebd205 req-3a0f8fd0-4b47-4397-86b9-6fedf50d8eae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047628 Oct 04 11:14:18.168378 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2042/3276] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:18.187533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:18.188326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:18.217998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:18.218494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:18.218928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:18.219630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:18.220081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:18.220509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:18.607800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:18.616352 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd991875-dadb-43b1-bd74-4a9c822cee5b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.445203 Oct 04 11:14:18.616936 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2043/3277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:18 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:18.629058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:18.631128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:18.648909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:18.649713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:18.650378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:18.651427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:18.651891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:18.652319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:18.932381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:18.943279 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d52db94a-d770-44cf-9f51-b39ca7a0be28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.322704 Oct 04 11:14:18.943882 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2044/3278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:18 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:19.144444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:19.145069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:19.151788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:19.153142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:19.153237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:19.154131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:19.154656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:19.155828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:19.819612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:19.828383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9396ebe-a9b8-44a0-a0c8-444835aea871 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1684 microversion: 2.1 time: 0.688174 Oct 04 11:14:19.829440 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2045/3279] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:19 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1684 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:19.834364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:19.835238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:19.841824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:19.842598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:19.843732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:19.844924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:19.845647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:19.846302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:20.135164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:20.144366 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-59ea6dfa-d4b3-4430-a21c-1c17a3bf7fd4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1318 microversion: 2.1 time: 0.313633 Oct 04 11:14:20.158144 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2046/3280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:19 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:20.162948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:20.163691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:20.170368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:20.171137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:20.175191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:20.176042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:20.176622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:20.177181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:20.471128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ad6e4fab-75ce-4c6c-beea-48f123e4065e tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1858 microversion: 2.1 time: 0.310874 Oct 04 11:14:20.489219 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2047/3281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:20 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1858 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:20.495122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:20.496343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:20.515038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:20.516005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:20.516600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:20.517927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:20.518705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:20.519538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:20.771631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:20.780212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2906e123-9fe9-44a1-a197-81964fd99bee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.289282 Oct 04 11:14:20.781062 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2048/3282] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:20 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:20.797151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-791135-8", "block_migration": true, "disk_over_commit": false}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:20.799767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:20.805893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:20.806385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:20.806857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:20.807755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:20.808217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:20.808680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:20.838833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lazy-loading 'flavor' on Instance uuid 9444c1a9-b95a-4973-a2d6-e12370497909 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:14:20.855016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Going to try to live migrate instance to n-h2-791135-8 {{(pid=122409) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:14:22.492747 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-39da113f-26b4-4926-a237-27009c9b7adb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/action" status: 202 len: 0 microversion: 2.1 time: 1.710376 Oct 04 11:14:22.508344 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2049/3283] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:14:20 2022] POST /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/action => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:14:22.518236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:22.519157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:22.526662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:22.527469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:22.528753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:22.529797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:22.533844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:22.536424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:22.784506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:22.801784 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b096e728-d859-48b5-96ef-b318ead0d41b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.291103 Oct 04 11:14:22.804677 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2050/3284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:22 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:22.817835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:22.834740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:22.847782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:22.848503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:22.850033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:22.851322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:22.851980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:22.852656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.119763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:23.128689 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e59abfc-8d41-4d27-9adb-3c2d719043ce tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1508 microversion: 2.1 time: 0.322449 Oct 04 11:14:23.129657 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2051/3285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:22 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:23.134584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:23.135276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:23.141514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.142212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.142863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.143826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.144870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.145415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.343215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:23.351050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0bfd96ba-02e2-41dc-9b9c-1776dbc785c5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.220184 Oct 04 11:14:23.351721 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2052/3286] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:23 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:23.356180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6eee5a4d-b44c-41f1-a777-81ba7cf47a50 req-ecefcbed-bdc9-4a79-8d5e-8c0e814f876f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc74744-2d54-4822-9ef1-a4bbf68631a1", "name": "network-vif-plugged", "status": "completed", "tag": "80f2f48c-bcbb-4f85-a616-a9fa7ca9f9d0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:23.366243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6eee5a4d-b44c-41f1-a777-81ba7cf47a50 req-ecefcbed-bdc9-4a79-8d5e-8c0e814f876f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.366728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6eee5a4d-b44c-41f1-a777-81ba7cf47a50 req-ecefcbed-bdc9-4a79-8d5e-8c0e814f876f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.367164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6eee5a4d-b44c-41f1-a777-81ba7cf47a50 req-ecefcbed-bdc9-4a79-8d5e-8c0e814f876f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.378959 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6eee5a4d-b44c-41f1-a777-81ba7cf47a50 req-ecefcbed-bdc9-4a79-8d5e-8c0e814f876f service nova] Creating event network-vif-plugged:80f2f48c-bcbb-4f85-a616-a9fa7ca9f9d0 for instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 on n-h1-791135-8 Oct 04 11:14:23.385454 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6eee5a4d-b44c-41f1-a777-81ba7cf47a50 req-ecefcbed-bdc9-4a79-8d5e-8c0e814f876f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Oct 04 11:14:23.386380 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2053/3287] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:23.393295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:23.394153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:23.401069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.401831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.402264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.403709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.404203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.404635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.409059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:23.643706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:23.653535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8b966bc-3c5c-4e03-b1a3-1a221fe9b84e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.264183 Oct 04 11:14:23.654779 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2054/3288] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:23 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:23.658921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:23.659551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:23.665206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.665757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.666203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.666903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.667361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.667790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.694329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:14:23.790701 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6904fe9b-c53d-4cc8-a514-c67b1dd5c9fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 204 len: 0 microversion: 2.1 time: 0.135365 Oct 04 11:14:23.791537 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2055/3289] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:14:23 2022] DELETE /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:14:23.797062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:23.797780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:23.804126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.804520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.805130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.805894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:23.806347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:23.806774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:23.964583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:23.973426 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51fe5eee-86dd-458a-af2c-ad770d0cd1d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.180793 Oct 04 11:14:23.974191 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2056/3290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:23 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:24.147085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-965417351", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "68ac64c4-cb24-4d23-b02c-ea4d50e226b9"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:24.229541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] validate_networks() for [('68ac64c4-cb24-4d23-b02c-ea4d50e226b9', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:14:24.733388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:14:24.734235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:14:24.734688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:14:24.735139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:14:24.735878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:14:24.747175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:24.748210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:24.748717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:24.750485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:24.750952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:24.751378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:24.770972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Getting quotas for project 7af53703c5144463a8771ea0d4d659a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:14:24.775450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Getting quotas for user 86c8af1c7207464784f22cbdddc2a5c4 and project 7af53703c5144463a8771ea0d4d659a5. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:14:24.789271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:14:24.791605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:14:24.844237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de5d2489-36d1-4367-982c-43a5d5653a8f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851469 Oct 04 11:14:24.845952 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2057/3291] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:14:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:14:24.862465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:24.863692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:24.880010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:24.880506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:24.880941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:24.881713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:24.882335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:24.882921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:25.122992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:25.132303 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68906d81-7d5b-44fd-9471-9c1d1388b673 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1508 microversion: 2.1 time: 0.281778 Oct 04 11:14:25.137484 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2058/3292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:24 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:25.145013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:25.145922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:25.152870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:25.153583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:25.154382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:25.162335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:25.163056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:25.163697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:25.436289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:25.450491 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7034cca6-6bfd-4391-b933-1bc33e3032b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1553 microversion: 2.1 time: 0.311527 Oct 04 11:14:25.466920 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2059/3293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:25 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:25.475336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:25.477278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:25.484459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:25.485250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:25.486197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:25.488592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:25.489081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:25.489550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:25.682794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:25.692012 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e5aa47f-461b-4d71-819f-259c99a38ee6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1309 microversion: 2.1 time: 0.223903 Oct 04 11:14:25.693010 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2060/3294] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:25 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1309 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:25.698040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:25.698896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:25.705928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:25.706686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:25.707475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:25.709017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:25.709736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:25.710376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:25.886414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:25.897305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cff9fb18-c431-44ef-b2ab-6426ffe87adc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.202811 Oct 04 11:14:25.909372 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2061/3295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:25 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:25.909372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:25.909372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:25.915354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:25.916011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:25.916613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:25.917442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:25.918170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:25.918926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.001306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:26.011289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f8386215-2ca0-4217-b5cb-6b39a88ab6e4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1228 microversion: 2.1 time: 0.111857 Oct 04 11:14:26.013298 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2062/3296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:25 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1228 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:26.019201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:26.022570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:26.028864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.029511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.030013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.030860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.031430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.035331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.134678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:14:26.135102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:14:26.135574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:14:26.135976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:14:26.136385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:14:26.203721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:26.211943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.212775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.213462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.214753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.215470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.216129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.254876 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f34e066-5221-4fd7-87b6-1890191ba8b4 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "POST /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5/action" status: 202 len: 1110 microversion: 2.1 time: 0.240104 Oct 04 11:14:26.255640 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2063/3297] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:14:26 2022] POST /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5/action => generated 1110 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 11:14:26.260393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:26.261260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:26.268462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.269421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.270400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.271403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.272107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.272767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.462538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:26.477862 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-257dfe3d-6705-4cd4-935f-26f918508b40 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.219362 Oct 04 11:14:26.501028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2064/3298] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:26 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:26.520964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6c1f1dcd-2dd3-4b2b-a80e-af3e64ceebe5 req-bda548c2-a63b-4a19-9e94-a65a247ba903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "name": "network-vif-unplugged", "status": "completed", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:26.532324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6c1f1dcd-2dd3-4b2b-a80e-af3e64ceebe5 req-bda548c2-a63b-4a19-9e94-a65a247ba903 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.533126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6c1f1dcd-2dd3-4b2b-a80e-af3e64ceebe5 req-bda548c2-a63b-4a19-9e94-a65a247ba903 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.534294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6c1f1dcd-2dd3-4b2b-a80e-af3e64ceebe5 req-bda548c2-a63b-4a19-9e94-a65a247ba903 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.549179 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6c1f1dcd-2dd3-4b2b-a80e-af3e64ceebe5 req-bda548c2-a63b-4a19-9e94-a65a247ba903 service nova] Creating event network-vif-unplugged:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:14:26.562876 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6c1f1dcd-2dd3-4b2b-a80e-af3e64ceebe5 req-bda548c2-a63b-4a19-9e94-a65a247ba903 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060272 Oct 04 11:14:26.568859 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2065/3299] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:26.587214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:26.588465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:26.596081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.596983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.597633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.600732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:26.601438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:26.602204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:26.980018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:26.992049 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb2fed7c-d367-4dd0-8af9-0e5ff67e11c9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.410310 Oct 04 11:14:26.994964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2066/3300] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:26 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:27.005489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:27.006396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:27.013288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:27.014917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:27.015429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:27.016355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:27.016984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:27.017811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:27.325971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:27.337240 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8f4c7d7-5aa1-4d17-94e7-5f76828f4d99 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1553 microversion: 2.1 time: 0.341072 Oct 04 11:14:27.338493 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2067/3301] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:26 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1553 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:27.345435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:27.346366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:27.353026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:27.353828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:27.354452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:27.355607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:27.356153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:27.356585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:27.376592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:27.925638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:27.951052 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0fc6795d-f93e-4b8a-a3f4-4bf8dda25606 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.608572 Oct 04 11:14:27.951675 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2068/3302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:27 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:27.962134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:27.962752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:28.006271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:28.008276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:28.008723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:28.010304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:28.010836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:28.011193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:28.691795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:28.700654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-357102bd-435f-4d34-862e-b5fdb9ebb15d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1490 microversion: 2.1 time: 0.747900 Oct 04 11:14:28.709575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2069/3303] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:27 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1490 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:28.709575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:28.709575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:28.716638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:28.717137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:28.717657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:28.718541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:28.718881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:28.719440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:28.947843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:28.957033 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-752abec1-d3f7-48fc-8c07-d93b418063e8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.253971 Oct 04 11:14:28.957796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2070/3304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:28 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:28.977193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:28.977835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:28.983903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:28.984404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:28.984849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:28.985676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:28.986328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:28.986935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.068670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:29.077428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e19e94f-1218-4a63-87eb-58b36c38c404 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1282 microversion: 2.1 time: 0.103916 Oct 04 11:14:29.078014 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2071/3305] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:28 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:29.083334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a4b2df4a-fc0d-4175-8264-3543e33dffe6 req-0c84b9bb-a5e4-4d5c-89cd-8cf090314e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c34390-7b46-48fa-abcd-67db6ce2a58d", "name": "network-vif-deleted", "tag": "90c4d3b8-3c84-43cf-b7d7-3e4d8ca66e3f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:29.092946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4b2df4a-fc0d-4175-8264-3543e33dffe6 req-0c84b9bb-a5e4-4d5c-89cd-8cf090314e6f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.093517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4b2df4a-fc0d-4175-8264-3543e33dffe6 req-0c84b9bb-a5e4-4d5c-89cd-8cf090314e6f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.093955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4b2df4a-fc0d-4175-8264-3543e33dffe6 req-0c84b9bb-a5e4-4d5c-89cd-8cf090314e6f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.105976 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a4b2df4a-fc0d-4175-8264-3543e33dffe6 req-0c84b9bb-a5e4-4d5c-89cd-8cf090314e6f service nova] Creating event network-vif-deleted:90c4d3b8-3c84-43cf-b7d7-3e4d8ca66e3f for instance 53c34390-7b46-48fa-abcd-67db6ce2a58d on n-h1-791135-8 Oct 04 11:14:29.110860 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a4b2df4a-fc0d-4175-8264-3543e33dffe6 req-0c84b9bb-a5e4-4d5c-89cd-8cf090314e6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030938 Oct 04 11:14:29.111901 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2072/3306] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:29.116919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:29.117659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:29.124885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.125398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.125907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.126621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.127209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.127643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.360978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:29.370226 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a982cb0e-de6c-481c-a19a-00290fb4aeea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.256907 Oct 04 11:14:29.372568 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2073/3307] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:29 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:29.377996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:29.378933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:29.388396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.389141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.389852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.390853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.391708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.392361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.598041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:29.608284 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6cf91fb1-950a-4564-9432-792afd21fe24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.234292 Oct 04 11:14:29.609656 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2074/3308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:29 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:29.615665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:29.616858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:29.630421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.631208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.631821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.632526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.633189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.633820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.787965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:29.801794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa86998e-9d1b-4ae7-b973-0870f59cbad8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1346 microversion: 2.1 time: 0.190581 Oct 04 11:14:29.803999 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2075/3309] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:29 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1346 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:29.812169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1168256749"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:29.814764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:29.820229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:29.831662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.832411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.833339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.834291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.834948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.836169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.940462 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-273598c5-10a9-4a7d-a9da-0194d7c8b0b1 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "PUT /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1075 microversion: 2.1 time: 0.135598 Oct 04 11:14:29.953820 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2076/3310] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:14:29 2022] PUT /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1075 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:29.958928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:29.960778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:29.966910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.967412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.967832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:29.968531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:29.968978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:29.969904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:30.067760 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3514744-b75e-4a1e-98fd-acae16d61346 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.112828 Oct 04 11:14:30.068494 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2077/3311] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:14:29 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:14:30.075328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:30.076722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:30.084866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:30.085623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:30.086329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:30.087068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:30.087685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:30.088171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:30.430052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:30.437959 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-745f7800-dc4a-419b-88b1-4ebc104372ed tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1501 microversion: 2.1 time: 0.367944 Oct 04 11:14:30.438534 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2078/3312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:30 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1501 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:30.453644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:30.455142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:30.461841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:30.462357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:30.462922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:30.463650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:30.464102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:30.465029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:30.753800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:30.764321 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-401b610c-c9f1-43d7-9d0d-dd9f07d6df59 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.315707 Oct 04 11:14:30.765661 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2079/3313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:30 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:30.782524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:30.783688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:30.790252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:30.790820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:30.791325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:30.792092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:30.792616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:30.793106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.176597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:31.186050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82a9667a-38ec-4fc2-aabf-f86e0a3e071f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1673 microversion: 2.1 time: 0.411181 Oct 04 11:14:31.200757 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2080/3314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:30 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1673 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:31.200757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:31.200757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:31.200757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.200757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.200757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.201671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.202086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.202774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.450529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:31.461232 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d4c55d6d-b147-4e72-ae75-8d770cbba16b tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1324 microversion: 2.1 time: 0.273178 Oct 04 11:14:31.462138 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2081/3315] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:31 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:31.467315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:31.468117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:31.476872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.478224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.478861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.479574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.480739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.481177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.684299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:31.692363 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f56bf39a-b8b4-48d5-bde3-4cea867e0086 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1501 microversion: 2.1 time: 0.229059 Oct 04 11:14:31.693320 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2082/3316] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:31 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1501 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:31.700200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:31.701046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:31.708155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.708812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.709454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.710318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.710768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.711193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.842766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:31.850740 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4dcff2f-1d59-4e2d-aa5f-28c8a8918d96 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.155942 Oct 04 11:14:31.851251 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2083/3317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:31 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:31.865582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:31.865582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:31.865582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.865582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.865582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.865582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.865582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.866209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.869917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:31.935748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:31.943895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-88d726d2-1929-42bf-aeb9-3619cdaf0a7a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1346 microversion: 2.1 time: 0.091610 Oct 04 11:14:31.944462 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2084/3318] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:31 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:31.949065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-61fb9185-8551-4afb-ae38-33509272a4de req-54adcea4-2916-45cc-9f1f-db19aa3975b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc90ac61-0c14-4e9c-81f3-ae62058485a5", "tag": "99bf0b88-3a8f-492f-bc26-f96d34c040a8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:31.958484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-61fb9185-8551-4afb-ae38-33509272a4de req-54adcea4-2916-45cc-9f1f-db19aa3975b9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.958968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-61fb9185-8551-4afb-ae38-33509272a4de req-54adcea4-2916-45cc-9f1f-db19aa3975b9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.959399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-61fb9185-8551-4afb-ae38-33509272a4de req-54adcea4-2916-45cc-9f1f-db19aa3975b9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:31.970917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-61fb9185-8551-4afb-ae38-33509272a4de req-54adcea4-2916-45cc-9f1f-db19aa3975b9 service nova] Creating event network-changed:99bf0b88-3a8f-492f-bc26-f96d34c040a8 for instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 on n-h1-791135-8 Oct 04 11:14:31.975748 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-61fb9185-8551-4afb-ae38-33509272a4de req-54adcea4-2916-45cc-9f1f-db19aa3975b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030115 Oct 04 11:14:31.976545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2085/3319] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:31.982059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-441a4334-b0fc-4aa0-8fd0-4b0199c0c8af tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:31.988433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441a4334-b0fc-4aa0-8fd0-4b0199c0c8af tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:31.988914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441a4334-b0fc-4aa0-8fd0-4b0199c0c8af tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:31.989405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441a4334-b0fc-4aa0-8fd0-4b0199c0c8af tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.012295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-441a4334-b0fc-4aa0-8fd0-4b0199c0c8af tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Going to try to stop instance {{(pid=122409) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:14:32.059350 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-441a4334-b0fc-4aa0-8fd0-4b0199c0c8af tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "POST /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1/action" status: 202 len: 0 microversion: 2.1 time: 0.081484 Oct 04 11:14:32.060531 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2086/3320] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:14:31 2022] POST /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:14:32.066900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:32.067911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:32.074808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.075307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.075754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.076468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.076930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.077414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.211939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:32.220407 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b2b992b7-4af1-4507-8933-6599f422de00 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.158025 Oct 04 11:14:32.220982 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2087/3321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:32 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:32.225563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:32.226044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:32.232376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.232863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.233304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.234024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.234484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.234914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.364913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:32.372767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6fc4f76-a124-45eb-b61f-d10e1a09b165 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.150825 Oct 04 11:14:32.373344 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2088/3322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:32 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:32.389539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:32.390245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:32.396095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.396583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.397026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.397748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.398217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.398645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.534314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:32.543411 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d86a3e8f-91e0-4638-9973-50bf030a0dda tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1678 microversion: 2.1 time: 0.169090 Oct 04 11:14:32.544002 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2089/3323] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:32 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:32.549146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:32.549847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:32.559340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.559340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.559340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.559340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.559340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.559340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.690190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:32.699417 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0304e0ae-87d3-4034-a868-3715a5fd961c tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1324 microversion: 2.1 time: 0.153817 Oct 04 11:14:32.700005 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2090/3324] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:32 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:32.704587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:32.709307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:32.710103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Searching by: {'deleted': False, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:14:32.715444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.715926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.716356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.717079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.717578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.718005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.742681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:14:32.771577 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80c6e4a1-8e4b-41e8-adc1-078a0a4f2214 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.070492 Oct 04 11:14:32.772172 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2091/3325] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:14:32 2022] GET /compute/v2.1/servers => generated 340 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:32.784407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:32.789037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:32.789820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Searching by: {'deleted': False, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:14:32.795360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.795836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.796277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.797106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.797602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.798034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.830882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:14:32.866983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:32.873872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:32.874629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:32.875071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:32.997562 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45071026-54ea-4a98-8ece-32df95dd8ad5 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.216686 Oct 04 11:14:32.998163 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2092/3326] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:14:32 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:14:33.009959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:33.009959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:33.020687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.021184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.021645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.022363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.022833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.023243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.171104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:33.180614 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d106745-2ed4-4ae6-af91-bada395b9ec5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.181346 Oct 04 11:14:33.181321 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2093/3327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:32 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:33.194484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:33.195033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:33.201025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.201555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.201987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.202672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.203205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.203627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.269765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:33.278459 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-87d3cd44-7af3-46ea-88bd-0eb07f4e0d9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1346 microversion: 2.1 time: 0.087891 Oct 04 11:14:33.279029 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2094/3328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:33 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:33.283858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32cfb0e3-b696-41a2-9a5d-06486771ec7f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:33.291897 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32cfb0e3-b696-41a2-9a5d-06486771ec7f tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011887 Oct 04 11:14:33.297493 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2095/3329] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:14:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:33.304808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:33.305465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:33.312125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.312618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.313059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.314102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.315287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.315287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.522028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:33.531203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8146f4aa-6486-4420-9ca3-236098bda7dd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.232629 Oct 04 11:14:33.531776 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2096/3330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:33 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:33.536539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:33.537456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:33.545741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.546370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.546910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.547504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.547954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.548390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.750563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:33.760756 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51e5ba4b-8612-4d52-93a3-df2e031b97dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.227899 Oct 04 11:14:33.773378 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2097/3331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:33 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:33.778909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:33.784326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:33.795505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.796005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.796442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:33.797158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:33.797647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:33.798076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.033869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:34.042149 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5dbf2a6d-a98a-4fdb-8c8c-4e0dd2647ecf tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.278514 Oct 04 11:14:34.046582 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2098/3332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:33 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:34.047243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:34.047844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:34.058696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.059183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.059715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.061315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.065663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.065930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.202925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:34.211054 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2bd5ea77-2edc-48f6-b0d7-b26158d026f9 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1324 microversion: 2.1 time: 0.167320 Oct 04 11:14:34.211707 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2099/3333] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:34 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1324 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:34.225922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:34.226413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:34.232250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.232720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.233150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.233860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.234318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.234736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.253948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:34.262932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:14:34.338443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0ae0bb42-a52f-49a6-89dd-b798578caa1e tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 204 len: 0 microversion: 2.1 time: 0.115794 Oct 04 11:14:34.339121 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2100/3334] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:14:34 2022] DELETE /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:14:34.344254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:34.346653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:34.352356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.352839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.353269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.353992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.354439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.354857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.574295 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd8772ba-e03b-4500-b389-ecfc54f085dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 200 len: 324 microversion: 2.1 time: 0.233649 Oct 04 11:14:34.574950 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2101/3335] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:14:34 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 324 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:34.579850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:34.580537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:34.587482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.587945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.588375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.589055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.589575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.590001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.720661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:34.728821 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-79e6440a-5f02-404f-b6d7-bfb05d6b08ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.152776 Oct 04 11:14:34.729410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2102/3336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:34 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:34.734305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:34.734925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:34.740522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.741001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.741480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.742163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.742609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.743030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.775774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.776244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.776691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.777126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lazy-loading 'fault' on Instance uuid 53c34390-7b46-48fa-abcd-67db6ce2a58d {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:14:34.820857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:34.828981 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eecf7854-0495-44aa-93f9-e2eea937c1db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 200 len: 1351 microversion: 2.1 time: 0.098115 Oct 04 11:14:34.829588 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2103/3337] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:34 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:34.833879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:34.834479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:34.839908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.840381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.840812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.841521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.841970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.842391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.968840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:34.976541 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-665be603-c2d9-4b84-904b-2ec8c9bf7dac tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1716 microversion: 2.1 time: 0.146019 Oct 04 11:14:34.977117 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2104/3338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:34 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1716 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:34.985479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:34.985479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:34.988598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.988598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.988903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:34.989614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:34.990073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:34.990502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:35.128443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:35.136528 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4392f565-ba98-44a0-b884-3051bea19d52 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.158421 Oct 04 11:14:35.137092 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2105/3339] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:34 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:35.141799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:35.142397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:35.148122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:35.148645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:35.149084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:35.149932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:35.150387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:35.150812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:35.595340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:35.603140 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b417abde-1722-43f5-b471-251e822d22b3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.465068 Oct 04 11:14:35.603715 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2106/3340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:35 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:35.608718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:35.609306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:35.614819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:35.615292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:35.615724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:35.616398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:35.616840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:35.617257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:35.745324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:35.753499 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aecb0580-c6d4-4acb-b535-7091fc788750 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.148786 Oct 04 11:14:35.754078 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2107/3341] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:35 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:35.758576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:35.759184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:35.764672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:35.765158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:35.765634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:35.766330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:35.766788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:35.767219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:35.912665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:35.924820 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70b810e8-0acb-4e5f-981b-7210c619459f tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1324 microversion: 2.1 time: 0.169614 Oct 04 11:14:35.925551 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2108/3342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:35 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:35.930460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:35.931175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:35.938213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:35.938838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:35.939370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:35.940247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:35.940802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:35.941232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.094321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:36.103297 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c68ed02a-868d-4711-9cd7-77db020cf45f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.176641 Oct 04 11:14:36.104027 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2109/3343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:35 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:36.110699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:36.111392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:36.117621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.118189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.118626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.119316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.119795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.120186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.366970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:36.375673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfce5b48-ecef-475c-ae13-08e8d17d26cd tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.269561 Oct 04 11:14:36.376258 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2110/3344] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:36 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:36.381221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:36.381860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:36.388760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.389246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.389724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.390414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.391057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.391482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.405363 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d HTTP/1.1 Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53c34390-7b46-48fa-abcd-67db6ce2a58d'} Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:36.407045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5eccfb0a-9f29-4200-84b1-cf78d8ffdc55 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 404 len: 111 microversion: 2.1 time: 0.031129 Oct 04 11:14:36.411716 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2111/3345] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:36 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:14:36.413930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:36.414537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:36.420666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.421089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.421572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.422277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.422730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.423266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.727044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:36.736640 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8db30b4f-89d4-49cd-a7d8-e65795e4eb49 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1716 microversion: 2.1 time: 0.325836 Oct 04 11:14:36.737380 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2112/3346] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:36 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1716 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:36.742282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8f19a02d-1a3c-484d-a5b7-37e4162b37f1 req-1d1e413d-4ebc-45f0-9977-67b224b46417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc90ac61-0c14-4e9c-81f3-ae62058485a5", "name": "network-vif-plugged", "status": "completed", "tag": "99bf0b88-3a8f-492f-bc26-f96d34c040a8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:36.752668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8f19a02d-1a3c-484d-a5b7-37e4162b37f1 req-1d1e413d-4ebc-45f0-9977-67b224b46417 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.753278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8f19a02d-1a3c-484d-a5b7-37e4162b37f1 req-1d1e413d-4ebc-45f0-9977-67b224b46417 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.753796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8f19a02d-1a3c-484d-a5b7-37e4162b37f1 req-1d1e413d-4ebc-45f0-9977-67b224b46417 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.764880 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8f19a02d-1a3c-484d-a5b7-37e4162b37f1 req-1d1e413d-4ebc-45f0-9977-67b224b46417 service nova] Creating event network-vif-plugged:99bf0b88-3a8f-492f-bc26-f96d34c040a8 for instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 on n-h1-791135-8 Oct 04 11:14:36.769967 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8f19a02d-1a3c-484d-a5b7-37e4162b37f1 req-1d1e413d-4ebc-45f0-9977-67b224b46417 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 Oct 04 11:14:36.770881 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2113/3347] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:36.776335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:36.777058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:36.783110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.783588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.784900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:36.785885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:36.786346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:36.786771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:37.162589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:37.173527 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe153f42-46d6-4b25-9bf5-62520fae352e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.401259 Oct 04 11:14:37.189377 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2114/3348] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:36 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:37.189377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:37.189377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:37.189377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:37.189377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:37.189377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:37.189377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:37.189377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:37.190199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:37.542621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:37.557675 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e77ae18-4b54-49a8-9718-f7b5c3ee05f9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.382281 Oct 04 11:14:37.569377 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2115/3349] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:37 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:37.569377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:37.569377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:37.573015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:37.574074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:37.574515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:37.575212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:37.575663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:37.576093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:37.591027 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d/os-volume_attachments HTTP/1.1 Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '53c34390-7b46-48fa-abcd-67db6ce2a58d'} Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:37.591878 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0567e796-7373-4712-8d36-8a181a43f1ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034066 Oct 04 11:14:37.596513 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2116/3350] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:14:37 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:14:37.598308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:37.598918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:37.605541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:37.606034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:37.606782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:37.607493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:37.609516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:37.609995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:37.636628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:37.938938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:37.948038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-38ee24e3-0304-4c61-8867-0377d2791835 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.353186 Oct 04 11:14:37.962071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2117/3351] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:37 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:37.978793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:37.979504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:37.990160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:37.990731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:37.991169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:37.992020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:37.992475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:37.993266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.270437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:38.278860 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fc7b25f-cf54-4a04-b60d-38da6c4edbe7 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1324 microversion: 2.1 time: 0.304635 Oct 04 11:14:38.279437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2118/3352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:37 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1324 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:38.286645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:38.287792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:38.299848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:38.300577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:38.301266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.302692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:38.304873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:38.305528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.482529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:38.491185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc99950c-38e1-4fb3-b8ae-cc2fd3a35e64 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.210284 Oct 04 11:14:38.505389 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2119/3353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:38 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:38.506738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-60c8acaa-e1a1-47d4-8172-222ba184d82e req-8fbee7ec-87f9-49ab-8953-265d52d9f974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9444c1a9-b95a-4973-a2d6-e12370497909", "name": "network-vif-unplugged", "status": "completed", "tag": "8fb4c923-b521-4de9-b13f-7a7861de1c64"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:38.541919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-60c8acaa-e1a1-47d4-8172-222ba184d82e req-8fbee7ec-87f9-49ab-8953-265d52d9f974 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:38.579064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-60c8acaa-e1a1-47d4-8172-222ba184d82e req-8fbee7ec-87f9-49ab-8953-265d52d9f974 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:38.579580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-60c8acaa-e1a1-47d4-8172-222ba184d82e req-8fbee7ec-87f9-49ab-8953-265d52d9f974 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.594170 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-60c8acaa-e1a1-47d4-8172-222ba184d82e req-8fbee7ec-87f9-49ab-8953-265d52d9f974 service nova] Creating event network-vif-unplugged:8fb4c923-b521-4de9-b13f-7a7861de1c64 for instance 9444c1a9-b95a-4973-a2d6-e12370497909 on n-h1-791135-8 Oct 04 11:14:38.599648 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-60c8acaa-e1a1-47d4-8172-222ba184d82e req-8fbee7ec-87f9-49ab-8953-265d52d9f974 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101867 Oct 04 11:14:38.603536 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2120/3354] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:38.608973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:38.609721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:38.615881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:38.617587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:38.618028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:38.618716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.619424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:38.619927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:38.620925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.773789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:38.782938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9768b6dd-8d09-4423-87b9-3a6a9d8b226f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.178008 Oct 04 11:14:38.784083 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2121/3355] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:38 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:38.788907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:38.789716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:38.800652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:38.801138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:38.801601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.802298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:38.802768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:38.803193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.834398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:38.834878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:38.835307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:38.835780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lazy-loading 'fault' on Instance uuid f2627725-9355-4894-963d-4941f7f08f2e {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:14:38.877458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacf4d04c2754298bb4be5f2cea021e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b769c0f7c949e6a9bcf2da47c4ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:38.885912 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2c452a8b-58df-4af0-9e4b-2980a7300e3b tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 200 len: 1367 microversion: 2.1 time: 0.100420 Oct 04 11:14:38.886469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2122/3356] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:38 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:38.897784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-588155271", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "49989f52-07b9-48bb-b42a-1e9bb7c15958"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:38.957750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] validate_networks() for [('49989f52-07b9-48bb-b42a-1e9bb7c15958', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:14:39.330169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:14:39.330588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:14:39.331058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:14:39.331528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:14:39.331989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:14:39.342449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:39.342945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:39.343437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:39.344165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:39.344619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:39.345047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:39.362676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:14:39.369721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for user 510d473de29b4d7d8bb303f64f1e17d4 and project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:14:39.383615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:14:39.385944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:14:39.430653 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-613abff8-f4a1-4560-89b7-b7ba89d04e7b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540193 Oct 04 11:14:39.431306 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2123/3357] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:14:39.436314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:39.436920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:39.443193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:39.443869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:39.444328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:39.445018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:39.446091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:39.446530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:39.587696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:39.596988 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8efa8a3-8fac-414e-b73a-c0015fe73a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.164652 Oct 04 11:14:39.597637 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2124/3358] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:39 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:39.602174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1900955390", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:39.655463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] validate_networks() for [('b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:14:40.050450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:14:40.051019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:14:40.051347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:14:40.051788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:14:40.052346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:14:40.061606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.062094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.062537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.063257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.063710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.064136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.081953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:14:40.085870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for user 2e4e772e6a5b41a0b0f836b374bc69b4 and project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:14:40.098074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:14:40.100267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:14:40.147989 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a18d736d-53ad-410d-aa6f-a475c6361fc5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549238 Oct 04 11:14:40.149303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2125/3359] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:14:40.157519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:40.158256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:40.164897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.165452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.165885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.166584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.167218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.167997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.302683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:40.311902 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9686fc8-9304-4c86-8080-570b3d56afca tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.161259 Oct 04 11:14:40.312467 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2126/3360] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:40 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:40.316867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:40.317530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:40.324113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.324719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.325277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.326003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.326450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.326879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.488397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:40.497545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c60ce120-486a-4f00-876c-07f750d65a1d tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1522 microversion: 2.1 time: 0.184049 Oct 04 11:14:40.501650 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2127/3361] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:40 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:40.506574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:40.507238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:40.514324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.514959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.515397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.516137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.516601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.517029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.583411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:40.591387 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5f181e4-5ddb-4298-993a-0606d8f079eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1266 microversion: 2.1 time: 0.092278 Oct 04 11:14:40.592138 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2128/3362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:40 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:40.596597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:40.597266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:40.604379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.605509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.606013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.606786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.607271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.607789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.745022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:40.756732 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-48c68b67-84d2-4268-9fca-9fba25358f20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.163541 Oct 04 11:14:40.772640 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2129/3363] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:40 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:40.777819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:40.778495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] [instance: f2627725-9355-4894-963d-4941f7f08f2e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:40.784713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.785201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.785677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.786368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.786827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.787503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.802683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] HTTP exception thrown: Instance f2627725-9355-4894-963d-4941f7f08f2e could not be found. Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Request method failure captured: Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e HTTP/1.1 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBVJbYhQAfrqbYs1MZ6TtzgXZ-y1xu6hz8TiyM_57lvP09fmMiEUs5IeDrLtsXcmVGr5y0lZ1jM9JR5Gw5Ha24kB8fb79eOXtaPmNZuEp_cgx_M2Iyn7lZISX0CIE4paV65vBcU6EPr420iAZXJUDZ1yGTNLnPlwsd4NoD5i2Xx6oBw Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 36b769c0f7c949e6a9bcf2da47c4ba88 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestManualDisk-97491042 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36b769c0f7c949e6a9bcf2da47c4ba88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36b769c0f7c949e6a9bcf2da47c4ba88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36b769c0f7c949e6a9bcf2da47c4ba88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36b769c0f7c949e6a9bcf2da47c4ba88"}]}] Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestManualDisk-97491042 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 36b769c0f7c949e6a9bcf2da47c4ba88 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestManualDisk-97491042 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestManualDisk-97491042-project Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: bacf4d04c2754298bb4be5f2cea021e6 Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestManualDisk-97491042-project Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f2627725-9355-4894-963d-4941f7f08f2e could not be found. Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f2627725-9355-4894-963d-4941f7f08f2e'} Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2627725-9355-4894-963d-4941f7f08f2e could not be found. Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2627725-9355-4894-963d-4941f7f08f2e could not be found. Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:40.804592 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:40.809394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:40.809394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:40.809394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:40.809394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:40.809394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:40.809394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2627725-9355-4894-963d-4941f7f08f2e could not be found. Oct 04 11:14:40.809394 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:40.811514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Returning 404 to user: Instance f2627725-9355-4894-963d-4941f7f08f2e could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:40.812475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8fc4d1c2-557a-4788-8537-798da91fe80d tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e" status: 404 len: 111 microversion: 2.1 time: 0.038444 Oct 04 11:14:40.813145 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2130/3364] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:40 2022] GET /compute/v2.1/servers/f2627725-9355-4894-963d-4941f7f08f2e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:14:40.817904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:40.818732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:40.825003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.825627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.826017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.826962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.827639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.828286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.918110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:40.939388 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbec96dd-dca5-4c40-9a33-a58323e7b813 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1211 microversion: 2.1 time: 0.124856 Oct 04 11:14:40.941158 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2131/3365] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:40 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:40.959396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:40.960255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:40.967823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.968401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.968906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.969707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:40.970238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:40.970737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:40.996938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Request method failure captured: Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5/ips/invalid HTTP/1.1 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBWO0MMfT0RA0gpxlWJEgdKxZ72bUw_ejk7S6EXNvleXZ6zIG6okNE3BGsm6kUmmCoSl99ye7ir7tAoPCb9xrzieREu0r7xgfTn6pjl0UvxEeiB8RNnjwhhlt3z09kRzD17GMP99oLGsCfalt_BrShcbUHGx6ktYlkH6ecWaEgjhhkg Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7af53703c5144463a8771ea0d4d659a5 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7af53703c5144463a8771ea0d4d659a5"}]}] Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7af53703c5144463a8771ea0d4d659a5 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerAddressesNegativeTestJSON-1131374841-project Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 86c8af1c7207464784f22cbdddc2a5c4 Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1131374841-project Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance is not a member of specified network Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': 'dc90ac61-0c14-4e9c-81f3-ae62058485a5', 'id': 'invalid'} Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 11:14:41.001645 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:41.005324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:41.005324 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ebd96fb3-f67b-46ac-8a10-96ee9768a17e tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.060873 Oct 04 11:14:41.005324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2132/3366] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:14:40 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5/ips/invalid => generated 91 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:14:41.016341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:41.016963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:41.023650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.025418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.025418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:41.026007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.027066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.027610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:41.056859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:14:41.152320 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d74939c-16e4-4a71-bc47-14e89e2ec795 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 204 len: 0 microversion: 2.1 time: 0.146529 Oct 04 11:14:41.156445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2133/3367] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:14:41 2022] DELETE /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:14:41.161920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:41.163341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:41.170796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.171293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.171731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:41.172424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.172890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.173393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:41.659405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:41.668108 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-330f523e-3e98-47a8-9fb7-dd3ef2f8803c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.510406 Oct 04 11:14:41.668684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2134/3368] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:41 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:41.673207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2a4b43a6-d667-4c29-92a6-68b740cfce5f req-b3bf79b2-9cb9-45dd-9ed7-0351fa355a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2627725-9355-4894-963d-4941f7f08f2e", "name": "network-vif-deleted", "tag": "a2aba20c-ac9d-4aed-bb36-8403c61bf3f1"}, {"name": "network-changed", "server_uuid": "9444c1a9-b95a-4973-a2d6-e12370497909", "tag": "8fb4c923-b521-4de9-b13f-7a7861de1c64"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:41.684793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2a4b43a6-d667-4c29-92a6-68b740cfce5f req-b3bf79b2-9cb9-45dd-9ed7-0351fa355a97 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.685273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2a4b43a6-d667-4c29-92a6-68b740cfce5f req-b3bf79b2-9cb9-45dd-9ed7-0351fa355a97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.685734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2a4b43a6-d667-4c29-92a6-68b740cfce5f req-b3bf79b2-9cb9-45dd-9ed7-0351fa355a97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:41.689761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:41.699946 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2a4b43a6-d667-4c29-92a6-68b740cfce5f req-b3bf79b2-9cb9-45dd-9ed7-0351fa355a97 service nova] Creating event network-vif-deleted:a2aba20c-ac9d-4aed-bb36-8403c61bf3f1 for instance f2627725-9355-4894-963d-4941f7f08f2e on n-h1-791135-8 Oct 04 11:14:41.700457 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2a4b43a6-d667-4c29-92a6-68b740cfce5f req-b3bf79b2-9cb9-45dd-9ed7-0351fa355a97 service nova] Creating event network-changed:8fb4c923-b521-4de9-b13f-7a7861de1c64 for instance 9444c1a9-b95a-4973-a2d6-e12370497909 on n-h1-791135-8 Oct 04 11:14:41.707171 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2a4b43a6-d667-4c29-92a6-68b740cfce5f req-b3bf79b2-9cb9-45dd-9ed7-0351fa355a97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037329 Oct 04 11:14:41.707774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2135/3369] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:41.716055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a293e7b-0e69-473b-9800-0ee26e79f408 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] Calling method '.version_select at 0x7f71cf24a1f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:41.737552 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a293e7b-0e69-473b-9800-0ee26e79f408 tempest-ServersTestManualDisk-97491042 tempest-ServersTestManualDisk-97491042-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-470910660" status: 202 len: 0 microversion: 2.1 time: 0.028286 Oct 04 11:14:41.738171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2136/3370] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:14:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-470910660 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:14:41.743118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53f2c764-6218-4a15-9227-77347e9bfc56 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:41.743597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53f2c764-6218-4a15-9227-77347e9bfc56 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Failed to fetch instance by id 999 {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 11:14:41.744095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-53f2c764-6218-4a15-9227-77347e9bfc56 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53f2c764-6218-4a15-9227-77347e9bfc56 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Request method failure captured: Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBWO0MMfT0RA0gpxlWJEgdKxZ72bUw_ejk7S6EXNvleXZ6zIG6okNE3BGsm6kUmmCoSl99ye7ir7tAoPCb9xrzieREu0r7xgfTn6pjl0UvxEeiB8RNnjwhhlt3z09kRzD17GMP99oLGsCfalt_BrShcbUHGx6ktYlkH6ecWaEgjhhkg Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7af53703c5144463a8771ea0d4d659a5 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7af53703c5144463a8771ea0d4d659a5"}]}] Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7af53703c5144463a8771ea0d4d659a5 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerAddressesNegativeTestJSON-1131374841-project Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 86c8af1c7207464784f22cbdddc2a5c4 Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1131374841-project Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 999 could not be found. Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '999'} Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 11:14:41.746190 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:41.752698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53f2c764-6218-4a15-9227-77347e9bfc56 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:41.752698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53f2c764-6218-4a15-9227-77347e9bfc56 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008178 Oct 04 11:14:41.753112 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2137/3371] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 11:14:41 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:14:41.757844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:41.758573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:41.768647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.769146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.769605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:41.770517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.771143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.771726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:41.871567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:41.888322 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d3116e0b-6416-4712-850d-cb62967101f6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1272 microversion: 2.1 time: 0.134079 Oct 04 11:14:41.889455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2138/3372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:41 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:41.895638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:41.896488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:41.905022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.905827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.906479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:41.908387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:41.909061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:41.909724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:42.313004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:42.321992 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-41cb1505-fd72-4dcb-bca6-b362d3d0dbab tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.431149 Oct 04 11:14:42.328261 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2139/3373] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:41 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:42.328261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:42.328767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:42.335521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:42.336136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:42.336898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:42.337646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:42.338170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:42.339570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:42.367185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:14:42.453097 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-20cc1f88-5921-4dd9-bbbd-3c57f9a74371 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 204 len: 0 microversion: 2.1 time: 0.129310 Oct 04 11:14:42.453739 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2140/3374] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:14:42 2022] DELETE /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:14:42.461922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:42.464436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:42.471321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:42.471895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:42.472436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:42.474805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:42.475708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:42.476834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:42.784957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:42.794114 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4cf49251-852d-4923-8971-2c80f774bdf6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.338447 Oct 04 11:14:42.795436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2141/3375] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:42 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:42.801143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:42.801783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:42.808400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:42.808883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:42.809423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:42.810289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:42.811087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:42.811920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.043411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:43.053499 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-045f4674-b1d8-4018-ac97-60063f420cae tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.256257 Oct 04 11:14:43.056376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2142/3376] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:42 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:43.060482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:43.061084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:43.068300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.068791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.069226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.069954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.070400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.070971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.203140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:43.211381 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-586a4cfd-282c-4e2b-b2a1-f8f84d51c940 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1528 microversion: 2.1 time: 0.156161 Oct 04 11:14:43.211963 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2143/3377] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:43 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1528 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:43.217178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:43.217726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:43.224765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.225545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.225983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.226719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.227594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.228168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.372143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:43.380714 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d66e90d9-c8d2-4996-8bdf-78906c7b98b9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.167756 Oct 04 11:14:43.381289 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2144/3378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:43 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:43.385872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:43.386471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:43.392283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.392763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.393193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.393906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.394354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.394772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.528683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:43.537154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ef2d47d-8b9d-45d4-bbf5-09ac3641035c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1314 microversion: 2.1 time: 0.154890 Oct 04 11:14:43.537745 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2145/3379] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:43 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:43.542198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:43.542799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:43.555225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.558462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.558995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.559787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.560342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.560764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.690633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:43.699030 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa7e4e9b-8802-4abc-bcfe-c86cbd182486 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.159772 Oct 04 11:14:43.699639 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2146/3380] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:43 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:43.819532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:43.820147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:43.827044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.827531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.827961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:43.828650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:43.830369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:43.830979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:44.076772 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:14:44.077434 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:14:44.147777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:44.156930 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e4f0957-ac5d-46ad-b096-7e7c1f6bae2c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.341367 Oct 04 11:14:44.157736 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2147/3381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:43 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:14:44.163058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:44.163204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:44.169559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:44.170060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:44.171635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:44.171635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:44.171828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:44.172118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:44.420199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:44.430111 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2557a0ea-e9e4-4a64-9454-4918f1961b27 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.271446 Oct 04 11:14:44.430970 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2148/3382] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:44 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:44.452386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:44.453858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:44.459053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:44.459993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:44.460751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:44.461731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:44.463018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:44.463018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:44.713217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:44.722612 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-133cd878-5630-4ba9-820d-29bd67a274cc tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1528 microversion: 2.1 time: 0.279420 Oct 04 11:14:44.723197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2149/3383] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:44 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1528 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:44.727889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:44.728909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:44.735189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:44.737641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:44.739100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:44.739772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:44.740718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:44.741254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:44.741789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:44.962095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:44.974258 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37fa9836-7db0-4feb-8461-c25f5dcff4fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.249720 Oct 04 11:14:44.974907 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2150/3384] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:44 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:44.981044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:44.981981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:44.988581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:44.989148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:44.989716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:44.991432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:44.992100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:44.992645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:45.281537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:45.289659 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac48c673-c312-4e52-b0d2-d35637cfeb45 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1314 microversion: 2.1 time: 0.313449 Oct 04 11:14:45.290699 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2151/3385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:44 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:45.296840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:45.297565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:45.305264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:45.305783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:45.306244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:45.306937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:45.307440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:45.307912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:45.568997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:45.578437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:45.582846 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-03ff2f39-9beb-4506-a3bd-b46d4d3c66da tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.290932 Oct 04 11:14:45.591841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2152/3386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:45 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:45.598359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ea7d743a-cc8f-452e-8595-506e48752db0 req-bd67d1cc-3418-48ee-9c58-0780fd66149a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db8d07bc-542d-4a94-8d39-8a895efc5346", "tag": "c8794012-b552-4534-968e-69f64ea5fb5e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:45.611349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ea7d743a-cc8f-452e-8595-506e48752db0 req-bd67d1cc-3418-48ee-9c58-0780fd66149a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:45.611969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ea7d743a-cc8f-452e-8595-506e48752db0 req-bd67d1cc-3418-48ee-9c58-0780fd66149a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:45.612422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ea7d743a-cc8f-452e-8595-506e48752db0 req-bd67d1cc-3418-48ee-9c58-0780fd66149a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:45.626699 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ea7d743a-cc8f-452e-8595-506e48752db0 req-bd67d1cc-3418-48ee-9c58-0780fd66149a service nova] Creating event network-changed:c8794012-b552-4534-968e-69f64ea5fb5e for instance db8d07bc-542d-4a94-8d39-8a895efc5346 on n-h1-791135-8 Oct 04 11:14:45.631623 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ea7d743a-cc8f-452e-8595-506e48752db0 req-bd67d1cc-3418-48ee-9c58-0780fd66149a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037576 Oct 04 11:14:45.632697 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2153/3387] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:45.637838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:45.638764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:45.645250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:45.645772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:45.646205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:45.647045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:45.647346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:45.647830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:45.846441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:45.854728 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02a68197-3805-42a8-8d06-ef3b3827b9d2 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.220730 Oct 04 11:14:45.855321 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2154/3388] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:45 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:45.925992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-403791b5-2e73-4859-bb10-8272c07c5338 req-7b128202-d967-4750-96d3-2a480fd6d339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc90ac61-0c14-4e9c-81f3-ae62058485a5", "name": "network-vif-deleted", "tag": "99bf0b88-3a8f-492f-bc26-f96d34c040a8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:45.936114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-403791b5-2e73-4859-bb10-8272c07c5338 req-7b128202-d967-4750-96d3-2a480fd6d339 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:45.936694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-403791b5-2e73-4859-bb10-8272c07c5338 req-7b128202-d967-4750-96d3-2a480fd6d339 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:45.937200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-403791b5-2e73-4859-bb10-8272c07c5338 req-7b128202-d967-4750-96d3-2a480fd6d339 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:45.949543 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-403791b5-2e73-4859-bb10-8272c07c5338 req-7b128202-d967-4750-96d3-2a480fd6d339 service nova] Creating event network-vif-deleted:99bf0b88-3a8f-492f-bc26-f96d34c040a8 for instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 on n-h1-791135-8 Oct 04 11:14:45.954598 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-403791b5-2e73-4859-bb10-8272c07c5338 req-7b128202-d967-4750-96d3-2a480fd6d339 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097921 Oct 04 11:14:45.955327 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2155/3389] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:45.960379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:45.961084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:45.968232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:45.968726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:45.969169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:45.969919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:45.970382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:45.970811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.113062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:46.122733 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9852243-a6cb-43a8-b749-a2c04ee52667 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.166224 Oct 04 11:14:46.123399 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2156/3390] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:45 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:46.128660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:46.129539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:46.137121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.138046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.138785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.139783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.140457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.141246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.176073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.176560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.176996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.177466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lazy-loading 'fault' on Instance uuid dc90ac61-0c14-4e9c-81f3-ae62058485a5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:14:46.219219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:46.226776 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2567698d-343a-43d1-8931-9e796d393678 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1314 microversion: 2.1 time: 0.101747 Oct 04 11:14:46.227540 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2157/3391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:46 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1314 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:46.255558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:46.256320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:46.262841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.263391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.263833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.264593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.265046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.265501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.409674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:46.418187 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e23c89e6-6661-4a5d-ab8f-539bbddf7141 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.170490 Oct 04 11:14:46.429898 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2158/3392] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:46 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:46.429898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:46.429898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:46.439066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.439565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.440008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.440742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.441207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.441922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.591161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:46.600310 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-081a6055-d7c8-4f0b-9b98-f0206c1f6106 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1314 microversion: 2.1 time: 0.180426 Oct 04 11:14:46.601330 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2159/3393] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:46 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:46.615593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:46.616218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:46.622971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.623472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.624157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.625249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.625533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.625970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.768478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:46.776146 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c91aa13-2478-47d6-bbd2-0e5f0c547eeb tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.165345 Oct 04 11:14:46.776763 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2160/3394] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:46 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:46.878477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:46.879137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:46.885031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.885551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.886014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:46.886696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:46.887152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:46.887577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:47.024884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:47.034562 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5aee0b58-dfab-4792-813d-f71b4f13be9e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.160160 Oct 04 11:14:47.036607 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2161/3395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:46 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:14:47.146322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:47.147021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:47.167073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:47.168305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:47.168453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:47.169281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:47.169852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:47.170352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:47.331738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:47.339900 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5761e2e-2b7d-4890-a8de-4014c358cfab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.197158 Oct 04 11:14:47.340609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2162/3396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:47 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:14:47.345124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:47.345761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:47.351567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:47.352061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:47.352498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:47.353194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:47.353746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:47.354104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:47.409329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:47.410386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:47.411153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:47.412078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lazy-loading 'fault' on Instance uuid dc90ac61-0c14-4e9c-81f3-ae62058485a5 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:14:47.972974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c8af1c7207464784f22cbdddc2a5c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af53703c5144463a8771ea0d4d659a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:47.997857 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5ab592a0-b054-4d92-b0cc-88fdc2cc8658 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 200 len: 1314 microversion: 2.1 time: 0.655612 Oct 04 11:14:47.998461 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2163/3397] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:47 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:48.006138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:48.007080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:48.016012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.016622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.017271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.018258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.018903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.019634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.193725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:48.203674 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7d09432-63c8-4174-add1-5ab51584f5e9 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.203766 Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2164/3398] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:47 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.221055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.436707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:48.446045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea73e405-f792-4449-a9a0-807653f3b72f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1314 microversion: 2.1 time: 0.240816 Oct 04 11:14:48.447004 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2165/3399] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:48 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:48.451577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:48.452187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:48.458641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.459398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.460100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.461225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.462220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.463229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.634144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:48.645265 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab8ed0c1-d715-43af-bfc3-364663623926 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.196926 Oct 04 11:14:48.646446 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2166/3400] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:48 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:48.657839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:48.662094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:48.671774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.672283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.672724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.673467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.673933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.674362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.853230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:48.868838 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-335bfc31-bf18-4f04-a9d9-6827ebe39fac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.215003 Oct 04 11:14:48.888978 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2167/3401] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:48 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:48.897172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ba49e2aa-41ad-442d-b53b-b40e882b584a req-ade72286-872e-4ef0-8d24-2ba76e8f27ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4", "tag": "ce3169e1-4dc2-4ba9-92e3-4875e77fa860"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:48.909202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ba49e2aa-41ad-442d-b53b-b40e882b584a req-ade72286-872e-4ef0-8d24-2ba76e8f27ca service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.915347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ba49e2aa-41ad-442d-b53b-b40e882b584a req-ade72286-872e-4ef0-8d24-2ba76e8f27ca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.915881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ba49e2aa-41ad-442d-b53b-b40e882b584a req-ade72286-872e-4ef0-8d24-2ba76e8f27ca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.928953 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ba49e2aa-41ad-442d-b53b-b40e882b584a req-ade72286-872e-4ef0-8d24-2ba76e8f27ca service nova] Creating event network-changed:ce3169e1-4dc2-4ba9-92e3-4875e77fa860 for instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 on n-h1-791135-8 Oct 04 11:14:48.934204 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ba49e2aa-41ad-442d-b53b-b40e882b584a req-ade72286-872e-4ef0-8d24-2ba76e8f27ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044276 Oct 04 11:14:48.935220 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2168/3402] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:48.940305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:48.940999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:48.947552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.948571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.949005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:48.949727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:48.950175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:48.950594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:49.361256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:49.371868 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3b5d028-6c6d-40fe-91ef-3ee76fde8eff tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.435417 Oct 04 11:14:49.385454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2169/3403] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:48 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:49.394661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:49.396441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] [instance: dc90ac61-0c14-4e9c-81f3-ae62058485a5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:49.411257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:49.415386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:49.417120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:49.419731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:49.420455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:49.420897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:49.447128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] HTTP exception thrown: Instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 could not be found. Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Request method failure captured: Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 HTTP/1.1 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBWO0MMfT0RA0gpxlWJEgdKxZ72bUw_ejk7S6EXNvleXZ6zIG6okNE3BGsm6kUmmCoSl99ye7ir7tAoPCb9xrzieREu0r7xgfTn6pjl0UvxEeiB8RNnjwhhlt3z09kRzD17GMP99oLGsCfalt_BrShcbUHGx6ktYlkH6ecWaEgjhhkg Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7af53703c5144463a8771ea0d4d659a5 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7af53703c5144463a8771ea0d4d659a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7af53703c5144463a8771ea0d4d659a5"}]}] Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7af53703c5144463a8771ea0d4d659a5 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1131374841 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerAddressesNegativeTestJSON-1131374841-project Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 86c8af1c7207464784f22cbdddc2a5c4 Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1131374841-project Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 could not be found. Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'dc90ac61-0c14-4e9c-81f3-ae62058485a5'} Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 could not be found. Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 could not be found. Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:49.450770 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 could not be found. Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] Returning 404 to user: Instance dc90ac61-0c14-4e9c-81f3-ae62058485a5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-383ab209-4854-4357-bb8e-b332f94c7aa4 tempest-ServerAddressesNegativeTestJSON-1131374841 tempest-ServerAddressesNegativeTestJSON-1131374841-project] 10.222.0.23 "GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5" status: 404 len: 111 microversion: 2.1 time: 0.078347 Oct 04 11:14:49.455807 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2170/3404] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:49 2022] GET /compute/v2.1/servers/dc90ac61-0c14-4e9c-81f3-ae62058485a5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:14:49.476511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:49.478674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:49.497425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:49.497997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:49.498642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:49.499853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:49.500660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:49.501275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:49.539739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:49.865551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:49.881320 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea1d426d-b3e7-447e-bf05-9a6dda274a84 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.426218 Oct 04 11:14:49.882717 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2171/3405] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:49 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:49.888856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:49.890651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:49.902256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:49.903306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:49.903919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:49.905960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:49.907664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:49.908121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:50.072352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:50.095125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=20 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:50.172602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:50.180468 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f67fbc88-96f2-4f59-887c-887586f15170 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1314 microversion: 2.1 time: 0.296443 Oct 04 11:14:50.193945 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2172/3406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:49 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:50.204251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:50.205503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:50.212037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:50.212897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:50.213654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:50.214624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:50.215305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:50.215954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:50.458400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:50.470317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4971a74-c768-46db-b133-77c62e1c8373 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.274900 Oct 04 11:14:50.471028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2173/3407] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:50 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:50.476398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:50.477240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:50.484445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:50.485760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:50.486202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:50.486908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:50.487555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:50.488150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:50.795586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:50.804507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f87e4f7-a1c4-481f-a718-64c2b18e1c23 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.332242 Oct 04 11:14:50.817492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2174/3408] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:50 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:50.967830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-769d3aa3-e3b5-4e00-9bdf-4e7ef73eae92 req-44d8d876-6add-463b-ac12-f44e7684657b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8d07bc-542d-4a94-8d39-8a895efc5346", "name": "network-vif-plugged", "status": "completed", "tag": "c8794012-b552-4534-968e-69f64ea5fb5e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:50.977892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-769d3aa3-e3b5-4e00-9bdf-4e7ef73eae92 req-44d8d876-6add-463b-ac12-f44e7684657b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:50.978669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-769d3aa3-e3b5-4e00-9bdf-4e7ef73eae92 req-44d8d876-6add-463b-ac12-f44e7684657b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:50.979099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-769d3aa3-e3b5-4e00-9bdf-4e7ef73eae92 req-44d8d876-6add-463b-ac12-f44e7684657b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:50.990951 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-769d3aa3-e3b5-4e00-9bdf-4e7ef73eae92 req-44d8d876-6add-463b-ac12-f44e7684657b service nova] Creating event network-vif-plugged:c8794012-b552-4534-968e-69f64ea5fb5e for instance db8d07bc-542d-4a94-8d39-8a895efc5346 on n-h1-791135-8 Oct 04 11:14:50.995956 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-769d3aa3-e3b5-4e00-9bdf-4e7ef73eae92 req-44d8d876-6add-463b-ac12-f44e7684657b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189608 Oct 04 11:14:50.996708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2175/3409] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:51.002360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:51.003115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:51.009727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:51.010220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:51.011207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:51.011915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:51.012367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:51.012996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:51.354621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:51.362462 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-292e2eeb-028b-4727-b0e8-e103cdf8274a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.364550 Oct 04 11:14:51.363041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2176/3410] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:50 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:51.373586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:51.373586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:51.374528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:51.375014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:51.375447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:51.376133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:51.376763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:51.377190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:51.751541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:51.762210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71a064c5-d417-4653-a554-8da7abb10db2 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1717 microversion: 2.1 time: 0.398145 Oct 04 11:14:51.763397 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2177/3411] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:51 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1717 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:51.768150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:51.769049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:51.781849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:51.782347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:51.782785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:51.783491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:51.783946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:51.784373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:52.098754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:52.113694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5ea8a745-fe7e-4a38-870d-43c91bada767 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1314 microversion: 2.1 time: 0.348248 Oct 04 11:14:52.115540 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2178/3412] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:51 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:52.122927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:52.124178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:52.131524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:52.132283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:52.133012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:52.133895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:52.134514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:52.135390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:52.780189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:52.790125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f464ed7d-776d-405a-b5ff-f1ef5ef4b262 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.672930 Oct 04 11:14:52.805381 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2179/3413] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:52 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:52.805381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:52.805381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:52.805381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:52.805381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:52.805381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:52.806122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:52.806438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:52.806775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:53.068823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:53.077870 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-507a7952-997a-4781-b3fa-1ccfb8ec930b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.284783 Oct 04 11:14:53.082292 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2180/3414] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:52 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:53.086425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:53.087044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:53.106934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:53.107445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:53.107897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:53.108614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:53.109081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:53.109563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:53.421848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:53.451624 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b27e1d1-b20e-4c2d-8df4-8bb5630886d5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.368823 Oct 04 11:14:53.455196 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2181/3415] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:53 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:53.467696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:53.468980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:53.483054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:53.484860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:53.486441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:53.497069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:53.518439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:53.520968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:53.816885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:53.826887 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d4217fdb-3c10-493b-b165-b9d9e454e4a5 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1707 microversion: 2.1 time: 0.369640 Oct 04 11:14:53.827593 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2182/3416] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:53 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1707 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:53.832367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:53.832985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:53.842094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:53.842595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:53.843044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:53.843766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:53.844230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:53.844663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:53.925638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:53.947845 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5ec7d8c-d089-40e4-8fbf-9c9d5f5448d5 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1293 microversion: 2.1 time: 0.118888 Oct 04 11:14:53.966988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2183/3417] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:53 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1293 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:53.972160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c5fdcb2a-c2e6-45c0-ab68-93c33cf1a724 req-0d66b3e9-5663-4cfe-991d-af4106d4ef66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db8d07bc-542d-4a94-8d39-8a895efc5346", "name": "network-vif-deleted", "tag": "c8794012-b552-4534-968e-69f64ea5fb5e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:53.982600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5fdcb2a-c2e6-45c0-ab68-93c33cf1a724 req-0d66b3e9-5663-4cfe-991d-af4106d4ef66 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:53.983085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5fdcb2a-c2e6-45c0-ab68-93c33cf1a724 req-0d66b3e9-5663-4cfe-991d-af4106d4ef66 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:53.984049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5fdcb2a-c2e6-45c0-ab68-93c33cf1a724 req-0d66b3e9-5663-4cfe-991d-af4106d4ef66 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:53.995895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c5fdcb2a-c2e6-45c0-ab68-93c33cf1a724 req-0d66b3e9-5663-4cfe-991d-af4106d4ef66 service nova] Creating event network-vif-deleted:c8794012-b552-4534-968e-69f64ea5fb5e for instance db8d07bc-542d-4a94-8d39-8a895efc5346 on n-h1-791135-8 Oct 04 11:14:54.000824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c5fdcb2a-c2e6-45c0-ab68-93c33cf1a724 req-0d66b3e9-5663-4cfe-991d-af4106d4ef66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032421 Oct 04 11:14:54.001767 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2184/3418] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:54.007083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:54.007931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:54.015938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:54.015938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:54.015938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:54.015938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:54.016449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:54.016559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:54.435751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:54.449392 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-007a4e76-dc0e-4832-868f-045899fe3117 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.446313 Oct 04 11:14:54.452634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2185/3419] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:54 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:54.464145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5952d801-b6db-44eb-b4b4-9a55c1734da8 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '.version_select at 0x7f71cf2194c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:54.475059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5952d801-b6db-44eb-b4b4-9a55c1734da8 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:54.481527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5952d801-b6db-44eb-b4b4-9a55c1734da8 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:54.482287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5952d801-b6db-44eb-b4b4-9a55c1734da8 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:54.496868 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5952d801-b6db-44eb-b4b4-9a55c1734da8 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.042816 Oct 04 11:14:54.501585 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2186/3420] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 11:14:54 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:54.513751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:54.514629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:54.523817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:54.527348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:54.528113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:54.529094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:54.529836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:54.532689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:54.837658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:54.850523 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bda0ee65-a605-420b-83e8-c651c5f2a5fb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.347357 Oct 04 11:14:54.851511 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2187/3421] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:54 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:54.857265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-70f55ca8-e8e7-430d-8f44-b308e83da7da req-e1c2f843-eed5-4652-a917-8fd278989cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4", "name": "network-vif-plugged", "status": "completed", "tag": "ce3169e1-4dc2-4ba9-92e3-4875e77fa860"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:54.878099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-70f55ca8-e8e7-430d-8f44-b308e83da7da req-e1c2f843-eed5-4652-a917-8fd278989cb8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:54.878844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-70f55ca8-e8e7-430d-8f44-b308e83da7da req-e1c2f843-eed5-4652-a917-8fd278989cb8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:54.879580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-70f55ca8-e8e7-430d-8f44-b308e83da7da req-e1c2f843-eed5-4652-a917-8fd278989cb8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:54.905297 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-70f55ca8-e8e7-430d-8f44-b308e83da7da req-e1c2f843-eed5-4652-a917-8fd278989cb8 service nova] Creating event network-vif-plugged:ce3169e1-4dc2-4ba9-92e3-4875e77fa860 for instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 on n-h1-791135-8 Oct 04 11:14:54.917920 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-70f55ca8-e8e7-430d-8f44-b308e83da7da req-e1c2f843-eed5-4652-a917-8fd278989cb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064691 Oct 04 11:14:54.920941 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2188/3422] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:54.929824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:54.930465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:54.940227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:54.941109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:54.942355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:54.944172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:54.944809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:54.945433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.161698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:55.172233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5cabf8b-1684-4d13-96f9-383ef7313532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.248302 Oct 04 11:14:55.190562 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2189/3423] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:54 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:55.199991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:55.201559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:55.210630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.210630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.210630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.211789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.211789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.212115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.378970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:55.388698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2adea974-c6fb-499a-accc-3a139aeefa62 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1858 microversion: 2.1 time: 0.195637 Oct 04 11:14:55.391749 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2190/3424] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:55 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1858 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:55.396921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:55.398065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:55.406871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.408133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.408849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.410240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.411761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.412637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.503773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:55.517142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d60e892d-d2bc-41ec-8c5b-9b7cb226dbcc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1293 microversion: 2.1 time: 0.123358 Oct 04 11:14:55.518484 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2191/3425] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:55 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1293 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:55.536253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:55.537627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:55.560281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.560788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.561235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.562324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.562458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.562861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.712725 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-43f4ee03-c5ff-4c28-8c2b-71fa196ba1eb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1858 microversion: 2.1 time: 0.192618 Oct 04 11:14:55.723067 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2192/3426] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:55 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1858 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:55.723067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:55.723067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:55.727515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.728116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.728656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.730076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.730991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.731526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.906274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:55.916257 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e05ad306-2a46-4486-980f-f66faa2d81b8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.199352 Oct 04 11:14:55.916257 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2193/3427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:55 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:55.926846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:55.927425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:55.938767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.939455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.939898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:55.941168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:55.941720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:55.942184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:56.034424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lazy-loading 'services' on Instance uuid 9444c1a9-b95a-4973-a2d6-e12370497909 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:14:56.112309 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e95ef9b8-167a-445c-bcf6-3f3958c4be7c tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments/fac8721a-aa1f-410b-a875-fc0d0dd54b9a" status: 202 len: 0 microversion: 2.1 time: 0.189262 Oct 04 11:14:56.113394 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2194/3428] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:14:55 2022] DELETE /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments/fac8721a-aa1f-410b-a875-fc0d0dd54b9a => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:14:56.141535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:56.142305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:56.153668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:56.154435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:56.155040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:56.155932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:56.156571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:56.157161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:56.661819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:56.673882 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b73e9db3-a20a-4811-8970-dc5f7fccd154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1515 microversion: 2.1 time: 0.558995 Oct 04 11:14:56.674776 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2195/3429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:56 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1515 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:56.690914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:56.693740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:56.703056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:56.704359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:56.704828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:56.705564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:56.706800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:56.707238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:56.751274 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7745e06-f330-4689-8ebd-0cbf117b8383 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074049 Oct 04 11:14:56.756636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2196/3430] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:14:56 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:56.757678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:56.758322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:56.767462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:56.768301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:56.768918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:56.770479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:56.771126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:56.771724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:57.042133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:57.057273 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3835af1f-5005-4a6c-ae76-7fd8ab428126 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1315 microversion: 2.1 time: 0.303765 Oct 04 11:14:57.058681 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2197/3431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:56 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:57.065753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:57.066557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:57.073982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:57.075167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:57.075752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:57.081633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:57.082643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:57.083290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:57.124925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:14:57.132241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:57.132930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:57.133557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:57.134165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lazy-loading 'fault' on Instance uuid db8d07bc-542d-4a94-8d39-8a895efc5346 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:14:57.184025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:57.192624 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3aec2122-ef55-4c14-818a-a89635816d78 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 200 len: 1304 microversion: 2.1 time: 0.132485 Oct 04 11:14:57.197388 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2198/3432] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:57 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:57.206582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:57.207411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:57.214366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:57.217310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:57.218049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:57.218929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:57.219576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:57.220161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:57.417696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:57.425902 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc8cdadf-9756-4193-b0d2-4e5f4d6674e8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.226250 Oct 04 11:14:57.426483 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2199/3433] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:57 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:57.961100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1448177931", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:14:58.054958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] validate_networks() for [('4eb79ddf-f4fd-42e8-b663-e7ad6a4f34e8', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:14:58.694800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:14:58.695251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:14:58.695726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:14:58.696142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:14:58.696574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:14:58.720886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:58.723757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:58.724446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:58.725968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:58.726991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:58.727909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:58.758517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Getting quotas for project cbe011632a1f4089b1bc5d369e072819. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:14:58.768338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Getting quotas for user 21a0bfe3c8e347beaabf2dc28c7ef2b0 and project cbe011632a1f4089b1bc5d369e072819. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:14:58.787727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:14:58.791060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:14:58.872884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-05a09aa6-bd33-4b28-ba22-1e4cfd602c39 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.267877 Oct 04 11:14:58.880449 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2200/3434] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:14:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:14:58.886387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:58.887339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:58.898711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:58.900509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:58.902047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:58.903352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:58.904496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:58.905280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:59.133016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:59.143043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8da72095-3c06-45c0-bdf9-abf93fcd09ac tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1533 microversion: 2.1 time: 0.261018 Oct 04 11:14:59.144168 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2201/3435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:58 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1533 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:59.168321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:59.172253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:59.189619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:59.191216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:59.192221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:59.193601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:59.194386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:59.195026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:59.243665 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f23e970a-9799-4aef-87a0-0eb52df06956 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088011 Oct 04 11:14:59.245693 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2202/3436] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:14:59 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:14:59.274831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:59.277764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:59.294122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:59.296076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:59.297930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:59.301239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:59.302988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:59.303376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:59.649212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:14:59.667122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6d8c600-fde2-4d51-9269-fe854fb96dfe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1502 microversion: 2.1 time: 0.418204 Oct 04 11:14:59.667912 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2203/3437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:59 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1502 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:14:59.690064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:59.690693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:59.704996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:59.705528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:59.709565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:59.710661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:59.711148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:59.711628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:59.751372 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 HTTP/1.1 Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'db8d07bc-542d-4a94-8d39-8a895efc5346'} Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:14:59.756480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:14:59.760704 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-83258a4c-6d3c-4982-a897-5e25fb929d12 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 404 len: 111 microversion: 2.1 time: 0.077398 Oct 04 11:14:59.762333 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2204/3438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:59 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:14:59.772113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:14:59.772733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:14:59.790962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:59.792080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:59.792527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:14:59.796018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:14:59.796512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:14:59.796965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:00.151327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:00.163805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76e0e58a-94c0-4d01-b19a-9dc29c3207c4 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.399538 Oct 04 11:15:00.164952 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2205/3439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:14:59 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:00.177189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:00.177952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:00.188004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:00.190889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:00.191383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:00.192216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:00.193396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:00.193396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:00.293021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:00.310144 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ef263f62-5b43-44d9-ac21-fe601217e493 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1219 microversion: 2.1 time: 0.144232 Oct 04 11:15:00.324481 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2206/3440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:00 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:00.332056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4296c648-04bb-4c8a-b182-cfbbc8a5f80e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:00.354439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4296c648-04bb-4c8a-b182-cfbbc8a5f80e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:00.356919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4296c648-04bb-4c8a-b182-cfbbc8a5f80e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:00.357486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4296c648-04bb-4c8a-b182-cfbbc8a5f80e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:00.415386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4296c648-04bb-4c8a-b182-cfbbc8a5f80e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Going to try to stop instance {{(pid=122409) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:15:00.490885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:00.548649 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4296c648-04bb-4c8a-b182-cfbbc8a5f80e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4/action" status: 202 len: 0 microversion: 2.1 time: 0.224450 Oct 04 11:15:00.552036 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2207/3441] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:15:00 2022] POST /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:15:00.565734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-726051650", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "49989f52-07b9-48bb-b42a-1e9bb7c15958"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:00.692479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] validate_networks() for [('49989f52-07b9-48bb-b42a-1e9bb7c15958', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:15:01.808668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:15:01.809896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:15:01.810576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:15:01.811348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:15:01.812047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:15:01.842979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:01.853620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:01.854416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:01.855434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:01.862483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:01.863439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:01.912499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:01.925906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for user 510d473de29b4d7d8bb303f64f1e17d4 and project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:01.955939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:15:01.958450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:15:02.086140 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-44e2d451-8c6c-4f67-96e3-dc9c884bbf04 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532422 Oct 04 11:15:02.087378 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2208/3442] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:15:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:15:02.097587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:02.099919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:02.114323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:02.120750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:02.121519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:02.122449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:02.123101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:02.123718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:02.649747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:02.659222 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51b6dd8f-a018-4f1e-9722-9225b64a47dc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1521 microversion: 2.1 time: 0.570517 Oct 04 11:15:02.674146 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2209/3443] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:02 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:02.691819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:02.702084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:02.731739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:02.733862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:02.736428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:02.738705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:02.741230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:02.743836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:02.883664 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d113be84-8020-413f-bad0-4475ad40feca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200071 Oct 04 11:15:02.894456 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2210/3444] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:15:02 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:02.905423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:02.913319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:02.932304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:02.935098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:02.935781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:02.936730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:02.939955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:02.940650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:03.507837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:03.522020 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ad6c5b29-5068-425b-b39c-2151b81c9f43 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.626035 Oct 04 11:15:03.522643 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2211/3445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:02 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:03.537695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0ffc1817-cd3a-41a6-9dd5-20a636f7375e req-14ddbb17-92e4-4062-a8d2-35f3a101b651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26460e6f-e9a5-4ea4-b756-53ed860dfce5", "name": "network-vif-unplugged", "status": "completed", "tag": "be548080-747c-4a27-8154-3532837cc1aa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:03.574265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ffc1817-cd3a-41a6-9dd5-20a636f7375e req-14ddbb17-92e4-4062-a8d2-35f3a101b651 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:03.576063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ffc1817-cd3a-41a6-9dd5-20a636f7375e req-14ddbb17-92e4-4062-a8d2-35f3a101b651 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:03.579579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ffc1817-cd3a-41a6-9dd5-20a636f7375e req-14ddbb17-92e4-4062-a8d2-35f3a101b651 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:03.624091 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0ffc1817-cd3a-41a6-9dd5-20a636f7375e req-14ddbb17-92e4-4062-a8d2-35f3a101b651 service nova] Creating event network-vif-unplugged:be548080-747c-4a27-8154-3532837cc1aa for instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 on n-h1-791135-8 Oct 04 11:15:03.637489 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0ffc1817-cd3a-41a6-9dd5-20a636f7375e req-14ddbb17-92e4-4062-a8d2-35f3a101b651 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105609 Oct 04 11:15:03.640790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2212/3446] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:03.651180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:03.652225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:03.695312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:03.696002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:03.696473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:03.697236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:03.698306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:03.698750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:04.228149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:04.247441 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c995d5d-fdd5-4288-8fce-abcde57a55d6 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1511 microversion: 2.1 time: 0.602201 Oct 04 11:15:04.250173 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2213/3447] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:03 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1511 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:04.256423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:04.257540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:04.267601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:04.268913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:04.269581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:04.271422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:04.272271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:04.272889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:04.690156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:04.711070 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1dd23a8-183c-4898-aaee-8c3b1b0acdc9 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.459025 Oct 04 11:15:04.712471 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2214/3448] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:04 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:04.723196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:04.723812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:04.747444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:04.748227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:04.749223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:04.754847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:04.756172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:04.756797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:04.943861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:04.958730 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-612597ad-eb83-4bb9-8598-aab018b2cbfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1272 microversion: 2.1 time: 0.244045 Oct 04 11:15:04.959716 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2215/3449] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:04 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:04.974234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:04.978252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:04.995848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:04.996663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:04.997341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:04.998345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:04.999970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:05.000662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:05.252819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:05.263773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5ad0591-79a4-456a-857b-5e1f6adbc284 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1521 microversion: 2.1 time: 0.302659 Oct 04 11:15:05.264693 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2216/3450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:04 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:05.270881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:05.274788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:05.284818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:05.285328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:05.285820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:05.286710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:05.287191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:05.287632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:05.328633 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c2639836-f7ad-44cc-be43-ea3c56ab48be tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062342 Oct 04 11:15:05.329238 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2217/3451] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:15:05 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:15:05.338927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:05.339538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:05.346949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:05.347446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:05.347888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:05.348593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:05.349617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:05.350239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:05.990910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:06.002361 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7b70337-1941-40ea-bf2c-bfefd7491b35 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.671571 Oct 04 11:15:06.018113 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2218/3452] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:05 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:06.034562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:06.037201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:06.050973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:06.051839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:06.052528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:06.056568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:06.057477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:06.059942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:06.452780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:06.466616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-297ab24a-daf4-494f-833e-418c843f2da3 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1488 microversion: 2.1 time: 0.444654 Oct 04 11:15:06.467484 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2219/3453] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:06 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1488 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:06.489329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5d12ae68-de66-4381-98df-755acdc02ad8 req-53c57857-0949-4e64-bbe2-8d6ef3be117b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8f11dc-6474-4736-9972-1fb65647ece0", "tag": "02b3a097-9732-4f13-9254-dc56af34ccbe"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:06.522611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5d12ae68-de66-4381-98df-755acdc02ad8 req-53c57857-0949-4e64-bbe2-8d6ef3be117b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:06.523097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5d12ae68-de66-4381-98df-755acdc02ad8 req-53c57857-0949-4e64-bbe2-8d6ef3be117b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:06.526583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5d12ae68-de66-4381-98df-755acdc02ad8 req-53c57857-0949-4e64-bbe2-8d6ef3be117b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:06.559741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5d12ae68-de66-4381-98df-755acdc02ad8 req-53c57857-0949-4e64-bbe2-8d6ef3be117b service nova] Creating event network-changed:02b3a097-9732-4f13-9254-dc56af34ccbe for instance 8d8f11dc-6474-4736-9972-1fb65647ece0 on n-h2-791135-8 Oct 04 11:15:06.569873 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5d12ae68-de66-4381-98df-755acdc02ad8 req-53c57857-0949-4e64-bbe2-8d6ef3be117b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099310 Oct 04 11:15:06.571092 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2220/3454] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:06.580107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:06.582797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:06.593038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:06.593756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:06.594393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:06.595407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:06.602834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:06.603571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:06.894489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:06.905496 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c9dac1e4-74e5-4f45-ac3b-ca3556e54111 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.331581 Oct 04 11:15:06.906601 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2221/3455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:06 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:06.911490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:06.912346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:06.936567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:06.937073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:06.937620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:06.938694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:06.939503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:06.940111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:07.152641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:07.163386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f78b5419-79f6-4216-ae64-dbf091b408aa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1314 microversion: 2.1 time: 0.254363 Oct 04 11:15:07.165455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2222/3456] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:06 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:07.170507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:07.171396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:07.180070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:07.180655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:07.181227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:07.182775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:07.183473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:07.183986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:07.367202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:07.377169 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-74a45dd6-f622-4968-b9b6-7b6626c20cca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1521 microversion: 2.1 time: 0.210263 Oct 04 11:15:07.378054 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2223/3457] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:07 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:07.383008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b8cde5c2-8b24-4828-8c43-d0ed112da0a2 req-f181e8c8-298c-4705-8307-1c639642962d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26460e6f-e9a5-4ea4-b756-53ed860dfce5", "name": "network-vif-plugged", "status": "completed", "tag": "be548080-747c-4a27-8154-3532837cc1aa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:07.393639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8cde5c2-8b24-4828-8c43-d0ed112da0a2 req-f181e8c8-298c-4705-8307-1c639642962d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:07.394595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8cde5c2-8b24-4828-8c43-d0ed112da0a2 req-f181e8c8-298c-4705-8307-1c639642962d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:07.395198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8cde5c2-8b24-4828-8c43-d0ed112da0a2 req-f181e8c8-298c-4705-8307-1c639642962d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:07.668570 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b8cde5c2-8b24-4828-8c43-d0ed112da0a2 req-f181e8c8-298c-4705-8307-1c639642962d service nova] Creating event network-vif-plugged:be548080-747c-4a27-8154-3532837cc1aa for instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 on n-h1-791135-8 Oct 04 11:15:07.673589 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b8cde5c2-8b24-4828-8c43-d0ed112da0a2 req-f181e8c8-298c-4705-8307-1c639642962d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294100 Oct 04 11:15:07.674701 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2224/3458] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:07.680214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1472139613"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:07.683465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:07.689880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:07.690600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:07.691247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:07.691966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:07.692422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:07.692858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:07.761460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:07.793141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10a1d18d-9ab4-4a7f-9ff5-28587d06d7fd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "PUT /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1061 microversion: 2.1 time: 0.116913 Oct 04 11:15:07.801626 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2225/3459] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:15:07 2022] PUT /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1061 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:07.885491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99daf384-ae03-4e62-8327-ecd41b3eba33 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Action: 'create', calling method: .version_select at 0x7f71cf1cc940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:07.906908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-99daf384-ae03-4e62-8327-ecd41b3eba33 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Getting quotas for project c9fade565c104c50b8e2f98092277fa9. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:07.914208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-99daf384-ae03-4e62-8327-ecd41b3eba33 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Getting quotas for user 6e79b1565fd44de193d066d8fbf2fcda and project c9fade565c104c50b8e2f98092277fa9. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:07.949164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:07.968496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-99daf384-ae03-4e62-8327-ecd41b3eba33 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Getting quotas for project c9fade565c104c50b8e2f98092277fa9. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:07.973454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-99daf384-ae03-4e62-8327-ecd41b3eba33 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Getting quotas for user 6e79b1565fd44de193d066d8fbf2fcda and project c9fade565c104c50b8e2f98092277fa9. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:07.987898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99daf384-ae03-4e62-8327-ecd41b3eba33 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.192910 Oct 04 11:15:07.988884 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2226/3460] 10.222.0.23 () {62 vars in 1214 bytes} [Tue Oct 4 11:15:07 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:15:07.993882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:07.995418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:08.002482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.003594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.004057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.004774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.005295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.005820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.161368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:08.170197 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cbb8df4-9f77-4924-8c7b-67fe157c2427 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.179996 Oct 04 11:15:08.170804 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2227/3461] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:07 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:08.176393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-858f85e6-3e87-453f-898f-4b1976f1b5c3 req-42814134-8c4d-4b9d-b254-f434aef8bed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429321cb-fd5a-48ad-9bae-33c0b5b4e342", "tag": "c684299e-39b3-4d92-90b9-9971b1e58097"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:08.189129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-858f85e6-3e87-453f-898f-4b1976f1b5c3 req-42814134-8c4d-4b9d-b254-f434aef8bed7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.189651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-858f85e6-3e87-453f-898f-4b1976f1b5c3 req-42814134-8c4d-4b9d-b254-f434aef8bed7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.190274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-858f85e6-3e87-453f-898f-4b1976f1b5c3 req-42814134-8c4d-4b9d-b254-f434aef8bed7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.203724 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-858f85e6-3e87-453f-898f-4b1976f1b5c3 req-42814134-8c4d-4b9d-b254-f434aef8bed7 service nova] Creating event network-changed:c684299e-39b3-4d92-90b9-9971b1e58097 for instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 on n-h2-791135-8 Oct 04 11:15:08.209779 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-858f85e6-3e87-453f-898f-4b1976f1b5c3 req-42814134-8c4d-4b9d-b254-f434aef8bed7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037694 Oct 04 11:15:08.214816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2228/3462] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:08.223648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:08.224792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:08.233554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.234464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.235011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.237578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.238202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.238725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.398006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:08.407090 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a827ce4-bc7a-4f27-998a-ff41994e0684 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1488 microversion: 2.1 time: 0.189089 Oct 04 11:15:08.407856 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2229/3463] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:08 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1488 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:08.417920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:08.418467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:08.424729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.425328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.425831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.426602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.427245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.428244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.577681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:08.587234 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1327777a-2fff-4ce7-92b3-1144a300a2b4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.177975 Oct 04 11:15:08.597979 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2230/3464] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:08 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:08.606023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f03d77e-a42f-4ceb-a956-579bc4cde2a2 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:08.623416 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f03d77e-a42f-4ceb-a956-579bc4cde2a2 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.023100 Oct 04 11:15:08.634589 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2231/3465] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Oct 4 11:15:08 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:15:08.670452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:08.673791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:08.690748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.691424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.691963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.693524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.694114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.694654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.866799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:08.875849 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba33487d-3f5a-4a4a-8122-b5699988964b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1314 microversion: 2.1 time: 0.226222 Oct 04 11:15:08.877160 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2232/3466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:08 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:08.882177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:08.882983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:08.891501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.892408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.892882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:08.893633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:08.894092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:08.894517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:09.040711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:09.049596 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-624c7d1b-669e-4052-bf3f-e06ccd024460 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1521 microversion: 2.1 time: 0.171000 Oct 04 11:15:09.050858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2233/3467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:08 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:09.059063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:09.059945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:09.066927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:09.067647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:09.068301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:09.069069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:09.069612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:09.070494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:09.432324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:09.456009 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a844505d-8d46-4dab-850a-2c369a557ec9 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1488 microversion: 2.1 time: 0.403854 Oct 04 11:15:09.456625 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2234/3468] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:09 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1488 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:09.464263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a31a5230-b35a-4305-b69a-364fc1467dd2 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:09.489099 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a31a5230-b35a-4305-b69a-364fc1467dd2 tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/3ad3d5a4-ae85-41e2-bc3c-6269041c997f" status: 200 len: 235 microversion: 2.64 time: 0.031279 Oct 04 11:15:09.490285 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2235/3469] 10.222.0.23 () {60 vars in 1304 bytes} [Tue Oct 4 11:15:09 2022] GET /compute/v2.1/os-server-groups/3ad3d5a4-ae85-41e2-bc3c-6269041c997f => generated 235 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:15:09.502779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:09.503404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:09.510443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:09.510961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:09.511528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:09.512272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:09.512746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:09.513189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:09.723427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:09.733309 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b3ed1e1a-d6eb-49aa-9e84-2f1a9b5e7235 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.234861 Oct 04 11:15:09.734347 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2236/3470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:09 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:09.756981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:09.757644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:09.764889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:09.765601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:09.766300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:09.767100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:09.767677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:09.768199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:09.804623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:15:09.925458 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-19cf5e52-b801-4d49-ab5b-4c8c2cff5386 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 204 len: 0 microversion: 2.1 time: 0.177101 Oct 04 11:15:09.931335 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2237/3471] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:09 2022] DELETE /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:15:09.938046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91414538-ac5c-4ae5-982e-a7339796f6ed tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:09.982925 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91414538-ac5c-4ae5-982e-a7339796f6ed tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/3ad3d5a4-ae85-41e2-bc3c-6269041c997f" status: 204 len: 0 microversion: 2.64 time: 0.050033 Oct 04 11:15:09.983583 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2238/3472] 10.222.0.23 () {60 vars in 1307 bytes} [Tue Oct 4 11:15:09 2022] DELETE /compute/v2.1/os-server-groups/3ad3d5a4-ae85-41e2-bc3c-6269041c997f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:15:09.990637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:09.991793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:09.998111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:09.998604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:09.999457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:10.000304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:10.000807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:10.001333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:10.271861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:10.281078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-623e2d55-210d-4acf-94a4-614e53c672c6 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.296429 Oct 04 11:15:10.282244 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2239/3473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:09 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:10.287200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:10.288077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:10.295139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:10.295815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:10.296440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:10.297150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:10.297808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:10.298439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:10.451068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:10.459005 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11e4b4cd-ce43-46cf-9591-50ec7c2b189a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1314 microversion: 2.1 time: 0.175572 Oct 04 11:15:10.459595 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2240/3474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:10 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:10.471673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:10.472370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:10.480084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:10.480951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:10.481452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:10.482416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:10.483306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:10.483827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:10.653498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:10.662455 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68f86d4b-068b-4a48-ad3d-8e1286333b90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1494 microversion: 2.1 time: 0.195825 Oct 04 11:15:10.663368 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2241/3475] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:10 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1494 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:10.682344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fffe1e02-21cc-4992-90d6-8d376f2ed07f tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:10.688517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-fffe1e02-21cc-4992-90d6-8d376f2ed07f tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] HTTP exception thrown: Instance group 3ad3d5a4-ae85-41e2-bc3c-6269041c997f could not be found. Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fffe1e02-21cc-4992-90d6-8d376f2ed07f tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Request method failure captured: Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-server-groups/3ad3d5a4-ae85-41e2-bc3c-6269041c997f HTTP/1.1 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBW6zvPqb5bydctDXEYalF1nUZh70YJgNd0x6DtqvwBtaCnnysLlZUECqx0189MqyRGJoMd6vUPzWr-K4mhM7d45BZWtiHKtW1mBE3Fgyl7kDNycodGLduJQhyOSpEdKqfKYNp2R4HMwirRhsAafNCgGZSS57IUbWsHXr11oKmHZSyg Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c9fade565c104c50b8e2f98092277fa9 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerGroup264TestJSON-128297300 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9fade565c104c50b8e2f98092277fa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9fade565c104c50b8e2f98092277fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9fade565c104c50b8e2f98092277fa9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9fade565c104c50b8e2f98092277fa9"}]}] Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerGroup264TestJSON-128297300 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c9fade565c104c50b8e2f98092277fa9 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerGroup264TestJSON-128297300 Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerGroup264TestJSON-128297300-project Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6e79b1565fd44de193d066d8fbf2fcda Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerGroup264TestJSON-128297300-project Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance group 3ad3d5a4-ae85-41e2-bc3c-6269041c997f could not be found. Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '3ad3d5a4-ae85-41e2-bc3c-6269041c997f'} Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3ad3d5a4-ae85-41e2-bc3c-6269041c997f could not be found. Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3ad3d5a4-ae85-41e2-bc3c-6269041c997f could not be found. Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:10.697531 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:10.702763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:10.702763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:10.702763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:10.702763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:10.702763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3ad3d5a4-ae85-41e2-bc3c-6269041c997f could not be found. Oct 04 11:15:10.702763 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:10.702763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fffe1e02-21cc-4992-90d6-8d376f2ed07f tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] Returning 404 to user: Instance group 3ad3d5a4-ae85-41e2-bc3c-6269041c997f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:10.702763 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fffe1e02-21cc-4992-90d6-8d376f2ed07f tempest-ServerGroup264TestJSON-128297300 tempest-ServerGroup264TestJSON-128297300-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/3ad3d5a4-ae85-41e2-bc3c-6269041c997f" status: 404 len: 117 microversion: 2.64 time: 0.024212 Oct 04 11:15:10.703418 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2242/3476] 10.222.0.23 () {60 vars in 1307 bytes} [Tue Oct 4 11:15:10 2022] DELETE /compute/v2.1/os-server-groups/3ad3d5a4-ae85-41e2-bc3c-6269041c997f => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:15:10.708079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:10.708702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:10.716440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:10.716925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:10.717374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:10.718085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:10.718539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:10.718959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.014613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:11.026320 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-60715da5-7799-42d5-927b-5b5f5d32d532 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1506 microversion: 2.1 time: 0.321417 Oct 04 11:15:11.026916 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2243/3477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:10 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:11.144874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:11.145398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:11.154939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:11.155738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:11.156177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.157070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:11.157732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:11.158158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.185106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:15:11.236435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:11.281604 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec942906-d98e-4fce-a56e-893c0a40255d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 204 len: 0 microversion: 2.32 time: 0.252640 Oct 04 11:15:11.285728 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2244/3478] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:15:11 2022] DELETE /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:15:11.289693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:11.290015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:11.297032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:11.297252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:11.297659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.298698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:11.299931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:11.300369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.533145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:11.542207 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-846ae26c-bb69-40d5-8088-4f9092c72297 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.257525 Oct 04 11:15:11.557374 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2245/3479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:11 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:11.557374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:11.557374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:11.557374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:11.557374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:11.557374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.557374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:11.557374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:11.558255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.792808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:11.801222 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4078cca2-5a1c-4960-906d-b2e692854e24 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 200 len: 1506 microversion: 2.1 time: 0.257157 Oct 04 11:15:11.814521 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2246/3480] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:11 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:11.826526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:11.827325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:11.833778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:11.834482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:11.835037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.835832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:11.836427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:11.836944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:11.884275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:12.122987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:12.141083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:12.146425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:12.147772 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06b0f310-c22b-4525-a1ec-308b3a5ab96a tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 2951 microversion: 2.32 time: 0.332099 Oct 04 11:15:12.148349 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2247/3481] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:11 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 2951 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:12.154583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:12.155403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:12.162111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:12.162892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:12.163512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:12.164584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:12.165728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:12.166364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:12.469861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:12.479805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f060b31-1af6-4173-a171-9fdc34908d19 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.330053 Oct 04 11:15:12.493770 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2248/3482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:12 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:12.502258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:12.503139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:12.511954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:12.512838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:12.513344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:12.514080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:12.514536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:12.514962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:12.775996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:12.787123 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6594b7cc-677b-4d57-a5ef-6d613d7dc913 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1314 microversion: 2.1 time: 0.289682 Oct 04 11:15:12.792512 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2249/3483] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:12 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:12.805867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:12.808980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:12.818562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:12.819080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:12.819584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:12.820359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:12.820881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:12.821428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:13.332556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:13.345819 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8180e272-20ea-4f5e-a32a-c2b7d944e559 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1494 microversion: 2.1 time: 0.551751 Oct 04 11:15:13.346734 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2250/3484] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:12 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1494 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:13.351434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:13.352080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:13.359114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:13.359612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:13.360059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:13.360764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:13.361383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:13.361822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:13.390556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:15:13.542488 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-67412236-8321-4abc-a061-11bf3bffedba tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 204 len: 0 microversion: 2.1 time: 0.194275 Oct 04 11:15:13.553382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2251/3485] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:13 2022] DELETE /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:15:13.568957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:13.571684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:13.588718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:13.589448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:13.590975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:13.593285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:13.594836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:13.595388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:13.795727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:13.818894 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6357b9b5-a458-4501-a66d-f86d58686528 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.274163 Oct 04 11:15:13.819743 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2252/3486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:13 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:13.830062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:13.830820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:13.838626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:13.839693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:13.840200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:13.841261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:13.842228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:13.842736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:14.081998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:14.095581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:14.099552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:14.101270 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cb20d5d4-3f65-450a-ba1b-525fe7b7c413 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 2951 microversion: 2.32 time: 0.280663 Oct 04 11:15:14.104132 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2253/3487] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:13 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 2951 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:14.111755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:14.112596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:14.119561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:14.119561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:14.120637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:14.121499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:14.122074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:14.122789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:14.311281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:14.321525 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2bd087b-3164-44bd-8a6a-ae98eee78ea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.215999 Oct 04 11:15:14.340811 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2254/3488] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:14 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:14.349610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2129747434", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "46ef5295-5c7d-4bd5-bee2-4e0ba8effdeb"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:14.455118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] validate_networks() for [('46ef5295-5c7d-4bd5-bee2-4e0ba8effdeb', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:15:15.499293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:15:15.500685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:15:15.501337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:15:15.501948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:15:15.502523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:15:15.520569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:15.521402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:15.522078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:15.523029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:15.526952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:15.527614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:15.568536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Getting quotas for project 52b172e7699d45d6b47f9bdc5a38203e. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:15.577486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Getting quotas for user 5d291ac2bcf94e3288c243542024c848 and project 52b172e7699d45d6b47f9bdc5a38203e. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:15.580558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:15.606139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:15:15.615572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:15:15.700077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b40f462d-c9c6-4532-9a3c-791ed1ce447a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356226 Oct 04 11:15:15.708611 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2255/3489] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:15:15.715192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:15.715895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:15.725463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:15.726028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:15.726735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:15.728960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:15.730136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:15.730582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:16.505342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:16.514130 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-505feb77-eda2-4406-95d4-c90e81bc544d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1314 microversion: 2.1 time: 0.804007 Oct 04 11:15:16.533977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2256/3490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:15 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:16.802439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:16.805378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:16.827726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:16.832064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:16.834036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:16.836426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:16.838618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:16.852426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:16.968448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:16.969018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:16.969567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:16.970347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lazy-loading 'fault' on Instance uuid 8dc74744-2d54-4822-9ef1-a4bbf68631a1 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:15:17.067657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:17.104711 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24b5530d-8ace-474a-8696-b0a061b31f90 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 200 len: 1310 microversion: 2.1 time: 0.566706 Oct 04 11:15:17.118035 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2257/3491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:16 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 1310 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:17.118035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1c3fd3e1-e0ef-411b-87b7-51213a39e6cb req-dd8e019a-7fa2-4c90-bc52-aaedf7dc943f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc74744-2d54-4822-9ef1-a4bbf68631a1", "name": "network-vif-unplugged", "status": "completed", "tag": "80f2f48c-bcbb-4f85-a616-a9fa7ca9f9d0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:17.128579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1c3fd3e1-e0ef-411b-87b7-51213a39e6cb req-dd8e019a-7fa2-4c90-bc52-aaedf7dc943f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:17.129076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1c3fd3e1-e0ef-411b-87b7-51213a39e6cb req-dd8e019a-7fa2-4c90-bc52-aaedf7dc943f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:17.129565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1c3fd3e1-e0ef-411b-87b7-51213a39e6cb req-dd8e019a-7fa2-4c90-bc52-aaedf7dc943f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:17.145098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1c3fd3e1-e0ef-411b-87b7-51213a39e6cb req-dd8e019a-7fa2-4c90-bc52-aaedf7dc943f service nova] Creating event network-vif-unplugged:80f2f48c-bcbb-4f85-a616-a9fa7ca9f9d0 for instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 on n-h1-791135-8 Oct 04 11:15:17.151999 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1c3fd3e1-e0ef-411b-87b7-51213a39e6cb req-dd8e019a-7fa2-4c90-bc52-aaedf7dc943f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043990 Oct 04 11:15:17.153239 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2258/3492] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:17.163617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:17.167590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:17.174190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:17.176029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:17.179207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:17.185499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:17.186007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:17.186462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:17.456829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:17.470672 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e772b3c5-0076-45ff-ad33-004d324c7169 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.314159 Oct 04 11:15:17.472845 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2259/3493] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:17 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:17.485304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:17.486330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:17.500002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:17.500911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:17.501650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:17.503891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:17.505876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:17.507994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:17.578920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:17.910440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:17.924897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:17.927750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:17.930415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-abb2320b-8e48-4705-928f-271040eadd08 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 2930 microversion: 2.32 time: 0.454607 Oct 04 11:15:17.932625 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2260/3494] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:17 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 2930 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:17.944751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:17.946644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:17.958107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:17.958946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:17.959841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:17.960512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:17.961231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:17.961853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:18.171649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:18.189049 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09d7a2db-ac8c-43b3-a825-889ed40f635c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.254426 Oct 04 11:15:18.213858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2261/3495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:17 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:18.225599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:18.227310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:18.236450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:18.244747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:18.246791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:18.247776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:18.249680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:18.250590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:18.359429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:18.375688 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82a17a6e-b71b-483d-86c4-b0165c1b9bad tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1270 microversion: 2.1 time: 0.160229 Oct 04 11:15:18.383731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2262/3496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:18 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:18.398099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c4e08b68-a492-4f53-b9c5-fd859c549019 req-9bd31a7e-748a-4411-aa48-7fadc55d6de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc74744-2d54-4822-9ef1-a4bbf68631a1", "name": "network-vif-deleted", "tag": "80f2f48c-bcbb-4f85-a616-a9fa7ca9f9d0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:18.415104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c4e08b68-a492-4f53-b9c5-fd859c549019 req-9bd31a7e-748a-4411-aa48-7fadc55d6de1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:18.416054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c4e08b68-a492-4f53-b9c5-fd859c549019 req-9bd31a7e-748a-4411-aa48-7fadc55d6de1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:18.416659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c4e08b68-a492-4f53-b9c5-fd859c549019 req-9bd31a7e-748a-4411-aa48-7fadc55d6de1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:18.441729 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c4e08b68-a492-4f53-b9c5-fd859c549019 req-9bd31a7e-748a-4411-aa48-7fadc55d6de1 service nova] Creating event network-vif-deleted:80f2f48c-bcbb-4f85-a616-a9fa7ca9f9d0 for instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 on n-h1-791135-8 Oct 04 11:15:18.449504 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c4e08b68-a492-4f53-b9c5-fd859c549019 req-9bd31a7e-748a-4411-aa48-7fadc55d6de1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063841 Oct 04 11:15:18.454038 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2263/3497] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:18.466908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-937a3df9-a0ae-4f6c-8400-e4eee3140137 req-d03d0d93-a676-4206-9f88-e8bc2ee670fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26460e6f-e9a5-4ea4-b756-53ed860dfce5", "name": "network-vif-deleted", "tag": "be548080-747c-4a27-8154-3532837cc1aa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:18.492012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-937a3df9-a0ae-4f6c-8400-e4eee3140137 req-d03d0d93-a676-4206-9f88-e8bc2ee670fd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:18.492864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-937a3df9-a0ae-4f6c-8400-e4eee3140137 req-d03d0d93-a676-4206-9f88-e8bc2ee670fd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:18.494144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-937a3df9-a0ae-4f6c-8400-e4eee3140137 req-d03d0d93-a676-4206-9f88-e8bc2ee670fd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:18.526348 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-937a3df9-a0ae-4f6c-8400-e4eee3140137 req-d03d0d93-a676-4206-9f88-e8bc2ee670fd service nova] Creating event network-vif-deleted:be548080-747c-4a27-8154-3532837cc1aa for instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 on n-h1-791135-8 Oct 04 11:15:18.532203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-937a3df9-a0ae-4f6c-8400-e4eee3140137 req-d03d0d93-a676-4206-9f88-e8bc2ee670fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076560 Oct 04 11:15:18.533303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2264/3498] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:18.539372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:18.540287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:18.548890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:18.549689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:18.551220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:18.555762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:18.556517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:18.558919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:18.948442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:18.958960 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9e8ba93-e23d-41c7-8022-fe59b3f19d00 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1314 microversion: 2.1 time: 0.424160 Oct 04 11:15:18.973387 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2265/3499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:18 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:18.973387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:18.973387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:18.989303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:18.989869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:18.993169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:18.994635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:18.995189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:18.998258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:19.028719 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 HTTP/1.1 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8dc74744-2d54-4822-9ef1-a4bbf68631a1'} Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.032330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:19.038929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:19.038929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:19.038929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:19.038929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:19.038929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.038929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.038929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:19.038929 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f146e3d0-7107-405e-8b91-615eee87b494 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 404 len: 111 microversion: 2.1 time: 0.071569 Oct 04 11:15:19.054058 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2266/3500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:18 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:19.065118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:19.067605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:19.081830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:19.082366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:19.082818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:19.083707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:19.084186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:19.084639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:19.380268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:19.392549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6626febd-956c-47d5-b55f-0533e3e492ed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.334536 Oct 04 11:15:19.400630 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2267/3501] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:19 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:19.411261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:19.414476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:19.430948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:19.431471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:19.433563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:19.441790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:19.450214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:19.451645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:19.733399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:19.762674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:19.765794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:19.767536 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-224c904f-0d4e-4d8e-b358-5b3f553b967b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 2863 microversion: 2.32 time: 0.365064 Oct 04 11:15:19.768376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2268/3502] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:19 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 2863 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:19.778787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:19.779512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:19.790111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:19.792106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:19.792734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:19.793938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:19.794398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:19.794847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:19.813642 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 HTTP/1.1 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8dc74744-2d54-4822-9ef1-a4bbf68631a1'} Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:19.817072 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:19.822813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:19.826148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:19.828148 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e31e493-a086-4ea9-9325-5a703b19249d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 404 len: 111 microversion: 2.1 time: 0.057552 Oct 04 11:15:19.829190 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2269/3503] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:19 2022] DELETE /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:20.055261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b64c3f55-56d4-49ec-9bbd-506bcbf7fe8e tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] Calling method '.version_select at 0x7f71cf1c5a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:20.185046 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b64c3f55-56d4-49ec-9bbd-506bcbf7fe8e tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.347979 Oct 04 11:15:20.188199 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2270/3504] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:15:19 2022] GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f/defaults => generated 371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:20.204238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8f11dc-6474-4736-9972-1fb65647ece0", "name": "network-vif-plugged", "status": "completed", "tag": "02b3a097-9732-4f13-9254-dc56af34ccbe"}, {"server_uuid": "429321cb-fd5a-48ad-9bae-33c0b5b4e342", "name": "network-vif-plugged", "status": "completed", "tag": "c684299e-39b3-4d92-90b9-9971b1e58097"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-unplugged", "status": "completed", "tag": "6cee2a64-e738-4a11-b292-980ede0a7155"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-unplugged", "status": "completed", "tag": "f5229279-5aae-4110-b650-3053d2901abf"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-unplugged", "status": "completed", "tag": "1fd6aa11-1a36-4cb6-bc83-1c8b8e59925d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:20.236214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:20.236849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:20.238788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:20.287118 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Creating event network-vif-plugged:02b3a097-9732-4f13-9254-dc56af34ccbe for instance 8d8f11dc-6474-4736-9972-1fb65647ece0 on n-h2-791135-8 Oct 04 11:15:20.287831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Creating event network-vif-plugged:c684299e-39b3-4d92-90b9-9971b1e58097 for instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 on n-h2-791135-8 Oct 04 11:15:20.289001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Creating event network-vif-unplugged:6cee2a64-e738-4a11-b292-980ede0a7155 for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:20.289891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Creating event network-vif-unplugged:f5229279-5aae-4110-b650-3053d2901abf for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:20.291767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] Creating event network-vif-unplugged:1fd6aa11-1a36-4cb6-bc83-1c8b8e59925d for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:20.320765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f471cfb7-16d3-400e-a250-b0124c742446 req-7ff40cbb-ddb2-4de4-8de6-4a66191c3c55 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 873 microversion: 2.1 time: 0.130968 Oct 04 11:15:20.323738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2271/3505] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 873 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:20.330812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:20.338522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:20.351538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:20.353960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:20.357073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:20.358659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:20.359584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:20.360846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:20.707674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:20.718167 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f369190-000b-48bc-90ca-78faca0fdcd4 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.392946 Oct 04 11:15:20.721871 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2272/3506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:20 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:20.726960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:20.730599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:20.749770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:20.751048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:20.751497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:20.752225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:20.752702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:20.753169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:21.017988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:21.031898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f45f6e90-2f4b-48dd-8e7f-6bce0831ce7f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1318 microversion: 2.1 time: 0.308586 Oct 04 11:15:21.033361 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2273/3507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:20 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:21.055787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:21.056457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 8dc74744-2d54-4822-9ef1-a4bbf68631a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:21.072532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:21.077024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:21.077559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:21.078311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:21.083395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:21.084117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:21.117156 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 HTTP/1.1 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8dc74744-2d54-4822-9ef1-a4bbf68631a1'} Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:21.119482 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:21.125217 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:21.125217 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:21.125217 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:21.125217 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:21.125217 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. Oct 04 11:15:21.125217 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:21.125217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 8dc74744-2d54-4822-9ef1-a4bbf68631a1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:21.125217 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a603f7e-52fe-4eff-ae13-f9dbb12f08dd tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1" status: 404 len: 111 microversion: 2.1 time: 0.088559 Oct 04 11:15:21.127164 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2274/3508] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:21 2022] GET /compute/v2.1/servers/8dc74744-2d54-4822-9ef1-a4bbf68631a1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:21.145664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:21.150216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:21.164544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:21.167494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:21.168273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:21.169103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:21.169674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:21.174177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:21.529694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:21.543685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9141ff9f-aae7-467c-9c07-1b442245e052 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1314 microversion: 2.1 time: 0.401826 Oct 04 11:15:21.546513 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2275/3509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:21 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:21.567077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9f38aa7-442e-4509-aab7-7e4698d55e99 tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] Calling method '.version_select at 0x7f71d405da60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:21.710248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=27 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:21.720624 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9f38aa7-442e-4509-aab7-7e4698d55e99 tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f" status: 200 len: 371 microversion: 2.1 time: 0.174649 Oct 04 11:15:21.722488 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2276/3510] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:15:21 2022] GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f => generated 371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:21.728732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:21.729909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:21.748657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:21.750552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:21.751211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:21.751848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:21.752342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:21.752899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.171534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:22.180476 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cb8e666a-e62a-49af-9d38-acb1fcfce6e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.456572 Oct 04 11:15:22.181651 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2277/3511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:21 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:22.186964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-54979a79-7324-4760-ade0-aa12362cb035 req-ff6995f5-f53e-4639-b630-0aa858d48865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-deleted", "tag": "91e8e93c-e545-42c5-a472-0e7ec77847ed"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:22.198674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-54979a79-7324-4760-ade0-aa12362cb035 req-ff6995f5-f53e-4639-b630-0aa858d48865 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:22.199157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-54979a79-7324-4760-ade0-aa12362cb035 req-ff6995f5-f53e-4639-b630-0aa858d48865 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:22.199589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-54979a79-7324-4760-ade0-aa12362cb035 req-ff6995f5-f53e-4639-b630-0aa858d48865 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.213172 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-54979a79-7324-4760-ade0-aa12362cb035 req-ff6995f5-f53e-4639-b630-0aa858d48865 service nova] Creating event network-vif-deleted:91e8e93c-e545-42c5-a472-0e7ec77847ed for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:22.218590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-54979a79-7324-4760-ade0-aa12362cb035 req-ff6995f5-f53e-4639-b630-0aa858d48865 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035465 Oct 04 11:15:22.219155 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2278/3512] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:22.224762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:22.225714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:22.233663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:22.234158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:22.234603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.235311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:22.235766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:22.236192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.406967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:22.418354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:22.419713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:22.421515 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9a6c8fbd-9387-4220-9c1f-dba15c5986e2 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 2771 microversion: 2.32 time: 0.201001 Oct 04 11:15:22.422162 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2279/3513] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:22 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 2771 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:22.428721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:22.429159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:22.436581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:22.437075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:22.437551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.438257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:22.438972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:22.439400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.472319 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 HTTP/1.1 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a737a39b-9ea3-47a5-bb79-75864179bab1'} Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:22.475955 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f186623-0993-4c8e-b151-61679b715944 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 404 len: 111 microversion: 2.1 time: 0.065750 Oct 04 11:15:22.494132 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2280/3514] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:22 2022] DELETE /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:22.504361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63531b4f-9682-4697-b830-d9f07d76bf99 tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] Calling method '.version_select at 0x7f71d4251ca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:22.642889 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63531b4f-9682-4697-b830-d9f07d76bf99 tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.148924 Oct 04 11:15:22.643882 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2281/3515] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:15:22 2022] GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f/defaults => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:22.656798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:22.657308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:22.665239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:22.665783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:22.666226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.666937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:22.667397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:22.667889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.847955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:22.857040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4d122d5f-0ba4-43a0-85ed-e2760a2bcaa1 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1323 microversion: 2.1 time: 0.212114 Oct 04 11:15:22.859554 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2282/3516] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:22 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:22.954416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b44acb5d-5390-4ea2-8c8f-939719fcc0a8 req-7f09cf68-605f-496b-8eed-aae38f358f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2062e0cb-5c32-4913-8415-c060e6cfbefb", "tag": "f22f3b95-17d8-4714-afd1-814596d5b702"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:22.966004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b44acb5d-5390-4ea2-8c8f-939719fcc0a8 req-7f09cf68-605f-496b-8eed-aae38f358f7f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:22.966790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b44acb5d-5390-4ea2-8c8f-939719fcc0a8 req-7f09cf68-605f-496b-8eed-aae38f358f7f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:22.967417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b44acb5d-5390-4ea2-8c8f-939719fcc0a8 req-7f09cf68-605f-496b-8eed-aae38f358f7f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:22.981048 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b44acb5d-5390-4ea2-8c8f-939719fcc0a8 req-7f09cf68-605f-496b-8eed-aae38f358f7f service nova] Creating event network-changed:f22f3b95-17d8-4714-afd1-814596d5b702 for instance 2062e0cb-5c32-4913-8415-c060e6cfbefb on n-h2-791135-8 Oct 04 11:15:23.002262 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b44acb5d-5390-4ea2-8c8f-939719fcc0a8 req-7f09cf68-605f-496b-8eed-aae38f358f7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141331 Oct 04 11:15:23.009098 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2283/3517] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:23.020777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:23.021864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:23.038963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.041879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.042323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.050545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.051045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.051842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.335046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:23.344824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d27d4939-f94e-406a-9efe-011010345002 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1318 microversion: 2.1 time: 0.334389 Oct 04 11:15:23.346355 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2284/3518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:23 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:23.351853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-200cbc42-4fda-43bf-816d-0489b1afd0d8 req-a584519f-c55f-4784-867c-7e3d3a367d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-unplugged", "status": "completed", "tag": "1e9950d3-05db-4d70-91e8-ee743c2d5efb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:23.365015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-200cbc42-4fda-43bf-816d-0489b1afd0d8 req-a584519f-c55f-4784-867c-7e3d3a367d48 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.366504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-200cbc42-4fda-43bf-816d-0489b1afd0d8 req-a584519f-c55f-4784-867c-7e3d3a367d48 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.367330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-200cbc42-4fda-43bf-816d-0489b1afd0d8 req-a584519f-c55f-4784-867c-7e3d3a367d48 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.385405 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-200cbc42-4fda-43bf-816d-0489b1afd0d8 req-a584519f-c55f-4784-867c-7e3d3a367d48 service nova] Creating event network-vif-unplugged:1e9950d3-05db-4d70-91e8-ee743c2d5efb for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:23.395358 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-200cbc42-4fda-43bf-816d-0489b1afd0d8 req-a584519f-c55f-4784-867c-7e3d3a367d48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046194 Oct 04 11:15:23.397101 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2285/3519] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:23.405657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:23.407178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a737a39b-9ea3-47a5-bb79-75864179bab1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:23.414053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.414596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.415147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.416836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.417629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.418278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.434091 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 HTTP/1.1 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a737a39b-9ea3-47a5-bb79-75864179bab1'} Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.435778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance a737a39b-9ea3-47a5-bb79-75864179bab1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7251b6d7-e7c9-4d36-b3fb-c96acbad9b28 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1" status: 404 len: 111 microversion: 2.1 time: 0.038696 Oct 04 11:15:23.440440 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2286/3520] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:23 2022] GET /compute/v2.1/servers/a737a39b-9ea3-47a5-bb79-75864179bab1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:23.442833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:23.443655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:23.451135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.451695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.452146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.452858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.453543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.454209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.480868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:23.662653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:23.672371 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd8a720d-ba23-43b3-8f4b-dedb267a8829 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1500 microversion: 2.1 time: 0.233317 Oct 04 11:15:23.672968 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2287/3521] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:23 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1500 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:23.681599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52961190-5678-4558-8ede-6008d5eb3445 tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] Calling method '.version_select at 0x7f71d4251940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:23.758860 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52961190-5678-4558-8ede-6008d5eb3445 tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f" status: 200 len: 371 microversion: 2.1 time: 0.084180 Oct 04 11:15:23.760317 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2288/3522] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:15:23 2022] GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:23.774044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:23.775235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:23.783569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.784454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.785259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.786559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.787394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.788435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.928476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:23.937382 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9eb5d5e-4414-449b-85d5-fb62f7a033e7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.168207 Oct 04 11:15:23.938134 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2289/3523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:23 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:23.942635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:23.944839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:23.950811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.951284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.951718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.952562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.953046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.953498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.971001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 HTTP/1.1 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '69ff9d7b-1e62-40ff-8770-36c69d67eea7'} Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:23.972589 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-abcb7212-b988-4e28-8850-fcda89cce5e7 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 404 len: 111 microversion: 2.1 time: 0.035326 Oct 04 11:15:23.977828 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2290/3524] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:23 2022] DELETE /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:23.980553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:23.981152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:23.987156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.987635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.988069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:23.988768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:23.989216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:23.989675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.057885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:24.068409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:24.070191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:24.072504 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-efe0af64-fce4-416b-ac1a-67629b6e3f71 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1603 microversion: 2.32 time: 0.096445 Oct 04 11:15:24.086109 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2291/3525] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:23 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1603 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:24.098239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:24.098640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:24.105647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.106444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.107237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.107857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.108189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.108625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.187666 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4d1f1255-316d-4544-83b2-581a99f4c692 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342/action" status: 202 len: 0 microversion: 2.1 time: 0.099808 Oct 04 11:15:24.191385 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2292/3526] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:15:24 2022] POST /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:15:24.193922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-40247cf2-1c0b-4c4d-afe7-051f31464747 tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] Calling method '.version_select at 0x7f71d440e940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:24.280774 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-40247cf2-1c0b-4c4d-afe7-051f31464747 tempest-QuotasTestJSON-2125555593 tempest-QuotasTestJSON-2125555593-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f?user_id=5c4ab368ac464e3c9348a39d591b8ea6" status: 200 len: 371 microversion: 2.1 time: 0.090905 Oct 04 11:15:24.289976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2293/3527] 10.222.0.23 () {58 vars in 1323 bytes} [Tue Oct 4 11:15:24 2022] GET /compute/v2.1/os-quota-sets/49d14714ec144adaae1a13d98520274f?user_id=5c4ab368ac464e3c9348a39d591b8ea6 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:24.289976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:24.289976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:24.301788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.302274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.302720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.303581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.303895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.304327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.455074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:24.463585 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-962a8d3a-6a72-4069-ad58-269e43e69fc2 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1518 microversion: 2.1 time: 0.180958 Oct 04 11:15:24.478588 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2294/3528] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:24 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:24.486720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:24.487343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 69ff9d7b-1e62-40ff-8770-36c69d67eea7] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:24.495053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.495552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.496103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.496815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.497305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.497839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.515354 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 HTTP/1.1 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '69ff9d7b-1e62-40ff-8770-36c69d67eea7'} Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:24.517038 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 69ff9d7b-1e62-40ff-8770-36c69d67eea7 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e00696e8-479c-4f9e-a17d-a69874a97618 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7" status: 404 len: 111 microversion: 2.1 time: 0.038913 Oct 04 11:15:24.523865 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2295/3529] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:24 2022] GET /compute/v2.1/servers/69ff9d7b-1e62-40ff-8770-36c69d67eea7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:24.528131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:24.529402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:24.535440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.535929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.536374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.537074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.537783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.538668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.722430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:24.732412 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91cafe7e-b6b0-46ee-8eef-b708f6b2ab50 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1505 microversion: 2.1 time: 0.208449 Oct 04 11:15:24.734999 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2296/3530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:24 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:24.750985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-deleted", "tag": "1fd6aa11-1a36-4cb6-bc83-1c8b8e59925d"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-deleted", "tag": "6cee2a64-e738-4a11-b292-980ede0a7155"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-deleted", "tag": "1e9950d3-05db-4d70-91e8-ee743c2d5efb"}, {"server_uuid": "43c996e1-0d61-42be-9696-2eda7c00a9f4", "name": "network-vif-deleted", "tag": "f5229279-5aae-4110-b650-3053d2901abf"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:24.759673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:24.764190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.764710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.765146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.780470 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] Creating event network-vif-deleted:1fd6aa11-1a36-4cb6-bc83-1c8b8e59925d for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:24.780979 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] Creating event network-vif-deleted:6cee2a64-e738-4a11-b292-980ede0a7155 for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:24.781509 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] Creating event network-vif-deleted:1e9950d3-05db-4d70-91e8-ee743c2d5efb for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:24.782000 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] Creating event network-vif-deleted:f5229279-5aae-4110-b650-3053d2901abf for instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 on n-h1-791135-8 Oct 04 11:15:24.787595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-606ede75-5703-406d-8bd5-864101987ac1 req-1aa7ac73-6f40-4659-952c-c297f444f8ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.051035 Oct 04 11:15:24.788594 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2297/3531] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:24.795500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:24.796850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:24.803391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.804098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.804706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:24.805595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:24.806533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:24.807402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.014543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:25.027253 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e343d10-9402-4533-843e-d3356e7fe4c6 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1318 microversion: 2.1 time: 0.237184 Oct 04 11:15:25.028515 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2298/3532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:24 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:25.042329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:25.055403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:25.064545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.065070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.065732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.067051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.067608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.068154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.103400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lazy-loading 'flavor' on Instance uuid 8d8f11dc-6474-4736-9972-1fb65647ece0 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:15:25.255523 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b05580b-2db6-49c3-b27e-77f91174a000 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action" status: 200 len: 32 microversion: 2.1 time: 0.225464 Oct 04 11:15:25.256773 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2299/3533] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:15:25 2022] POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:15:25.263701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:25.264762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:25.272993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.273881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.274783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.275569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.276159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.276659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.293684 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 HTTP/1.1 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b7425e6f-ad86-45e6-87ca-80082bfa0e04'} Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:25.309541 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:25.314897 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06e598fd-9e2a-4f26-942a-d92c4b852687 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 404 len: 111 microversion: 2.1 time: 0.053278 Oct 04 11:15:25.315904 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2300/3534] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:25 2022] DELETE /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:25.324961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:25.326456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:25.343352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.343784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.344234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.344955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.345440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.345874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.511882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:25.520438 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c5975d0-577b-4368-8a4d-0d90f0b69e37 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.204124 Oct 04 11:15:25.521636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2301/3535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:25 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:25.527053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:25.527886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:25.534173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.534883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.535633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.536519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.537157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.537790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.538530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:25.624066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:25.635298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:25.636690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:25.637993 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a60da07-5e01-4955-97e3-e8debe33eb06 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1603 microversion: 2.32 time: 0.115169 Oct 04 11:15:25.638749 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2302/3536] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:25 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1603 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:25.653665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:25.654288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:25.668919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.669475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.669923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.670646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.671179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.671620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.914527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:25.936014 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fbb7b8bc-7c97-424a-9691-d33484e0d1f8 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.296092 Oct 04 11:15:25.960095 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2303/3537] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:25 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:25.970416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:25.970984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: b7425e6f-ad86-45e6-87ca-80082bfa0e04] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:25.986486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.987087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.987548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:25.988352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:25.988840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:25.989280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:26.020037 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 HTTP/1.1 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b7425e6f-ad86-45e6-87ca-80082bfa0e04'} Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.021700 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:26.027448 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:26.027448 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:26.027448 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:26.027448 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:26.027448 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. Oct 04 11:15:26.027448 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.027448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance b7425e6f-ad86-45e6-87ca-80082bfa0e04 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:26.029042 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0011302f-7435-4fb5-8ce8-9d3b3a69e160 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04" status: 404 len: 111 microversion: 2.1 time: 0.067516 Oct 04 11:15:26.029694 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2304/3538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:25 2022] GET /compute/v2.1/servers/b7425e6f-ad86-45e6-87ca-80082bfa0e04 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:26.044188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:26.050188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:26.060874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:26.061897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:26.062440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:26.063341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:26.063871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:26.064318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:26.748405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:26.764407 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c558852-2783-41bf-891d-bd03cc06acfd tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1485 microversion: 2.1 time: 0.733624 Oct 04 11:15:26.765605 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2305/3539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:26 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1485 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:26.772275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:26.772798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:26.790493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:26.791743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:26.792689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:26.793788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:26.794427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:26.795028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:26.812552 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 HTTP/1.1 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '49e36650-3d63-4ce5-9045-f07a07011621'} Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:26.815598 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:26.821264 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:26.823708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:26.824892 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd57e433-4ba1-4979-bf2a-d8f5695c7cee tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 404 len: 111 microversion: 2.1 time: 0.058098 Oct 04 11:15:26.826045 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2306/3540] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:26 2022] DELETE /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:26.831221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:26.832269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:26.839699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:26.840478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:26.841091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:26.842313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:26.842967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:26.843697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:26.851536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:27.160069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:27.170565 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc1e4f93-c04d-463e-a644-8afbf8e8ba7b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1318 microversion: 2.1 time: 0.343202 Oct 04 11:15:27.190240 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2307/3541] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:26 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:27.200366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:27.208097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:27.215838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.216545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.217150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.225777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.226489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.227209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.536426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:27.545631 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0d34d9d-ba89-46da-bf0d-107fd8028fb7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.349667 Oct 04 11:15:27.557489 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2308/3542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:27 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:27.563360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:27.564210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:27.571234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.571778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.572221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.573075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.573600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.574037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.650807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:27.660589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:27.662304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:27.663952 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f1cd83d-51a0-4e7c-9b50-c691714bd1c4 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1603 microversion: 2.32 time: 0.104761 Oct 04 11:15:27.664719 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2309/3543] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:27 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1603 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:27.669685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:27.670376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:27.677044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.677798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.678417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.679326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.679956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.680556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.711162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:15:27.852127 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ced13072-3966-4a10-b8f6-9ef4ef69b09b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 204 len: 0 microversion: 2.1 time: 0.185547 Oct 04 11:15:27.852862 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2310/3544] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:27 2022] DELETE /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:15:27.861468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:27.861971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 49e36650-3d63-4ce5-9045-f07a07011621] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:27.869682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.870183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.870672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.871383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.871884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.872316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.890876 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 HTTP/1.1 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '49e36650-3d63-4ce5-9045-f07a07011621'} Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:27.892477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 49e36650-3d63-4ce5-9045-f07a07011621 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa1f6047-987f-4501-8808-2944948478b5 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621" status: 404 len: 111 microversion: 2.1 time: 0.039707 Oct 04 11:15:27.899362 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2311/3545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:27 2022] GET /compute/v2.1/servers/49e36650-3d63-4ce5-9045-f07a07011621 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:27.905385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:27.905385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:27.909296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.909810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.910351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:27.911129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:27.911587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:27.912014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.096232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:28.106561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2915ac39-5142-47ab-a19d-1c710add9ecc tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.210878 Oct 04 11:15:28.107519 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2312/3546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:27 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:28.113089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:28.113735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:28.126026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.126624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.127105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.127865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.128328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.128758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.335062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:28.345628 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a00f5ed-3472-4704-8882-e61cd194459b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1491 microversion: 2.1 time: 0.236978 Oct 04 11:15:28.346583 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2313/3547] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:28 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1491 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:28.352053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:28.352673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:28.359482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.360326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.360829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.361990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.362246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.362737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.382395 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 HTTP/1.1 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '52a84e23-3478-4a9a-822a-45920bd38647'} Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:28.384871 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d730c61-9e09-4228-917b-92330f72dd06 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 404 len: 111 microversion: 2.1 time: 0.038289 Oct 04 11:15:28.390818 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2314/3548] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:28 2022] DELETE /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:28.393796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:28.394324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:28.411777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.420129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.420706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.421515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.427030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.428968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.687547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:28.706915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d16e0af6-165c-43a1-b768-a2aa25eb4048 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1318 microversion: 2.1 time: 0.317328 Oct 04 11:15:28.721394 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2315/3549] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:28 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:28.721394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:28.721394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 52a84e23-3478-4a9a-822a-45920bd38647] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:28.731376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.732725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.733614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.734992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.735375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.735875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.754015 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 HTTP/1.1 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '52a84e23-3478-4a9a-822a-45920bd38647'} Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.755631 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 52a84e23-3478-4a9a-822a-45920bd38647 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81314166-a9bc-43d1-be52-6815f1c21a76 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647" status: 404 len: 111 microversion: 2.1 time: 0.045067 Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2316/3550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:28 2022] GET /compute/v2.1/servers/52a84e23-3478-4a9a-822a-45920bd38647 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:28.766111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:28.773153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.773637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.774135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.774888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.775300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.775737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.945457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:28.956709 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1afefb0d-9858-42ec-8bb3-4bde01b72260 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.196814 Oct 04 11:15:28.957433 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2317/3551] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:28 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:28.963763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:28.964601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:28.972528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.973060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.973804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:28.974625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:28.975130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:28.976267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.061643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:29.071575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:29.073057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:29.074373 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-47beb15e-ee38-4d86-966c-bce68ab7b954 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1603 microversion: 2.32 time: 0.115967 Oct 04 11:15:29.075242 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2318/3552] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:28 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1603 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:29.103518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:29.109757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 6a260641-f3a6-4dbb-9be0-6980d44a0fd8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:29.121633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.122683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.125616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.126699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.127397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.128040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.146305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 HTTP/1.1 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '6a260641-f3a6-4dbb-9be0-6980d44a0fd8'} Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:29.148425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4c4801a-777b-42e3-a85f-f7fb9b8dc7f8 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8" status: 404 len: 111 microversion: 2.1 time: 0.059442 Oct 04 11:15:29.155899 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2319/3553] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:29 2022] DELETE /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:29.157831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:29.161377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:29.166667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.167273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.167718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.168542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.169013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.169485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.379193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:29.387966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ffd3ffca-0f35-4365-a92a-b914b14963ae tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.234694 Oct 04 11:15:29.388804 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2320/3554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:29 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:29.409180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:29.409860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: 6a260641-f3a6-4dbb-9be0-6980d44a0fd8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:29.416299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.416576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.416958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.417692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.418153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.418586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.435385 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 HTTP/1.1 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '6a260641-f3a6-4dbb-9be0-6980d44a0fd8'} Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.436965 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance 6a260641-f3a6-4dbb-9be0-6980d44a0fd8 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1165ec41-ca56-4df4-8556-b23bf179ab4d tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8" status: 404 len: 111 microversion: 2.1 time: 0.039980 Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2321/3555] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:29 2022] GET /compute/v2.1/servers/6a260641-f3a6-4dbb-9be0-6980d44a0fd8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:29.444532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:29.446031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:29.451651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.452151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.452602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.453318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.453860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.454299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.716143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:29.725387 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-646974e1-50bc-4f07-ba76-70ce757ba18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 200 len: 1491 microversion: 2.1 time: 0.284931 Oct 04 11:15:29.742758 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2322/3556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:29 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 1491 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:29.742758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:29.742758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:29.748557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.752262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.752262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.760026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:29.760735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:29.761314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:29.796407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:15:29.877827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:29.925851 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5ef2607e-b77d-49ff-92d4-34dc2a03ba3a tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 204 len: 0 microversion: 2.1 time: 0.194414 Oct 04 11:15:29.929451 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2323/3557] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:15:29 2022] DELETE /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:15:29.938834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24adc572-ac24-48ad-8b78-9c8ade80f9a7 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d4421dc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:30.033191 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24adc572-ac24-48ad-8b78-9c8ade80f9a7 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3cce9246-2299-4776-b738-aeff2f2792e0" status: 200 len: 351 microversion: 2.1 time: 0.102321 Oct 04 11:15:30.034624 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2324/3558] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:15:29 2022] GET /compute/v2.1/os-volumes/3cce9246-2299-4776-b738-aeff2f2792e0 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:30.039317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:30.041127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:30.066803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:30.067332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:30.068639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:30.069459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:30.069936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:30.070376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:30.516050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:30.526304 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f44972d7-7c35-4cb5-988b-3f4dc083725f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1318 microversion: 2.1 time: 0.490372 Oct 04 11:15:30.527520 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2325/3559] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:30 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:30.532579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:30.533451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:30.562202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:30.562202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:30.562202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:30.562202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:30.565665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:30.566202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:30.885596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0787189ca1f844709e5f9cec124c772e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c6529843094fdd90961baa8313dd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:30.893794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dbfd62a6-1705-46c5-8611-1ba93a263c8f tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 200 len: 1480 microversion: 2.1 time: 0.364977 Oct 04 11:15:30.906222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2326/3560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:30 2022] GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 1480 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:30.911997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:30.912614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:30.922251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:30.923017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:30.923628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:30.924501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:30.925117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:30.925739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.093150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:31.104239 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e006a0d-9a22-4bc2-ba95-6abe9c296c4b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1512 microversion: 2.1 time: 0.196328 Oct 04 11:15:31.105455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2327/3561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:30 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:31.117902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:31.120515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:31.129098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:31.129869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:31.130755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.131675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:31.132955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:31.133873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.209453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:31.236972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:31.243532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:31.246178 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e499e07-0ba7-4fb1-8835-2542de3fc62d tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1603 microversion: 2.32 time: 0.139606 Oct 04 11:15:31.259463 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2328/3562] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:31 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1603 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:31.280814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:31.282662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:31.298066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:31.298581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:31.299022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.301577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:31.304530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:31.305173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.598043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:31.628197 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c58e37f-3616-4fc3-a348-98b475f59e95 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.366934 Oct 04 11:15:31.628537 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2329/3563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:31 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:31.641901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-92b0e85d-981c-4887-b1c0-9f9e0d6e1517 req-1e5d094a-4d91-4999-aa8e-ad069234c964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429321cb-fd5a-48ad-9bae-33c0b5b4e342", "name": "network-vif-deleted", "tag": "c684299e-39b3-4d92-90b9-9971b1e58097"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:31.652373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92b0e85d-981c-4887-b1c0-9f9e0d6e1517 req-1e5d094a-4d91-4999-aa8e-ad069234c964 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:31.652867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92b0e85d-981c-4887-b1c0-9f9e0d6e1517 req-1e5d094a-4d91-4999-aa8e-ad069234c964 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:31.653302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92b0e85d-981c-4887-b1c0-9f9e0d6e1517 req-1e5d094a-4d91-4999-aa8e-ad069234c964 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.668762 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-92b0e85d-981c-4887-b1c0-9f9e0d6e1517 req-1e5d094a-4d91-4999-aa8e-ad069234c964 service nova] Creating event network-vif-deleted:c684299e-39b3-4d92-90b9-9971b1e58097 for instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 on n-h2-791135-8 Oct 04 11:15:31.674508 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-92b0e85d-981c-4887-b1c0-9f9e0d6e1517 req-1e5d094a-4d91-4999-aa8e-ad069234c964 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044644 Oct 04 11:15:31.675354 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2330/3564] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:31.682411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6aa37bdf-bb33-43e9-8584-f2e711d39c37 req-3453b63f-7b74-4e63-ba1c-eb0429c47090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2062e0cb-5c32-4913-8415-c060e6cfbefb", "name": "network-vif-plugged", "status": "completed", "tag": "f22f3b95-17d8-4714-afd1-814596d5b702"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:31.693129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6aa37bdf-bb33-43e9-8584-f2e711d39c37 req-3453b63f-7b74-4e63-ba1c-eb0429c47090 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:31.693929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6aa37bdf-bb33-43e9-8584-f2e711d39c37 req-3453b63f-7b74-4e63-ba1c-eb0429c47090 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:31.694580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6aa37bdf-bb33-43e9-8584-f2e711d39c37 req-3453b63f-7b74-4e63-ba1c-eb0429c47090 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.710100 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6aa37bdf-bb33-43e9-8584-f2e711d39c37 req-3453b63f-7b74-4e63-ba1c-eb0429c47090 service nova] Creating event network-vif-plugged:f22f3b95-17d8-4714-afd1-814596d5b702 for instance 2062e0cb-5c32-4913-8415-c060e6cfbefb on n-h2-791135-8 Oct 04 11:15:31.716959 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6aa37bdf-bb33-43e9-8584-f2e711d39c37 req-3453b63f-7b74-4e63-ba1c-eb0429c47090 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040009 Oct 04 11:15:31.718186 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2331/3565] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:31.724332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:31.725297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:31.733142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:31.733885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:31.734388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.735392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:31.735925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:31.736559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:31.753961 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 HTTP/1.1 Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '429321cb-fd5a-48ad-9bae-33c0b5b4e342'} Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:31.756877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a978793-21fb-42cd-9209-de42c3101077 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 404 len: 111 microversion: 2.1 time: 0.040701 Oct 04 11:15:31.775692 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2332/3566] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:31 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:31.780720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2100127327", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "973c00bd-0fce-4cb1-a025-a2c2987cef21"}], "block_device_mapping_v2": [{"uuid": "b8dadc8f-f5c4-4665-97fd-5dc64c75418e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:31.903878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] validate_networks() for [('973c00bd-0fce-4cb1-a025-a2c2987cef21', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:15:32.338864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:15:32.339327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:15:32.339813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:15:32.340232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:15:32.340685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:15:32.349766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:32.350254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:32.350727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:32.351465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:32.351925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:32.352360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:32.370612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for project d8213366237849c5bd0db518c55bc288. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:32.374958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Getting quotas for user 8f8c67a2ba884edbb978a166d91294d7 and project d8213366237849c5bd0db518c55bc288. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:32.432698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:15:32.434885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8dadc8f-f5c4-4665-97fd-5dc64c75418e',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:15:32.566566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-875241f9-dddc-4a6d-87f5-61416d4f28b0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803369 Oct 04 11:15:32.567220 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2333/3567] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:15:32.572216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:32.573137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:32.579712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:32.580205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:32.580646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:32.581409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:32.581871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:32.582495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:32.754099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:32.762039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12c31c47-4aea-42bc-ba81-0882c5a00b66 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1318 microversion: 2.1 time: 0.193453 Oct 04 11:15:32.762618 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2334/3568] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:32 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:32.768569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:32.769193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] [instance: a4e5a084-0715-4974-afee-615b911a7431] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:32.775396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:32.777448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:32.778451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:32.778905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:32.780192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:32.780665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:32.781103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:32.798302 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] HTTP exception thrown: Instance a4e5a084-0715-4974-afee-615b911a7431 could not be found. Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Request method failure captured: Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 HTTP/1.1 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSXsM4usyw1HrGJ15DS5PTxH6Tfcu1THtYOtwRhqxmg8D5vYh4rJFyCRSioAN3brKzA3Vzp4YLyLlctGkJkLK2Vnd_aVMb_qGRZhYiHLGAf6S3kswBP7AszxBXFdlLLaQaD6ieqKrKVGhEPJ-Y50g2jfOeCJ9hqNyOD1ghJTwQj85A Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99c6529843094fdd90961baa8313dd87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99c6529843094fdd90961baa8313dd87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99c6529843094fdd90961baa8313dd87"}]}] Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestJSON-798804032 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 99c6529843094fdd90961baa8313dd87 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestJSON-798804032 Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestJSON-798804032-project Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0787189ca1f844709e5f9cec124c772e Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestJSON-798804032-project Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a4e5a084-0715-4974-afee-615b911a7431 could not be found. Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a4e5a084-0715-4974-afee-615b911a7431'} Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e5a084-0715-4974-afee-615b911a7431 could not be found. Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e5a084-0715-4974-afee-615b911a7431 could not be found. Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:32.799882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e5a084-0715-4974-afee-615b911a7431 could not be found. Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] Returning 404 to user: Instance a4e5a084-0715-4974-afee-615b911a7431 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b943558e-c409-4c86-8304-87c0b402e278 tempest-ServersTestJSON-798804032 tempest-ServersTestJSON-798804032-project] 10.222.0.23 "GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431" status: 404 len: 111 microversion: 2.1 time: 0.037709 Oct 04 11:15:32.804748 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2335/3569] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:32 2022] GET /compute/v2.1/servers/a4e5a084-0715-4974-afee-615b911a7431 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:15:32.808659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-665210279", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "49989f52-07b9-48bb-b42a-1e9bb7c15958"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:32.911595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] validate_networks() for [('49989f52-07b9-48bb-b42a-1e9bb7c15958', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:15:33.424052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:15:33.424505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:15:33.425212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:15:33.425837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:15:33.426440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:15:33.455994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:33.456500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:33.456945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:33.457944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:33.458575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:33.459191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:33.489695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:33.496132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for user 510d473de29b4d7d8bb303f64f1e17d4 and project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:33.514002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:15:33.516409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:15:33.597907 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ba6306d-3a8c-4aaa-b40b-02137732fac1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794294 Oct 04 11:15:33.599173 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2336/3570] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:15:33.604507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:33.605335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:33.612343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:33.613123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:33.613796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:33.615333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:33.615991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:33.616821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:33.801315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:33.811898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6658657f-e078-48e4-a27a-850d33fa48bc tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1489 microversion: 2.1 time: 0.211405 Oct 04 11:15:33.812561 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2337/3571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:33 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1489 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:33.817746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:33.818572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:33.836358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:33.837947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:33.838486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:33.839920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:33.840338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:33.840842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:33.935342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:33.948211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:33.951029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:33.952996 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a330280e-b553-4392-8228-73e0bbe35d1e tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1603 microversion: 2.32 time: 0.139152 Oct 04 11:15:33.953958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2338/3572] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:33 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1603 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:33.962911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:33.963524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:33.970252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:33.971365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:33.971825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:33.972670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:33.973181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:33.973805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:34.057401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:34.067125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1537478d-f64e-4bed-819d-4e5f0954acf6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1151 microversion: 2.1 time: 0.111485 Oct 04 11:15:34.084727 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2339/3573] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:33 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1151 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:34.091702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:34.092719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:34.099855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:34.100369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:34.100818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:34.101590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:34.102067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:34.103049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:34.300189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:34.321116 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b89fd50-f63f-481d-8fa8-fd73e97b5794 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.234445 Oct 04 11:15:34.324134 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2340/3574] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:34 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:34.334862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61d352ec-f603-4f2a-a0a7-0f10f66db8f2 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d45803a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:39.461202 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61d352ec-f603-4f2a-a0a7-0f10f66db8f2 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e5f72715-52d2-47ea-8d91-463151f45726" status: 200 len: 351 microversion: 2.1 time: 5.130418 Oct 04 11:15:39.465856 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2341/3575] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:15:34 2022] GET /compute/v2.1/os-volumes/e5f72715-52d2-47ea-8d91-463151f45726 => generated 351 bytes in 5138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:39.467399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:39.468008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:39.485796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:39.486242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:39.487204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:39.487932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:39.488549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:39.488988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:39.691634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:39.701245 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7c6dbba-abdc-4ce4-949a-1b86206abb8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1314 microversion: 2.1 time: 0.238110 Oct 04 11:15:39.713912 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2342/3576] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:39 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:39.723382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6a45bf9b-d44b-4854-940f-cf57d94b7c55 req-df7ff8a8-80c5-4490-a4fe-f7be8aa63d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e5a084-0715-4974-afee-615b911a7431", "name": "network-vif-deleted", "tag": "7754a394-96de-4897-a004-0548fa843b5e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:39.737499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6a45bf9b-d44b-4854-940f-cf57d94b7c55 req-df7ff8a8-80c5-4490-a4fe-f7be8aa63d0e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:39.738592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6a45bf9b-d44b-4854-940f-cf57d94b7c55 req-df7ff8a8-80c5-4490-a4fe-f7be8aa63d0e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:39.739204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6a45bf9b-d44b-4854-940f-cf57d94b7c55 req-df7ff8a8-80c5-4490-a4fe-f7be8aa63d0e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:39.752742 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6a45bf9b-d44b-4854-940f-cf57d94b7c55 req-df7ff8a8-80c5-4490-a4fe-f7be8aa63d0e service nova] Creating event network-vif-deleted:7754a394-96de-4897-a004-0548fa843b5e for instance a4e5a084-0715-4974-afee-615b911a7431 on n-h1-791135-8 Oct 04 11:15:39.758903 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6a45bf9b-d44b-4854-940f-cf57d94b7c55 req-df7ff8a8-80c5-4490-a4fe-f7be8aa63d0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043188 Oct 04 11:15:39.760266 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2343/3577] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:39.765898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:39.766810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:39.774873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:39.775626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:39.776245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:39.777203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:39.777943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:39.778594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.054782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:40.064983 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11230922-827f-4a25-8768-b3e627e13b87 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1508 microversion: 2.1 time: 0.303377 Oct 04 11:15:40.078129 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2344/3578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:39 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1508 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:40.092079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:40.094693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:40.104551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.105337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.111070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.112811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.113324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.116962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.214008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b1050088-58d8-43ef-befa-2b5917e2f1e3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 200 len: 179 microversion: 2.1 time: 0.134164 Oct 04 11:15:40.215453 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2345/3579] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:15:40 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:40.221222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:40.222942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:40.240005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.242054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.243250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.246454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.247117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.249689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.334673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.337160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.337748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.340745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lazy-loading 'fault' on Instance uuid 43c996e1-0d61-42be-9696-2eda7c00a9f4 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:15:40.413426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:40.426511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:40.428744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63b8bbdea0c144d6b76d6a85bb1f1964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df6182d03a546539effc445c7d02041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:40.432998 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-948781c8-80ea-4eb1-8e65-481057d7b9f6 tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 200 len: 1608 microversion: 2.32 time: 0.213573 Oct 04 11:15:40.450923 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2346/3580] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:40 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 1608 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:40.467585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:40.470219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:40.487083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.487875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.488568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.489638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.492919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.493873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.506130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:40.815005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:40.833790 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97905e5f-f585-4307-b6a5-37f999191125 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1211 microversion: 2.1 time: 0.376248 Oct 04 11:15:40.845398 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2347/3581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:40 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1211 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:40.853177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:40.856812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:40.876694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.878237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.880023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:40.881727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:40.882548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:40.882999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:41.223193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:41.233070 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-54ce2cc6-ca71-4bb7-962b-7dbc42277940 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.395781 Oct 04 11:15:41.233685 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2348/3582] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:40 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:41.250040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:41.253313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:41.266262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:41.267053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:41.268838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:41.269774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:41.271815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:41.272470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:41.528126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:41.565489 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b1c1b5bb-3d22-4703-bf8f-f44f74445fbc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1508 microversion: 2.1 time: 0.323584 Oct 04 11:15:41.565984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2349/3583] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:41 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1508 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:41.577423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:41.578058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:41.591274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:41.592024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:41.592269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:41.593210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:41.594509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:41.595339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:41.853533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:41.862562 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e4b58bb-12a5-4378-a7c8-8933cdc64752 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.295386 Oct 04 11:15:41.877870 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2350/3584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:41 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:41.889539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:41.890168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:41.911468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:41.911974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:41.912421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:41.913270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:41.913777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:41.914215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:42.099616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:42.112895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f54f43b-2811-41ff-9c27-0def8ae00b6b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1314 microversion: 2.1 time: 0.233777 Oct 04 11:15:42.113520 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2351/3585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:41 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:42.129556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:42.130192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:42.139753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:42.140618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:42.141603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:42.142519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:42.143146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:42.143845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:42.161994 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] HTTP exception thrown: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Request method failure captured: Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 HTTP/1.1 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBRQLr_6hgJJWUzF69mUZMis06UZGkPEKXare2vPFrrT0FSCpzR74A6q70Zli7UKM87Kn0Or5tzKgIkjsK3okUsk6w5MNAMBELUXd5UU-hV7-d1ki9OhyD6m2O_W1SSK7USh864EpIujjjYjJ3h3ouDPzPxBxKoPSc889jxWcNCJqN8 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 1df6182d03a546539effc445c7d02041 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1df6182d03a546539effc445c7d02041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1df6182d03a546539effc445c7d02041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1df6182d03a546539effc445c7d02041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1df6182d03a546539effc445c7d02041"}]}] Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 1df6182d03a546539effc445c7d02041 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TaggedBootDevicesTest-726726768-project Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 63b8bbdea0c144d6b76d6a85bb1f1964 Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TaggedBootDevicesTest-726726768-project Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '43c996e1-0d61-42be-9696-2eda7c00a9f4'} Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:42.164189 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:42.169856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:42.169856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:42.169856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:42.169856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:42.169856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:42.169856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:42.169856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:42.171977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Returning 404 to user: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:42.173051 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cef16572-19c4-4075-a513-a9cc91630bee tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 404 len: 111 microversion: 2.32 time: 0.058341 Oct 04 11:15:42.174432 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2352/3586] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:42 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:15:42.188821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:42.194519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:42.210015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:42.210532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:42.210982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:42.212870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:42.215248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:42.215707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:42.361507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e354a65-76a4-4666-b110-0abb9d93c13f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "PUT /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1080 microversion: 2.1 time: 0.184908 Oct 04 11:15:42.375067 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2353/3587] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:15:42 2022] PUT /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1080 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:42.381862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:42.385942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:42.392621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:42.393117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:42.393604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:42.394321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:42.394783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:42.395214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:42.699445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:42.714622 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0796a51-72d1-4543-b81c-ed828a1397ca tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1211 microversion: 2.1 time: 0.337888 Oct 04 11:15:42.733606 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2354/3588] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:42 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1211 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:42.747350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:42.750344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:42.765858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:42.771480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:42.772284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:42.775255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:42.775969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:42.776590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:43.088489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:43.104443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-559adf5c-24a6-4c6f-bb4b-aa5d4f44eba7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.361093 Oct 04 11:15:43.110134 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2355/3589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:42 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:43.115460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-010bc47d-fa1c-4957-a194-72f3259862cf req-807476bf-031b-43c8-b38d-6f997c64fcdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9864f24-c32a-437c-8e4f-c04cae010181", "tag": "a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57"}, {"name": "network-changed", "server_uuid": "ec51c0bd-aa08-4238-a45e-423092ecdd39", "tag": "9fd16c1d-0044-4461-bbc3-bbb0c1eda32f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:43.150132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-010bc47d-fa1c-4957-a194-72f3259862cf req-807476bf-031b-43c8-b38d-6f997c64fcdc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:43.155875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-010bc47d-fa1c-4957-a194-72f3259862cf req-807476bf-031b-43c8-b38d-6f997c64fcdc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:43.156335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-010bc47d-fa1c-4957-a194-72f3259862cf req-807476bf-031b-43c8-b38d-6f997c64fcdc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:43.186044 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-010bc47d-fa1c-4957-a194-72f3259862cf req-807476bf-031b-43c8-b38d-6f997c64fcdc service nova] Creating event network-changed:a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57 for instance c9864f24-c32a-437c-8e4f-c04cae010181 on n-h1-791135-8 Oct 04 11:15:43.186619 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-010bc47d-fa1c-4957-a194-72f3259862cf req-807476bf-031b-43c8-b38d-6f997c64fcdc service nova] Creating event network-changed:9fd16c1d-0044-4461-bbc3-bbb0c1eda32f for instance ec51c0bd-aa08-4238-a45e-423092ecdd39 on n-h1-791135-8 Oct 04 11:15:43.215832 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-010bc47d-fa1c-4957-a194-72f3259862cf req-807476bf-031b-43c8-b38d-6f997c64fcdc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.108779 Oct 04 11:15:43.216808 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2356/3590] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:43.223641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0167a2b8-d7bc-427c-8591-22e7e74baa4b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '.version_select at 0x7f71d4497dc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:43.257942 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0167a2b8-d7bc-427c-8591-22e7e74baa4b tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-822941176" status: 204 len: 0 microversion: 2.32 time: 0.039674 Oct 04 11:15:43.275592 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2357/3591] 10.222.0.23 () {60 vars in 1259 bytes} [Tue Oct 4 11:15:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-822941176 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:15:43.290174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab37d547-c969-4eed-a3b2-69f977db6011 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d44fb3a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:43.404002 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab37d547-c969-4eed-a3b2-69f977db6011 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/df364b60-65ab-4c6b-a3fa-3da804127a64" status: 200 len: 351 microversion: 2.1 time: 0.125605 Oct 04 11:15:43.412947 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2358/3592] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:15:43 2022] GET /compute/v2.1/os-volumes/df364b60-65ab-4c6b-a3fa-3da804127a64 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:43.412947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:43.412947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:43.423747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:43.426007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:43.426471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:43.427218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:43.427694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:43.431045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:43.486637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:43.507977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=19 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:43.691294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:43.703147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8cf7b386-b129-4252-9886-5ad8b00c4cba tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.297358 Oct 04 11:15:43.718093 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2359/3593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:43 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:43.727228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:43.728354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:43.735683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:43.736182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:43.736632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:43.737400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:43.737992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:43.740356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:43.926866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:43.936893 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cab25ea5-721e-4d0b-80b1-e02cb1d88dab tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1506 microversion: 2.1 time: 0.217560 Oct 04 11:15:43.937741 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2360/3594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:43 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:43.944870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:43.946038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:43.954867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:43.955560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:43.955804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:43.956575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:43.957044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:43.957509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:44.110906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:44.120909 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fac449ea-0d0e-443d-95e9-bda7b68df0f3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.180989 Oct 04 11:15:44.133370 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2361/3595] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:43 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:44.133370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:44.133370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:44.134691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:44.135402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:44.136027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:44.136920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:44.137820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:44.138547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:44.362577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:44.372127 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5fe75e2-2805-4454-a1c1-354d8507ef9a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1314 microversion: 2.1 time: 0.248543 Oct 04 11:15:44.400849 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2362/3596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:44 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:44.416039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a22efd30-b719-48f2-9ee3-0adcd0bf0b75 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d43dbaf0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:44.525905 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a22efd30-b719-48f2-9ee3-0adcd0bf0b75 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.123042 Oct 04 11:15:44.526584 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2363/3597] 10.222.0.23 () {58 vars in 1134 bytes} [Tue Oct 4 11:15:44 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:44.543126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:44.544061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:44.553178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:44.553917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:44.554570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:44.556046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:44.556682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:44.557282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:44.755506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:44.765013 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b2a235fb-4621-467e-bbbc-ca013b6219e4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1211 microversion: 2.1 time: 0.225887 Oct 04 11:15:44.766416 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2364/3598] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:44 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1211 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:44.778314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:44.780238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:44.787193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:44.788460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:44.790964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:44.791892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:44.801705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:44.802308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:45.693774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:45.706685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1bfbd9ca-01cc-467a-8898-61b70c59c337 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1506 microversion: 2.1 time: 0.937638 Oct 04 11:15:45.707300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2365/3599] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:44 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1506 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:45.717309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:45.718147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:45.742420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:45.744457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:45.745126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:45.746134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:45.746801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:45.747257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:45.998258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:46.028864 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-060bf4e8-7b8e-4b52-9d6f-8a5a68a64c78 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.320278 Oct 04 11:15:46.032037 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2366/3600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:45 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:46.043209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-92b1ceff-8e60-404c-89c7-7e2873bbaed4 req-ba94c52f-528d-45f8-ad39-5a29df679fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51c0bd-aa08-4238-a45e-423092ecdd39", "name": "network-vif-plugged", "status": "completed", "tag": "9fd16c1d-0044-4461-bbc3-bbb0c1eda32f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:46.061232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92b1ceff-8e60-404c-89c7-7e2873bbaed4 req-ba94c52f-528d-45f8-ad39-5a29df679fac service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:46.062151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92b1ceff-8e60-404c-89c7-7e2873bbaed4 req-ba94c52f-528d-45f8-ad39-5a29df679fac service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:46.063378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-92b1ceff-8e60-404c-89c7-7e2873bbaed4 req-ba94c52f-528d-45f8-ad39-5a29df679fac service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:46.084478 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-92b1ceff-8e60-404c-89c7-7e2873bbaed4 req-ba94c52f-528d-45f8-ad39-5a29df679fac service nova] Creating event network-vif-plugged:9fd16c1d-0044-4461-bbc3-bbb0c1eda32f for instance ec51c0bd-aa08-4238-a45e-423092ecdd39 on n-h1-791135-8 Oct 04 11:15:46.096474 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-92b1ceff-8e60-404c-89c7-7e2873bbaed4 req-ba94c52f-528d-45f8-ad39-5a29df679fac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062683 Oct 04 11:15:46.101694 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2367/3601] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:46.112204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a60eb42c-ddaa-4c30-8c01-fc6f76bc7d5c tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d457ab80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:46.220014 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a60eb42c-ddaa-4c30-8c01-fc6f76bc7d5c tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.116179 Oct 04 11:15:46.220812 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2368/3602] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Oct 4 11:15:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:46.225150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:46.226369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:46.233209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:46.233801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:46.234464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:46.235191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:46.235654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:46.236088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:46.242212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:46.411603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:46.422370 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-83381089-20ef-45f2-a7d8-e3e597b1dec3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.200639 Oct 04 11:15:46.427080 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2369/3603] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:46 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:46.433649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:46.434278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:46.441084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:46.441608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:46.442050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:46.442771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:46.443240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:46.443675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:46.741262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:46.756831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c3d2347-ef3e-48df-b2fe-c63045a17163 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1314 microversion: 2.1 time: 0.327505 Oct 04 11:15:46.760328 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2370/3604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:46 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:46.788048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:46.794759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:46.808662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:46.809197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:46.811497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:46.812491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:46.814601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:46.816538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:46.946925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:15:46.950206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:15:46.950206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:15:46.950206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:15:46.950206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:15:47.027260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:47.033259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:47.033791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:47.034238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:47.035185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:47.035642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:47.036259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:47.088399 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e6cd514-b9c2-4af1-aec4-471f02f23d20 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "POST /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb/action" status: 202 len: 1112 microversion: 2.1 time: 0.309312 Oct 04 11:15:47.103492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2371/3605] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:15:46 2022] POST /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb/action => generated 1112 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 11:15:47.110169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:47.111279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:47.121245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:47.122125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:47.134695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:47.135949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:47.136583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:47.137130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:47.296326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:47.307016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-777a79f0-d2b8-4ec5-8baf-4543ce2d0249 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1199 microversion: 2.1 time: 0.201460 Oct 04 11:15:47.307910 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2372/3606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:47 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1199 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:47.312583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1194366076", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:47.402869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] validate_networks() for [('b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:15:48.030947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:15:48.031672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:15:48.031846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:15:48.032265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:15:48.032684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:15:48.044123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:48.044618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:48.045094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:48.045865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:48.046521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:48.046955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:48.064348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:48.068511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for user 2e4e772e6a5b41a0b0f836b374bc69b4 and project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:48.078961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:48.082589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:15:48.085261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:15:48.135079 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-160e7859-679d-4379-bd8b-620d351d0ca7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826084 Oct 04 11:15:48.135736 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2373/3607] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:15:48.140533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4fcf8ad-18ca-4852-82f1-7dd32597301e tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d4580af0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:48.232782 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d4fcf8ad-18ca-4852-82f1-7dd32597301e tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.095754 Oct 04 11:15:48.233395 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2374/3608] 10.222.0.23 () {58 vars in 1134 bytes} [Tue Oct 4 11:15:48 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:48.413058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6739d381-59dc-4575-b0fb-da4a2b1c9501 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'create', calling method: .version_select at 0x7f71d4615550>, body: {"keypair": {"name": "tempest-keypair-935841497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNgltfuzEb+zBudXi2DNViEUPJmy52VBaRZdTzKSCKnNnDoUjkmKp6E3IuKR6b3BOz0yrJtOiwXeLfaaPK/bAMK8kYPydkm+CHJQJhSc/PLBQe9nugeHQCLILwphA6Dxw=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:48.434734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-6739d381-59dc-4575-b0fb-da4a2b1c9501 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Getting quotas for project 20d71eb38ede4033ae37903456138987. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:48.439599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-6739d381-59dc-4575-b0fb-da4a2b1c9501 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Getting quotas for user 15409bd95f884840b4f3fe972ade15ef and project 20d71eb38ede4033ae37903456138987. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:48.472981 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6739d381-59dc-4575-b0fb-da4a2b1c9501 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.237532 Oct 04 11:15:48.481888 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2375/3609] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:15:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 247 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:15:48.487658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:48.488404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:48.497023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:48.498071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:48.499043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:48.500283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:48.501167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:48.502289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:48.954492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:48.974949 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13b3224c-26ac-40b3-abcd-7e9b7035f0f3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1517 microversion: 2.1 time: 0.492235 Oct 04 11:15:48.990594 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2376/3610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:48 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1517 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:48.995808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:48.996644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:49.003814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:49.004743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:49.005512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:49.006265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:49.007033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:49.007709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:49.318855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:49.330259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0fe26c18-732e-4a87-9a72-6c9246c1c9dd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.338227 Oct 04 11:15:49.347332 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2377/3611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:48 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:49.356663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:49.358136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:49.366621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:49.368448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:49.369262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:49.371093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:49.372062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:49.372721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:49.621941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:49.631229 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-21f42d7a-6fbb-4325-8f43-aa6812383578 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1501 microversion: 2.1 time: 0.282420 Oct 04 11:15:49.632437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2378/3612] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:49 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1501 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:49.637841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:49.638706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:49.644703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:49.645334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:49.645824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:49.646759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:49.647431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:49.648072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:49.715406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:49.724014 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ad1d9a7-8162-4015-b8fe-e2808118f2e1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1267 microversion: 2.1 time: 0.089759 Oct 04 11:15:49.724600 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2379/3613] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:49 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:49.732039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3fff773e-217f-437a-913c-f1fba470a592 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d46354c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:49.847330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3fff773e-217f-437a-913c-f1fba470a592 tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.121017 Oct 04 11:15:49.848599 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2380/3614] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Oct 4 11:15:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:49.855820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:49.856707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:49.866135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:49.867036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:49.867848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:49.868763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:49.869479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:49.870237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:50.137073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:50.148188 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-011f5743-35e7-4825-9ded-908d7ccd673f tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1199 microversion: 2.1 time: 0.298244 Oct 04 11:15:50.148957 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2381/3615] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:49 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1199 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:50.154642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:50.155866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:50.164748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:50.165522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:50.166217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:50.167800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:50.168646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:50.170221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:50.194491 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] HTTP exception thrown: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Request method failure captured: Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 HTTP/1.1 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBRQLr_6hgJJWUzF69mUZMis06UZGkPEKXare2vPFrrT0FSCpzR74A6q70Zli7UKM87Kn0Or5tzKgIkjsK3okUsk6w5MNAMBELUXd5UU-hV7-d1ki9OhyD6m2O_W1SSK7USh864EpIujjjYjJ3h3ouDPzPxBxKoPSc889jxWcNCJqN8 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 1df6182d03a546539effc445c7d02041 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1df6182d03a546539effc445c7d02041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1df6182d03a546539effc445c7d02041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1df6182d03a546539effc445c7d02041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1df6182d03a546539effc445c7d02041"}]}] Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 1df6182d03a546539effc445c7d02041 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TaggedBootDevicesTest-726726768-project Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 63b8bbdea0c144d6b76d6a85bb1f1964 Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TaggedBootDevicesTest-726726768-project Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '43c996e1-0d61-42be-9696-2eda7c00a9f4'} Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:50.196970 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Returning 404 to user: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:50.203283 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6f2da33e-f349-45ae-a55e-f283bbc273ce tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "DELETE /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 404 len: 111 microversion: 2.32 time: 0.048736 Oct 04 11:15:50.205476 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2382/3616] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:15:50 2022] DELETE /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:15:50.210994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:50.211604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:50.218800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:50.219574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:50.220118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:50.220893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:50.221443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:50.222159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:50.257753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lazy-loading 'flavor' on Instance uuid ec51c0bd-aa08-4238-a45e-423092ecdd39 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:15:50.422905 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:15:50.422905 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:15:50.491021 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2703e62f-01cf-4911-8742-691a6a6ae77c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39/action" status: 202 len: 0 microversion: 2.1 time: 0.285374 Oct 04 11:15:50.492983 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2383/3617] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:15:50 2022] POST /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:15:50.513813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-803a0145-5220-445a-a819-46a1775e1c0d tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d4421af0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:50.653092 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-803a0145-5220-445a-a819-46a1775e1c0d tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.158091 Oct 04 11:15:50.653982 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2384/3618] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Oct 4 11:15:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:50.659754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:50.660500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:50.681087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:50.681602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:50.682052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:50.682772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:50.683711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:50.684549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:50.988949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:51.001938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3686c09e-41ab-4a9f-a464-26e42bf0c1d8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1517 microversion: 2.1 time: 0.345695 Oct 04 11:15:51.018711 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2385/3619] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:50 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1517 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:51.025232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:51.026171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] [instance: 43c996e1-0d61-42be-9696-2eda7c00a9f4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:51.035371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:51.036641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:51.038667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:51.040464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:51.041491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:51.042108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:51.078431 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] HTTP exception thrown: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Request method failure captured: Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 HTTP/1.1 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBRQLr_6hgJJWUzF69mUZMis06UZGkPEKXare2vPFrrT0FSCpzR74A6q70Zli7UKM87Kn0Or5tzKgIkjsK3okUsk6w5MNAMBELUXd5UU-hV7-d1ki9OhyD6m2O_W1SSK7USh864EpIujjjYjJ3h3ouDPzPxBxKoPSc889jxWcNCJqN8 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 1df6182d03a546539effc445c7d02041 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1df6182d03a546539effc445c7d02041"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1df6182d03a546539effc445c7d02041"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1df6182d03a546539effc445c7d02041"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1df6182d03a546539effc445c7d02041"}]}] Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 1df6182d03a546539effc445c7d02041 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TaggedBootDevicesTest-726726768 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TaggedBootDevicesTest-726726768-project Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 63b8bbdea0c144d6b76d6a85bb1f1964 Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TaggedBootDevicesTest-726726768-project Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '43c996e1-0d61-42be-9696-2eda7c00a9f4'} Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:15:51.080434 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:51.086641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:15:51.086641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:15:51.086641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:15:51.086641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:15:51.086641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:15:51.086641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. Oct 04 11:15:51.086641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:15:51.094458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] Returning 404 to user: Instance 43c996e1-0d61-42be-9696-2eda7c00a9f4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:15:51.095460 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ec2a28f-c6e8-457d-b866-94f072d2fbec tempest-TaggedBootDevicesTest-726726768 tempest-TaggedBootDevicesTest-726726768-project] 10.222.0.23 "GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4" status: 404 len: 111 microversion: 2.32 time: 0.075344 Oct 04 11:15:51.096343 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2386/3620] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:51 2022] GET /compute/v2.1/servers/43c996e1-0d61-42be-9696-2eda7c00a9f4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:15:51.106249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:51.106922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:51.118729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:51.119286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:51.119735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:51.120463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:51.120931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:51.121395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:51.471072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:51.475114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:51.481623 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-246ede7b-e0a7-473f-b1b5-189bd5a88118 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.384124 Oct 04 11:15:51.493295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2387/3621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:51 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:51.502503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:51.503778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:51.512467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:51.513253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:51.513924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:51.514951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:51.515575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:51.516219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:51.758790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:51.767170 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a70d9847-9c1e-4cb5-ace6-a6469df342d2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1507 microversion: 2.1 time: 0.272039 Oct 04 11:15:51.767772 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2388/3622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:51 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:51.772515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3347e510-a406-4499-bbf6-c53ba5c621dd tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d45e54c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:51.859955 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3347e510-a406-4499-bbf6-c53ba5c621dd tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.090808 Oct 04 11:15:51.860816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2389/3623] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 11:15:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:51.866046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-786222281", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7903534a-2cfe-47f8-9aed-6247c17a6f8d"}], "security_groups": [{"name": "tempest-securitygroup--1200920353"}], "key_name": "tempest-keypair-935841497", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:52.030290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] validate_networks() for [('7903534a-2cfe-47f8-9aed-6247c17a6f8d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:15:53.011262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:15:53.011892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:15:53.012162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:15:53.012597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:15:53.013437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:15:53.023478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.023964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.024405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.025133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.025616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.026048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.045008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Getting quotas for project 20d71eb38ede4033ae37903456138987. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:15:53.049127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Getting quotas for user 15409bd95f884840b4f3fe972ade15ef and project 20d71eb38ede4033ae37903456138987. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:15:53.060955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:15:53.063372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:15:53.109819 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa83dc67-d182-44fb-b832-d22c1912d37f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.247667 Oct 04 11:15:53.116617 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2390/3624] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:15:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:15:53.120968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:53.121624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:53.131004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.131673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.132456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.133443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.134086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.134693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.276534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:53.284844 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6a2bff6-ee05-484b-bb6f-cf49363ca17c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1315 microversion: 2.1 time: 0.173317 Oct 04 11:15:53.285474 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2391/3625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:53 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:53.294298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:53.295282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:53.302157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.302653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.303092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.303803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.304722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.305289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.469557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:53.478008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3caf433f-41e4-4d6b-96f4-0ddfdf2cbe91 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1199 microversion: 2.1 time: 0.191241 Oct 04 11:15:53.495565 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2392/3626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:53 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1199 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:53.503333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aad34ca4-d2e7-4f59-a3c0-28086fd01a6b tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71cfa90310>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:53.609672 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aad34ca4-d2e7-4f59-a3c0-28086fd01a6b tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.112365 Oct 04 11:15:53.611004 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2393/3627] 10.222.0.23 () {58 vars in 1188 bytes} [Tue Oct 4 11:15:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:53.616017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c3ce0a60-1a88-41bf-84d1-7fa7f345e0e5 req-50150d8f-0759-446c-b558-6c74bffab9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04da9dcb-a1e6-4e40-9bca-c5ad16b358eb", "tag": "b2606441-a024-4be2-83b9-0cbe077c7576"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:53.632466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c3ce0a60-1a88-41bf-84d1-7fa7f345e0e5 req-50150d8f-0759-446c-b558-6c74bffab9e2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.633390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c3ce0a60-1a88-41bf-84d1-7fa7f345e0e5 req-50150d8f-0759-446c-b558-6c74bffab9e2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.633847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c3ce0a60-1a88-41bf-84d1-7fa7f345e0e5 req-50150d8f-0759-446c-b558-6c74bffab9e2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.645040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c3ce0a60-1a88-41bf-84d1-7fa7f345e0e5 req-50150d8f-0759-446c-b558-6c74bffab9e2 service nova] Creating event network-changed:b2606441-a024-4be2-83b9-0cbe077c7576 for instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb on n-h2-791135-8 Oct 04 11:15:53.651929 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c3ce0a60-1a88-41bf-84d1-7fa7f345e0e5 req-50150d8f-0759-446c-b558-6c74bffab9e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039557 Oct 04 11:15:53.652531 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2394/3628] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:53.669192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:53.670203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:53.678709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.679422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.680633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.681721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.682295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.682873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.824805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:53.835516 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ee30625-de58-4034-805a-37ced3a8d73d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1517 microversion: 2.1 time: 0.181689 Oct 04 11:15:53.836185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2395/3629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:53 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:53.844554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:53.845695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:53.853914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.854476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.854990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:53.855698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:53.856150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:53.856653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.006092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:54.015142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e96f54ec-38dc-4163-b3ee-3c80dc820f90 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.174274 Oct 04 11:15:54.015737 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2396/3630] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:53 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:54.020855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:54.021599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:54.028490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:54.028983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:54.029441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.031935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:54.032409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:54.032839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.169907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:54.178480 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6245405f-685a-4df4-8bba-0c505bd16070 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1507 microversion: 2.1 time: 0.161440 Oct 04 11:15:54.188471 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2397/3631] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:54 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:54.188471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:54.188471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:54.191668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:54.192165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:54.192769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.193522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:54.194147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:54.194517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.260733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:54.269557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:54.271168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:54.272317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-984e68a4-1fed-49da-9c18-9dedb1e75318 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1332 microversion: 2.20 time: 0.092255 Oct 04 11:15:54.274130 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2398/3632] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:54 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:54.285747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a9c8dbb-2797-4a24-b08b-917b19ad7b8f tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] Calling method '.version_select at 0x7f71d4493c10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:54.451471 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a9c8dbb-2797-4a24-b08b-917b19ad7b8f tempest-VolumesTestJSON-1369160180 tempest-VolumesTestJSON-1369160180-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.176014 Oct 04 11:15:54.452412 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2399/3633] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 11:15:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:54.457568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:54.458577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:54.470575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:54.476919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:54.481632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.482960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:54.483765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:54.484234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.775496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:54.783777 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c0e7ddb4-f416-4637-b869-91fd6859a985 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1315 microversion: 2.1 time: 0.330013 Oct 04 11:15:54.784362 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2400/3634] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:54 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:54.795016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:54.796008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:54.802724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:54.803493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:54.804126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.805106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:54.805782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:54.806658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:54.990351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:55.002883 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-320177d2-9238-42d7-8272-2424c12168f3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1199 microversion: 2.1 time: 0.215567 Oct 04 11:15:55.004373 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2401/3635] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:54 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1199 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:55.017033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:55.020068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:55.036712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:55.040296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:55.041119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:55.043383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:55.044039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:55.045985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:55.321269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:55.332456 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e065c1f-0c33-4209-af35-3431b15682e9 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1517 microversion: 2.1 time: 0.325108 Oct 04 11:15:55.334577 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2402/3636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:55 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:55.363347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:55.363969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:55.378375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:55.386680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:55.387469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:55.388350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:55.388823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:55.389305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:55.577218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:55.589795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-937ea32d-3560-4bac-9190-c31cdc183559 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.242500 Oct 04 11:15:55.605384 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2403/3637] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:55 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:55.610754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:55.611586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:55.631193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:55.634449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:55.635205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:55.636005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:55.637232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:55.641909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:55.958429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:55.969522 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c3041da-b45e-4bd8-985f-7a653514e37e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1507 microversion: 2.1 time: 0.375252 Oct 04 11:15:55.985445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2404/3638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:55 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:55.990915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:55.991878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:56.001463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.005665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.006401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:56.007367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.008175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.008826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:56.181055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:56.190451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:56.191964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:56.193300 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82f2a575-eaed-414b-bb63-9a92d5f3ee44 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1406 microversion: 2.20 time: 0.206396 Oct 04 11:15:56.194131 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2405/3639] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:55 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:56.212802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:56.215153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:56.223551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.224280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.224923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:56.225862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.227146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.227797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:56.421538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:56.441686 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea3577db-f597-4bdc-8fa9-fe2dd9dd1574 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1315 microversion: 2.1 time: 0.229725 Oct 04 11:15:56.442646 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2406/3640] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:56 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:56.448223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:56.448846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:56.457141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.458463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.459334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:56.460710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.462268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.462960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:56.647098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:56.660689 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78c6e1de-d343-4213-9c2a-6691b2fde507 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1199 microversion: 2.1 time: 0.216221 Oct 04 11:15:56.661609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2407/3641] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:56 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1199 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:56.669809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:56.670532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:56.678842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.680309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.680873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:56.681940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.682518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.683077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:56.909475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:56.921567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:56.929172 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75029074-baaf-4c4c-92c2-534a2d5404b0 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1517 microversion: 2.1 time: 0.264835 Oct 04 11:15:56.933056 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2408/3642] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:56 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:56.962365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-67021f88-bc3c-4e53-95eb-f5ae0851684c req-8a516e71-11bd-452c-b0d1-f08d2556ac4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9864f24-c32a-437c-8e4f-c04cae010181", "name": "network-vif-plugged", "status": "completed", "tag": "a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:56.987800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-67021f88-bc3c-4e53-95eb-f5ae0851684c req-8a516e71-11bd-452c-b0d1-f08d2556ac4a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:56.988977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-67021f88-bc3c-4e53-95eb-f5ae0851684c req-8a516e71-11bd-452c-b0d1-f08d2556ac4a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:56.990801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-67021f88-bc3c-4e53-95eb-f5ae0851684c req-8a516e71-11bd-452c-b0d1-f08d2556ac4a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.022679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-67021f88-bc3c-4e53-95eb-f5ae0851684c req-8a516e71-11bd-452c-b0d1-f08d2556ac4a service nova] Creating event network-vif-plugged:a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57 for instance c9864f24-c32a-437c-8e4f-c04cae010181 on n-h1-791135-8 Oct 04 11:15:57.036736 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-67021f88-bc3c-4e53-95eb-f5ae0851684c req-8a516e71-11bd-452c-b0d1-f08d2556ac4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088609 Oct 04 11:15:57.038336 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2409/3643] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:57.052150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:57.053464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:57.069465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.071330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.072417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.075230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.078444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.079248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.360917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:57.370890 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93606b7b-4f78-4129-9cb4-1d2a6d3f60e5 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.328788 Oct 04 11:15:57.386382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2410/3644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:57 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:57.392986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:57.393733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:57.401819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.402756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.402929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.403514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.403975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.404454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.568389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:57.576868 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab2e69c9-6cbc-402f-bcef-c5a016b40394 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1507 microversion: 2.1 time: 0.189059 Oct 04 11:15:57.577685 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2411/3645] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:57 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:57.582041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e9c3416c-21d7-4fa1-a30f-d90f6d3632dc req-7db13df6-f98f-4348-9636-3d53a65fb0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6e745e-9cfe-4562-a91f-7fa25f3ad109", "tag": "8a5bddce-130d-4805-99d6-8f5074eab124"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:15:57.592367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e9c3416c-21d7-4fa1-a30f-d90f6d3632dc req-7db13df6-f98f-4348-9636-3d53a65fb0e4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.592933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e9c3416c-21d7-4fa1-a30f-d90f6d3632dc req-7db13df6-f98f-4348-9636-3d53a65fb0e4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.593457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e9c3416c-21d7-4fa1-a30f-d90f6d3632dc req-7db13df6-f98f-4348-9636-3d53a65fb0e4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.606009 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e9c3416c-21d7-4fa1-a30f-d90f6d3632dc req-7db13df6-f98f-4348-9636-3d53a65fb0e4 service nova] Creating event network-changed:8a5bddce-130d-4805-99d6-8f5074eab124 for instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 on n-h1-791135-8 Oct 04 11:15:57.610800 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e9c3416c-21d7-4fa1-a30f-d90f6d3632dc req-7db13df6-f98f-4348-9636-3d53a65fb0e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032126 Oct 04 11:15:57.611745 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2412/3646] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:15:57.617262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:57.618091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:57.625127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.625730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.626176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.626910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.627375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.627819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.876394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:57.885133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:57.886630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:57.887781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6bd1fe0f-560f-4d95-8cb7-2f48281e60a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1406 microversion: 2.20 time: 0.274916 Oct 04 11:15:57.898487 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2413/3647] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:57 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:57.904371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:57.905168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:57.908681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:15:57.917714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.918541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.918831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:57.919541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:57.920144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:57.920576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:58.130513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:58.152201 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea9b89bf-d069-4cc5-8693-805c262cfea7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1315 microversion: 2.1 time: 0.252248 Oct 04 11:15:58.152927 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2414/3648] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:57 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:58.161501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:58.161501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:58.175102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:58.175604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:58.176061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:58.176814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:58.177288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:58.177754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:58.359746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:58.376031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3da31cb5-0c18-4c2a-97a7-27965c98a9ff tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1199 microversion: 2.1 time: 0.221977 Oct 04 11:15:58.379266 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2415/3649] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:58 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1199 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:58.387486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:58.388117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:58.395021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:58.395517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:58.395954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:58.396666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:58.397119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:58.397589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:58.560799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:58.570838 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8b78671-4ee7-48e7-af14-a608a6795d77 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1517 microversion: 2.1 time: 0.189710 Oct 04 11:15:58.588158 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2416/3650] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:58 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:58.593827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:58.594444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:58.600696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:58.601200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:58.602241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:58.603107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:58.603577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:58.604203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:58.838196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:58.846060 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28dfa664-770c-4c28-b7ce-ee0e493edef0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1524 microversion: 2.1 time: 0.256747 Oct 04 11:15:58.846826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2417/3651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:58 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1524 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:58.852459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:58.853061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:58.859093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:58.859591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:58.860011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:58.860946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:58.861597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:58.862451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:59.034787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:59.046645 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ca3c6bc-ea72-4182-ab8b-b0f1a1c08f8b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1507 microversion: 2.1 time: 0.198670 Oct 04 11:15:59.048106 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2418/3652] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:58 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:59.076812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:59.079310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:59.102805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:59.103319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:59.105689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:59.106779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:59.107362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:59.107998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:59.392399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:59.410654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:59.412167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:59.413400 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc456437-bbd8-4369-9fd2-dd5f50514ec2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1406 microversion: 2.20 time: 0.364247 Oct 04 11:15:59.416952 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2419/3653] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:15:59 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:15:59.428241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:59.428985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:59.447440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:59.447937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:59.448427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:59.449148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:59.449894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:59.450335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:59.696518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:59.705259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fef47457-374f-47a3-b56a-27680b96cbe6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1315 microversion: 2.1 time: 0.286047 Oct 04 11:15:59.718709 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2420/3654] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:59 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:59.728852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:59.729528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:59.736124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:59.736622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:59.737056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:59.738056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:59.738527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:59.738957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:59.924947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:15:59.935083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-495711c5-20ec-4f0e-ae6c-6b45aad64afc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1382 microversion: 2.1 time: 0.215209 Oct 04 11:15:59.936574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2421/3655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:59 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1382 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:15:59.941438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:15:59.942046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:15:59.948905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:59.949416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:59.949860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:15:59.950802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:15:59.951263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:15:59.951765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:00.123133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:00.132406 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c28833d-3181-43cf-be1e-7b5e98710465 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1517 microversion: 2.1 time: 0.194721 Oct 04 11:16:00.133607 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2422/3656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:15:59 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:00.138397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:00.139000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:00.145266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:00.145991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:00.146431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:00.147127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:00.147592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:00.148866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:00.335400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:00.355522 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b675ff0d-700b-4adf-af5b-91d97625ae48 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1504 microversion: 2.1 time: 0.220822 Oct 04 11:16:00.365399 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2423/3657] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:00 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:00.538384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:00.539772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:00.547266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:00.548462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:00.549058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:00.549986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:00.550713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:00.551576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:00.758964 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5fd922ab-562f-449a-94e7-287da1c1e8af tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1533 microversion: 2.1 time: 0.399189 Oct 04 11:16:00.770129 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2424/3658] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:00 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1533 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:00.770129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:00.770129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:00.776003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:00.776493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:00.776939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:00.777664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:00.778113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:00.778805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:00.953839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:00.969028 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ff61ba1-207f-4351-a6e6-925e02a9fcd9 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1507 microversion: 2.1 time: 0.207594 Oct 04 11:16:00.969904 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2425/3659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:00 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:00.989128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9159fe38-ee5d-4d7e-a4bf-3e2218ff6e70 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Action: 'create', calling method: .version_select at 0x7f71d46b03a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1861368330", "description": "tempest-description-1865622728"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:01.202776 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9159fe38-ee5d-4d7e-a4bf-3e2218ff6e70 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.227530 Oct 04 11:16:01.208711 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2426/3660] 10.222.0.23 () {60 vars in 1180 bytes} [Tue Oct 4 11:16:00 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:01.219161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:01.219774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:01.231533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:01.232899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:01.233552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:01.234286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:01.234736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:01.235159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:01.398885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:01.403204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:01.408645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:01.410592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:01.411822 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd41eb7a-844f-498f-99c2-f48bcf9c92ae tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1406 microversion: 2.20 time: 0.201704 Oct 04 11:16:01.426194 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2427/3661] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:01 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:01.437482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:01.438262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:01.444620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:01.445433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:01.445844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:01.447379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:01.447379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:01.447689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:01.673825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:01.685369 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a2ffa58-ce99-4bcd-8b00-54f00d650828 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1315 microversion: 2.1 time: 0.258126 Oct 04 11:16:01.686555 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2428/3662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:01 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:01.692350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-851066f2-b521-4249-be61-1354d075f86e req-1502988e-b22c-4967-b1bb-dc18a48244ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04da9dcb-a1e6-4e40-9bca-c5ad16b358eb", "name": "network-vif-plugged", "status": "completed", "tag": "b2606441-a024-4be2-83b9-0cbe077c7576"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:01.706019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-851066f2-b521-4249-be61-1354d075f86e req-1502988e-b22c-4967-b1bb-dc18a48244ac service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:01.706718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-851066f2-b521-4249-be61-1354d075f86e req-1502988e-b22c-4967-b1bb-dc18a48244ac service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:01.707653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-851066f2-b521-4249-be61-1354d075f86e req-1502988e-b22c-4967-b1bb-dc18a48244ac service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:01.721053 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-851066f2-b521-4249-be61-1354d075f86e req-1502988e-b22c-4967-b1bb-dc18a48244ac service nova] Creating event network-vif-plugged:b2606441-a024-4be2-83b9-0cbe077c7576 for instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb on n-h2-791135-8 Oct 04 11:16:01.726912 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-851066f2-b521-4249-be61-1354d075f86e req-1502988e-b22c-4967-b1bb-dc18a48244ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038181 Oct 04 11:16:01.728425 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2429/3663] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:01.734595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:01.735437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:01.743526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:01.744024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:01.744473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:01.745313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:01.745825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:01.746263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:02.006368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3946d00-097c-4914-aa38-9de028d541a7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1533 microversion: 2.1 time: 0.276507 Oct 04 11:16:02.006953 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2430/3664] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:01 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1533 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:02.021548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:02.021548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:02.030022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:02.030513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:02.030949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:02.031667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:02.032120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:02.032544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:02.195468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:02.203573 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7bd8c133-d6f4-4179-93df-65a43a544e6b tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1517 microversion: 2.1 time: 0.195610 Oct 04 11:16:02.204251 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2431/3665] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:02 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:02.219013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1861368330"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:02.221339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:02.229140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:02.229770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:02.230281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:02.231068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:02.231595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:02.232096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:02.431018 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.security_group_api [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Adding security group bfbaa610-eacb-4140-bc87-022a968baefb to port 02b3a097-9732-4f13-9254-dc56af34ccbe Oct 04 11:16:02.848837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22133da6-bc12-4116-ba4b-bdc1141b4db0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action" status: 202 len: 0 microversion: 2.1 time: 0.643430 Oct 04 11:16:02.852924 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2432/3666] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:02 2022] POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:02.856422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:02.857070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:02.863868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:02.864614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:02.865408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:02.866347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:02.867744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:02.868387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.036744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:03.056346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=16 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:03.089099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:03.100346 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa3f2d38-a00e-4930-9346-b62e4c275141 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1507 microversion: 2.1 time: 0.249333 Oct 04 11:16:03.102345 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2433/3667] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:02 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:03.107213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-441afa9a-b9eb-4bfd-a768-a0a821315260 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:03.111290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441afa9a-b9eb-4bfd-a768-a0a821315260 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:03.112031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441afa9a-b9eb-4bfd-a768-a0a821315260 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:03.112832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441afa9a-b9eb-4bfd-a768-a0a821315260 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.113828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441afa9a-b9eb-4bfd-a768-a0a821315260 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:03.114543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441afa9a-b9eb-4bfd-a768-a0a821315260 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:03.115198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-441afa9a-b9eb-4bfd-a768-a0a821315260 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.148040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-441afa9a-b9eb-4bfd-a768-a0a821315260 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043435 Oct 04 11:16:03.149454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2434/3668] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 11:16:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:03.155361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:03.156967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:03.166446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:03.167325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:03.169598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.170746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:03.171453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:03.172477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.329059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:03.340188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:03.341717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:03.343047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31937369-4da3-42d7-9a00-cf84ff75fec6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1406 microversion: 2.20 time: 0.192211 Oct 04 11:16:03.343988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2435/3669] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:03 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:03.348854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:03.349506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:03.356854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:03.357385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:03.357835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.358539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:03.359010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:03.359446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.499972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:03.508394 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c37ef41b-f790-4797-b3b1-b8f9c4d01f14 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1315 microversion: 2.1 time: 0.162667 Oct 04 11:16:03.509145 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2436/3670] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:03 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:03.513719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1861368330"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:03.514257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:03.520608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:03.521093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:03.521581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.522272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:03.522726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:03.523174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:03.675995 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.security_group_api [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Removing security group bfbaa610-eacb-4140-bc87-022a968baefb from port 02b3a097-9732-4f13-9254-dc56af34ccbe Oct 04 11:16:04.101036 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5938515b-70aa-4db9-99c5-bb22683b8211 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action" status: 202 len: 0 microversion: 2.1 time: 0.590777 Oct 04 11:16:04.102589 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2437/3671] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:03 2022] POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:04.107480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-710e033f-1ee2-4231-b92d-05f040f48d8b req-7cac78c7-6d39-476c-8f4f-e386cce2636b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8f11dc-6474-4736-9972-1fb65647ece0", "tag": "02b3a097-9732-4f13-9254-dc56af34ccbe"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:04.134047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-710e033f-1ee2-4231-b92d-05f040f48d8b req-7cac78c7-6d39-476c-8f4f-e386cce2636b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:04.134735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-710e033f-1ee2-4231-b92d-05f040f48d8b req-7cac78c7-6d39-476c-8f4f-e386cce2636b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:04.135248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-710e033f-1ee2-4231-b92d-05f040f48d8b req-7cac78c7-6d39-476c-8f4f-e386cce2636b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:04.158970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-710e033f-1ee2-4231-b92d-05f040f48d8b req-7cac78c7-6d39-476c-8f4f-e386cce2636b service nova] Creating event network-changed:02b3a097-9732-4f13-9254-dc56af34ccbe for instance 8d8f11dc-6474-4736-9972-1fb65647ece0 on n-h2-791135-8 Oct 04 11:16:04.170580 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-710e033f-1ee2-4231-b92d-05f040f48d8b req-7cac78c7-6d39-476c-8f4f-e386cce2636b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065914 Oct 04 11:16:04.171738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2438/3672] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:04.180214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-791135-8", "block_migration": false, "disk_over_commit": false}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:04.199399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:04.219004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:04.226815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:04.227309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:04.228090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:04.228572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:04.229008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:04.269123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lazy-loading 'flavor' on Instance uuid c9864f24-c32a-437c-8e4f-c04cae010181 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:16:04.286148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Going to try to live migrate instance to n-h2-791135-8 {{(pid=122409) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:16:09.001125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92563cfb-7f01-478d-991b-3c217ed5dcc7 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181/action" status: 202 len: 0 microversion: 2.1 time: 4.827214 Oct 04 11:16:09.002135 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2439/3673] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:04 2022] POST /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181/action => generated 0 bytes in 4830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:09.009895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:09.010599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:09.033671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:09.034177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:09.034613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:09.037645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:09.039255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:09.040756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:09.342036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:09.350606 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7eccd11f-b96f-45f4-bc97-cd73d48a703d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1523 microversion: 2.1 time: 0.346404 Oct 04 11:16:09.351920 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2440/3674] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:09 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:09.356852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7104fa0e-68d2-4f26-ae12-252b24f9dfe2 req-eb95b28f-01b2-4504-9780-bd10bbb1e3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6e745e-9cfe-4562-a91f-7fa25f3ad109", "name": "network-vif-plugged", "status": "completed", "tag": "8a5bddce-130d-4805-99d6-8f5074eab124"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:09.366315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7104fa0e-68d2-4f26-ae12-252b24f9dfe2 req-eb95b28f-01b2-4504-9780-bd10bbb1e3c7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:09.367652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7104fa0e-68d2-4f26-ae12-252b24f9dfe2 req-eb95b28f-01b2-4504-9780-bd10bbb1e3c7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:09.368284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7104fa0e-68d2-4f26-ae12-252b24f9dfe2 req-eb95b28f-01b2-4504-9780-bd10bbb1e3c7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:09.380342 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7104fa0e-68d2-4f26-ae12-252b24f9dfe2 req-eb95b28f-01b2-4504-9780-bd10bbb1e3c7 service nova] Creating event network-vif-plugged:8a5bddce-130d-4805-99d6-8f5074eab124 for instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 on n-h1-791135-8 Oct 04 11:16:09.385985 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7104fa0e-68d2-4f26-ae12-252b24f9dfe2 req-eb95b28f-01b2-4504-9780-bd10bbb1e3c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032443 Oct 04 11:16:09.386905 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2441/3675] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:09.391965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3bd2c360-c7a9-4aa8-9923-bfefd83ab49f tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Action: 'create', calling method: .version_select at 0x7f71d4d2cc10>, body: {"pool": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:11.775724 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3bd2c360-c7a9-4aa8-9923-bfefd83ab49f tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.387554 Oct 04 11:16:11.776392 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2442/3676] 10.222.0.23 () {60 vars in 1170 bytes} [Tue Oct 4 11:16:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:11.781592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:11.782560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:11.797610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:11.802513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:11.802970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:11.803699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:11.804199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:11.804630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:12.040814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:12.058073 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbd99ed5-7ab3-41de-beba-63de4da35731 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1507 microversion: 2.1 time: 0.280385 Oct 04 11:16:12.073382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2443/3677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:11 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:12.076067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:12.076294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:12.083264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:12.083757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:12.084333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:12.085045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:12.085534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:12.086610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:12.294777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:12.303567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:12.307984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:12.309693 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f0b0857-fec2-4904-a1d4-b6aef44a8605 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1597 microversion: 2.20 time: 0.241785 Oct 04 11:16:12.321907 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2444/3678] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:12 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1597 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:12.340747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:12.341814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:12.351283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:12.352037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:12.352731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:12.353974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:12.354726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:12.355482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:12.617525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:12.632860 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35664fc9-fb24-4020-973b-81b1f44e1f00 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1502 microversion: 2.1 time: 0.303175 Oct 04 11:16:12.634719 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2445/3679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:12 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1502 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:12.641025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-487cd6ba-2191-4bcd-9b43-c94a0177dbdb req-d7d32a4c-7536-473f-85d1-c55a6a3fc85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8f11dc-6474-4736-9972-1fb65647ece0", "tag": "02b3a097-9732-4f13-9254-dc56af34ccbe"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:12.657888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-487cd6ba-2191-4bcd-9b43-c94a0177dbdb req-d7d32a4c-7536-473f-85d1-c55a6a3fc85e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:12.659471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-487cd6ba-2191-4bcd-9b43-c94a0177dbdb req-d7d32a4c-7536-473f-85d1-c55a6a3fc85e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:12.662433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-487cd6ba-2191-4bcd-9b43-c94a0177dbdb req-d7d32a4c-7536-473f-85d1-c55a6a3fc85e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:12.676337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-487cd6ba-2191-4bcd-9b43-c94a0177dbdb req-d7d32a4c-7536-473f-85d1-c55a6a3fc85e service nova] Creating event network-changed:02b3a097-9732-4f13-9254-dc56af34ccbe for instance 8d8f11dc-6474-4736-9972-1fb65647ece0 on n-h2-791135-8 Oct 04 11:16:12.682395 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-487cd6ba-2191-4bcd-9b43-c94a0177dbdb req-d7d32a4c-7536-473f-85d1-c55a6a3fc85e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045458 Oct 04 11:16:12.684475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2446/3680] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:12.691237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:12.692209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:12.700494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:12.701341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:12.702083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:12.703286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:12.703934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:12.704547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:12.766155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:13.129586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:13.171414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:13.180792 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f834fe21-1e09-4a35-936f-c24d618e8be3 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.494724 Oct 04 11:16:13.186019 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2447/3681] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:12 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:13.195723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:13.196354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:13.211992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:13.212501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:13.216873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:13.218002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:13.218668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:13.220854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:14.022392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:14.035822 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cca3e615-f0d3-4d43-86f8-641230b7d3a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1523 microversion: 2.1 time: 0.848274 Oct 04 11:16:14.053165 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2448/3682] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:13 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1523 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:14.058263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b37b4976-488a-4cd5-8f79-6d5afcd08e48 req-a89948b2-6868-4738-9e77-06b286e28d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2062e0cb-5c32-4913-8415-c060e6cfbefb", "name": "network-vif-unplugged", "status": "completed", "tag": "f22f3b95-17d8-4714-afd1-814596d5b702"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:14.077588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b37b4976-488a-4cd5-8f79-6d5afcd08e48 req-a89948b2-6868-4738-9e77-06b286e28d5b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:14.078136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b37b4976-488a-4cd5-8f79-6d5afcd08e48 req-a89948b2-6868-4738-9e77-06b286e28d5b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:14.082616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b37b4976-488a-4cd5-8f79-6d5afcd08e48 req-a89948b2-6868-4738-9e77-06b286e28d5b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:14.104463 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b37b4976-488a-4cd5-8f79-6d5afcd08e48 req-a89948b2-6868-4738-9e77-06b286e28d5b service nova] Creating event network-vif-unplugged:f22f3b95-17d8-4714-afd1-814596d5b702 for instance 2062e0cb-5c32-4913-8415-c060e6cfbefb on n-h2-791135-8 Oct 04 11:16:14.110854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b37b4976-488a-4cd5-8f79-6d5afcd08e48 req-a89948b2-6868-4738-9e77-06b286e28d5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066677 Oct 04 11:16:14.111866 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2449/3683] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:14.120583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.148"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:14.125270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:14.132884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:14.133615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:14.134161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:14.135144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:14.135852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:14.136533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:14.171620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "refresh_cache-8d8f11dc-6474-4736-9972-1fb65647ece0" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:16:14.172395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquired lock "refresh_cache-8d8f11dc-6474-4736-9972-1fb65647ece0" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:16:15.780469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Building network info cache for instance {{(pid=122409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:16:16.678487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Updating instance_info_cache with network_info: [{"id": "02b3a097-9732-4f13-9254-dc56af34ccbe", "address": "fa:16:3e:73:dd:40", "network": {"id": "4eb79ddf-f4fd-42e8-b663-e7ad6a4f34e8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-783961712-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cbe011632a1f4089b1bc5d369e072819", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap02b3a097-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:16:16.701731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Releasing lock "refresh_cache-8d8f11dc-6474-4736-9972-1fb65647ece0" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:16:16.701731 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a125b219-f30d-41e3-bd62-3b8f4d231843 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action" status: 202 len: 0 microversion: 2.1 time: 2.586926 Oct 04 11:16:16.701731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2450/3684] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:14 2022] POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action => generated 0 bytes in 2588 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:16:16.722767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:16.723284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:16.742124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:16.743169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:16.744054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:16.746466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:16.747277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:16.749495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:16.909789 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ce0b1bc4-a492-4754-9aaf-3cdce6a51eea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.199221 Oct 04 11:16:16.925589 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2451/3685] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Oct 4 11:16:16 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:16:16.925589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:16.925589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:16.928377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:16.929460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:16.930255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:16.931203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:16.931858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:16.932473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:17.066429 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-668c79cf-0564-465f-9743-37ddfcfa9d3f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb/action" status: 200 len: 8206 microversion: 2.1 time: 0.151502 Oct 04 11:16:17.067386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2452/3686] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:16 2022] POST /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb/action => generated 8206 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:17.077221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:17.077628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:17.097287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:17.098435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:17.104644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:17.106129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:17.108354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:17.109392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:17.470671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:17.484162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fbc889d5-4f6b-4ea7-810c-cc47d2782a0f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1528 microversion: 2.1 time: 0.415400 Oct 04 11:16:17.484864 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2453/3687] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:17 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1528 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:17.502227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:17.503040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:17.512783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:17.512783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:17.512783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:17.512783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:17.515115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:17.515816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:17.848651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:17.858177 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ece40c14-b854-409f-b08a-866d6ec98e0b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.372004 Oct 04 11:16:17.858774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2454/3688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:17 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:17.863744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:17.864355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:17.870731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:17.871388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:17.871965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:17.872685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:17.879623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:17.879623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:18.113050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:18.121005 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f8d1a14-3e92-423c-b4d4-c477d10c2484 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1523 microversion: 2.1 time: 0.261024 Oct 04 11:16:18.121803 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2455/3689] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:17 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:18.136357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4ed85dfb-06b3-4d9f-80c2-0df8e51f4fd7 req-9a469e24-635e-4c82-b1af-b4517002c691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8f11dc-6474-4736-9972-1fb65647ece0", "tag": "02b3a097-9732-4f13-9254-dc56af34ccbe"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:18.155986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4ed85dfb-06b3-4d9f-80c2-0df8e51f4fd7 req-9a469e24-635e-4c82-b1af-b4517002c691 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:18.156981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4ed85dfb-06b3-4d9f-80c2-0df8e51f4fd7 req-9a469e24-635e-4c82-b1af-b4517002c691 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:18.157597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4ed85dfb-06b3-4d9f-80c2-0df8e51f4fd7 req-9a469e24-635e-4c82-b1af-b4517002c691 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:18.180593 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4ed85dfb-06b3-4d9f-80c2-0df8e51f4fd7 req-9a469e24-635e-4c82-b1af-b4517002c691 service nova] Creating event network-changed:02b3a097-9732-4f13-9254-dc56af34ccbe for instance 8d8f11dc-6474-4736-9972-1fb65647ece0 on n-h2-791135-8 Oct 04 11:16:18.186368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4ed85dfb-06b3-4d9f-80c2-0df8e51f4fd7 req-9a469e24-635e-4c82-b1af-b4517002c691 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053460 Oct 04 11:16:18.187071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2456/3690] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:18.195936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-544584c4-43b4-4447-953a-7054be156f32 req-3f8b5d35-1be1-49f6-8757-4e2e102e37e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2062e0cb-5c32-4913-8415-c060e6cfbefb", "name": "network-vif-plugged", "status": "completed", "tag": "f22f3b95-17d8-4714-afd1-814596d5b702"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:18.211361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-544584c4-43b4-4447-953a-7054be156f32 req-3f8b5d35-1be1-49f6-8757-4e2e102e37e6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:18.211903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-544584c4-43b4-4447-953a-7054be156f32 req-3f8b5d35-1be1-49f6-8757-4e2e102e37e6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:18.212614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-544584c4-43b4-4447-953a-7054be156f32 req-3f8b5d35-1be1-49f6-8757-4e2e102e37e6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:18.233917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-544584c4-43b4-4447-953a-7054be156f32 req-3f8b5d35-1be1-49f6-8757-4e2e102e37e6 service nova] Creating event network-vif-plugged:f22f3b95-17d8-4714-afd1-814596d5b702 for instance 2062e0cb-5c32-4913-8415-c060e6cfbefb on n-h2-791135-8 Oct 04 11:16:18.239528 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-544584c4-43b4-4447-953a-7054be156f32 req-3f8b5d35-1be1-49f6-8757-4e2e102e37e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051058 Oct 04 11:16:18.240381 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2457/3691] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:18.664817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-926333554", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": "none"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:18.763322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:16:18.763877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:16:18.764549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:16:18.770011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:16:18.770561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:16:18.782878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:18.783577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:18.784330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:18.785275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:18.785894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:18.786444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:18.805990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Getting quotas for project 40b67ae9855a4949bf4ded7eee58ecf4. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:16:18.812369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Getting quotas for user 8b751af838e546359ca0a6ff205f0491 and project 40b67ae9855a4949bf4ded7eee58ecf4. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:16:18.826867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:16:18.829705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:16:18.861555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:18.906630 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ee2d963-703a-487f-aadd-603ef16e916d tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.664334 Oct 04 11:16:18.911501 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2458/3692] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:16:18.919675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.148"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:19.243576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:19.271687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:19.279548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:19.280114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:19.280892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:19.281644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:19.282271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:19.635906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "refresh_cache-8d8f11dc-6474-4736-9972-1fb65647ece0" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 11:16:19.636561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquired lock "refresh_cache-8d8f11dc-6474-4736-9972-1fb65647ece0" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 11:16:21.287778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Building network info cache for instance {{(pid=122409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 11:16:22.023718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Updating instance_info_cache with network_info: [{"id": "02b3a097-9732-4f13-9254-dc56af34ccbe", "address": "fa:16:3e:73:dd:40", "network": {"id": "4eb79ddf-f4fd-42e8-b663-e7ad6a4f34e8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-783961712-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cbe011632a1f4089b1bc5d369e072819", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap02b3a097-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:16:22.038723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Releasing lock "refresh_cache-8d8f11dc-6474-4736-9972-1fb65647ece0" {{(pid=122409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 11:16:22.039617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31b83434-10f8-4495-a969-98fcdf33f032 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action" status: 202 len: 0 microversion: 2.1 time: 3.126754 Oct 04 11:16:22.040303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2459/3693] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:18 2022] POST /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0/action => generated 0 bytes in 3128 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 11:16:22.052567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:22.053254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:22.066685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:22.067492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:22.068025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:22.068838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:22.070123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:22.070657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:22.305365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:22.315707 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6590b40-31bc-4b6b-92e8-2aae9324d99a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.273654 Oct 04 11:16:22.316811 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2460/3694] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:22 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:22.322178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:22.323034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:22.329799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:22.330686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:22.331973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:22.333449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:22.336231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:22.337028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:22.621642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:22.631386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84b416cf-3000-47d5-9a89-b4392075e881 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1523 microversion: 2.1 time: 0.312933 Oct 04 11:16:22.632904 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2461/3695] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:22 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:22.638097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:22.639031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:22.648604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:22.649602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:22.650288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:22.651407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:22.652106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:22.652757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:22.840501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:22.851436 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2551409d-227f-4d26-9fd1-91245875634e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.216911 Oct 04 11:16:22.852749 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2462/3696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:22 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:22.875875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:22.876794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:22.884085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:22.884832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:22.885629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:22.886578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:22.887255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:22.887859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:22.967586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:22.979341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:22.986539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:22.988883 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-41f18b0a-793d-42fe-af43-8a7960372219 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] 10.222.0.23 "GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03" status: 200 len: 1338 microversion: 2.47 time: 0.119745 Oct 04 11:16:22.993490 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2463/3697] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:22 2022] GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03 => generated 1338 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:23.009638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:23.010611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:23.022061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:23.024161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:23.025861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:23.026783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:23.028947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:23.029587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:23.240543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:23.259178 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70ee7580-992d-4b90-a053-2e6c9f98d86a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1508 microversion: 2.1 time: 0.263302 Oct 04 11:16:23.264836 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2464/3698] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:22 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:23.273574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f352e895-dc06-4930-b9c4-3481c44a62b9 req-c24af674-df65-425f-a3b2-aaf54c6257c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6e745e-9cfe-4562-a91f-7fa25f3ad109", "tag": "8a5bddce-130d-4805-99d6-8f5074eab124"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:23.298808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f352e895-dc06-4930-b9c4-3481c44a62b9 req-c24af674-df65-425f-a3b2-aaf54c6257c3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:23.299280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f352e895-dc06-4930-b9c4-3481c44a62b9 req-c24af674-df65-425f-a3b2-aaf54c6257c3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:23.299708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f352e895-dc06-4930-b9c4-3481c44a62b9 req-c24af674-df65-425f-a3b2-aaf54c6257c3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:23.317451 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f352e895-dc06-4930-b9c4-3481c44a62b9 req-c24af674-df65-425f-a3b2-aaf54c6257c3 service nova] Creating event network-changed:8a5bddce-130d-4805-99d6-8f5074eab124 for instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 on n-h1-791135-8 Oct 04 11:16:23.323587 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f352e895-dc06-4930-b9c4-3481c44a62b9 req-c24af674-df65-425f-a3b2-aaf54c6257c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054859 Oct 04 11:16:23.324205 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2465/3699] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:23.330163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-51956102-5990-4d41-aa0f-b0675605b04f req-cf1bc7a8-4e8f-4b52-b044-604d590d0f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51c0bd-aa08-4238-a45e-423092ecdd39", "name": "network-vif-plugged", "status": "completed", "tag": "9fd16c1d-0044-4461-bbc3-bbb0c1eda32f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:23.340887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-51956102-5990-4d41-aa0f-b0675605b04f req-cf1bc7a8-4e8f-4b52-b044-604d590d0f3f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:23.341400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-51956102-5990-4d41-aa0f-b0675605b04f req-cf1bc7a8-4e8f-4b52-b044-604d590d0f3f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:23.341838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-51956102-5990-4d41-aa0f-b0675605b04f req-cf1bc7a8-4e8f-4b52-b044-604d590d0f3f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:23.353557 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-51956102-5990-4d41-aa0f-b0675605b04f req-cf1bc7a8-4e8f-4b52-b044-604d590d0f3f service nova] Creating event network-vif-plugged:9fd16c1d-0044-4461-bbc3-bbb0c1eda32f for instance ec51c0bd-aa08-4238-a45e-423092ecdd39 on n-h1-791135-8 Oct 04 11:16:23.359132 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-51956102-5990-4d41-aa0f-b0675605b04f req-cf1bc7a8-4e8f-4b52-b044-604d590d0f3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033515 Oct 04 11:16:23.360152 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2466/3700] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:23.365480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-936938f5-2929-4bdd-8bd0-94e72ed4cea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '.version_select at 0x7f71cf6f7ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:24.737797 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-936938f5-2929-4bdd-8bd0-94e72ed4cea0 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/52e0042b-b197-4b2d-a681-0249e77aee95" status: 202 len: 0 microversion: 2.1 time: 1.375781 Oct 04 11:16:24.741421 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2467/3701] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:16:23 2022] DELETE /compute/v2.1/os-floating-ips/52e0042b-b197-4b2d-a681-0249e77aee95 => generated 0 bytes in 1381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:24.763634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:24.768337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:24.779813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:24.780649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:24.781324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:24.782757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:24.783754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:24.784436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:24.790894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:25.091953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:25.113732 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-986d0c63-45ac-4e83-bd4f-5e9d1bd7ebab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.357747 Oct 04 11:16:25.114506 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2468/3702] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:24 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:25.122585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:25.124600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:25.134856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:25.135837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:25.136517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:25.137660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:25.138416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:25.139289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:25.415188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:25.424687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-964c81be-9713-4918-8db5-0647da266342 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 200 len: 1508 microversion: 2.1 time: 0.308621 Oct 04 11:16:25.426455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2469/3703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:25 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:25.433570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:25.434431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:25.448419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:25.449018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:25.449580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:25.450703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:25.452033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:25.452762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:25.698705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:25.714304 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e5e3b40e-de53-4b5d-a307-fce38b996317 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1523 microversion: 2.1 time: 0.284372 Oct 04 11:16:25.720253 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2470/3704] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:25 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:25.726093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:25.738598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:25.750505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:25.751059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:25.751524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:25.752254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:25.752734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:25.753176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:26.014431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:26.028739 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6127b612-9cd6-408d-a665-aa7f71032332 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.306993 Oct 04 11:16:26.029372 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2471/3705] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:25 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:26.034018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:26.034629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:26.043608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:26.044413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:26.045105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:26.046543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:26.047179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:26.047783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:26.165611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:26.179672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:26.181666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:26.183153 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9b0437d-e128-4fb4-bbd4-3ed03b534ad3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] 10.222.0.23 "GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03" status: 200 len: 1359 microversion: 2.47 time: 0.152853 Oct 04 11:16:26.183998 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2472/3706] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:26 2022] GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:26.189887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e5f68852-8719-43fe-98d5-fc3190cb802c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '.version_select at 0x7f71d48e5ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:26.469661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e5f68852-8719-43fe-98d5-fc3190cb802c tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/bfbaa610-eacb-4140-bc87-022a968baefb" status: 202 len: 0 microversion: 2.1 time: 0.283638 Oct 04 11:16:26.471245 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2473/3707] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 11:16:26 2022] DELETE /compute/v2.1/os-security-groups/bfbaa610-eacb-4140-bc87-022a968baefb => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:26.482985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:26.484035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:26.507536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:26.510362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:26.510967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:26.512030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:26.512819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:26.513445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:26.698791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:26.708029 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4cfd4e9c-bc3f-44ce-9515-08554a5010ab tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.235470 Oct 04 11:16:26.723555 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2474/3708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:26 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:26.723555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bdcd7328-6379-41b7-9f3a-5dfd31fdce2c req-5603725e-ab09-412e-bc57-59365e101ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8f11dc-6474-4736-9972-1fb65647ece0", "tag": "02b3a097-9732-4f13-9254-dc56af34ccbe"}, {"server_uuid": "c9864f24-c32a-437c-8e4f-c04cae010181", "name": "network-vif-unplugged", "status": "completed", "tag": "a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:26.731197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bdcd7328-6379-41b7-9f3a-5dfd31fdce2c req-5603725e-ab09-412e-bc57-59365e101ab2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:26.731829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bdcd7328-6379-41b7-9f3a-5dfd31fdce2c req-5603725e-ab09-412e-bc57-59365e101ab2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:26.732638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bdcd7328-6379-41b7-9f3a-5dfd31fdce2c req-5603725e-ab09-412e-bc57-59365e101ab2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:26.749233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bdcd7328-6379-41b7-9f3a-5dfd31fdce2c req-5603725e-ab09-412e-bc57-59365e101ab2 service nova] Creating event network-changed:02b3a097-9732-4f13-9254-dc56af34ccbe for instance 8d8f11dc-6474-4736-9972-1fb65647ece0 on n-h2-791135-8 Oct 04 11:16:26.750014 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bdcd7328-6379-41b7-9f3a-5dfd31fdce2c req-5603725e-ab09-412e-bc57-59365e101ab2 service nova] Creating event network-vif-unplugged:a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57 for instance c9864f24-c32a-437c-8e4f-c04cae010181 on n-h1-791135-8 Oct 04 11:16:26.758719 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bdcd7328-6379-41b7-9f3a-5dfd31fdce2c req-5603725e-ab09-412e-bc57-59365e101ab2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.046974 Oct 04 11:16:26.759457 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2475/3709] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:26.769870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:26.771321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:26.780181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:26.781130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:26.781759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:26.784147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:26.784804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:26.785382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:26.817561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:16:26.974994 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1805eee0-f250-47cb-a587-4f9605d44a90 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 204 len: 0 microversion: 2.1 time: 0.209569 Oct 04 11:16:26.982096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2476/3710] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:16:26 2022] DELETE /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:16:26.989219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1921301537"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:26.995040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:27.002876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:27.003500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:27.003951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:27.004892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:27.005669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:27.007424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:27.333119 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3664bb8-d671-41db-b15b-5927b785da43 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] 10.222.0.23 "POST /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03/action" status: 202 len: 52 microversion: 2.47 time: 0.349025 Oct 04 11:16:27.343350 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2477/3711] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:16:26 2022] POST /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03/action => generated 52 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:16:27.343350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:27.343992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:27.353609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:27.354730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:27.355318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:27.356045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:27.357824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:27.358271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:27.396507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:16:27.528076 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8559682c-b602-49cf-8073-1a2201a68fda tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 204 len: 0 microversion: 2.1 time: 0.188213 Oct 04 11:16:27.529585 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2478/3712] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:16:27 2022] DELETE /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:16:27.542327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:27.543188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:27.553983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:27.554498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:27.554936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:27.555706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:27.556144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:27.556584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:27.786166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:27.799606 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4bcd5900-7c93-4864-8647-1b7cf6c48319 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.267769 Oct 04 11:16:27.800410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2479/3713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:27 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:27.815235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:27.816274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:27.828370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:27.828891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:27.830956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:27.831720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:27.832195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:27.832635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:28.033086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:28.044673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-42ed72c8-f1fd-42b8-bbf9-d4691cd1087a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1523 microversion: 2.1 time: 0.234020 Oct 04 11:16:28.045819 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2480/3714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:27 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:28.050828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:28.051435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:28.058094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:28.058722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:28.059172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:28.059882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:28.060338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:28.060766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:28.602050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:28.607212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:28.613590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84390e2a-e72d-486f-a8b6-e8d8d56a4162 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.566539 Oct 04 11:16:28.615165 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2481/3715] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:28 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:28.641945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-429652841", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "46ef5295-5c7d-4bd5-bee2-4e0ba8effdeb"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:28.722094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] validate_networks() for [('46ef5295-5c7d-4bd5-bee2-4e0ba8effdeb', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:16:28.797769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:28.823400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:29.217445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:16:29.217867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:16:29.218353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:16:29.218768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:16:29.219185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:16:29.230854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:29.231770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:29.232388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:29.233333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:29.233818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:29.234495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:29.257499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Getting quotas for project 52b172e7699d45d6b47f9bdc5a38203e. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:16:29.262413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Getting quotas for user 5d291ac2bcf94e3288c243542024c848 and project 52b172e7699d45d6b47f9bdc5a38203e. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:16:29.274833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:16:29.277187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:16:29.338034 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9770e596-cc3c-4189-820a-0fffe28bd583 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721524 Oct 04 11:16:29.339063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2482/3716] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:16:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:16:29.351233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:29.352002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:29.360516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:29.360940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:29.361554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:29.362271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:29.362740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:29.363177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:29.400403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:16:29.529933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b27393bf-d243-4faa-8d29-263facb7c0b3 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03" status: 204 len: 0 microversion: 2.47 time: 0.182615 Oct 04 11:16:29.531200 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2483/3717] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:16:29 2022] DELETE /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:16:29.539595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:29.540541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:29.551304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:29.551304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:29.551304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:29.551304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:29.551304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:29.551304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:29.772700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:29.785246 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b68b7cf3-b6cc-4c33-8f74-31c78fbc76a3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1510 microversion: 2.1 time: 0.251525 Oct 04 11:16:29.786297 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2484/3718] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:29 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:29.792376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:29.792958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:29.799776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:29.800379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:29.800685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:29.801612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:29.802259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:29.802692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:29.869377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Locking {{(pid=122409) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 11:16:29.987094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b2e28a1-1008-4001-8888-1b7f9caab510 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.199507 Oct 04 11:16:29.988792 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2485/3719] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:29 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:29.994958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d31ac3b1-7f90-4a66-8446-393834d301d0 req-af87aaa2-a9ff-4b28-b674-070849c7f109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9864f24-c32a-437c-8e4f-c04cae010181", "tag": "a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:30.012108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d31ac3b1-7f90-4a66-8446-393834d301d0 req-af87aaa2-a9ff-4b28-b674-070849c7f109 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.012613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d31ac3b1-7f90-4a66-8446-393834d301d0 req-af87aaa2-a9ff-4b28-b674-070849c7f109 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.013195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d31ac3b1-7f90-4a66-8446-393834d301d0 req-af87aaa2-a9ff-4b28-b674-070849c7f109 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.027775 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d31ac3b1-7f90-4a66-8446-393834d301d0 req-af87aaa2-a9ff-4b28-b674-070849c7f109 service nova] Creating event network-changed:a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57 for instance c9864f24-c32a-437c-8e4f-c04cae010181 on n-h1-791135-8 Oct 04 11:16:30.035205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d31ac3b1-7f90-4a66-8446-393834d301d0 req-af87aaa2-a9ff-4b28-b674-070849c7f109 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044075 Oct 04 11:16:30.035821 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2486/3720] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:30.046885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:30.047931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:30.055457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.055946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.056380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.057078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.057582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.058004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.258440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:30.268663 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5c8b7dc-d4da-4dfe-b117-127cc5d1cf8f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1523 microversion: 2.1 time: 0.226793 Oct 04 11:16:30.293028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2487/3721] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:30 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:30.299139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:30.299764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:30.307181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.307689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.308127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.308830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.309383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.309822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.401172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:30.413744 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8277c6e5-5276-4a32-9a04-5461a0c44154 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1221 microversion: 2.1 time: 0.118792 Oct 04 11:16:30.429566 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2488/3722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:30 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:30.429566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:30.429566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:30.437808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.438403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.439331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.448506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.450408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.454446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.548423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:30.562162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:30.566523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:30.568218 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10b78ca0-3a13-4287-a6fe-867117fbb178 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] 10.222.0.23 "GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03" status: 200 len: 1365 microversion: 2.47 time: 0.149415 Oct 04 11:16:30.569105 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2489/3723] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:30 2022] GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:30.576140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:30.576969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:30.585237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.585996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.586697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.587671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.588338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.589310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.756203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:30.767237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d36c2a5e-0bdf-48c2-8da8-6c2128648130 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.195604 Oct 04 11:16:30.768448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2490/3724] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:30 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:30.773252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:30.773903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:30.782786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.782786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.782786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.782786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.783228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.783415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.961172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:30.970681 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-928d3e3b-926e-465e-b799-faf1bcea2ef4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.200552 Oct 04 11:16:30.971422 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2491/3725] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:30 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:30.976502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:30.977703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:30.983487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.984090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.984671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:30.985417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:30.987576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:30.987576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:31.241057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:31.261882 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c7b8643-8f72-4813-ba97-eef2471d6f0b tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1510 microversion: 2.1 time: 0.287311 Oct 04 11:16:31.265024 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2492/3726] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:30 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:32.090960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd722d17-8cd0-488b-b1ae-a91edea679aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:32.095694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=92,nova_api:UPDATE=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:32.107079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd722d17-8cd0-488b-b1ae-a91edea679aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.109190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd722d17-8cd0-488b-b1ae-a91edea679aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.109686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd722d17-8cd0-488b-b1ae-a91edea679aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.145422 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-dd722d17-8cd0-488b-b1ae-a91edea679aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] HTTP exception thrown: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 is locked Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd722d17-8cd0-488b-b1ae-a91edea679aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Request method failure captured: Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action HTTP/1.1 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTgBRUIG2PZwhMucIFfNOaJhTW8FRNIQ1AQlPUHsedqas9jqhU97pFlTmC2P_2shOaBN-8bL35S9FHJjJYbIeCD_ez18W4hC0WkHZcx5E4ieVl3tVGqOlHgOGrv88HoQLJEP_Q7QQgNCyQnnj2s-e36-frBPInLxKBQrBd3gNqVZkk Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df60449892d147adb43f4750c9b584d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df60449892d147adb43f4750c9b584d3"}]}] Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2e4e772e6a5b41a0b0f836b374bc69b4 Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: {"os-stop": {}} Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 is locked Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '549ab102-7419-4fc0-9aff-94764bc2bbd3', 'body': {'os-stop': {}}} Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 is locked Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 is locked Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 is locked Oct 04 11:16:32.147176 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:32.153117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd722d17-8cd0-488b-b1ae-a91edea679aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Returning 409 to user: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 is locked {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:16:32.153117 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd722d17-8cd0-488b-b1ae-a91edea679aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 409 len: 107 microversion: 2.1 time: 0.882545 Oct 04 11:16:32.153117 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2493/3727] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:31 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 107 bytes in 884 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:16:32.158546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:32.159167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:32.167032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.167527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.168434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.169164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.170064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.171745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.429428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:32.451036 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb61a3e4-5d00-4007-9446-96f6888108f1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1523 microversion: 2.1 time: 0.296601 Oct 04 11:16:32.461836 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2494/3728] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:32 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:32.492239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:32.498220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:32.515122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.517992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.518596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.519428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.519977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.520485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.689032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:32.703727 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-268521ec-faac-43fb-8040-ff394110501a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1269 microversion: 2.1 time: 0.250699 Oct 04 11:16:32.705030 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2495/3729] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:32 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1269 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:32.737198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:32.739910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:32.747352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.747848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.748858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.749695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.750220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.750744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.754017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:32.794736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.795821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.796446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.797176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lazy-loading 'fault' on Instance uuid c47f969d-9ab0-4645-89f4-a1ab26df0e03 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:16:32.852139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:32.861789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:32.863921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b751af838e546359ca0a6ff205f0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b67ae9855a4949bf4ded7eee58ecf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:32.865591 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7580ffd-f670-4c17-9d41-36e528383eef tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] 10.222.0.23 "GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03" status: 200 len: 1370 microversion: 2.47 time: 0.143884 Oct 04 11:16:32.866388 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2496/3730] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:32 2022] GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:32.892193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:32.893924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:32.902216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.903101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.903775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:32.904737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:32.905468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:32.906164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:33.181651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:33.215145 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5af6e9a4-94da-433e-96d5-3f3df55705bd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.331317 Oct 04 11:16:33.219670 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2497/3731] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:32 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:33.252270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:33.256037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:33.267607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:33.268295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:33.268934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:33.269845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:33.270638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:33.272079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:33.375631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Unlocking {{(pid=122409) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 11:16:33.494991 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-145954f7-7a16-4fbe-b3cd-f9251c7cc3c7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.257663 Oct 04 11:16:33.495765 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2498/3732] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:33 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:33.507211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:33.507844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:33.524383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:33.524888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:33.525325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:33.526052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:33.526518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:33.526937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:33.778945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:33.790925 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1b92868-17aa-4565-97df-e71f57bb4cd3 tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1510 microversion: 2.1 time: 0.294073 Oct 04 11:16:33.791556 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2499/3733] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:33 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:33.800391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:33.803281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:33.841897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:33.849499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:33.850816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:33.851597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:33.854429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:33.855787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:34.326402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:34.340140 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-998c8642-f5c1-417d-964b-090047e4da21 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1523 microversion: 2.1 time: 0.546738 Oct 04 11:16:34.343682 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2500/3734] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:33 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:34.359633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93d60ffd-6310-49ac-8917-b32f0b1da4f6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:34.375180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d60ffd-6310-49ac-8917-b32f0b1da4f6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:34.378126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d60ffd-6310-49ac-8917-b32f0b1da4f6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:34.382393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93d60ffd-6310-49ac-8917-b32f0b1da4f6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:34.466637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93d60ffd-6310-49ac-8917-b32f0b1da4f6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Going to try to stop instance {{(pid=122409) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:16:34.610859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93d60ffd-6310-49ac-8917-b32f0b1da4f6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.263108 Oct 04 11:16:34.611538 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2501/3735] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:34 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:34.636464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:34.639947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:34.666117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:34.666720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:34.667311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:34.668160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:34.668753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:34.682217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:34.814662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:34.835867 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-039e35ca-757c-4280-8ec5-79ffa3da2043 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1275 microversion: 2.1 time: 0.223072 Oct 04 11:16:34.845754 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2502/3736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:34 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:34.851476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:34.868018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] [instance: c47f969d-9ab0-4645-89f4-a1ab26df0e03] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:34.881373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:34.883885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:34.885056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:34.886237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:34.886974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:34.887646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:34.918790 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] HTTP exception thrown: Instance c47f969d-9ab0-4645-89f4-a1ab26df0e03 could not be found. Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Request method failure captured: Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03 HTTP/1.1 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBX_8FXCRrcuODtRc5b5Z67n2wEdqTM9dekLqidH70eFuqIJnrUAGS_jUfCkr_PwiYi2jRnIbTHbhcn2rrno7PnVF4N1gKlaI5CMDll84nIo-TrvYMfqnCr7J5RJozdN-DrOihhPjKHHRMa10GtzQm9_GYSoQIhf9JvBd1B99rlhF1A Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 40b67ae9855a4949bf4ded7eee58ecf4 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersAaction247Test-61076499 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_40b67ae9855a4949bf4ded7eee58ecf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/40b67ae9855a4949bf4ded7eee58ecf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "tempest-type-1201107225", "name": "tempest-service-43706935", "endpoints": [{"region": "tempest-region-696253580", "publicURL": "https://url-10194812.com"}]}, {"type": "tempest-type-335037085", "name": "tempest-service-894978642", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "tempest-type-1002071265", "name": "tempest-service-1477407760", "endpoints": [{"region": "tempest-region-1493988237", "internalURL": "https://url-1671828786.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/40b67ae9855a4949bf4ded7eee58ecf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/40b67ae9855a4949bf4ded7eee58ecf4"}]}] Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersAaction247Test-61076499 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 40b67ae9855a4949bf4ded7eee58ecf4 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersAaction247Test-61076499 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersAaction247Test-61076499-project Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8b751af838e546359ca0a6ff205f0491 Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersAaction247Test-61076499-project Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c47f969d-9ab0-4645-89f4-a1ab26df0e03 could not be found. Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c47f969d-9ab0-4645-89f4-a1ab26df0e03'} Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47f969d-9ab0-4645-89f4-a1ab26df0e03 could not be found. Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:16:34.921261 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47f969d-9ab0-4645-89f4-a1ab26df0e03 could not be found. Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47f969d-9ab0-4645-89f4-a1ab26df0e03 could not be found. Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:34.926864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] Returning 404 to user: Instance c47f969d-9ab0-4645-89f4-a1ab26df0e03 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:16:34.928574 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b322bb42-5b29-46f2-964b-2f62e5191d12 tempest-ServersAaction247Test-61076499 tempest-ServersAaction247Test-61076499-project] 10.222.0.23 "GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03" status: 404 len: 111 microversion: 2.47 time: 0.080389 Oct 04 11:16:34.928574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2503/3737] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:34 2022] GET /compute/v2.1/servers/c47f969d-9ab0-4645-89f4-a1ab26df0e03 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:16:34.940479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d1613e68-adac-4b27-95ca-774a2b0b2e8e req-0a1db5ba-6d45-46d2-a114-efaa5b60ca04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2062e0cb-5c32-4913-8415-c060e6cfbefb", "name": "network-vif-deleted", "tag": "f22f3b95-17d8-4714-afd1-814596d5b702"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:34.963009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1613e68-adac-4b27-95ca-774a2b0b2e8e req-0a1db5ba-6d45-46d2-a114-efaa5b60ca04 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:34.963462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1613e68-adac-4b27-95ca-774a2b0b2e8e req-0a1db5ba-6d45-46d2-a114-efaa5b60ca04 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:34.967464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1613e68-adac-4b27-95ca-774a2b0b2e8e req-0a1db5ba-6d45-46d2-a114-efaa5b60ca04 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:35.004915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d1613e68-adac-4b27-95ca-774a2b0b2e8e req-0a1db5ba-6d45-46d2-a114-efaa5b60ca04 service nova] Creating event network-vif-deleted:f22f3b95-17d8-4714-afd1-814596d5b702 for instance 2062e0cb-5c32-4913-8415-c060e6cfbefb on n-h2-791135-8 Oct 04 11:16:35.028178 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d1613e68-adac-4b27-95ca-774a2b0b2e8e req-0a1db5ba-6d45-46d2-a114-efaa5b60ca04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098945 Oct 04 11:16:35.034733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2504/3738] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:35.049802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:35.050881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:35.062872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:35.064350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:35.066826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:35.067847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:35.069278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:35.071342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:35.621107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:35.632213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a13c822-d54b-4dc3-bba6-f402e8852515 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.595754 Oct 04 11:16:35.633005 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2505/3739] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:35 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:35.647927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:35.652181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:35.666873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:35.670537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:35.677770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:35.678955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:35.679686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:35.680596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:35.908377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:35.918964 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f11b4f66-5e3e-4be5-ab46-91c53945245a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.284914 Oct 04 11:16:35.920254 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2506/3740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:35 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:35.925776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:35.926730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:35.950399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:35.952110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:35.952880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:35.966166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:35.967338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:35.968081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:36.025086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:36.026530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:36.027289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:36.028867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lazy-loading 'fault' on Instance uuid 8d8f11dc-6474-4736-9972-1fb65647ece0 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:16:36.124230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a0bfe3c8e347beaabf2dc28c7ef2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe011632a1f4089b1bc5d369e072819', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:36.149942 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64fb1c2f-c0ff-4288-bd37-2259344a7cfd tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 200 len: 1313 microversion: 2.1 time: 0.228016 Oct 04 11:16:36.150889 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2507/3741] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:35 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:36.158058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:36.158739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:36.164719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:36.165219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:36.165839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:36.166378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:36.174590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:36.175302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:36.369390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:36.379162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e17d0f1-a79e-4f03-846d-b655bd737086 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1523 microversion: 2.1 time: 0.226922 Oct 04 11:16:36.379792 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2508/3742] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:36 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:36.384578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:36.385685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:36.392113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:36.392697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:36.393099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:36.394030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:36.394524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:36.395027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:36.547319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:36.551890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:36.559818 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2eaeaa2c-6dfd-42b7-a82b-b851fa215676 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1317 microversion: 2.1 time: 0.178753 Oct 04 11:16:36.560454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2509/3743] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:36 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:36.663578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:36.664280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:36.684532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:36.686189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:36.687802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:36.688602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:36.689149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:36.690007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.010037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:37.019495 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb589089-3b3b-47cd-bf9c-8261b8b4e24a tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.360726 Oct 04 11:16:37.020692 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2510/3744] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:36 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:16:37.042886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:37.043629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:37.052652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.053525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.058289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.059358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.060059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.060710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.297480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:37.306539 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c5184ac-e2c4-4354-a354-87ab063907d7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.271401 Oct 04 11:16:37.310277 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2511/3745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:37 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:37.317002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7c787433-8d5a-49bd-b227-6d3e27c43c8f req-142f2ed7-a69f-4e01-9473-a0abc3059b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8f11dc-6474-4736-9972-1fb65647ece0", "name": "network-vif-deleted", "tag": "02b3a097-9732-4f13-9254-dc56af34ccbe"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:37.342617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c787433-8d5a-49bd-b227-6d3e27c43c8f req-142f2ed7-a69f-4e01-9473-a0abc3059b65 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.345961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c787433-8d5a-49bd-b227-6d3e27c43c8f req-142f2ed7-a69f-4e01-9473-a0abc3059b65 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.346621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c787433-8d5a-49bd-b227-6d3e27c43c8f req-142f2ed7-a69f-4e01-9473-a0abc3059b65 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.371925 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7c787433-8d5a-49bd-b227-6d3e27c43c8f req-142f2ed7-a69f-4e01-9473-a0abc3059b65 service nova] Creating event network-vif-deleted:02b3a097-9732-4f13-9254-dc56af34ccbe for instance 8d8f11dc-6474-4736-9972-1fb65647ece0 on n-h2-791135-8 Oct 04 11:16:37.380061 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7c787433-8d5a-49bd-b227-6d3e27c43c8f req-142f2ed7-a69f-4e01-9473-a0abc3059b65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066738 Oct 04 11:16:37.382686 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2512/3746] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:37.389606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:37.390789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] [instance: 8d8f11dc-6474-4736-9972-1fb65647ece0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:37.423494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.424252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.424848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.425968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.426740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.428449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.448106 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] HTTP exception thrown: Instance 8d8f11dc-6474-4736-9972-1fb65647ece0 could not be found. Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Request method failure captured: Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 HTTP/1.1 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBWxzNCsiSlYLZA43ytR5Nwj89d6eO8x2wPT7rkAdt4crHHMyCuPCkgscs82ucPRrlJg4TLTfrV2N2pFpEnenV4KLZLPuf90ABg_AMe54MXDbkhOI4jlXyEd_lSBk0CvKaaIfzU5XbaK2CaDtIaV1Cn48DlbTfHhCGdVHS_QGtxtTbw Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: cbe011632a1f4089b1bc5d369e072819 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1222441058 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cbe011632a1f4089b1bc5d369e072819"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cbe011632a1f4089b1bc5d369e072819"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cbe011632a1f4089b1bc5d369e072819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cbe011632a1f4089b1bc5d369e072819"}]}] Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1222441058 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: cbe011632a1f4089b1bc5d369e072819 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1222441058 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueTestJSONUnderV235-1222441058-project Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 21a0bfe3c8e347beaabf2dc28c7ef2b0 Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1222441058-project Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8d8f11dc-6474-4736-9972-1fb65647ece0 could not be found. Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8d8f11dc-6474-4736-9972-1fb65647ece0'} Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8f11dc-6474-4736-9972-1fb65647ece0 could not be found. Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8f11dc-6474-4736-9972-1fb65647ece0 could not be found. Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:37.457780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8f11dc-6474-4736-9972-1fb65647ece0 could not be found. Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:37.462406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] Returning 404 to user: Instance 8d8f11dc-6474-4736-9972-1fb65647ece0 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:16:37.463171 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b64ff289-e74f-43d4-8458-9e9c066975bf tempest-ServerRescueTestJSONUnderV235-1222441058 tempest-ServerRescueTestJSONUnderV235-1222441058-project] 10.222.0.23 "GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0" status: 404 len: 111 microversion: 2.1 time: 0.077438 Oct 04 11:16:37.464660 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2513/3747] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:37 2022] GET /compute/v2.1/servers/8d8f11dc-6474-4736-9972-1fb65647ece0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:16:37.479193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:37.480845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:37.497166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.497801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.498912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.500051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.501139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.503388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.918798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:37.926592 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca04aa4c-710e-4414-89a3-29065c808065 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1505 microversion: 2.1 time: 0.459888 Oct 04 11:16:37.933512 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2514/3748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:37 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:37.956773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:37.960821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:37.986938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.987660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.988278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:37.989179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:37.989831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:37.990469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:38.389636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:38.400319 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7b8abc9-645c-460e-8309-c6080375026d tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1317 microversion: 2.1 time: 0.465467 Oct 04 11:16:38.410948 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2515/3749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:37 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:38.418061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:38.418814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:38.425788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:38.426474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:38.427047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:38.428067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:38.428529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:38.429033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:39.011559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:39.020463 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61631afb-84a9-478f-8800-7984865b8af6 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1392 microversion: 2.1 time: 0.607379 Oct 04 11:16:39.025871 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2516/3750] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:38 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1392 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:39.172553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1744813722", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": "none"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:39.233228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:16:39.233710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:16:39.234301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:16:39.234617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:16:39.235029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:16:39.242986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:39.245998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:39.246661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:39.247050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:39.247772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:39.248233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:39.248931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:39.267814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Getting quotas for project ae6e290643bf4f34aaf1f6e1d2c6e88d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:16:39.271990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Getting quotas for user 4ad17d67f008497baa2f0b8724541c99 and project ae6e290643bf4f34aaf1f6e1d2c6e88d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:16:39.285636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:16:39.288849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:16:39.343616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5b6a755-eb7a-4173-ba26-df4376b68316 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.316165 Oct 04 11:16:39.344984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2517/3751] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:16:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:16:39.351352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:39.352176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:39.360488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:39.361299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:39.361931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:39.362854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:39.363458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:39.363899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:39.661717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:39.673634 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fec0aa34-ab67-4650-b6aa-d10dca506532 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.327351 Oct 04 11:16:39.674230 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2518/3752] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:39 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:39.681818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:39.682552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:39.695527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:39.695935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:39.696695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:39.697729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:39.698357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:39.699031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:39.969498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:39.980277 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4024930-8e18-470d-b218-adae2f9a4f4a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1505 microversion: 2.1 time: 0.302071 Oct 04 11:16:39.982647 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2519/3753] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:39 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:40.028973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25cbc192-b60c-4781-8b40-dd7932a1c753 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:40.031996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25cbc192-b60c-4781-8b40-dd7932a1c753 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:40.155351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25cbc192-b60c-4781-8b40-dd7932a1c753 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:40.180698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25cbc192-b60c-4781-8b40-dd7932a1c753 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:40.187223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25cbc192-b60c-4781-8b40-dd7932a1c753 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:40.190777 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25cbc192-b60c-4781-8b40-dd7932a1c753 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1278 microversion: 2.54 time: 0.187776 Oct 04 11:16:40.192917 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2520/3754] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:39 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:40.219452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2835d159-760b-4500-8e33-07c5d0ec83c1 req-73b7876f-3a2e-46b7-886e-047cbc73c2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c00c95a0-710b-4c4f-8082-c2e2a8d6c505", "tag": "21bcb484-e9cd-488c-bd99-2bcddd15d45e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:40.246716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2835d159-760b-4500-8e33-07c5d0ec83c1 req-73b7876f-3a2e-46b7-886e-047cbc73c2a8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:40.247265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2835d159-760b-4500-8e33-07c5d0ec83c1 req-73b7876f-3a2e-46b7-886e-047cbc73c2a8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:40.255698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2835d159-760b-4500-8e33-07c5d0ec83c1 req-73b7876f-3a2e-46b7-886e-047cbc73c2a8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:40.275850 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2835d159-760b-4500-8e33-07c5d0ec83c1 req-73b7876f-3a2e-46b7-886e-047cbc73c2a8 service nova] Creating event network-changed:21bcb484-e9cd-488c-bd99-2bcddd15d45e for instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 on n-h1-791135-8 Oct 04 11:16:40.282724 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2835d159-760b-4500-8e33-07c5d0ec83c1 req-73b7876f-3a2e-46b7-886e-047cbc73c2a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086658 Oct 04 11:16:40.284570 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2521/3755] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:40.291758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:40.292940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:40.305003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:40.305551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:40.306051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:40.306772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:40.308156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:40.308783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:40.651476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:40.663175 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1847187-fdd3-4020-8adb-82bde06ca0e3 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1317 microversion: 2.1 time: 0.376572 Oct 04 11:16:40.664895 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2522/3756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:40 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:40.670331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:40.671397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:40.677990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:40.678771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:40.679434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:40.680320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:40.680943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:40.681606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:40.934614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:40.943852 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b94201fa-166b-44bb-b2fc-166922cbe033 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1382 microversion: 2.1 time: 0.277582 Oct 04 11:16:40.945599 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2523/3757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:40 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1382 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:40.974249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:40.975824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:40.982834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:40.984025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:40.984025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:40.984603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:40.985307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:40.985903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:41.239188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:41.249276 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd5db4e8-e932-426a-8b11-32016572d03b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.302413 Oct 04 11:16:41.250376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2524/3758] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:40 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:41.276126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-76818ac0-8e7f-403d-b24e-e12070ba070b req-6602c397-bc5b-49ad-b10b-feb5d5550d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51c0bd-aa08-4238-a45e-423092ecdd39", "name": "network-vif-unplugged", "status": "completed", "tag": "9fd16c1d-0044-4461-bbc3-bbb0c1eda32f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:41.292710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-76818ac0-8e7f-403d-b24e-e12070ba070b req-6602c397-bc5b-49ad-b10b-feb5d5550d2f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:41.294173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-76818ac0-8e7f-403d-b24e-e12070ba070b req-6602c397-bc5b-49ad-b10b-feb5d5550d2f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:41.296098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-76818ac0-8e7f-403d-b24e-e12070ba070b req-6602c397-bc5b-49ad-b10b-feb5d5550d2f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:41.327869 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-76818ac0-8e7f-403d-b24e-e12070ba070b req-6602c397-bc5b-49ad-b10b-feb5d5550d2f service nova] Creating event network-vif-unplugged:9fd16c1d-0044-4461-bbc3-bbb0c1eda32f for instance ec51c0bd-aa08-4238-a45e-423092ecdd39 on n-h1-791135-8 Oct 04 11:16:41.341879 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-76818ac0-8e7f-403d-b24e-e12070ba070b req-6602c397-bc5b-49ad-b10b-feb5d5550d2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076913 Oct 04 11:16:41.342818 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2525/3759] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:41.348002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0f34c64-0363-48a4-8f4e-d24fbb6a0176 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '.version_select at 0x7f71cf2b9280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:41.351942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f34c64-0363-48a4-8f4e-d24fbb6a0176 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:41.352364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f34c64-0363-48a4-8f4e-d24fbb6a0176 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:41.352902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f34c64-0363-48a4-8f4e-d24fbb6a0176 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:41.364028 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0f34c64-0363-48a4-8f4e-d24fbb6a0176 tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.019958 Oct 04 11:16:41.374594 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2526/3760] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 11:16:41 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:41.378829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:41.379582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:41.386790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:41.387280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:41.387715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:41.388554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:41.389014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:41.389469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:41.616388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:41.640237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c414863e-056b-452f-af92-ed443ec3a2e8 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 200 len: 1508 microversion: 2.1 time: 0.269198 Oct 04 11:16:41.643718 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2527/3761] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:41 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:41.668390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:41.669450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:41.687434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:41.688146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:41.689324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:41.690303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:41.690931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:41.691657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:41.853827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:41.874598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:41.877790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:41.883414 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b076f8cf-b266-43fc-a5c3-d1f0de6ff79f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1336 microversion: 2.54 time: 0.236528 Oct 04 11:16:41.898000 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2528/3762] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:41 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1336 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:41.927424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:41.932207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:41.945817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:41.947247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:41.956654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:41.957777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:41.958271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:41.958701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:42.291494 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6946919a-a619-4f47-b4d0-0ab8315b53fb tempest-LiveMigrationTest-1365396444 tempest-LiveMigrationTest-1365396444-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1533 microversion: 2.1 time: 0.390913 Oct 04 11:16:42.294958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2529/3763] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:41 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1533 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:42.300326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:42.301212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:42.310945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:42.311643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:42.312266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:42.313143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:42.313645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:42.314070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:42.348243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:16:42.356966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.api [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Working on deleting snapshot f160bed2-2f04-451b-83ee-4b5ab3f5a29b from shelved instance... Oct 04 11:16:43.123790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:43.150475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Doing local delete in cell 6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) {{(pid=122409) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 11:16:43.151365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:43.151870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:43.152310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:43.152752 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.api [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 11:16:43.160821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] deallocate_for_instance() {{(pid=122409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 11:16:43.783572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Updating instance_info_cache with network_info: [] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:16:44.169086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:44.274972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06680bfe-e8a2-4a86-baf1-f8dfa232e030 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 204 len: 0 microversion: 2.1 time: 1.978257 Oct 04 11:16:44.279003 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2530/3764] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:16:42 2022] DELETE /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 0 bytes in 1980 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:16:44.282170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:44.282782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:44.290307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:44.291528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:44.292175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:44.293168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:44.293916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:44.294445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:44.499720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:44.510310 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-30d6bab4-17b5-46bb-bb20-08e4f2dbcce1 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1317 microversion: 2.1 time: 0.232788 Oct 04 11:16:44.521912 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2531/3765] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:44 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:44.536391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:44.538037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:44.545582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:44.546637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:44.547287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:44.548311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:44.549056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:44.549597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:44.726230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:44.738187 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd670939-8bae-48e0-aed5-6ca8f10b7d51 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.214376 Oct 04 11:16:44.739452 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2532/3766] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:44 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:44.754302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:44.754878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:44.771043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:44.772131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:44.772669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:44.773710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:44.774183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:44.774617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:44.803843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:16:44.899837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c72bda8f-70ba-4f69-a890-e53fbe68f9fc tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 204 len: 0 microversion: 2.1 time: 0.158131 Oct 04 11:16:44.900889 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2533/3767] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:16:44 2022] DELETE /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:16:44.909321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:44.910415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:44.916910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:44.917505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:44.917942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:44.918718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:44.919361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:44.919842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:45.006568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:45.020096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:45.022514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:45.023898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13097816-3d54-472b-880e-d4d5bc95b537 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1336 microversion: 2.54 time: 0.121626 Oct 04 11:16:45.024541 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2534/3768] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:44 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:45.030199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ae6466ca-e108-44aa-8cc6-2b77f399749b req-a2cac348-88aa-40b6-b2da-2c2a8b7c38c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51c0bd-aa08-4238-a45e-423092ecdd39", "name": "network-vif-deleted", "tag": "9fd16c1d-0044-4461-bbc3-bbb0c1eda32f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:45.044339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ae6466ca-e108-44aa-8cc6-2b77f399749b req-a2cac348-88aa-40b6-b2da-2c2a8b7c38c8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:45.045603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ae6466ca-e108-44aa-8cc6-2b77f399749b req-a2cac348-88aa-40b6-b2da-2c2a8b7c38c8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:45.046754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ae6466ca-e108-44aa-8cc6-2b77f399749b req-a2cac348-88aa-40b6-b2da-2c2a8b7c38c8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:45.060897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.server_external_events [req-ae6466ca-e108-44aa-8cc6-2b77f399749b req-a2cac348-88aa-40b6-b2da-2c2a8b7c38c8 service nova] Unable to find a host for instance ec51c0bd-aa08-4238-a45e-423092ecdd39. Dropping event network-vif-deleted {{(pid=122409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 11:16:45.062247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ae6466ca-e108-44aa-8cc6-2b77f399749b req-a2cac348-88aa-40b6-b2da-2c2a8b7c38c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.036158 Oct 04 11:16:45.064470 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2535/3769] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 11:16:45.071632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:45.072451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:45.079168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:45.079686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:45.080207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:45.080915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:45.081521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:45.081839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:45.101335 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 HTTP/1.1 Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'ec51c0bd-aa08-4238-a45e-423092ecdd39'} Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:45.103373 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6fb00c9f-fd98-49da-a34b-14bf40f2dd4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 404 len: 111 microversion: 2.1 time: 0.039311 Oct 04 11:16:45.108838 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2536/3770] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:45 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:16:45.112027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ed446cd4-3b7e-4f2d-b951-5a3c19dafb32 req-d30fa76a-56a8-4bec-8f24-4fed4d8fc98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00c95a0-710b-4c4f-8082-c2e2a8d6c505", "name": "network-vif-plugged", "status": "completed", "tag": "21bcb484-e9cd-488c-bd99-2bcddd15d45e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:45.143029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ed446cd4-3b7e-4f2d-b951-5a3c19dafb32 req-d30fa76a-56a8-4bec-8f24-4fed4d8fc98a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:45.145736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ed446cd4-3b7e-4f2d-b951-5a3c19dafb32 req-d30fa76a-56a8-4bec-8f24-4fed4d8fc98a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:45.146157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ed446cd4-3b7e-4f2d-b951-5a3c19dafb32 req-d30fa76a-56a8-4bec-8f24-4fed4d8fc98a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:45.160401 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ed446cd4-3b7e-4f2d-b951-5a3c19dafb32 req-d30fa76a-56a8-4bec-8f24-4fed4d8fc98a service nova] Creating event network-vif-plugged:21bcb484-e9cd-488c-bd99-2bcddd15d45e for instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 on n-h1-791135-8 Oct 04 11:16:45.166618 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ed446cd4-3b7e-4f2d-b951-5a3c19dafb32 req-d30fa76a-56a8-4bec-8f24-4fed4d8fc98a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059084 Oct 04 11:16:45.167445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2537/3771] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:45.175646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:45.176677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:45.185393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:45.186536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:45.187309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:45.188275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:45.188925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:45.189612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:45.439805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:45.451963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5f9f817-b024-44cd-9722-65130fa438e0 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1388 microversion: 2.1 time: 0.282941 Oct 04 11:16:45.462309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2538/3772] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:45 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1388 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:45.462309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1232295413", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "49989f52-07b9-48bb-b42a-1e9bb7c15958"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:45.529237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] validate_networks() for [('49989f52-07b9-48bb-b42a-1e9bb7c15958', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:16:46.233614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:16:46.234143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:16:46.234439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:16:46.234854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:16:46.235262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:16:46.245014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:46.245443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:46.246232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:46.247810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:46.248887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:46.249475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:46.271119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:16:46.277323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for user 510d473de29b4d7d8bb303f64f1e17d4 and project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:16:46.301507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:16:46.304455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:16:46.367912 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e6628d6-58fa-428e-886e-f669a1d7d37d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904344 Oct 04 11:16:46.369067 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2539/3773] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:16:46.380385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:46.382704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:46.390287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:46.390784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:46.392437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:46.393318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:46.393834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:46.394271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:46.725404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:46.736620 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b391edb-50d1-4c37-bb95-c9d7a4e3f712 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1317 microversion: 2.1 time: 0.360989 Oct 04 11:16:46.739262 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2540/3774] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:46 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:46.758676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:46.760506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:46.777508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:46.778299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:46.778932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:46.779878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:46.780500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:46.781119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:47.189344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:47.215507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e48024af-c68b-4c63-ada6-db92cc5ac82e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1658 microversion: 2.1 time: 0.474981 Oct 04 11:16:47.225794 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2541/3775] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:46 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1658 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:47.242369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:47.243690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:47.265930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:47.266425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:47.267508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:47.269660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:47.270168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:47.270795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:47.419169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:47.423385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:UPDATE=17,nova_cell1:SELECT=78,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:47.431764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:47.441733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:47.443784 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e56d4de-86d6-481b-aac7-7bba6665485c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1357 microversion: 2.54 time: 0.216410 Oct 04 11:16:47.446967 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2542/3776] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:47 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:47.453419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:47.454426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:47.468057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:47.468841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:47.473001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:47.474248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:47.475556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:47.487714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:47.614057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:47.629087 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-04cfaf83-4fd4-4c80-8529-279b048ee219 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1211 microversion: 2.1 time: 0.180609 Oct 04 11:16:47.629957 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2543/3777] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:47 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1211 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:47.639681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:47.643605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:47.675887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:47.679793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:47.680659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:47.683076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:47.683724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:47.684488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:47.818717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:47.830193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d8a8c10-f267-4897-a827-e97a3280b521 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1184 microversion: 2.1 time: 0.198864 Oct 04 11:16:47.831037 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2544/3778] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:47 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1184 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:47.847799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76c985f9-d93c-41ef-a978-fd1d75f39cde tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:47.870616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76c985f9-d93c-41ef-a978-fd1d75f39cde tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:47.874379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76c985f9-d93c-41ef-a978-fd1d75f39cde tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:47.874989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76c985f9-d93c-41ef-a978-fd1d75f39cde tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:47.902409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76c985f9-d93c-41ef-a978-fd1d75f39cde tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Going to try to start instance {{(pid=122409) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 11:16:48.010050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76c985f9-d93c-41ef-a978-fd1d75f39cde tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.176021 Oct 04 11:16:48.012498 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2545/3779] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:47 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:48.019839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d160a14d-aaa2-4063-b246-23700b47cff7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Action: 'create', calling method: .version_select at 0x7f71cf19a3a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-532134357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQfSpC5+h0QAlDjBT6OOywHICQR71wJwfWiCh6MjbsnyLl2gVatrjYNQHvPuMxUhPzfaTCoIZlsXMnYenSVO/AecZJvdAXxNjZnAGtUeurgOwds6dh91Z65gqiYVcT7eQ=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:48.053603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-d160a14d-aaa2-4063-b246-23700b47cff7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Getting quotas for project ae6e290643bf4f34aaf1f6e1d2c6e88d. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:16:48.059063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-d160a14d-aaa2-4063-b246-23700b47cff7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Getting quotas for user 4ad17d67f008497baa2f0b8724541c99 and project ae6e290643bf4f34aaf1f6e1d2c6e88d. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:16:48.106906 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d160a14d-aaa2-4063-b246-23700b47cff7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.092234 Oct 04 11:16:48.107891 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2546/3780] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:16:48 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:16:48.116386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-27776d05-6e70-48d9-a861-6f733b47bdb8 req-766beeed-1644-4585-8741-cdd479a9e176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9864f24-c32a-437c-8e4f-c04cae010181", "name": "network-vif-deleted", "tag": "a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:48.142753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-27776d05-6e70-48d9-a861-6f733b47bdb8 req-766beeed-1644-4585-8741-cdd479a9e176 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:48.143161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-27776d05-6e70-48d9-a861-6f733b47bdb8 req-766beeed-1644-4585-8741-cdd479a9e176 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:48.143607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-27776d05-6e70-48d9-a861-6f733b47bdb8 req-766beeed-1644-4585-8741-cdd479a9e176 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:48.173594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-27776d05-6e70-48d9-a861-6f733b47bdb8 req-766beeed-1644-4585-8741-cdd479a9e176 service nova] Creating event network-vif-deleted:a5bdcc8e-5ca6-43a2-8b69-d8f7b2d5dc57 for instance c9864f24-c32a-437c-8e4f-c04cae010181 on n-h2-791135-8 Oct 04 11:16:48.186312 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-27776d05-6e70-48d9-a861-6f733b47bdb8 req-766beeed-1644-4585-8741-cdd479a9e176 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073910 Oct 04 11:16:48.186969 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2547/3781] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:48.197114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:48.197882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:48.214431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:48.214949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:48.215401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:48.228329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:48.228927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:48.229397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:48.493399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:48.518609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12b3095d-7336-4bb2-ac6a-43638abb3a39 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1508 microversion: 2.1 time: 0.325048 Oct 04 11:16:48.522775 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2548/3782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:48 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:48.551233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:48.556973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:48.574254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:48.580783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:48.581587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:48.585924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:48.586650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:48.587259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:48.997729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:49.013149 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0786c69-2514-4758-9694-4a112663439e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1667 microversion: 2.1 time: 0.474266 Oct 04 11:16:49.014344 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2549/3783] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:48 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1667 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:49.020295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-532134357", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:49.027921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:49.049605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:49.050208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:49.050771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:49.052146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:49.052771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:49.053452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:49.198716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:16:49.199564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:16:49.200278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:16:49.201016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:16:49.201632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:16:49.380600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:49.399149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:49.399673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:49.401780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:49.403346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:49.405007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:49.405487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:49.519428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c0e2fc79-75e2-404e-97c8-f80df622bc37 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "POST /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965/action" status: 202 len: 1139 microversion: 2.54 time: 0.503781 Oct 04 11:16:49.525116 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2550/3784] 10.222.0.23 () {62 vars in 1320 bytes} [Tue Oct 4 11:16:49 2022] POST /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965/action => generated 1139 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 11:16:49.540628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:49.542286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:49.578423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:49.579863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:49.580319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:49.581067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:49.585141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:49.585141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:49.906375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:49.916667 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1bde31f2-decb-455d-a4ba-b55287ee7a03 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1508 microversion: 2.1 time: 0.388829 Oct 04 11:16:49.916667 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2551/3785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:49 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:49.929725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:49.929725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:49.940079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:49.941016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:49.941507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:49.944639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:49.945014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:49.945548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:50.094795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:50.119016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de297204-960b-41c9-aef7-33d81e63e7c6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1273 microversion: 2.1 time: 0.201298 Oct 04 11:16:50.120191 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2552/3786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:49 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:50.126570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:50.127395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:50.133677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:50.134357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:50.135018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:50.135899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:50.136530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:50.137120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:50.335467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:50.347298 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1de41dea-649d-4f45-ad1d-d5e84c87ae24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1184 microversion: 2.1 time: 0.224587 Oct 04 11:16:50.348203 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2553/3787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:50 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1184 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:50.356460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:50.357517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:50.367900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:50.368691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:50.369478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:50.370342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:50.370961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:50.371743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:50.955049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:50.965738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:50.967177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:50.968368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1a93f3e-c268-4b69-9690-088b0feb9cf7 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.617768 Oct 04 11:16:50.968932 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2554/3788] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:50 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:50.978161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:50.988087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:51.011018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:51.011517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:51.011951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:51.012652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:51.013099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:51.013551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:51.122654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aacf11d2-91d7-4d29-8ae5-a75dfa36c3fc tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "PUT /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1080 microversion: 2.1 time: 0.148620 Oct 04 11:16:51.134863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2555/3789] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:16:50 2022] PUT /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1080 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:51.139232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:51.139852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:51.148954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:51.149376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:51.152883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:51.154001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:51.154142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:51.154573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:51.611124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:51.624075 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-437a5d4e-1c17-4ebc-83c0-860b953a42fb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.498601 Oct 04 11:16:51.630007 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2556/3790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:51 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:51.637388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:51.644455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:51.671122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:51.672310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:51.674674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:51.678065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:51.679878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:51.680564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:51.691178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:51.990241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:51.999744 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-975efb34-933a-4f1f-a92c-12c02d415297 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1506 microversion: 2.1 time: 0.367599 Oct 04 11:16:52.021977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2557/3791] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:51 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:52.029164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:52.029811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:52.042968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:52.046436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:52.050297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:52.051412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:52.051974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:52.053322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:52.312849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:52.324304 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9478695-8132-453f-b817-c1e07a4051b6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1315 microversion: 2.1 time: 0.298592 Oct 04 11:16:52.326611 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2558/3792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:52 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:52.336220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:52.338221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:52.357510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:52.358106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:52.358623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:52.359414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:52.359943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:52.360466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:52.522322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:52.531572 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53869e10-bc3f-4090-a868-48fd23251b24 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1184 microversion: 2.1 time: 0.203849 Oct 04 11:16:52.534976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2559/3793] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:52 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1184 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:52.534976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:52.534976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:52.557103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:52.563446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:52.566469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:52.570231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:52.571847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:52.572511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:52.883455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:52.894676 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-925957b9-bd48-4d89-9842-a6d94da29d0b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.358581 Oct 04 11:16:52.897036 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2560/3794] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:52 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:52.934162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8bd36cb9-3382-42e9-8b66-0b0238d4ba2f req-ae9751de-2c84-4ee5-b3e6-bec1e14d9782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640c0385-3b41-480f-8494-692f2fdd866c", "tag": "6f472f08-36c7-4c67-9f72-e982115a96c8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:53.002443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8bd36cb9-3382-42e9-8b66-0b0238d4ba2f req-ae9751de-2c84-4ee5-b3e6-bec1e14d9782 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.010935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8bd36cb9-3382-42e9-8b66-0b0238d4ba2f req-ae9751de-2c84-4ee5-b3e6-bec1e14d9782 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.012934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8bd36cb9-3382-42e9-8b66-0b0238d4ba2f req-ae9751de-2c84-4ee5-b3e6-bec1e14d9782 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.046291 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8bd36cb9-3382-42e9-8b66-0b0238d4ba2f req-ae9751de-2c84-4ee5-b3e6-bec1e14d9782 service nova] Creating event network-changed:6f472f08-36c7-4c67-9f72-e982115a96c8 for instance 640c0385-3b41-480f-8494-692f2fdd866c on n-h1-791135-8 Oct 04 11:16:53.062794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8bd36cb9-3382-42e9-8b66-0b0238d4ba2f req-ae9751de-2c84-4ee5-b3e6-bec1e14d9782 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163307 Oct 04 11:16:53.063761 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2561/3795] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:53.076232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:53.080330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:53.083699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:53.095695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.096213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.096662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.097420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.097889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.103714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.273182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:53.286194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:53.290144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:53.292294 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3aabbe1-4f21-4601-80bb-ff4221d6006e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.227087 Oct 04 11:16:53.293568 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2562/3796] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:53 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:53.299656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:53.301184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:53.311695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.312528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.313210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.314214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.315044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.316061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.512808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:53.522242 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-20158e6d-56f2-4004-b0ac-2d72fbdc0c67 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1506 microversion: 2.1 time: 0.227132 Oct 04 11:16:53.530225 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2563/3797] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:53 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:53.551343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:53.551890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:53.562659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.563150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.568728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.569802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.570471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.571172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.680809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Unlocking {{(pid=122409) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 11:16:53.820159 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3590d2b4-8d0a-4467-92af-954b8f2755ba tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.288492 Oct 04 11:16:53.822430 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2564/3798] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:16:53 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:16:53.832435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:53.833317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:53.846423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.849863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.850637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.852233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.853155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.855186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.912318 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f74f03dc-a7c2-4add-84d7-704d871050d4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/ips" status: 200 len: 151 microversion: 2.20 time: 0.083776 Oct 04 11:16:53.913096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2565/3799] 10.222.0.23 () {60 vars in 1289 bytes} [Tue Oct 4 11:16:53 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:16:53.926788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:53.928305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:53.947125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.949943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.950430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:53.951182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:53.954517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:53.955014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:54.223847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:54.237772 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f77a90d-c68b-46d9-b3a4-cd0abcf4f0ff tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1315 microversion: 2.1 time: 0.323147 Oct 04 11:16:54.238901 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2566/3800] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:53 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:54.244773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:54.248172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:54.260861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:54.261738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:54.262421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:54.263842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:54.264546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:54.265230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:54.351154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e514ac5-9f09-41fd-8811-81dcfae05212 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "PUT /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1082 microversion: 2.1 time: 0.110424 Oct 04 11:16:54.354197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2567/3801] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:16:54 2022] PUT /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1082 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:54.360675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:54.362734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:54.371720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:54.372467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:54.373269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:54.374416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:54.375003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:54.375485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:54.580108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:54.591127 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f537229-c076-40de-8ea1-5bd8f0e1a680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 200 len: 1184 microversion: 2.1 time: 0.235355 Oct 04 11:16:54.593451 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2568/3802] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:54 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 1184 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:54.603711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:54.604337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:54.612641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:54.613247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:54.614031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:54.615384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:54.616357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:54.617025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:54.956337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:54.968573 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6c2926b-481a-4ce4-b395-48f4bdc116b5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.373670 Oct 04 11:16:54.969723 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2569/3803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:54 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:54.991677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:54.992543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:55.000948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:55.007730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:55.012487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:55.013475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:55.013955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:55.014402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:55.205673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:55.221711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:55.223374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:55.231476 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cc4e925-f2b5-4cf7-8509-ad118132125c tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.252164 Oct 04 11:16:55.233702 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2570/3804] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:54 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:55.247185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:55.249211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:55.268021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:55.268536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:55.272948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:55.273992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:55.274589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:55.275205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:55.651738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:55.654255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:55.673309 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-df835793-0a0a-4d58-8791-c2592e155fcb tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1508 microversion: 2.1 time: 0.429581 Oct 04 11:16:55.687732 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2571/3805] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:55 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1508 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:55.977055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1990359854", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "d176e60b-41c3-40d6-bbe4-cbad87a0893f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:56.050506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] validate_networks() for [('d176e60b-41c3-40d6-bbe4-cbad87a0893f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:16:56.261928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:16:57.117931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:16:57.118655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:16:57.119449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:16:57.120301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:16:57.120908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:16:57.143787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:57.144894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:57.145665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:57.149399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:57.156408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:57.159576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:57.200544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Getting quotas for project 2fe3c551c5734a769e210fa056481a50. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:16:57.207974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Getting quotas for user 7713fb2efaef4fddbc40bcdf611e0f5d and project 2fe3c551c5734a769e210fa056481a50. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:16:57.224851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:16:57.227548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:16:57.325620 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5557da0a-6b06-4889-aefc-e82cb2372360 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.636540 Oct 04 11:16:57.334475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2572/3806] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:16:57.341294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:57.346873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:57.367106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:57.369805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:57.370537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:57.372190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:57.374209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:57.376110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:57.699812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:57.710358 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76df841b-44ea-4ca7-95ac-4c79ca33f86c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.373461 Oct 04 11:16:57.725837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2573/3807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:57 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:57.741714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:57.743622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:57.761874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:57.764574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:57.765476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:57.767573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:57.769773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:57.771645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.084589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:58.096920 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d8baef2-a598-4a83-94b9-01be8bbec611 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1315 microversion: 2.1 time: 0.369753 Oct 04 11:16:58.101659 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2574/3808] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:57 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:58.110871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:58.112845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: c9864f24-c32a-437c-8e4f-c04cae010181] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:58.125219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.125744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.126177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.126884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.127336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.127759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.178330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] HTTP exception thrown: Instance c9864f24-c32a-437c-8e4f-c04cae010181 could not be found. Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Request method failure captured: Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 HTTP/1.1 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSLRgD-Dayvj7WdURpJ4ALy9X49eFCd_L5UxpxZ37ii6M2YNKH3GbEstNicGC69FVZm77fsBkMATZ-Qa8WL_6QqKz-moKDj5op8vNM36kkELHG8acEVbRLtMXjFzB_YmtCtIVAbn_-sKWhbojTrbKefndQ1EZi9rZYULBzVZLRic2Y Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d8213366237849c5bd0db518c55bc288 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveMigrationTest-548723689 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8213366237849c5bd0db518c55bc288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8213366237849c5bd0db518c55bc288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8213366237849c5bd0db518c55bc288"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8213366237849c5bd0db518c55bc288"}]}] Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveMigrationTest-548723689 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d8213366237849c5bd0db518c55bc288 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveMigrationTest-548723689 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveMigrationTest-548723689-project Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8f8c67a2ba884edbb978a166d91294d7 Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveMigrationTest-548723689-project Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c9864f24-c32a-437c-8e4f-c04cae010181 could not be found. Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c9864f24-c32a-437c-8e4f-c04cae010181'} Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9864f24-c32a-437c-8e4f-c04cae010181 could not be found. Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9864f24-c32a-437c-8e4f-c04cae010181 could not be found. Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:16:58.182795 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:58.187540 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:16:58.187540 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:16:58.187540 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:16:58.187540 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:16:58.187540 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:16:58.187540 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9864f24-c32a-437c-8e4f-c04cae010181 could not be found. Oct 04 11:16:58.187540 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:16:58.189095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Returning 404 to user: Instance c9864f24-c32a-437c-8e4f-c04cae010181 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:16:58.193279 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1de7c26-9498-4545-803c-d5520c65634b tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181" status: 404 len: 111 microversion: 2.1 time: 0.088997 Oct 04 11:16:58.193966 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2575/3809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:58 2022] GET /compute/v2.1/servers/c9864f24-c32a-437c-8e4f-c04cae010181 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:16:58.202212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:58.203683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:58.215630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.216431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.217058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.217997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.218634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.219275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.537228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:58.546627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1bf70f12-782a-485e-99d3-c0abdc9b3e4c tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1508 microversion: 2.1 time: 0.349063 Oct 04 11:16:58.547436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2576/3810] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:58 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:16:58.568375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:58.586831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:58.604371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.604867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.605411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.606118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.606557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.606986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.704850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:58.719836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:58.721189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:58.722451 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f449b96d-bc49-4916-9eb6-7f36a7a24a0f tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.162113 Oct 04 11:16:58.742037 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2577/3811] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:58 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:58.763047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-72eb41a8-beec-4ab8-94ce-28c7abceb23b req-8841bd37-647e-4b70-aacd-f1c41bf48c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640c0385-3b41-480f-8494-692f2fdd866c", "name": "network-vif-plugged", "status": "completed", "tag": "6f472f08-36c7-4c67-9f72-e982115a96c8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:58.787967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-72eb41a8-beec-4ab8-94ce-28c7abceb23b req-8841bd37-647e-4b70-aacd-f1c41bf48c8c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.788459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-72eb41a8-beec-4ab8-94ce-28c7abceb23b req-8841bd37-647e-4b70-aacd-f1c41bf48c8c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.788896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-72eb41a8-beec-4ab8-94ce-28c7abceb23b req-8841bd37-647e-4b70-aacd-f1c41bf48c8c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.816396 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-72eb41a8-beec-4ab8-94ce-28c7abceb23b req-8841bd37-647e-4b70-aacd-f1c41bf48c8c service nova] Creating event network-vif-plugged:6f472f08-36c7-4c67-9f72-e982115a96c8 for instance 640c0385-3b41-480f-8494-692f2fdd866c on n-h1-791135-8 Oct 04 11:16:58.840347 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-72eb41a8-beec-4ab8-94ce-28c7abceb23b req-8841bd37-647e-4b70-aacd-f1c41bf48c8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095891 Oct 04 11:16:58.842296 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2578/3812] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:16:58.872337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:16:58.882985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:58.894261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.897779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.898440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.899383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:58.900023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:58.900858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:58.967479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lazy-loading 'flavor' on Instance uuid 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:16:59.385597 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e155f16-8fd7-4b93-ab49-9973aab754e7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/action" status: 202 len: 0 microversion: 2.20 time: 0.541304 Oct 04 11:16:59.386689 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2579/3813] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:16:58 2022] POST /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:16:59.404028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:59.408938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:59.417803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:59.419345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:59.420174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:59.421439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:59.422135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:59.423829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:59.658744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:59.677043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:59.683276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:16:59.689142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3b152ab-4781-4171-8278-c7682a08fa1b tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1314 microversion: 2.26 time: 0.298686 Oct 04 11:16:59.689782 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2580/3814] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:16:59 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:16:59.695610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:16:59.696849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:16:59.709274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:59.710186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:59.710854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:16:59.711834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:16:59.718169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:16:59.719120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:00.087964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:00.098259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a6b781db-db4c-4e57-800a-eb3646cad671 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.404693 Oct 04 11:17:00.099582 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2581/3815] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:16:59 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:00.106487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:00.107936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:00.116190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:00.117692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:00.118441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:00.119720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:00.122277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:00.123015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:00.184180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:17:00.360442 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-525d16a5-6144-429a-85e1-020e611c28d5 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 204 len: 0 microversion: 2.1 time: 0.259159 Oct 04 11:17:00.361797 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2582/3816] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:17:00 2022] DELETE /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:17:00.371722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:00.372941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:00.391061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:00.394799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:00.396411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:00.398777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:00.399686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:00.401167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:00.897563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:00.906025 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31e60d34-e97f-4159-82a7-bd8d5f60a0e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1315 microversion: 2.1 time: 0.542700 Oct 04 11:17:00.912406 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2583/3817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:00 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:00.927440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:00.932541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:00.951141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:00.952327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:00.952327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:00.955367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:00.957871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:00.959099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:01.187243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:01.199339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:01.200780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:01.202863 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1cfbc73-a22f-444a-a334-cba9fc3e7f68 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1722 microversion: 2.20 time: 0.291600 Oct 04 11:17:01.204190 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2584/3818] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:00 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:01.210242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:01.211306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:01.218595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:01.219395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:01.220135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:01.221216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:01.221912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:01.222545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:01.356405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:01.365231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:01.368035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:01.380863 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-335c5420-b60d-487d-be96-bc364b483397 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.166128 Oct 04 11:17:01.382551 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2585/3819] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:01 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:01.387407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:01.390132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:01.402952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:01.403735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:01.404745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:01.406561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:01.408379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:01.409398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:01.471534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:01.582738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1379c6b-33d2-4a58-addc-583c93767df2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.196977 Oct 04 11:17:01.586077 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2586/3820] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:17:01 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:17:01.600467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:01.604176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:01.617192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:01.618048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:01.619568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:01.621178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:01.622145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:01.622838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:01.698140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:17:01.791253 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.api [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Instance is already in deleting state, ignoring this request Oct 04 11:17:01.792272 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-26856a34-5854-4d98-aac8-90898bc43c99 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 204 len: 0 microversion: 2.1 time: 0.202597 Oct 04 11:17:01.793186 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2587/3821] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:17:01 2022] DELETE /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:17:01.800016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:01.800301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:01.809437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:01.809972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:01.810627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:01.811356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:01.811883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:01.812448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:02.217752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:02.227995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:02.229671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:02.231323 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b176cd76-bb2b-40dd-9157-40b35430190c tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1362 microversion: 2.26 time: 0.436641 Oct 04 11:17:02.231831 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2588/3822] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:01 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:02.237124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:02.244884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:02.245250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:02.245871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:02.246323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:02.247043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:02.248141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:02.248141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:02.446284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:02.455851 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53b9f8f5-dfa1-43af-93bd-05ab5fbafaf2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1656 microversion: 2.1 time: 0.222821 Oct 04 11:17:02.456733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2589/3823] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:02 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1656 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:02.477144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:02.477966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:02.484352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:02.484852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:02.485440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:02.486141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:02.486596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:02.487018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:02.730387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d291ac2bcf94e3288c243542024c848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b172e7699d45d6b47f9bdc5a38203e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:02.746441 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c3ff07d-ab0f-4e28-b146-7b7fbb10ce92 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 200 len: 1514 microversion: 2.1 time: 0.274017 Oct 04 11:17:02.749147 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2590/3824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:02 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:02.757726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:02.758804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:02.772422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:02.772681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:02.773132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:02.773906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:02.774514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:02.774963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:03.513065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:03.524798 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d41b36d-f733-467e-b21c-7dc0493f0dc1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1502 microversion: 2.1 time: 0.772244 Oct 04 11:17:03.526096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2591/3825] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:02 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1502 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:03.531141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:03.532499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:03.539515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:03.540280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:03.540926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:03.541856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:03.542756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:03.543367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:03.792508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:03.813798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:03.815521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:03.817004 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ced606a-d306-4128-bd26-63d9ab2c7a08 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1722 microversion: 2.20 time: 0.289685 Oct 04 11:17:03.818362 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2592/3826] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:03 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:03.823120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:03.823938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:03.843025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:03.844319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:03.844941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:03.845874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:03.846512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:03.847777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:03.965169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:03.975757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:03.977233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:03.978500 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14df5038-911c-4c37-8238-b67efcb5a8a4 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.159012 Oct 04 11:17:03.980183 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2593/3827] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:03 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:03.985480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:03.986259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:03.993927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:03.994722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:03.995339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:03.996732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:03.997418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:03.998025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.104144 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1da96106-56e8-49c4-a3a7-363b93451947 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.122170 Oct 04 11:17:04.104916 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2594/3828] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:17:03 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:17:04.113394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7a1315b8-93bb-417f-9109-2cd8e1199a53 req-26cf1286-b6df-4269-968c-225eac3d96a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c00c95a0-710b-4c4f-8082-c2e2a8d6c505", "name": "network-vif-deleted", "tag": "21bcb484-e9cd-488c-bd99-2bcddd15d45e"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:04.126311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7a1315b8-93bb-417f-9109-2cd8e1199a53 req-26cf1286-b6df-4269-968c-225eac3d96a4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.127161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7a1315b8-93bb-417f-9109-2cd8e1199a53 req-26cf1286-b6df-4269-968c-225eac3d96a4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.127702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7a1315b8-93bb-417f-9109-2cd8e1199a53 req-26cf1286-b6df-4269-968c-225eac3d96a4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.141191 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7a1315b8-93bb-417f-9109-2cd8e1199a53 req-26cf1286-b6df-4269-968c-225eac3d96a4 service nova] Creating event network-vif-deleted:21bcb484-e9cd-488c-bd99-2bcddd15d45e for instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 on n-h1-791135-8 Oct 04 11:17:04.170701 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7a1315b8-93bb-417f-9109-2cd8e1199a53 req-26cf1286-b6df-4269-968c-225eac3d96a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063909 Oct 04 11:17:04.175541 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2595/3829] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:04.191356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:04.193216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:04.201153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.202148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.202989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.203913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.204738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.205594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.467557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:04.481962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:04.483557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:04.486359 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb166ed2-25ec-461b-89af-3898c6a5768e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1362 microversion: 2.26 time: 0.304938 Oct 04 11:17:04.490245 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2596/3830] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:04 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:04.494964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1e69f5c5-a939-4e9c-8618-ceb84b4d48e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:04.508320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e69f5c5-a939-4e9c-8618-ceb84b4d48e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.508873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e69f5c5-a939-4e9c-8618-ceb84b4d48e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.509472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e69f5c5-a939-4e9c-8618-ceb84b4d48e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.532754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1e69f5c5-a939-4e9c-8618-ceb84b4d48e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Going to try to stop instance {{(pid=122409) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:17:04.587788 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1e69f5c5-a939-4e9c-8618-ceb84b4d48e1 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c/action" status: 202 len: 0 microversion: 2.1 time: 0.096016 Oct 04 11:17:04.588874 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2597/3831] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:17:04 2022] POST /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:17:04.594892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-375ba113-e54c-4a46-b0dc-7866d32e9990 req-c4d456cc-ea50-4e16-a17a-4f71ad3c3ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fff8ac-6c00-4ea8-9b1d-f51ed53a7291", "tag": "4723b54d-eabd-495f-a610-bca5cdb48693"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:04.607276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-375ba113-e54c-4a46-b0dc-7866d32e9990 req-c4d456cc-ea50-4e16-a17a-4f71ad3c3ad4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.607987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-375ba113-e54c-4a46-b0dc-7866d32e9990 req-c4d456cc-ea50-4e16-a17a-4f71ad3c3ad4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.608583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-375ba113-e54c-4a46-b0dc-7866d32e9990 req-c4d456cc-ea50-4e16-a17a-4f71ad3c3ad4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.621795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-375ba113-e54c-4a46-b0dc-7866d32e9990 req-c4d456cc-ea50-4e16-a17a-4f71ad3c3ad4 service nova] Creating event network-changed:4723b54d-eabd-495f-a610-bca5cdb48693 for instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 on n-h2-791135-8 Oct 04 11:17:04.626870 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-375ba113-e54c-4a46-b0dc-7866d32e9990 req-c4d456cc-ea50-4e16-a17a-4f71ad3c3ad4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036623 Oct 04 11:17:04.627467 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2598/3832] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:04.632504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:04.633192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: c00c95a0-710b-4c4f-8082-c2e2a8d6c505] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:04.639967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.640453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.640883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.641598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.642056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.642477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.656576 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] HTTP exception thrown: Instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 could not be found. Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Request method failure captured: Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 HTTP/1.1 Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBV3qSsYFiJQApw4opLT25nyktuUSqt8KGmpv7xmCSjmK4-I8ABgvXzZSWdzBzWdVwg0o4eOenz5ur4mHgHJ8RT8zjFjmPdM6TFq75QJOPOPUHjtvwc9jWRHuzzi6TmkPsLBg6ENf0272RPmyYPLt9XMdX8mB1OM0BzfyZxZmyj7Lis Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52b172e7699d45d6b47f9bdc5a38203e"}]}] Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5d291ac2bcf94e3288c243542024c848 Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 could not be found. Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c00c95a0-710b-4c4f-8082-c2e2a8d6c505'} Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 could not be found. Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 could not be found. Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:04.658546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 could not be found. Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Returning 404 to user: Instance c00c95a0-710b-4c4f-8082-c2e2a8d6c505 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36538c1c-d0e1-4c0b-b551-ff55375b639e tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505" status: 404 len: 111 microversion: 2.1 time: 0.031482 Oct 04 11:17:04.664678 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2599/3833] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:04 2022] GET /compute/v2.1/servers/c00c95a0-710b-4c4f-8082-c2e2a8d6c505 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:17:04.670527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:04.671159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:04.680608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.681256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.681838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.682684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.683329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.684016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.711795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:17:04.731460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:04.790632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:04.800327 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1598883-a979-42a3-9ccc-0f117dc1507e tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 204 len: 0 microversion: 2.1 time: 0.137110 Oct 04 11:17:04.800930 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2600/3834] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:17:04 2022] DELETE /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:17:04.806549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:04.807243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:04.813235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.814679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.815064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.815757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.816210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.816633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.955076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:04.963828 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9d54f3a-cbd2-486b-8587-1e3f599bf2b7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.161748 Oct 04 11:17:04.964399 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2601/3835] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:04 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:04.968940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:04.969568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:04.975778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.976280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.976716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:04.977427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:04.977882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:04.978303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.117516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.126150 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18a93b78-ce2c-48fc-9eeb-284a670ede8d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.160599 Oct 04 11:17:05.136964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2602/3836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:04 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:05.136964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:05.136964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:05.138878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.139489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.139990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.140748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.141318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.141854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.156514 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] HTTP exception thrown: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Request method failure captured: Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb HTTP/1.1 Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBV3qSsYFiJQApw4opLT25nyktuUSqt8KGmpv7xmCSjmK4-I8ABgvXzZSWdzBzWdVwg0o4eOenz5ur4mHgHJ8RT8zjFjmPdM6TFq75QJOPOPUHjtvwc9jWRHuzzi6TmkPsLBg6ENf0272RPmyYPLt9XMdX8mB1OM0BzfyZxZmyj7Lis Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52b172e7699d45d6b47f9bdc5a38203e"}]}] Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5d291ac2bcf94e3288c243542024c848 Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2062e0cb-5c32-4913-8415-c060e6cfbefb'} Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:05.158578 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Returning 404 to user: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a60857fe-85e0-45ed-8112-c0d4860b69a8 tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 404 len: 111 microversion: 2.1 time: 0.032911 Oct 04 11:17:05.164369 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2603/3837] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:17:05 2022] DELETE /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:17:05.168022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:05.168624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:05.174465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.174944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.175375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.176147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.176509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.177059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.313761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.322483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e98347e5-40bc-451a-9d75-d7ff95f92795 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1667 microversion: 2.1 time: 0.157895 Oct 04 11:17:05.322978 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2604/3838] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:05 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:05.327521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:05.328113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:05.334928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.335407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.335834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.336569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.336956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.337398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.472126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.480923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.482382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.483550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c48869bd-94d0-401d-af12-17fea5ba8ea1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1722 microversion: 2.20 time: 0.159475 Oct 04 11:17:05.484102 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2605/3839] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:05 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:05.490160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:05.490160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:05.494614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.495088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.495515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.496192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.496635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.497053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.631254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.640520 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e11a7f8-1dd2-455b-84a8-4b8a89b5e23e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.155452 Oct 04 11:17:05.641094 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2606/3840] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:05 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:05.645946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:05.646554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:05.652333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.652814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.653248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.653969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.654423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.654844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.719601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.728389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.730242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.731542 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa29794d-7b94-41bf-b927-9ae6051a7304 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.089166 Oct 04 11:17:05.732106 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2607/3841] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:05 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:05.736483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:05.737092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 2062e0cb-5c32-4913-8415-c060e6cfbefb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:05.743642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.744141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.744581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.745299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.745772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.746204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.760297 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] HTTP exception thrown: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Request method failure captured: Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb HTTP/1.1 Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBV3qSsYFiJQApw4opLT25nyktuUSqt8KGmpv7xmCSjmK4-I8ABgvXzZSWdzBzWdVwg0o4eOenz5ur4mHgHJ8RT8zjFjmPdM6TFq75QJOPOPUHjtvwc9jWRHuzzi6TmkPsLBg6ENf0272RPmyYPLt9XMdX8mB1OM0BzfyZxZmyj7Lis Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52b172e7699d45d6b47f9bdc5a38203e"}]}] Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5d291ac2bcf94e3288c243542024c848 Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2062e0cb-5c32-4913-8415-c060e6cfbefb'} Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:05.761875 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Returning 404 to user: Instance 2062e0cb-5c32-4913-8415-c060e6cfbefb could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f403a3c3-9a8f-425b-999e-d78963ddb18f tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb" status: 404 len: 111 microversion: 2.1 time: 0.030321 Oct 04 11:17:05.767311 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2608/3842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:05 2022] GET /compute/v2.1/servers/2062e0cb-5c32-4913-8415-c060e6cfbefb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:17:05.771454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:05.772067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:05.777794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.778278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.778723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.779418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.779883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.780313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.918762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.927726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.929530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:05.930682 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c2b01a3d-f43f-44c9-872b-f34e5f5a8ad2 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1362 microversion: 2.26 time: 0.162876 Oct 04 11:17:05.931257 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2609/3843] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:05 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:05.935780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:05.936394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:05.942440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.942929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.943373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:05.944070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:05.944541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:05.944957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.075555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:06.084731 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e64dcda9-ec29-434c-9563-46253ce6613e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.152475 Oct 04 11:17:06.085311 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2610/3844] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:05 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:06.090073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:06.090745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:06.097819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.098512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.099637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.100493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.101105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.101713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.116404 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] HTTP exception thrown: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Request method failure captured: Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 HTTP/1.1 Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBV3qSsYFiJQApw4opLT25nyktuUSqt8KGmpv7xmCSjmK4-I8ABgvXzZSWdzBzWdVwg0o4eOenz5ur4mHgHJ8RT8zjFjmPdM6TFq75QJOPOPUHjtvwc9jWRHuzzi6TmkPsLBg6ENf0272RPmyYPLt9XMdX8mB1OM0BzfyZxZmyj7Lis Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52b172e7699d45d6b47f9bdc5a38203e"}]}] Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5d291ac2bcf94e3288c243542024c848 Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '26460e6f-e9a5-4ea4-b756-53ed860dfce5'} Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:06.118068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Returning 404 to user: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12a759b2-8bdf-4139-a697-f04e734528ca tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 404 len: 111 microversion: 2.1 time: 0.033020 Oct 04 11:17:06.123621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2611/3845] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:17:06 2022] DELETE /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:17:06.125116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:06.125630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:06.131608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.132088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.132518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.133209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.133684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.134106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.272593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:06.281329 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6cac3761-21a0-4b22-9221-0c3359ba1a29 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.160068 Oct 04 11:17:06.281943 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2612/3846] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:06 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:06.294232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:06.294232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] [instance: 26460e6f-e9a5-4ea4-b756-53ed860dfce5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:06.294232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.294232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.294751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.298147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.298147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.298147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.311588 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] HTTP exception thrown: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Request method failure captured: Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 HTTP/1.1 Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBV3qSsYFiJQApw4opLT25nyktuUSqt8KGmpv7xmCSjmK4-I8ABgvXzZSWdzBzWdVwg0o4eOenz5ur4mHgHJ8RT8zjFjmPdM6TFq75QJOPOPUHjtvwc9jWRHuzzi6TmkPsLBg6ENf0272RPmyYPLt9XMdX8mB1OM0BzfyZxZmyj7Lis Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/52b172e7699d45d6b47f9bdc5a38203e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/52b172e7699d45d6b47f9bdc5a38203e"}]}] Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 52b172e7699d45d6b47f9bdc5a38203e Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1386570851 Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 5d291ac2bcf94e3288c243542024c848 Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiskConfigTestJSON-1386570851-project Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '26460e6f-e9a5-4ea4-b756-53ed860dfce5'} Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:06.313118 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] Returning 404 to user: Instance 26460e6f-e9a5-4ea4-b756-53ed860dfce5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6baa1f9-a339-463c-9b2f-eddc40bf729a tempest-ServerDiskConfigTestJSON-1386570851 tempest-ServerDiskConfigTestJSON-1386570851-project] 10.222.0.23 "GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5" status: 404 len: 111 microversion: 2.1 time: 0.031673 Oct 04 11:17:06.318221 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2613/3847] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:06 2022] GET /compute/v2.1/servers/26460e6f-e9a5-4ea4-b756-53ed860dfce5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:17:06.320070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:06.320674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:06.326613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.327099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.327592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.328257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.328701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.329124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.481945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:06.490050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-708de6f8-8e5c-4531-9f35-39a7afc6d38e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.173741 Oct 04 11:17:06.490619 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2614/3848] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:06 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:06.495080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:06.495882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:06.502777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.503565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.504527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.505376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.506023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.506474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.640973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:06.649288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5cbeee03-8112-4b0e-8943-8724d2d0cad5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.157672 Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2615/3849] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:06 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.665555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.810065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:06.820113 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5178cade-eb2c-4122-8cc4-1485cb710615 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1667 microversion: 2.1 time: 0.168719 Oct 04 11:17:06.833199 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2616/3850] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:06 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1667 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:06.833199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:06.833199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:06.839120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.839586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.840016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.840712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:06.841163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:06.842240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:06.977137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:06.985517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:06.986945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:06.988098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-205e7d5b-9c61-48c9-bf81-817395e1c386 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1722 microversion: 2.20 time: 0.166451 Oct 04 11:17:06.988659 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2617/3851] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:06 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:06.993806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:06.994408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:07.001891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:07.002595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:07.003350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:07.004117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:07.004601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:07.005793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:07.187644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:07.220390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=30 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:07.307226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:07.310276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:07.320280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17945d4e-e069-41f0-ad65-0680e0bbbe34 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.330419 Oct 04 11:17:07.320899 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2618/3852] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:06 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:07.325803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:07.326668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:07.335235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:07.336077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:07.336640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:07.337375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:07.338022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:07.338456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:07.447602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:07.464760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:07.466451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:07.469559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5e7000a-0c45-4b28-a817-a50843eace5a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.147253 Oct 04 11:17:07.470348 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2619/3853] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:07 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:07.475874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:07.476737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:07.496911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:07.497687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:07.498292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:07.499443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:07.500066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:07.500677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:07.735886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:07.744667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:07.746424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:07.747747 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c42e310a-20de-4438-b881-cf2383ca7fc3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1362 microversion: 2.26 time: 0.275973 Oct 04 11:17:07.765728 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2620/3854] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:07 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:07.772645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:07.773486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:07.779930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:07.780420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:07.780857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:07.781578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:07.782277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:07.782641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:07.993909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:08.002311 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1767d35-6a51-400f-832d-80aece5e930d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.235184 Oct 04 11:17:08.018125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2621/3855] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:07 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:08.027261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:08.028305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:08.036725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:08.037211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:08.037924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:08.038634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:08.039091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:08.039516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:08.328334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:08.340716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b8dd3be-45e2-4e74-86f9-2a08eb5f6004 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1667 microversion: 2.1 time: 0.321368 Oct 04 11:17:08.341614 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2622/3856] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:08 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1667 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:08.351042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:08.351665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:08.358129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:08.358621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:08.359062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:08.359765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:08.360284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:08.360719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:08.731492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:08.744603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:08.746558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:08.756280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0b80673-ac8f-45a0-979a-a3f41c3cfdab tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1722 microversion: 2.20 time: 0.413223 Oct 04 11:17:08.771380 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2623/3857] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:08 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1722 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:08.786825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:08.787740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:08.796134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:08.796960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:08.797667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:08.798632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:08.799317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:08.799970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:08.927984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:08.938877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:08.940924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:08.966219 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4642bcb1-8f98-454b-96a2-d174cfdf952e tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.192437 Oct 04 11:17:08.969522 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2624/3858] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:08 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:08.981598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:08.982247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:08.995197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:08.995607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:08.996167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:08.997554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:08.997554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:08.998710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:09.166358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:09.178577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:09.179577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:09.180747 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b94ffa10-cc36-42b3-add3-44d1e867c2cd tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1362 microversion: 2.26 time: 0.209502 Oct 04 11:17:09.181933 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2625/3859] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:08 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:09.189270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:09.190146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:09.210046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:09.210629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:09.211113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:09.211853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:09.212316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:09.212748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:09.371089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:09.381826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d3701e44-1146-4b1c-902e-5a38d5b81d67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.198487 Oct 04 11:17:09.394015 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2626/3860] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:09 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:09.405472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:09.406089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:09.412420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:09.413141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:09.413797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:09.414795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:09.415429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:09.416066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:09.482628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:09.491201 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94706f13-f33c-46cd-aa04-c9c06d7b73ae tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1599 microversion: 2.1 time: 0.090126 Oct 04 11:17:09.505724 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2627/3861] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:09 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1599 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:09.790624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:09.791301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:09.805182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:09.805773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:09.806184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:09.806907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:09.807374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:09.813953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:09.981759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:09.993678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:09.995141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:09.996735 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c63b3633-53c4-41d3-a71e-644a098efef4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1722 microversion: 2.20 time: 0.213261 Oct 04 11:17:09.997309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2628/3862] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:09 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:10.002939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:10.003571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:10.010425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.011296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.011905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.012784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.013472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.014159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.084980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:10.094255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:10.096087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:10.097511 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb30b8f7-75a7-438f-802a-56666c9c7954 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.098894 Oct 04 11:17:10.099462 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2629/3863] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:09 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:10.210900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:10.211371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:10.218203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.218806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.219251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.219965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.220422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.220932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.378249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:10.390056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:10.391614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:10.392834 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb369b33-9d5b-4b37-95bb-b2f38637b63d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1362 microversion: 2.26 time: 0.188605 Oct 04 11:17:10.393971 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2630/3864] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:10 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:10.404590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-50bb10d1-0ffc-43bd-a2dd-9b864d50bb28 req-5d3e082d-a1c9-45ff-aae8-c98ac847ce1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9444c1a9-b95a-4973-a2d6-e12370497909", "name": "network-vif-deleted", "tag": "8fb4c923-b521-4de9-b13f-7a7861de1c64"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:10.430428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-50bb10d1-0ffc-43bd-a2dd-9b864d50bb28 req-5d3e082d-a1c9-45ff-aae8-c98ac847ce1b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.432069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-50bb10d1-0ffc-43bd-a2dd-9b864d50bb28 req-5d3e082d-a1c9-45ff-aae8-c98ac847ce1b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.436576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-50bb10d1-0ffc-43bd-a2dd-9b864d50bb28 req-5d3e082d-a1c9-45ff-aae8-c98ac847ce1b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.490656 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-50bb10d1-0ffc-43bd-a2dd-9b864d50bb28 req-5d3e082d-a1c9-45ff-aae8-c98ac847ce1b service nova] Creating event network-vif-deleted:8fb4c923-b521-4de9-b13f-7a7861de1c64 for instance 9444c1a9-b95a-4973-a2d6-e12370497909 on n-h2-791135-8 Oct 04 11:17:10.509644 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-50bb10d1-0ffc-43bd-a2dd-9b864d50bb28 req-5d3e082d-a1c9-45ff-aae8-c98ac847ce1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113023 Oct 04 11:17:10.509644 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2631/3865] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:10.523390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:10.526427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:10.536180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.536795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.537240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.546312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.546819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.553226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.806790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:10.816413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c3f45c2-52a5-400a-bceb-635a115fbec3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.302468 Oct 04 11:17:10.817048 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2632/3866] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:10 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:10.822491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:10.823385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:10.829676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.830410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.831043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.832293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.833609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.834243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.875807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:10.876543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:10.877597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:10.878252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lazy-loading 'fault' on Instance uuid 9444c1a9-b95a-4973-a2d6-e12370497909 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:10.930583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:10.940630 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa1f84d7-ec29-4920-8dcb-731e478f11fd tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 200 len: 1323 microversion: 2.1 time: 0.121304 Oct 04 11:17:10.942115 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2633/3867] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:10 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 1323 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:11.023475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:11.024271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:11.035223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.035483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.040294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:11.040294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.040294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.041826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:11.233008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.246407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.251887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.255335 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b29b2904-b001-4ac8-8b9a-29f3ee292c0e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1743 microversion: 2.20 time: 0.234085 Oct 04 11:17:11.256646 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2634/3868] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:11 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:11.262472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:11.263082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:11.269408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.269873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.270476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:11.272069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.272539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.272969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:11.401166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.416636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:11.428061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.438933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.440182 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09e17975-4720-419b-a958-319c03e99fed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.182407 Oct 04 11:17:11.441065 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2635/3869] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:11 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:11.449062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:11.449872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:11.469461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.478129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.478596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:11.479356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.479819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.480242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:11.665849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.673997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.675711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:11.676604 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b21d7496-5eaf-4d99-aa19-cab98d33a6ec tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1362 microversion: 2.26 time: 0.234510 Oct 04 11:17:11.677392 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2636/3870] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:11 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:11.718680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-10da07dc-f511-43f3-a0e9-7579e40ece56 req-0bde7ee3-4479-4bb4-ad6c-ac2c4fc3adef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fff8ac-6c00-4ea8-9b1d-f51ed53a7291", "name": "network-vif-plugged", "status": "completed", "tag": "4723b54d-eabd-495f-a610-bca5cdb48693"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:11.729232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-10da07dc-f511-43f3-a0e9-7579e40ece56 req-0bde7ee3-4479-4bb4-ad6c-ac2c4fc3adef service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.730074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-10da07dc-f511-43f3-a0e9-7579e40ece56 req-0bde7ee3-4479-4bb4-ad6c-ac2c4fc3adef service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.733912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-10da07dc-f511-43f3-a0e9-7579e40ece56 req-0bde7ee3-4479-4bb4-ad6c-ac2c4fc3adef service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:11.750516 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-10da07dc-f511-43f3-a0e9-7579e40ece56 req-0bde7ee3-4479-4bb4-ad6c-ac2c4fc3adef service nova] Creating event network-vif-plugged:4723b54d-eabd-495f-a610-bca5cdb48693 for instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 on n-h2-791135-8 Oct 04 11:17:11.756178 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-10da07dc-f511-43f3-a0e9-7579e40ece56 req-0bde7ee3-4479-4bb4-ad6c-ac2c4fc3adef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050881 Oct 04 11:17:11.757621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2637/3871] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:11.841320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:11.842888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:11.859088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.859725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.860276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:11.861725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:11.862303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:11.863284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:12.195737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:12.203756 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-931060ab-59ef-43eb-a7f8-9c9e3f44a3db tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.366818 Oct 04 11:17:12.213332 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2638/3872] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:11 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:17:12.220866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:12.221756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 9444c1a9-b95a-4973-a2d6-e12370497909] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:12.236904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:12.237861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:12.238477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:12.240712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:12.242283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:12.242886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:12.264648 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] HTTP exception thrown: Instance 9444c1a9-b95a-4973-a2d6-e12370497909 could not be found. Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Request method failure captured: Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 HTTP/1.1 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSLRgD-Dayvj7WdURpJ4ALy9X49eFCd_L5UxpxZ37ii6M2YNKH3GbEstNicGC69FVZm77fsBkMATZ-Qa8WL_6QqKz-moKDj5op8vNM36kkELHG8acEVbRLtMXjFzB_YmtCtIVAbn_-sKWhbojTrbKefndQ1EZi9rZYULBzVZLRic2Y Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d8213366237849c5bd0db518c55bc288 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveMigrationTest-548723689 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8213366237849c5bd0db518c55bc288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8213366237849c5bd0db518c55bc288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8213366237849c5bd0db518c55bc288"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8213366237849c5bd0db518c55bc288"}]}] Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveMigrationTest-548723689 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d8213366237849c5bd0db518c55bc288 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveMigrationTest-548723689 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveMigrationTest-548723689-project Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8f8c67a2ba884edbb978a166d91294d7 Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveMigrationTest-548723689-project Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 9444c1a9-b95a-4973-a2d6-e12370497909 could not be found. Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '9444c1a9-b95a-4973-a2d6-e12370497909'} Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9444c1a9-b95a-4973-a2d6-e12370497909 could not be found. Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9444c1a9-b95a-4973-a2d6-e12370497909 could not be found. Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:12.266668 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9444c1a9-b95a-4973-a2d6-e12370497909 could not be found. Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Returning 404 to user: Instance 9444c1a9-b95a-4973-a2d6-e12370497909 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c3956791-5c02-4722-8cfb-d78607c52d04 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909" status: 404 len: 111 microversion: 2.1 time: 0.053627 Oct 04 11:17:12.272153 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2639/3873] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:12 2022] GET /compute/v2.1/servers/9444c1a9-b95a-4973-a2d6-e12370497909 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:17:12.284017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7efdcea5-a991-42f6-b889-f861adef4deb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '.version_select at 0x7f71cf0dd4c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:12.314817 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7efdcea5-a991-42f6-b889-f861adef4deb tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82662962" status: 202 len: 0 microversion: 2.1 time: 0.040129 Oct 04 11:17:12.316119 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2640/3874] 10.222.0.23 () {58 vars in 1215 bytes} [Tue Oct 4 11:17:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82662962 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:17:12.322232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:12.322921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:12.331496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:12.332267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:12.334363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:12.335268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:12.335807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:12.336424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:12.783161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:12.817799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:12.823996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:12.825228 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc398759-b8bc-436c-9ab4-27ee1f74c3e6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.507997 Oct 04 11:17:12.836207 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2641/3875] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:12 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:12.850813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:12.851461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:12.866734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:12.867498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:12.868413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:12.868646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:12.873186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:12.885679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:13.077085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:13.089524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:13.091072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:13.092769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bdc7af5d-a9aa-41a7-aa21-a6c8b6d8c3f5 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.255273 Oct 04 11:17:13.109732 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2642/3876] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:12 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:13.115313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:13.115930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:13.130136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:13.131728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:13.132439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:13.134207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:13.135018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:13.135798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:13.508732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:13.520387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:13.528112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:13.531103 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a6279b51-29a0-4592-94c1-e7f95fad7bf4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1362 microversion: 2.26 time: 0.418609 Oct 04 11:17:13.533634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2643/3877] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:13 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:13.545022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:13.549887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:13.566760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:13.567063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:13.567435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:13.568188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:13.568703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:13.569081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:14.228653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:14.239247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc2cfcf1-8834-4a2b-ac99-11868dd62f4f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.704339 Oct 04 11:17:14.239841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2644/3878] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:13 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:14.248150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:14.249154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:14.256173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:14.256725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:14.257071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:14.257974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:14.258610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:14.259206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:14.289779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:17:14.421046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=98,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:14.430205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37c7cb4e-d9da-40cb-ad0d-84e03a732694 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 204 len: 0 microversion: 2.1 time: 0.188638 Oct 04 11:17:14.433980 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2645/3879] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:17:14 2022] DELETE /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:17:14.438719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-690a0811-2f32-482a-856e-d007a14d9bba req-accb2912-77af-4787-93f1-8606cda3c78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6e745e-9cfe-4562-a91f-7fa25f3ad109", "name": "network-vif-plugged", "status": "completed", "tag": "8a5bddce-130d-4805-99d6-8f5074eab124"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:14.451071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-690a0811-2f32-482a-856e-d007a14d9bba req-accb2912-77af-4787-93f1-8606cda3c78c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:14.451544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-690a0811-2f32-482a-856e-d007a14d9bba req-accb2912-77af-4787-93f1-8606cda3c78c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:14.451977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-690a0811-2f32-482a-856e-d007a14d9bba req-accb2912-77af-4787-93f1-8606cda3c78c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:14.493415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-690a0811-2f32-482a-856e-d007a14d9bba req-accb2912-77af-4787-93f1-8606cda3c78c service nova] Creating event network-vif-plugged:8a5bddce-130d-4805-99d6-8f5074eab124 for instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 on n-h1-791135-8 Oct 04 11:17:14.510003 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-690a0811-2f32-482a-856e-d007a14d9bba req-accb2912-77af-4787-93f1-8606cda3c78c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076170 Oct 04 11:17:14.523980 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2646/3880] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:14.549173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:14.554478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:14.569263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:14.569814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:14.570255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:14.570966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:14.571423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:14.571988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:14.795397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:14.808768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:14.814668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:14.816601 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec903d58-505a-4591-816c-7efc55fcb66c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.289882 Oct 04 11:17:14.830254 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2647/3881] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:14 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:14.842172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:14.846139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:14.853539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:14.854285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:14.855821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:14.857482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:14.858146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:14.858773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:14.966308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:14.977136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:14.979549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:14.981332 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-653406f4-9a60-40a2-9721-fb316b0950ed tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.149730 Oct 04 11:17:14.998736 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2648/3882] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:14 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:15.012587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:15.013219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:15.038107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:15.039148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:15.042291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:15.043071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:15.043542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:15.043980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:15.300271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:15.311351 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-416e0131-ccd0-43b1-98ca-69d69bfc5680 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1486 microversion: 2.1 time: 0.311459 Oct 04 11:17:15.323067 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2649/3883] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:14 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1486 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:15.323067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:15.323067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:15.325535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:15.326039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:15.326478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:15.327767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:15.328233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:15.328859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:15.671058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:15.683399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:15.685260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:15.686459 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a149ea6c-ba6f-4e0f-a07d-28ddc03892ed tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1544 microversion: 2.26 time: 0.373518 Oct 04 11:17:15.710954 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2650/3884] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:15 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1544 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:15.722059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:15.722696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:15.739845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:15.740366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:15.740693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:15.742767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:15.743361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:15.743812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.132706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:16.143679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7687ceb3-36e9-46b1-946f-39b7887bebfa tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.431367 Oct 04 11:17:16.144287 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2651/3885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:15 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:16.153177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf0c2a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:16.166444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.169231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.170335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.171693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:16.179792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.180651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.181910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.182956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.183678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.185051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.221081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.222523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.223255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.238417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.239877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.240555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.254427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:16.284936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:16.306944 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac51242c-7592-4004-bac5-aef8635aac20 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-1420164369" status: 201 len: 0 microversion: 2.26 time: 0.159337 Oct 04 11:17:16.308655 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2652/3886] 10.222.0.23 () {62 vars in 1380 bytes} [Tue Oct 4 11:17:16 2022] PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-1420164369 => generated 0 bytes in 164 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 11:17:16.315857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:16.316688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:16.328593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.329381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.329851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.330752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.331296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.331910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.674683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:16.684834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:16.689374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:16.693826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-86c9ed42-259d-4041-9fc8-be0e67565f4d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.383811 Oct 04 11:17:16.715902 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2653/3887] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:16 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:16.720985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:16.721681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:16.734195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.734662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.735094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.736177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.736312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.736648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.872685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:16.882398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:16.884369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:16.885800 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-caf7611d-8a0c-4922-9ef6-6fa91d4d056d tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.168620 Oct 04 11:17:16.886651 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2654/3888] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:16 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:16.894854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34e6f8d9-0829-4074-a545-424b444defc0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf088160>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:16.904563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34e6f8d9-0829-4074-a545-424b444defc0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.905336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34e6f8d9-0829-4074-a545-424b444defc0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.906065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34e6f8d9-0829-4074-a545-424b444defc0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.919590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34e6f8d9-0829-4074-a545-424b444defc0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-1420164369" status: 204 len: 0 microversion: 2.26 time: 0.028635 Oct 04 11:17:16.924047 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2655/3889] 10.222.0.23 () {60 vars in 1361 bytes} [Tue Oct 4 11:17:16 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-1420164369 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:16.929657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:16.930547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:16.949055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.949706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.950266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.951065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.951646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.952181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.991944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:16.992534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:16.993050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:16.993730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lazy-loading 'fault' on Instance uuid 36e87860-71dc-4a7f-960f-6e847fb70876 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:17.080348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:17.090699 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2fe7c702-2804-471d-81d1-4bb5e85743d8 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 200 len: 1301 microversion: 2.1 time: 0.165244 Oct 04 11:17:17.094028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2656/3890] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:16 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 1301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:17.114522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-32e15c06-0aa4-41ef-beed-b01762ada52a req-5b5e0715-65be-4f2b-b104-85ba4bf8edf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e87860-71dc-4a7f-960f-6e847fb70876", "name": "network-vif-deleted", "tag": "dfb592c5-f413-48a2-a005-bbba21115474"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:17.171657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-32e15c06-0aa4-41ef-beed-b01762ada52a req-5b5e0715-65be-4f2b-b104-85ba4bf8edf5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:17.174338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-32e15c06-0aa4-41ef-beed-b01762ada52a req-5b5e0715-65be-4f2b-b104-85ba4bf8edf5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:17.177515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-32e15c06-0aa4-41ef-beed-b01762ada52a req-5b5e0715-65be-4f2b-b104-85ba4bf8edf5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:17.237276 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-32e15c06-0aa4-41ef-beed-b01762ada52a req-5b5e0715-65be-4f2b-b104-85ba4bf8edf5 service nova] Creating event network-vif-deleted:dfb592c5-f413-48a2-a005-bbba21115474 for instance 36e87860-71dc-4a7f-960f-6e847fb70876 on n-h2-791135-8 Oct 04 11:17:17.258918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-32e15c06-0aa4-41ef-beed-b01762ada52a req-5b5e0715-65be-4f2b-b104-85ba4bf8edf5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162564 Oct 04 11:17:17.266712 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2657/3891] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:17.284771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf0c2a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:17.315569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:17.316250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:17.316746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:17.320474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:17.352621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:17.353498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:17.356266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:17.361251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:17.362078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:17.362740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:17.482623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:17.492683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:17.493556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:17.540126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:17.618257 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61e4b15f-028b-4f07-a2ae-3db5a6ea4a41 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 204 len: 0 microversion: 2.26 time: 0.344750 Oct 04 11:17:17.628220 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2658/3892] 10.222.0.23 () {60 vars in 1295 bytes} [Tue Oct 4 11:17:17 2022] DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:17.638926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:17.642081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:17.655292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:17.655788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:17.660371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:17.666757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:17.668195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:17.668756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:17.957619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:17.974203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1339e77-f823-44c0-834c-26dff49b12e2 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.338720 Oct 04 11:17:17.975971 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2659/3893] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:17 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:17.985789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64c1ee98-3891-41e7-943f-570d45f93760 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf088550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:17.999519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64c1ee98-3891-41e7-943f-570d45f93760 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.000040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64c1ee98-3891-41e7-943f-570d45f93760 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.007740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64c1ee98-3891-41e7-943f-570d45f93760 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.034002 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64c1ee98-3891-41e7-943f-570d45f93760 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 200 len: 12 microversion: 2.26 time: 0.056863 Oct 04 11:17:18.035436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2660/3894] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 11:17:17 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:18.053480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:18.053480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:18.062766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.062766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.062766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.068108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.068662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.069115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.422379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:18.432998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:18.437545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:18.442991 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f7b9841-d9b4-464a-9e56-7c2a27c365a0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.406013 Oct 04 11:17:18.446515 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2661/3895] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:18 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:18.474382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:18.479691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:18.495326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.499461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.500066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.500942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.512429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.512991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.654868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:18.668156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:18.680708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:18.683983 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b80da6f-c561-4989-88c3-4ae43d180454 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.212706 Oct 04 11:17:18.685280 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2662/3896] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:18 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:18.692613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf042c10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:18.717046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.722548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.724259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.724876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:18.739318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.740347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.741016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.744742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.745498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.746159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.798826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.799769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.800535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.819882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.820674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.821545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.870964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:18.914300 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b789c80-cc9e-42ee-a2ed-e103e99fb807 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-224397891" status: 201 len: 0 microversion: 2.26 time: 0.227588 Oct 04 11:17:18.915685 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2663/3897] 10.222.0.23 () {62 vars in 1377 bytes} [Tue Oct 4 11:17:18 2022] PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-224397891 => generated 0 bytes in 230 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 11:17:18.925367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:18.927121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: 36e87860-71dc-4a7f-960f-6e847fb70876] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:18.934442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.935329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.935998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.936892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:18.937763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:18.942260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:18.965104 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] HTTP exception thrown: Instance 36e87860-71dc-4a7f-960f-6e847fb70876 could not be found. Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Request method failure captured: Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 HTTP/1.1 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSLRgD-Dayvj7WdURpJ4ALy9X49eFCd_L5UxpxZ37ii6M2YNKH3GbEstNicGC69FVZm77fsBkMATZ-Qa8WL_6QqKz-moKDj5op8vNM36kkELHG8acEVbRLtMXjFzB_YmtCtIVAbn_-sKWhbojTrbKefndQ1EZi9rZYULBzVZLRic2Y Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d8213366237849c5bd0db518c55bc288 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveMigrationTest-548723689 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8213366237849c5bd0db518c55bc288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8213366237849c5bd0db518c55bc288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8213366237849c5bd0db518c55bc288"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8213366237849c5bd0db518c55bc288"}]}] Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveMigrationTest-548723689 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d8213366237849c5bd0db518c55bc288 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveMigrationTest-548723689 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveMigrationTest-548723689-project Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8f8c67a2ba884edbb978a166d91294d7 Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveMigrationTest-548723689-project Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 36e87860-71dc-4a7f-960f-6e847fb70876 could not be found. Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '36e87860-71dc-4a7f-960f-6e847fb70876'} Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e87860-71dc-4a7f-960f-6e847fb70876 could not be found. Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e87860-71dc-4a7f-960f-6e847fb70876 could not be found. Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:18.971213 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:18.976843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:18.976843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:18.976843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:18.976843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:18.976843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:18.976843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e87860-71dc-4a7f-960f-6e847fb70876 could not be found. Oct 04 11:17:18.976843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:18.987756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Returning 404 to user: Instance 36e87860-71dc-4a7f-960f-6e847fb70876 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:18.990367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a02ce24-e27a-433b-ae1d-a21f24d9bcf4 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876" status: 404 len: 111 microversion: 2.1 time: 0.072170 Oct 04 11:17:18.994113 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2664/3898] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:18 2022] GET /compute/v2.1/servers/36e87860-71dc-4a7f-960f-6e847fb70876 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:17:19.002499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b385414f-6be5-4a9b-a749-70843bc6681a tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf088ca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:19.026021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b385414f-6be5-4a9b-a749-70843bc6681a tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.026914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b385414f-6be5-4a9b-a749-70843bc6681a tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.027581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b385414f-6be5-4a9b-a749-70843bc6681a tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.048049 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b385414f-6be5-4a9b-a749-70843bc6681a tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 200 len: 35 microversion: 2.26 time: 0.052595 Oct 04 11:17:19.049631 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2665/3899] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 11:17:18 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 35 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:19.059831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:19.061933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:19.072481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.075061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.075763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.080083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.080813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.081523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.137621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:17:19.294445 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01d5125e-284b-4283-893a-767fa873ae21 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 204 len: 0 microversion: 2.1 time: 0.242964 Oct 04 11:17:19.295346 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2666/3900] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:17:19 2022] DELETE /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:17:19.306870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:19.308993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:19.322334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.323977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.326828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.327661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.331221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.334421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.341024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:RELEASE=2,nova_cell1:SELECT=93,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:19.628881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:19.648557 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-df35df73-5e3c-414a-8e06-7274dbcfd18f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.352001 Oct 04 11:17:19.651404 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2667/3901] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:19 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:19.672560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf0a8550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:19.689457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.690116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.690679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.691260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:19.697861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.698474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.699068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.699863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.700422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.701138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.749677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.750256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.750718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.811764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:19.875996 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81c4215b-e9ef-4818-9bee-df7bbe31a0a3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-224397891" status: 204 len: 0 microversion: 2.26 time: 0.221532 Oct 04 11:17:19.876629 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2668/3902] 10.222.0.23 () {60 vars in 1361 bytes} [Tue Oct 4 11:17:19 2022] DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-224397891 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:19.893842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:19.894475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:19.927164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.927693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.928142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:19.928861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:19.929319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:19.941244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:20.395346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8c67a2ba884edbb978a166d91294d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8213366237849c5bd0db518c55bc288', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:20.404050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5976694d-c2dd-4a47-af73-70174a8ea794 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 200 len: 1500 microversion: 2.1 time: 0.522415 Oct 04 11:17:20.412236 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2669/3903] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:19 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 1500 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:20.418312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:20.419773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:20.434869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:20.435735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:20.436483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:20.437518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:20.438223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:20.438884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:21.013432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:21.028327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:21.042747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:21.052407 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00966316-2408-4b3b-b0b5-82f68d25ef51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.638528 Oct 04 11:17:21.066281 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2670/3904] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:20 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:21.078526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:21.079075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:21.085661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:21.087385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:21.087385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:21.088091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:21.088716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:21.089313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:21.360330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:21.374801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:21.380380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:21.382288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37928900-23df-4964-8806-644573316c30 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1408 microversion: 2.54 time: 0.314244 Oct 04 11:17:21.425521 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2671/3905] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:21 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:21.460682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d2347bbb-d9ea-42a0-a8db-bf59ace8c76e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf0548b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:21.526282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2347bbb-d9ea-42a0-a8db-bf59ace8c76e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:21.530322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2347bbb-d9ea-42a0-a8db-bf59ace8c76e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:21.538950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2347bbb-d9ea-42a0-a8db-bf59ace8c76e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:21.577988 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d2347bbb-d9ea-42a0-a8db-bf59ace8c76e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 200 len: 12 microversion: 2.26 time: 0.150635 Oct 04 11:17:21.585316 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2672/3906] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 11:17:21 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 12 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:21.591530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:21.595043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:21.607380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:21.609065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:21.610248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:21.612655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:21.618155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:21.620243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.533920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:22.546792 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b56463ff-3a16-41f2-9702-ae28e621cf6f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.964433 Oct 04 11:17:22.558311 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2673/3907] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:21 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:22.572394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5272f79f-1990-4590-8e80-e87bf527427e req-ccadc318-4a85-45be-8fe2-65a27578be41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce89cc9a-b946-425d-9da9-1df8bc6fbe14", "name": "network-vif-deleted", "tag": "c14ec83b-22fc-4601-b016-91807e8a04cb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:22.585681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5272f79f-1990-4590-8e80-e87bf527427e req-ccadc318-4a85-45be-8fe2-65a27578be41 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.586467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5272f79f-1990-4590-8e80-e87bf527427e req-ccadc318-4a85-45be-8fe2-65a27578be41 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.587085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5272f79f-1990-4590-8e80-e87bf527427e req-ccadc318-4a85-45be-8fe2-65a27578be41 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.600589 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5272f79f-1990-4590-8e80-e87bf527427e req-ccadc318-4a85-45be-8fe2-65a27578be41 service nova] Creating event network-vif-deleted:c14ec83b-22fc-4601-b016-91807e8a04cb for instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 on n-h1-791135-8 Oct 04 11:17:22.606209 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5272f79f-1990-4590-8e80-e87bf527427e req-ccadc318-4a85-45be-8fe2-65a27578be41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046393 Oct 04 11:17:22.609178 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2674/3908] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:22.617467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:22.618446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] [instance: ce89cc9a-b946-425d-9da9-1df8bc6fbe14] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:22.626073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.626849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.627355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.628128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.628653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.630195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.647905 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] HTTP exception thrown: Instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 could not be found. Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Request method failure captured: Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 HTTP/1.1 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBSLRgD-Dayvj7WdURpJ4ALy9X49eFCd_L5UxpxZ37ii6M2YNKH3GbEstNicGC69FVZm77fsBkMATZ-Qa8WL_6QqKz-moKDj5op8vNM36kkELHG8acEVbRLtMXjFzB_YmtCtIVAbn_-sKWhbojTrbKefndQ1EZi9rZYULBzVZLRic2Y Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d8213366237849c5bd0db518c55bc288 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-LiveMigrationTest-548723689 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8213366237849c5bd0db518c55bc288"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8213366237849c5bd0db518c55bc288"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8213366237849c5bd0db518c55bc288"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8213366237849c5bd0db518c55bc288"}]}] Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-LiveMigrationTest-548723689 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d8213366237849c5bd0db518c55bc288 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-LiveMigrationTest-548723689 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-LiveMigrationTest-548723689-project Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8f8c67a2ba884edbb978a166d91294d7 Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-LiveMigrationTest-548723689-project Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 could not be found. Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'ce89cc9a-b946-425d-9da9-1df8bc6fbe14'} Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 could not be found. Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 could not be found. Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:22.650137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 could not be found. Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] Returning 404 to user: Instance ce89cc9a-b946-425d-9da9-1df8bc6fbe14 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-994a9809-23d4-46a6-a9e7-33316fd3a0f7 tempest-LiveMigrationTest-548723689 tempest-LiveMigrationTest-548723689-project] 10.222.0.23 "GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14" status: 404 len: 111 microversion: 2.1 time: 0.040770 Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2675/3909] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:22 2022] GET /compute/v2.1/servers/ce89cc9a-b946-425d-9da9-1df8bc6fbe14 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:17:22.657621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf088f70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:22.665297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.665814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.666255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.666735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:22.672933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.673452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.673957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.675027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.675142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.675572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.705898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.706512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.706849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.726263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:22.758137 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-181f4c0d-6944-44e0-a532-bfb50e1a760e tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 204 len: 0 microversion: 2.26 time: 0.104868 Oct 04 11:17:22.762949 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2676/3910] 10.222.0.23 () {60 vars in 1295 bytes} [Tue Oct 4 11:17:22 2022] DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:22.768875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:22.769468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:22.779862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.780369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.780818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:22.781562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:22.782025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:22.782460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.333238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:23.350763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:23.354050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:23.356376 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-652d86d2-b4cc-426d-887f-73b1e31fdd94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.596660 Oct 04 11:17:23.357614 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2677/3911] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:22 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:23.385698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:23.387080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:23.394475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.396570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.397261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.398680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.399412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.400291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.586497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:23.595032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:23.602431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:23.603839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-395ca744-df87-4694-9ae8-3d6b21488932 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1414 microversion: 2.54 time: 0.227214 Oct 04 11:17:23.625377 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2678/3912] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:23 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1414 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:23.625377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf088dc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:23.641880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.646386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.646865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.647345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:23.661414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.661915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.662359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.663228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.663698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.664124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.721452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.721996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.722445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.744725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.745215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.745881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.801998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cdc785d5-06d1-4cd4-9eda-d4b3b608efca tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-431316551" status: 201 len: 0 microversion: 2.26 time: 0.228229 Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2679/3913] 10.222.0.23 () {62 vars in 1377 bytes} [Tue Oct 4 11:17:23 2022] PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-431316551 => generated 0 bytes in 235 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:23.865229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:24.199358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:24.210517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71104fb5-da1e-4e95-9685-93712ed0b6d6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.364539 Oct 04 11:17:24.218408 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2680/3914] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:23 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:24.224035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf069280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:24.246394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:24.249939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:24.253454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:24.254761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:24.269288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:24.270516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:24.271105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:24.271982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:24.274402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:24.274992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:24.337828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:24.340468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:24.349825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:24.372427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:24.379256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:24.379916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:24.389381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:24.428503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:24.447246 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f144435-ecc8-48e6-9e38-db761596fbe0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-890666933" status: 201 len: 0 microversion: 2.26 time: 0.227706 Oct 04 11:17:24.457883 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2681/3915] 10.222.0.23 () {62 vars in 1377 bytes} [Tue Oct 4 11:17:24 2022] PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-890666933 => generated 0 bytes in 238 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 11:17:24.464671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:24.465825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:24.495068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:24.505738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:24.506887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:24.510384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:24.513819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:24.515008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:24.904326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:24.931365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:24.938118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:24.940445 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7077592-cf9a-4c7b-a593-454a1835c0a4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.481001 Oct 04 11:17:24.967250 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2682/3916] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:24 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:24.979867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf0a8940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:25.017979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=98 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:25.031954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.038473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.039071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:25.039737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:25.055042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.056372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.063267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:25.064243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.064918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.065581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:25.112679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.118030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.118788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:25.173194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:25.206016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f52760f8-fae7-4c36-aa9f-8379128df482 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 204 len: 0 microversion: 2.26 time: 0.236961 Oct 04 11:17:25.212824 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2683/3917] 10.222.0.23 () {60 vars in 1295 bytes} [Tue Oct 4 11:17:24 2022] DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:25.225810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:25.227717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:25.244705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.249339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.250068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:25.252415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.253113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.259991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:25.469706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:25.481562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:25.484337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:25.486078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0a6a668c-e3d5-464d-8e26-5998d4e0a624 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1414 microversion: 2.54 time: 0.271906 Oct 04 11:17:25.509437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2684/3918] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:25 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1414 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:25.528946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf34d925-30ea-4681-95df-8c1eacac75d4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf0548b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:25.566601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf34d925-30ea-4681-95df-8c1eacac75d4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.567216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf34d925-30ea-4681-95df-8c1eacac75d4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.568388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf34d925-30ea-4681-95df-8c1eacac75d4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:25.600986 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf34d925-30ea-4681-95df-8c1eacac75d4 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 200 len: 12 microversion: 2.26 time: 0.084879 Oct 04 11:17:25.603218 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2685/3919] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 11:17:25 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 12 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:25.614125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:25.619365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:25.631657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.642508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.643115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:25.644082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:25.644861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:25.645461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:26.267369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:26.280297 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71a60803-5863-4839-893f-bed1074acb3a tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.674147 Oct 04 11:17:26.282232 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2686/3920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:25 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:26.288170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf0c2160>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:26.297112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:26.297867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:26.298458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:26.299252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:26.314830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:26.315476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:26.316133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:26.317438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:26.318031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:26.318592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:26.419785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:26.420479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:26.421055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:26.452723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:26.503877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0426716a-684d-432a-83cd-99051564a2ea tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 204 len: 0 microversion: 2.26 time: 0.220080 Oct 04 11:17:26.512121 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2687/3921] 10.222.0.23 () {60 vars in 1295 bytes} [Tue Oct 4 11:17:26 2022] DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:26.519315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:26.520618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:26.546061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:26.553129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:26.553858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:26.555290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:26.577249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:26.577943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.164715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:27.182519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:27.184192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:27.185620 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ab6c320-f4b2-4617-aa4c-caa9aa24f532 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.672446 Oct 04 11:17:27.186342 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2688/3922] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:26 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:27.194498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:27.195260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:27.203372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.204210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.204786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.205705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.206342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.206900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.513084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:27.522290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:27.527320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:27.530558 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5bb648d5-b9c5-4913-a7bd-ff70eabfef7b tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1399 microversion: 2.54 time: 0.342825 Oct 04 11:17:27.574764 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2689/3923] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:27 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1399 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:27.579840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf097b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:27.596434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.598754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.599301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.599880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:27.613679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.614398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.615656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.616533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.617907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.619104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.659411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.660094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.661264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.673645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.674297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.675360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.731003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:27.753475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-47278400-15d4-4130-81f6-5f277b236561 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-1857170098" status: 201 len: 0 microversion: 2.26 time: 0.177456 Oct 04 11:17:27.755294 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2690/3924] 10.222.0.23 () {62 vars in 1380 bytes} [Tue Oct 4 11:17:27 2022] PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-1857170098 => generated 0 bytes in 180 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 11:17:27.774347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:27.785549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:27.796134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.797110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.797749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:27.798601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:27.799391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:27.799960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:28.243795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:28.252776 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-831f4bb0-db95-4243-b135-963e125295eb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1512 microversion: 2.1 time: 0.492908 Oct 04 11:17:28.269702 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2691/3925] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:27 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:28.269702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a674e686-2fc9-4035-a3a1-55fb20cc1204 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '.version_select at 0x7f71cf054af0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:28.306223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a674e686-2fc9-4035-a3a1-55fb20cc1204 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-532134357" status: 204 len: 0 microversion: 2.54 time: 0.050703 Oct 04 11:17:28.310260 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2692/3926] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Oct 4 11:17:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-532134357 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:28.323273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf0889d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:28.344842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:28.350145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:28.350557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:28.350937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:28.370158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:28.370158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:28.370158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:28.370158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:28.370744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:28.372912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:28.444984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:28.447527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:28.448127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:28.459345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:28.459839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:28.460272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:28.503982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:28.509389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:28.524137 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa0817a9-6956-4134-bbfd-85c502a56e0d tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-1386447511" status: 201 len: 0 microversion: 2.26 time: 0.212528 Oct 04 11:17:28.530849 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2693/3927] 10.222.0.23 () {62 vars in 1380 bytes} [Tue Oct 4 11:17:28 2022] PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags/tempest-tag-1386447511 => generated 0 bytes in 220 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 11:17:28.537437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:28.538102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:28.566756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:28.567416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:28.567789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:28.568501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:28.569381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:28.569514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:28.926859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:28.965151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:28.968634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:28.976637 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8848582-3061-4b7d-b2d4-6e50e3ca293e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.444683 Oct 04 11:17:28.987813 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2694/3928] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:28 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:29.011232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:29.013968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:29.036081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:29.038552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:29.039000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:29.042140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:29.042608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:29.043142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:29.124946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:17:29.411096 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a93e473-84f8-4ed0-828f-c45d51291e9a tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "DELETE /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 204 len: 0 microversion: 2.54 time: 0.421011 Oct 04 11:17:29.412441 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2695/3929] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:17:28 2022] DELETE /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:29.419664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Action: 'update_all', calling method: .version_select at 0x7f71cf0540d0>, body: {"tags": ["tempest-tag-1515154221", "tempest-tag-194805201"]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:29.456672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:29.463716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:29.467444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:29.468495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:29.534273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:29.540478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:29.541023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:29.546318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:29.546318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:29.546318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:29.638186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:29.638676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:29.639110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:29.708152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:29.751641 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-917563f6-a10c-4f48-9346-48862e9d4af5 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 200 len: 61 microversion: 2.26 time: 0.337553 Oct 04 11:17:29.753829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2696/3930] 10.222.0.23 () {62 vars in 1312 bytes} [Tue Oct 4 11:17:29 2022] PUT /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 61 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:30.125769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1520478285", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:30.244607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] validate_networks() for [('bc8862a0-d086-4424-bebe-a8d7874e2d0c', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:17:30.426250 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:17:30.426955 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:17:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:17:31.384031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:17:31.385236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:17:31.385899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:17:31.386357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:17:31.387060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:17:31.418715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:31.425181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:31.426634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:31.429031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:31.429544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:31.429991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:31.500317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Getting quotas for project 0313e8ab904049c58fd4c9d9a7adf40a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:17:31.510740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Getting quotas for user d5c346b48e674ad48fa6fd6aa2634361 and project 0313e8ab904049c58fd4c9d9a7adf40a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:17:31.527662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:17:31.530984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:17:31.622337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-098cd1cf-3a76-453e-b090-7ff8420919ca tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.866596 Oct 04 11:17:31.624118 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2697/3931] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:17:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:17:31.636427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:31.637053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:31.666566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:31.667075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:31.667514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:31.668315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:31.668682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:31.669107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:32.088118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:32.100363 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3092e989-ae38-4f38-884f-9d0541d5bc23 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1489 microversion: 2.1 time: 0.474817 Oct 04 11:17:32.121706 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2698/3932] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:31 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1489 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:32.129712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:32.130574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:32.138252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:32.138954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:32.139697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:32.140608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:32.141408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:32.142004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:32.287040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:32.305866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:32.308379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad17d67f008497baa2f0b8724541c99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6e290643bf4f34aaf1f6e1d2c6e88d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:32.312809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd70f210-2f0f-4656-bc37-175c0b0b86c9 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 200 len: 1405 microversion: 2.54 time: 0.188425 Oct 04 11:17:32.314771 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2699/3933] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:32 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:32.325725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de447589-68ad-4d7a-83bb-d4383d9e3bd0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf027f70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:32.344545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de447589-68ad-4d7a-83bb-d4383d9e3bd0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:32.346008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de447589-68ad-4d7a-83bb-d4383d9e3bd0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:32.348916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de447589-68ad-4d7a-83bb-d4383d9e3bd0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:32.369220 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de447589-68ad-4d7a-83bb-d4383d9e3bd0 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 200 len: 61 microversion: 2.26 time: 0.053169 Oct 04 11:17:32.385925 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2700/3934] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Oct 4 11:17:32 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 61 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:32.411885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:32.417172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:32.434514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:32.436004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:32.436873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:32.438087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:32.438875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:32.439449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:32.641774 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba667bc3-046c-4611-bef0-5b99926eceb0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.249990 Oct 04 11:17:32.643960 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2701/3935] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:17:32 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:17:32.657232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:32.658015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:32.670900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:32.671405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:32.671990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:32.673936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:32.674450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:32.675187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.114287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:33.138725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:33.140239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:33.146929 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb776909-34eb-4645-b2ff-e689d47627e1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.498440 Oct 04 11:17:33.156706 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2702/3936] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:32 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:33.166369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:33.166986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:33.179238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.179763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.180171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.180921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.183242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.183899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.291062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:33.303859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45c15aba-cdb4-4171-b553-03b65af3608b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1218 microversion: 2.1 time: 0.145897 Oct 04 11:17:33.304531 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2703/3937] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:33 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:33.325675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:33.326180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:33.336790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.337281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.337748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.338464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.338914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.339336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.435168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:17:33.602815 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51f7db0a-9325-40a6-9a91-1a1921473deb tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 204 len: 0 microversion: 2.1 time: 0.296874 Oct 04 11:17:33.603674 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2704/3938] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:17:33 2022] DELETE /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:17:33.609821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '.version_select at 0x7f71cf042d30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:33.629698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.630391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.630883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.631605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:33.649879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.650388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.650833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.652487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.652957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.653403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.704146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.704639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.705068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.735539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lazy-loading 'flavor' on Instance uuid 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:33.759628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=4,nova_cell1:DELETE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:33.782898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd1e0504-c858-4cf7-afae-302f17652f18 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags" status: 204 len: 0 microversion: 2.26 time: 0.177541 Oct 04 11:17:33.783529 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2705/3939] 10.222.0.23 () {60 vars in 1295 bytes} [Tue Oct 4 11:17:33 2022] DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291/tags => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:33.807464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:33.808115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:33.819389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.819882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.820318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:33.825132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:33.825647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:33.826087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:34.004336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:34.031279 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-185c5f84-dd17-4a0c-98f0-328f65d45080 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1673 microversion: 2.1 time: 0.233950 Oct 04 11:17:34.032858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2706/3940] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:33 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1673 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:34.047473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:34.054566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] [instance: 508727fe-1429-45a5-808d-a21f849fa965] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:34.081803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:34.084151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:34.088133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:34.089082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:34.089838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:34.090528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:34.117244 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] HTTP exception thrown: Instance 508727fe-1429-45a5-808d-a21f849fa965 could not be found. Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Request method failure captured: Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 HTTP/1.1 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBYWpOYw48QAsI-oQ8y9EszjYVm7Fwvv2j9_xEUc9OaDFKoO2tHgMg7PasZtUF_tZd8ww0_LH8IAbBS8wpX8Axbu0wA2F6_XQuAYw4OY02Dt_SWHPsBDNRCjuMVWsvWEsfToAXQsMMzL2FxDLpGVIiUwEmQ88li9FRXbiT_8DE7C97Q Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ae6e290643bf4f34aaf1f6e1d2c6e88d Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerShowV254Test-1771943126 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ae6e290643bf4f34aaf1f6e1d2c6e88d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ae6e290643bf4f34aaf1f6e1d2c6e88d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ae6e290643bf4f34aaf1f6e1d2c6e88d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ae6e290643bf4f34aaf1f6e1d2c6e88d"}]}] Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerShowV254Test-1771943126 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ae6e290643bf4f34aaf1f6e1d2c6e88d Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerShowV254Test-1771943126 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerShowV254Test-1771943126-project Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ad17d67f008497baa2f0b8724541c99 Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerShowV254Test-1771943126-project Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 508727fe-1429-45a5-808d-a21f849fa965 could not be found. Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '508727fe-1429-45a5-808d-a21f849fa965'} Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 508727fe-1429-45a5-808d-a21f849fa965 could not be found. Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508727fe-1429-45a5-808d-a21f849fa965 could not be found. Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:34.119208 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:34.122831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:34.122831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:34.122831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:34.122831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:34.122831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:34.122831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508727fe-1429-45a5-808d-a21f849fa965 could not be found. Oct 04 11:17:34.122831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:34.127762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] Returning 404 to user: Instance 508727fe-1429-45a5-808d-a21f849fa965 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:34.130039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-79b252c7-a953-489f-b19d-6250d7326ab1 tempest-ServerShowV254Test-1771943126 tempest-ServerShowV254Test-1771943126-project] 10.222.0.23 "GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965" status: 404 len: 111 microversion: 2.54 time: 0.095026 Oct 04 11:17:34.138779 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2707/3941] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:34 2022] GET /compute/v2.1/servers/508727fe-1429-45a5-808d-a21f849fa965 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:17:34.177955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-721490928", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:34.278833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] validate_networks() for [('bc8862a0-d086-4424-bebe-a8d7874e2d0c', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:17:35.292425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:17:35.293653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:17:35.294216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:17:35.294621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:17:35.295235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:17:35.316565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:35.317589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:35.318997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:35.321035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:35.322804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:35.325530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:35.425064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Getting quotas for project 0313e8ab904049c58fd4c9d9a7adf40a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:17:35.431827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Getting quotas for user d5c346b48e674ad48fa6fd6aa2634361 and project 0313e8ab904049c58fd4c9d9a7adf40a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:17:35.446516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:35.451106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:17:35.455921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:17:35.536068 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6829472-cce8-468f-a073-ca148f487c71 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.379910 Oct 04 11:17:35.547411 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2708/3942] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:17:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:17:35.554483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:35.555391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:35.563977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:35.564966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:35.565657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:35.566624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:35.567281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:35.567906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:35.793655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:35.809416 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6691f9f-9e11-4a16-a536-a9d65dcdfa67 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1495 microversion: 2.1 time: 0.257140 Oct 04 11:17:35.828882 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2709/3943] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:35 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1495 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:35.837122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:35.837661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:35.854184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:35.854718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:35.859731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:35.860478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:35.862747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:35.863319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:35.911778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:17:36.150219 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ba0614b-7380-47b6-823a-2ecc02844a09 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 204 len: 0 microversion: 2.26 time: 0.319783 Oct 04 11:17:36.152175 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2710/3944] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:17:35 2022] DELETE /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:17:36.161497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:36.162547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:36.180531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:36.181581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:36.182475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:36.184904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:36.185621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:36.186303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:36.445431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:36.455228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:36.456683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:36.458381 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b161278c-925d-4c52-a5fd-940a031ac857 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1738 microversion: 2.20 time: 0.304319 Oct 04 11:17:36.473915 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2711/3945] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:36 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:36.482460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:36.483071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:36.490199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:36.490596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:36.491086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:36.491814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:36.492274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:36.492704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:36.696414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:36.707162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-276d0c10-65a6-481d-95a2-78b91dfc5a83 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1673 microversion: 2.1 time: 0.231879 Oct 04 11:17:36.708038 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2712/3946] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:36 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1673 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:36.725141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:36.725141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:36.731935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:36.732697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:36.733515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:36.734395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:36.735005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:36.735670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:36.810904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:36.822687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b9d29fd-cfa0-4024-9d27-a4bbe12d199e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1217 microversion: 2.1 time: 0.111981 Oct 04 11:17:36.823295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2713/3947] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:36 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:36.837831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:36.838474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:36.846384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:36.846623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:36.847068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:36.848318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:36.848777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:36.849206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:37.104456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:37.115933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:37.118055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:37.119486 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-772e013e-c8ce-41ea-b826-69990e8777e3 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1550 microversion: 2.26 time: 0.295264 Oct 04 11:17:37.120562 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2714/3948] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:36 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1550 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:37.135292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:37.136798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:37.152361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:37.153762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:37.154443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:37.156994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:37.157758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:37.161190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:37.336273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:37.345684 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb85ef99-b36d-41ac-a7e6-0bfdd0fab74e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1495 microversion: 2.1 time: 0.223669 Oct 04 11:17:37.346275 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2715/3949] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:37 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1495 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:37.486207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:37.486826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:37.502366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:37.502872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:37.503367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:37.504193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:37.504760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:37.505286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:38.057914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:38.069161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:38.090006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:38.091496 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-109f94d3-4055-4ef7-9c35-8a1e1e9366c8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1720 microversion: 2.20 time: 0.609259 Oct 04 11:17:38.092724 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2716/3950] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:37 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1720 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:17:38.114001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:38.115690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:38.133258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:38.138814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:38.139739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:38.143483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:38.145444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:38.146136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:38.606138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:38.616579 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-790b890b-c6a1-4c94-bbdc-68b72acfe4d8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.514851 Oct 04 11:17:38.617292 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2717/3951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:38 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:38.622364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:38.623116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:38.631858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:38.631858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:38.631858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:38.632284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:38.632862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:38.633429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:38.770984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:38.781156 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b48aa7e-4212-459f-866a-1d5eb718ee22 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1279 microversion: 2.1 time: 0.162587 Oct 04 11:17:38.791288 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2718/3952] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:38 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:38.796529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:38.797399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:38.811305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:38.812265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:38.812846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:38.813828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:38.814433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:38.815211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:39.242269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:39.261882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:39.263015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7713fb2efaef4fddbc40bcdf611e0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3c551c5734a769e210fa056481a50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:39.264700 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3710a3cb-b5ea-469d-8876-ba915e6accfa tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 200 len: 1550 microversion: 2.26 time: 0.472080 Oct 04 11:17:39.266947 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2719/3953] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:38 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 1550 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:39.281379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:39.281998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:39.300177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:39.305337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:39.305843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:39.306701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:39.307075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:39.307635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:39.401434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:39.403146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:39.403842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:39.404679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lazy-loading 'fault' on Instance uuid 640c0385-3b41-480f-8494-692f2fdd866c {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:39.513313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:39.534794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-266aa019-b856-45c9-9639-f8ae5253d832 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 200 len: 1305 microversion: 2.1 time: 0.266535 Oct 04 11:17:39.536444 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2720/3954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:39 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 1305 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:39.541224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f1c418dd-c316-4e94-a42b-b964c7f598a7 req-89ef2ebf-36c3-4a36-b856-c7f1b6856d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640c0385-3b41-480f-8494-692f2fdd866c", "name": "network-vif-deleted", "tag": "6f472f08-36c7-4c67-9f72-e982115a96c8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:39.573517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f1c418dd-c316-4e94-a42b-b964c7f598a7 req-89ef2ebf-36c3-4a36-b856-c7f1b6856d6e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:39.577136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f1c418dd-c316-4e94-a42b-b964c7f598a7 req-89ef2ebf-36c3-4a36-b856-c7f1b6856d6e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:39.580066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f1c418dd-c316-4e94-a42b-b964c7f598a7 req-89ef2ebf-36c3-4a36-b856-c7f1b6856d6e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:39.624965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f1c418dd-c316-4e94-a42b-b964c7f598a7 req-89ef2ebf-36c3-4a36-b856-c7f1b6856d6e service nova] Creating event network-vif-deleted:6f472f08-36c7-4c67-9f72-e982115a96c8 for instance 640c0385-3b41-480f-8494-692f2fdd866c on n-h1-791135-8 Oct 04 11:17:39.662148 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f1c418dd-c316-4e94-a42b-b964c7f598a7 req-89ef2ebf-36c3-4a36-b856-c7f1b6856d6e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120829 Oct 04 11:17:39.663867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2721/3955] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:39.672312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:39.673045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:39.692534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:39.693800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:39.694819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:39.695795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:39.696509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:39.697124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:39.737269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:40.025370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:40.036318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:40.044747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:40.046275 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29e7c4de-2779-4147-a855-cea1a87df3b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1720 microversion: 2.20 time: 0.378725 Oct 04 11:17:40.049690 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2722/3956] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:39 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:40.060386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-22cdf387-8d19-4977-ba28-d1ce85e836bd req-a9b5c3a0-3af4-4052-ad0f-e5c29d5c1fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6e745e-9cfe-4562-a91f-7fa25f3ad109", "name": "network-vif-unplugged", "status": "completed", "tag": "8a5bddce-130d-4805-99d6-8f5074eab124"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:40.078698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22cdf387-8d19-4977-ba28-d1ce85e836bd req-a9b5c3a0-3af4-4052-ad0f-e5c29d5c1fc5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:40.080390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22cdf387-8d19-4977-ba28-d1ce85e836bd req-a9b5c3a0-3af4-4052-ad0f-e5c29d5c1fc5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:40.085684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22cdf387-8d19-4977-ba28-d1ce85e836bd req-a9b5c3a0-3af4-4052-ad0f-e5c29d5c1fc5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:40.106960 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-22cdf387-8d19-4977-ba28-d1ce85e836bd req-a9b5c3a0-3af4-4052-ad0f-e5c29d5c1fc5 service nova] Creating event network-vif-unplugged:8a5bddce-130d-4805-99d6-8f5074eab124 for instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 on n-h1-791135-8 Oct 04 11:17:40.114007 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-22cdf387-8d19-4977-ba28-d1ce85e836bd req-a9b5c3a0-3af4-4052-ad0f-e5c29d5c1fc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060297 Oct 04 11:17:40.115171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2723/3957] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:40.122618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8671a704-fda2-4b41-a295-d6646beee002 req-5ce8c08a-b156-491e-955d-daea88c378d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fff8ac-6c00-4ea8-9b1d-f51ed53a7291", "name": "network-vif-deleted", "tag": "4723b54d-eabd-495f-a610-bca5cdb48693"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:40.133511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8671a704-fda2-4b41-a295-d6646beee002 req-5ce8c08a-b156-491e-955d-daea88c378d9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:40.134276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8671a704-fda2-4b41-a295-d6646beee002 req-5ce8c08a-b156-491e-955d-daea88c378d9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:40.134897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8671a704-fda2-4b41-a295-d6646beee002 req-5ce8c08a-b156-491e-955d-daea88c378d9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:40.166085 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8671a704-fda2-4b41-a295-d6646beee002 req-5ce8c08a-b156-491e-955d-daea88c378d9 service nova] Creating event network-vif-deleted:4723b54d-eabd-495f-a610-bca5cdb48693 for instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 on n-h2-791135-8 Oct 04 11:17:40.172205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8671a704-fda2-4b41-a295-d6646beee002 req-5ce8c08a-b156-491e-955d-daea88c378d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054886 Oct 04 11:17:40.173401 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2724/3958] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:40.180727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:40.182237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:40.190577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:40.191477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:40.192671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:40.193648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:40.194293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:40.194943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:40.374512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:40.383613 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8f0f34a-8c34-426f-ad89-6485360edf03 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1321 microversion: 2.1 time: 0.208698 Oct 04 11:17:40.384430 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2725/3959] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:40 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:40.402685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:40.403537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] [instance: 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:40.415247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:40.416112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:40.416556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:40.418379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:40.418856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:40.419695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:40.436423 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] HTTP exception thrown: Instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 could not be found. Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Request method failure captured: Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 HTTP/1.1 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBYmdsXIzP2TUqyd6bS1ncU8o4I0WiIvcIskC1T92oBgi9qnpHi5qmAHVVEp6xYyh1HhbyxMR6z3maNhwHTjH9SY8Hg4u9jXQBu7Kt1w57YVrwj-QS4NK3OfDmx8dwFShOj6ztDw51SCfFlpC3cl9nKvbqAdUCnitO1TIhG5uWc5n48 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2fe3c551c5734a769e210fa056481a50 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerTagsTestJSON-1354645216 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2fe3c551c5734a769e210fa056481a50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2fe3c551c5734a769e210fa056481a50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2fe3c551c5734a769e210fa056481a50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2fe3c551c5734a769e210fa056481a50"}]}] Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerTagsTestJSON-1354645216 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2fe3c551c5734a769e210fa056481a50 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerTagsTestJSON-1354645216 Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerTagsTestJSON-1354645216-project Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 7713fb2efaef4fddbc40bcdf611e0f5d Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerTagsTestJSON-1354645216-project Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 could not be found. Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '91fff8ac-6c00-4ea8-9b1d-f51ed53a7291'} Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 could not be found. Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 could not be found. Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:40.438493 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.441877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:40.441877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:40.441877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:40.441877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:40.441877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:40.441877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 could not be found. Oct 04 11:17:40.441877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.445416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] Returning 404 to user: Instance 91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:40.446480 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd3dd93e-1854-4ddf-a16f-f4ffa509c627 tempest-ServerTagsTestJSON-1354645216 tempest-ServerTagsTestJSON-1354645216-project] 10.222.0.23 "GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291" status: 404 len: 111 microversion: 2.26 time: 0.060939 Oct 04 11:17:40.452242 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2726/3960] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:40 2022] GET /compute/v2.1/servers/91fff8ac-6c00-4ea8-9b1d-f51ed53a7291 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:17:40.563196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:40.564462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:40.579126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:40.579939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:40.585773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:40.587577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:40.588253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:40.589065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:40.618049 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c HTTP/1.1 Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '640c0385-3b41-480f-8494-692f2fdd866c'} Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:17:40.619613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.623094 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:17:40.623094 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:17:40.623094 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:17:40.623094 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:17:40.623094 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:17:40.623094 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:17:40.623094 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:17:40.625597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:17:40.627102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97640e75-7169-426a-9b37-6bf49372479c tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 404 len: 111 microversion: 2.1 time: 0.068246 Oct 04 11:17:40.628193 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2727/3961] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:40 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:17:40.762073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1804075296", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "49989f52-07b9-48bb-b42a-1e9bb7c15958"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:40.826565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] validate_networks() for [('49989f52-07b9-48bb-b42a-1e9bb7c15958', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:17:42.710127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:17:42.711155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:17:42.713491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:17:42.714078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:17:42.714897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:17:42.731486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:42.732489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:42.732971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:42.733798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:42.734424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:42.735079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:42.772731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:17:42.779302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Getting quotas for user 510d473de29b4d7d8bb303f64f1e17d4 and project 9347664341cd4b5abbf6bffd5a6da90a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:17:42.805167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:17:42.807914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:17:42.887307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3aa263d1-31ae-4b9d-ad16-7ef766e41d2e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126928 Oct 04 11:17:42.888190 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2728/3962] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:17:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:17:42.901866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:42.903343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:42.913334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:42.914253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:42.914907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:42.915850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:42.916555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:42.919496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:43.281195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:43.308054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:43.312768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:43.315586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-08b6159d-8fd8-4a84-b32c-2f349220cdb5 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1663 microversion: 2.20 time: 0.424998 Oct 04 11:17:43.320764 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2729/3963] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:42 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1663 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:43.338915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:43.340603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:43.359370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:43.360919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:43.361564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:43.362655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:43.363267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:43.364047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:43.763764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:43.775067 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bdf54cce-479d-4a0d-8660-d3ae694926a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1321 microversion: 2.1 time: 0.452506 Oct 04 11:17:43.775757 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2730/3964] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:43 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:43.781967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-de916a28-377b-4beb-934b-d2eafa88cb6a req-14f144c5-d134-4c05-bbbb-ce8dbb004811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77681c9a-5e04-4b84-a338-33360377e251", "tag": "c49d45af-ed02-47a4-b127-7ff640b59053"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:43.801738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-de916a28-377b-4beb-934b-d2eafa88cb6a req-14f144c5-d134-4c05-bbbb-ce8dbb004811 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:43.802647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-de916a28-377b-4beb-934b-d2eafa88cb6a req-14f144c5-d134-4c05-bbbb-ce8dbb004811 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:43.803265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-de916a28-377b-4beb-934b-d2eafa88cb6a req-14f144c5-d134-4c05-bbbb-ce8dbb004811 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:43.818520 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-de916a28-377b-4beb-934b-d2eafa88cb6a req-14f144c5-d134-4c05-bbbb-ce8dbb004811 service nova] Creating event network-changed:c49d45af-ed02-47a4-b127-7ff640b59053 for instance 77681c9a-5e04-4b84-a338-33360377e251 on n-h2-791135-8 Oct 04 11:17:43.824368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-de916a28-377b-4beb-934b-d2eafa88cb6a req-14f144c5-d134-4c05-bbbb-ce8dbb004811 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047255 Oct 04 11:17:43.825685 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2731/3965] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:44.350304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:44.351324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:44.366038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:44.366642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:44.367357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:44.368416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:44.369227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:44.371972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:44.599352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:44.611753 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-55eabd29-47b2-47c5-806a-ea6ad10aa0c3 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1211 microversion: 2.1 time: 0.784645 Oct 04 11:17:44.613275 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2732/3966] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:43 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1211 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:44.619398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e06c4d68-e0cd-409b-8fc7-aa6031effebf"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:44.622002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:44.628585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:44.629253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:44.629901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:44.630766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:44.631381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:44.632367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:45.247521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-013274ba-23bd-4be8-930d-aadd42023e51 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.632256 Oct 04 11:17:45.249400 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2733/3967] 10.222.0.23 () {62 vars in 1364 bytes} [Tue Oct 4 11:17:44 2022] POST /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments => generated 188 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:17:45.257308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3e97e45a-638e-403d-bd47-352a308eb90b req-1a59f618-33d9-46c4-ab31-e89dd6154a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46eb658-0913-4726-acb8-874f01b5c154", "tag": "8ca489d8-9727-487d-837c-0eeabde037c6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:45.271211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3e97e45a-638e-403d-bd47-352a308eb90b req-1a59f618-33d9-46c4-ab31-e89dd6154a4d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:45.272423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3e97e45a-638e-403d-bd47-352a308eb90b req-1a59f618-33d9-46c4-ab31-e89dd6154a4d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:45.272883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3e97e45a-638e-403d-bd47-352a308eb90b req-1a59f618-33d9-46c4-ab31-e89dd6154a4d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:45.290031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3e97e45a-638e-403d-bd47-352a308eb90b req-1a59f618-33d9-46c4-ab31-e89dd6154a4d service nova] Creating event network-changed:8ca489d8-9727-487d-837c-0eeabde037c6 for instance a46eb658-0913-4726-acb8-874f01b5c154 on n-h1-791135-8 Oct 04 11:17:45.298175 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3e97e45a-638e-403d-bd47-352a308eb90b req-1a59f618-33d9-46c4-ab31-e89dd6154a4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045276 Oct 04 11:17:45.300450 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2734/3968] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:45.311668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:45.314407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:45.323584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:45.335650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:45.336199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:45.336966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:45.338999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:45.339470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:46.641988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:46.653899 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-89105255-0b1e-4bcd-991d-1a75bdee900e tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1321 microversion: 2.1 time: 1.347189 Oct 04 11:17:46.654870 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2735/3969] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:45 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1321 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:46.669622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:46.670231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:46.683697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:46.684229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:46.690067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:46.692964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:46.693708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:46.695914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:46.798048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122409) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 11:17:46.934396 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cda7f3d2-9f14-4963-88f8-ecaf1c43943c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/action" status: 202 len: 0 microversion: 2.20 time: 0.277352 Oct 04 11:17:46.942006 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2736/3970] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:17:46 2022] POST /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:17:46.954508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:46.955136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:46.975477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:46.976903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:46.978527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:46.979308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:46.979781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:46.980219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:47.199365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:47.211738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8accd4e1-b093-496d-8489-e49981705f25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1273 microversion: 2.1 time: 0.267237 Oct 04 11:17:47.212458 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2737/3971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:46 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:47.220314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:47.226334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:47.246673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:47.249113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:47.250522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:47.251631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:47.259776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:47.260519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:48.249913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:48.265965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:48.267720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:48.274426 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-317159e1-491d-4a1f-ba1a-c78a841e0829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1749 microversion: 2.20 time: 1.059118 Oct 04 11:17:48.275766 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2738/3972] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:47 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1749 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:48.301434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:48.303940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:48.328085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:48.335025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:48.338885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:48.341719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:48.343067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:48.347734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:49.034410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:49.043599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e56c791b-cbef-42c2-8894-4e26532f738f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1321 microversion: 2.1 time: 0.766060 Oct 04 11:17:49.047830 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2739/3973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:48 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:49.064166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:49.067319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:49.104086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:49.111455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:49.112248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:49.114003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:49.114797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:49.115608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:49.126283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:49.889611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:49.916042 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c81e1195-25aa-499e-b330-7ae1d608b87f tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1315 microversion: 2.1 time: 0.866692 Oct 04 11:17:49.927761 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2740/3974] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:49 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:49.932735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0ec72f03-e037-41e5-a292-c084a69bcc96 req-640aa022-5185-45fb-8518-ba71f618b890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77681c9a-5e04-4b84-a338-33360377e251", "name": "network-vif-plugged", "status": "completed", "tag": "c49d45af-ed02-47a4-b127-7ff640b59053"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:49.953884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ec72f03-e037-41e5-a292-c084a69bcc96 req-640aa022-5185-45fb-8518-ba71f618b890 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:49.954637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ec72f03-e037-41e5-a292-c084a69bcc96 req-640aa022-5185-45fb-8518-ba71f618b890 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:49.955217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ec72f03-e037-41e5-a292-c084a69bcc96 req-640aa022-5185-45fb-8518-ba71f618b890 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:49.975052 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0ec72f03-e037-41e5-a292-c084a69bcc96 req-640aa022-5185-45fb-8518-ba71f618b890 service nova] Creating event network-vif-plugged:c49d45af-ed02-47a4-b127-7ff640b59053 for instance 77681c9a-5e04-4b84-a338-33360377e251 on n-h2-791135-8 Oct 04 11:17:49.991553 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0ec72f03-e037-41e5-a292-c084a69bcc96 req-640aa022-5185-45fb-8518-ba71f618b890 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062209 Oct 04 11:17:49.992496 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2741/3975] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:49.999245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:50.006114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:50.018838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:50.019493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:50.020096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:50.021086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:50.021725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:50.022559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:50.852835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:50.870346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:50.873138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:50.878541 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9199d109-050c-421b-9f78-71c9e75a0586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1751 microversion: 2.20 time: 0.883505 Oct 04 11:17:50.910560 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2742/3976] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:49 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1751 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:50.924218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:50.928928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:50.932890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:50.949069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:50.949684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:50.950653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:50.951607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:50.953909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:50.954560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:51.586908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:51.594638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8fb0d15-2d20-4432-af64-b49cca58bf21 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1321 microversion: 2.1 time: 0.682223 Oct 04 11:17:51.613294 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2743/3977] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:50 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1321 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:51.633882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:51.639271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:51.661254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:51.662147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:51.662781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:51.663736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:51.664447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:51.665080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:52.571267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:52.593176 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba9e6c73-ec9c-48e5-bfb3-10eadec580e0 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1315 microversion: 2.1 time: 0.977967 Oct 04 11:17:52.596501 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2744/3978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:51 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1315 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:52.747945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:52.787961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=18 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:52.857674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b04256ab-9b3c-4bf0-bd60-0ca8b8dd34eb tempest-QuotaClassesAdmin257Test-1220815515 tempest-QuotaClassesAdmin257Test-1220815515-project-admin] Calling method '.version_select at 0x7f71cefd9a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:52.877036 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b04256ab-9b3c-4bf0-bd60-0ca8b8dd34eb tempest-QuotaClassesAdmin257Test-1220815515 tempest-QuotaClassesAdmin257Test-1220815515-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.278774 Oct 04 11:17:52.877978 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2745/3979] 10.222.0.23 () {60 vars in 1226 bytes} [Tue Oct 4 11:17:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:17:52.986027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-504114570", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:53.087902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] validate_networks() for [('350c987a-5b2c-443d-b477-a345ff55756e', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:17:53.922867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:17:53.923449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:17:53.924082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:17:53.924716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:17:53.925936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:17:53.949495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:53.950128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:53.950669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:53.951510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:53.952047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:53.953614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:53.980439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Getting quotas for project 2031b742afb6490790401bc9da99e6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:17:53.993016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Getting quotas for user d9f8fec48e504ec4a91b7ee04bfdeadb and project 2031b742afb6490790401bc9da99e6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:17:54.011744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:17:54.014626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:17:54.085911 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0474c16-9599-480e-8145-44cf6a888b75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205847 Oct 04 11:17:54.087408 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2746/3980] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:17:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:17:54.093585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:54.094612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:54.109088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:54.110566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:54.111000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:54.111876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:54.112281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:54.112821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:54.330299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:54.341876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:54.343805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:54.345389 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8e48e48-168f-49b2-aaca-a12c009190eb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1751 microversion: 2.20 time: 0.256563 Oct 04 11:17:54.346613 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2747/3981] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:54 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:54.352795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d0f82710-f4c4-4919-99f4-cfaeee6a1b2c req-cf0c050f-425a-49fa-bdaa-bc09921fe2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46eb658-0913-4726-acb8-874f01b5c154", "name": "network-vif-plugged", "status": "completed", "tag": "8ca489d8-9727-487d-837c-0eeabde037c6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:54.364670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d0f82710-f4c4-4919-99f4-cfaeee6a1b2c req-cf0c050f-425a-49fa-bdaa-bc09921fe2b8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:54.365163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d0f82710-f4c4-4919-99f4-cfaeee6a1b2c req-cf0c050f-425a-49fa-bdaa-bc09921fe2b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:54.365651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d0f82710-f4c4-4919-99f4-cfaeee6a1b2c req-cf0c050f-425a-49fa-bdaa-bc09921fe2b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:54.380526 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d0f82710-f4c4-4919-99f4-cfaeee6a1b2c req-cf0c050f-425a-49fa-bdaa-bc09921fe2b8 service nova] Creating event network-vif-plugged:8ca489d8-9727-487d-837c-0eeabde037c6 for instance a46eb658-0913-4726-acb8-874f01b5c154 on n-h1-791135-8 Oct 04 11:17:54.386365 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d0f82710-f4c4-4919-99f4-cfaeee6a1b2c req-cf0c050f-425a-49fa-bdaa-bc09921fe2b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037554 Oct 04 11:17:54.392023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2748/3982] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:54.400545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:54.401550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:54.408603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:54.409641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:54.410315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:54.411629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:54.412705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:54.413381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:54.877474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:54.889900 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-15571064-f4b6-41af-96fb-acdd3c028b1b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1321 microversion: 2.1 time: 0.495211 Oct 04 11:17:54.892464 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2749/3983] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:54 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:54.897956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3f63fea8-ac91-4ff8-a050-02b4a0dbd3af req-172f9ea2-6670-4ad9-838e-7c943000559c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8219af10-9131-46d1-a559-de9196299a29", "tag": "28513d2d-daee-4cdf-a162-adbe32ea4325"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:54.944645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3f63fea8-ac91-4ff8-a050-02b4a0dbd3af req-172f9ea2-6670-4ad9-838e-7c943000559c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:54.945443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3f63fea8-ac91-4ff8-a050-02b4a0dbd3af req-172f9ea2-6670-4ad9-838e-7c943000559c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:54.945581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3f63fea8-ac91-4ff8-a050-02b4a0dbd3af req-172f9ea2-6670-4ad9-838e-7c943000559c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:54.962974 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3f63fea8-ac91-4ff8-a050-02b4a0dbd3af req-172f9ea2-6670-4ad9-838e-7c943000559c service nova] Creating event network-changed:28513d2d-daee-4cdf-a162-adbe32ea4325 for instance 8219af10-9131-46d1-a559-de9196299a29 on n-h2-791135-8 Oct 04 11:17:54.970060 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3f63fea8-ac91-4ff8-a050-02b4a0dbd3af req-172f9ea2-6670-4ad9-838e-7c943000559c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075243 Oct 04 11:17:54.971188 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2750/3984] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:17:54.979485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b25e033c-5f92-44df-93c4-9a98cb7e45a9 tempest-QuotaClassesAdmin257Test-1220815515 tempest-QuotaClassesAdmin257Test-1220815515-project-admin] Action: 'update', calling method: .version_select at 0x7f71cf042d30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:55.355359 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b25e033c-5f92-44df-93c4-9a98cb7e45a9 tempest-QuotaClassesAdmin257Test-1220815515 tempest-QuotaClassesAdmin257Test-1220815515-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.381488 Oct 04 11:17:55.358913 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2751/3985] 10.222.0.23 () {62 vars in 1247 bytes} [Tue Oct 4 11:17:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:17:55.367461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:55.374576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:55.395516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:55.396074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:55.397037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:55.399876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:55.400371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:55.400846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:55.657607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:55.667023 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-015deb5e-9300-44b4-81e7-a053178abcba tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1315 microversion: 2.1 time: 0.306758 Oct 04 11:17:55.667617 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2752/3986] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:55 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:55.698298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:55.698922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:55.706808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:55.707318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:55.707754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:55.708543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:55.708999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:55.709447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:55.847133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:55.862859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-432e11c2-e9c2-4918-b27f-f7c5ec66e7c8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1268 microversion: 2.1 time: 0.173735 Oct 04 11:17:55.865482 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2753/3987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:55 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:56.122175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1007646589", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": "none"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:56.215481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:17:56.215918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:17:56.216380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:17:56.216790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:17:56.217207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:17:56.247803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:56.251925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:56.252423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:56.253228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:56.253717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:56.264793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:56.333748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Getting quotas for project 2f2ad14056014a80990a0653bdfdf164. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:17:56.355686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Getting quotas for user 364fb7f9f59d4c48b0ef063c69d4f93e and project 2f2ad14056014a80990a0653bdfdf164. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:17:56.397956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:17:56.400460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:17:56.539694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2175c6e8-df45-408a-b2b4-58cc2c40b9d1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.649937 Oct 04 11:17:56.540817 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2754/3988] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:17:56.554485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3407d7fa-3c93-44a7-9cc5-88e276997f10 tempest-QuotaClassesAdmin257Test-1220815515 tempest-QuotaClassesAdmin257Test-1220815515-project-admin] Calling method '.version_select at 0x7f71cf042a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:56.576296 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3407d7fa-3c93-44a7-9cc5-88e276997f10 tempest-QuotaClassesAdmin257Test-1220815515 tempest-QuotaClassesAdmin257Test-1220815515-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.033591 Oct 04 11:17:56.578528 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2755/3989] 10.222.0.23 () {60 vars in 1226 bytes} [Tue Oct 4 11:17:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:17:56.583324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:56.584003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:56.592782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:56.593449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:56.594008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:56.595121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:56.595849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:56.596282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:57.169281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:57.187914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:57.198047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:57.199369 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ae81c13-4e4c-4560-b54d-6c4bc0bb54b1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1751 microversion: 2.20 time: 0.620840 Oct 04 11:17:57.204998 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2756/3990] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:56 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1751 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:57.221792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:57.222805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:57.242121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:57.242588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:57.243039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:57.243768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:57.244191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:57.244634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:57.583662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:57.591802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0160de5-8277-40c9-bf73-579af79cbb96 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1515 microversion: 2.1 time: 0.385569 Oct 04 11:17:57.596886 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2757/3991] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:57 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1515 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:57.602714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:57.602714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:57.614377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:57.626564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:57.627324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:57.629063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:57.631462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:57.635773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:57.838680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:57.879494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:57.883266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:57.887938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ba49242-e9bf-416d-ad0b-d6878de33c25 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1282 microversion: 2.57 time: 0.289789 Oct 04 11:17:57.892518 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2758/3992] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:57 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1282 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:17:57.904354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ca4c66a-12ac-411e-afd6-9e8222a4a193 tempest-QuotaClassesAdmin257Test-1220815515 tempest-QuotaClassesAdmin257Test-1220815515-project-admin] Action: 'update', calling method: .version_select at 0x7f71ceff9670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:57.974694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=13,nova_api:UPDATE=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:58.103703 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ca4c66a-12ac-411e-afd6-9e8222a4a193 tempest-QuotaClassesAdmin257Test-1220815515 tempest-QuotaClassesAdmin257Test-1220815515-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.208025 Oct 04 11:17:58.105608 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2759/3993] 10.222.0.23 () {62 vars in 1247 bytes} [Tue Oct 4 11:17:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:17:58.110615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:58.111483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:58.121141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:58.122421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:58.123844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:58.124771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:58.125550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:58.126366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:58.401764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:58.415350 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-764cbf33-0f68-45cf-8a8a-5b86e20c1d17 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1315 microversion: 2.1 time: 0.308171 Oct 04 11:17:58.416373 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2760/3994] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:58 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:58.426808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:58.428528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:58.441339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:58.441869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:58.444148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:58.446532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:58.447006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:58.447440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:58.893735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:58.909045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d07d0007-ad14-419c-b6d1-afcc3a926460 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1316 microversion: 2.1 time: 0.490245 Oct 04 11:17:58.913895 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2761/3995] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:17:58 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:17:58.937274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:17:58.948001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:58.967085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:58.971162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:58.972933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:58.973881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:58.979726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:58.980438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:59.424019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lazy-loading 'flavor' on Instance uuid a46eb658-0913-4726-acb8-874f01b5c154 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:17:59.494988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:17:59.526938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3462a8fc-3e06-4afa-b2b8-403a193334fe tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154/action" status: 200 len: 32 microversion: 2.1 time: 0.610124 Oct 04 11:17:59.533306 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2762/3996] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:17:58 2022] POST /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154/action => generated 32 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:17:59.541249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:17:59.542137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:17:59.551112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:59.551962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:59.552546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:59.553675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:17:59.554317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:17:59.554890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:17:59.981555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:59.995240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:59.997048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:17:59.998661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-258d975c-33fc-4811-a733-2e85c510f990 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.462780 Oct 04 11:18:00.009377 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2763/3997] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:59 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:00.021121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:00.021121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:00.039475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:00.039974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:00.040415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:00.041160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:00.042689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:00.043405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:00.299239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:00.318651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:00.321154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:00.322819 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3739ac29-d76d-4e63-87df-4aa2564d1851 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1336 microversion: 2.57 time: 0.321780 Oct 04 11:18:00.323687 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2764/3998] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:17:59 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1336 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:00.329844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:00.330675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:00.347285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:00.348115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:00.349174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:00.352286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:00.355783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:00.356296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:01.147673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:01.156687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f73f4f34-cd3c-489c-8578-36f4df795429 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1315 microversion: 2.1 time: 0.831497 Oct 04 11:18:01.157850 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2765/3999] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:00 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:01.162775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:01.163816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:01.171005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:01.171865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:01.172579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:01.173563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:01.174246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:01.175481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:01.597553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:01.624581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4607ff81-c6fb-4923-a505-65d21c666fec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.461523 Oct 04 11:18:01.625951 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2766/4000] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:01 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:01.641306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:01.642670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:01.657294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:01.660175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:01.660682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:01.661802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:01.666016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:01.666982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:01.935115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:01.944121 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ebfb5be-7fe4-4a3e-baf2-e196b5ba76fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1316 microversion: 2.1 time: 0.309375 Oct 04 11:18:01.950590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2767/4001] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:01 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:01.971703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-014f4d79-dc37-4ffd-8a93-563da62520d6 req-068f345f-09d8-4f17-83cb-393299761b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219af10-9131-46d1-a559-de9196299a29", "name": "network-vif-plugged", "status": "completed", "tag": "28513d2d-daee-4cdf-a162-adbe32ea4325"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:01.995764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-014f4d79-dc37-4ffd-8a93-563da62520d6 req-068f345f-09d8-4f17-83cb-393299761b97 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:01.996454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-014f4d79-dc37-4ffd-8a93-563da62520d6 req-068f345f-09d8-4f17-83cb-393299761b97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:01.996997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-014f4d79-dc37-4ffd-8a93-563da62520d6 req-068f345f-09d8-4f17-83cb-393299761b97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:02.013825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-014f4d79-dc37-4ffd-8a93-563da62520d6 req-068f345f-09d8-4f17-83cb-393299761b97 service nova] Creating event network-vif-plugged:28513d2d-daee-4cdf-a162-adbe32ea4325 for instance 8219af10-9131-46d1-a559-de9196299a29 on n-h2-791135-8 Oct 04 11:18:02.019386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-014f4d79-dc37-4ffd-8a93-563da62520d6 req-068f345f-09d8-4f17-83cb-393299761b97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052846 Oct 04 11:18:02.020575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2768/4002] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:02.026189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:02.027388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:02.034866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:02.035795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:02.036339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:02.038458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:02.042388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:02.043147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:02.404052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:02.421175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:02.426058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:02.427446 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37802a61-e7a0-4414-b304-d64c6607698b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.405483 Oct 04 11:18:02.429455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2769/4003] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:02 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:02.443424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:02.449700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:02.456484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:02.457598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:02.458524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:02.459426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:02.460045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:02.460708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:02.548915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:02.562627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:02.570595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:02.580266 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3db679c0-2417-4eba-a0c0-78e3f934086c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1336 microversion: 2.57 time: 0.147919 Oct 04 11:18:02.594366 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2770/4004] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:02 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1336 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:02.605703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3c007ff9-dbb2-4bc7-aa5d-4f94e63d2a4a req-30b65ca2-276b-41c0-9f4d-80369e39437c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d5329f-b493-4a25-a450-823121e8358a", "tag": "e7754be9-28f5-4ac8-8494-76e4d61e21a4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:02.617946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3c007ff9-dbb2-4bc7-aa5d-4f94e63d2a4a req-30b65ca2-276b-41c0-9f4d-80369e39437c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:02.618387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3c007ff9-dbb2-4bc7-aa5d-4f94e63d2a4a req-30b65ca2-276b-41c0-9f4d-80369e39437c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:02.618797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3c007ff9-dbb2-4bc7-aa5d-4f94e63d2a4a req-30b65ca2-276b-41c0-9f4d-80369e39437c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:02.648016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3c007ff9-dbb2-4bc7-aa5d-4f94e63d2a4a req-30b65ca2-276b-41c0-9f4d-80369e39437c service nova] Creating event network-changed:e7754be9-28f5-4ac8-8494-76e4d61e21a4 for instance 53d5329f-b493-4a25-a450-823121e8358a on n-h1-791135-8 Oct 04 11:18:02.657939 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3c007ff9-dbb2-4bc7-aa5d-4f94e63d2a4a req-30b65ca2-276b-41c0-9f4d-80369e39437c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062146 Oct 04 11:18:02.658833 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2771/4005] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:02.664530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:02.666160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:02.690526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:02.692645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:02.693693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:02.695075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:02.715345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:02.715867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:03.211999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:03.223448 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-df75651a-2902-45dc-b594-4504b2777b25 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1315 microversion: 2.1 time: 0.563011 Oct 04 11:18:03.224096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2772/4006] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:02 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:03.246253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:03.247462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:03.262247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:03.263088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:03.273684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:03.277786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:03.283435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:03.283435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:03.617977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:03.628179 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a73fbc4-a182-4b34-8d0f-885268d51d73 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.402650 Oct 04 11:18:03.648002 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2773/4007] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:03 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:03.653375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:03.654455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:03.663546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:03.664696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:03.665944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:03.667557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:03.668596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:03.669560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:03.951655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:03.960226 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eac4adac-53c1-4d4d-a89a-27fdd612e8d5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1316 microversion: 2.1 time: 0.310804 Oct 04 11:18:03.975087 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2774/4008] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:03 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:03.975087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:03.975087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:03.975087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:03.975087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:03.975087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:03.975087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:03.975087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:03.975653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:04.089217 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:18:04.090221 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:18:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:18:04.172084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:04.185822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:04.187569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:04.189058 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d079634e-053e-43fb-9b65-4e6a4a5b105f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.226445 Oct 04 11:18:04.190774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2775/4009] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:03 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:04.195420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:04.196285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:04.210745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:04.211550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:04.212356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:04.213527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:04.214052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:04.214743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:04.300509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:04.311792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:04.313955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:04.316270 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17aab162-0ba2-4c47-b2e2-93f2b86f702c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1357 microversion: 2.57 time: 0.124257 Oct 04 11:18:04.317649 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2776/4010] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:04 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1357 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:04.323306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:04.324272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:04.330619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:04.331972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:04.332646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:04.333803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:04.334474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:04.335089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:04.535335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:04.565225 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c3dad982-f624-4702-8fb9-330966728edc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1315 microversion: 2.1 time: 0.226731 Oct 04 11:18:04.570802 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2777/4011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:04 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:04.587153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:04.595811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:04.612974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:04.614254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:04.615385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:04.616108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:04.616565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:04.616991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:04.732125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:18:04.733329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:18:04.733553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:18:04.734034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:18:04.756022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:18:04.879788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:04.925454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:04.940543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:04.941105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:04.949838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:04.950669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:04.951162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:04.951600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:05.017440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63f0dcbc-d986-471d-87a0-05f9d64c00b6 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "POST /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3/action" status: 202 len: 1138 microversion: 2.57 time: 0.443105 Oct 04 11:18:05.018689 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2778/4012] 10.222.0.23 () {62 vars in 1320 bytes} [Tue Oct 4 11:18:04 2022] POST /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3/action => generated 1138 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 11:18:05.023526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:05.025812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:05.033379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:05.033379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:05.034595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:05.036264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:05.036264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:05.036581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:05.619243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:05.634227 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98359d6f-fff9-4738-bb8b-37b239fb13ea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.613064 Oct 04 11:18:05.635654 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2779/4013] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:05 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:05.650251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:05.650882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:05.685861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:05.686173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:05.686621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:05.687826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:05.688242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:05.688673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:06.162410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:06.182837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6da55a14-4d7c-4356-a884-f3c46f55934b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1316 microversion: 2.1 time: 0.536003 Oct 04 11:18:06.184300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2780/4014] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:05 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:06.189798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:06.190790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:06.205531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:06.206282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:06.206882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:06.207793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:06.208414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:06.209001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:06.306130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:06.380161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:06.394854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:06.398952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:06.406179 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0670fd6d-9c86-4d4e-9c02-477c240b054d tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.220598 Oct 04 11:18:06.410153 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2781/4015] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:06 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:06.417116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:06.420335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:06.441967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:06.444542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:06.446164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:06.447676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:06.448565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:06.449449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:06.700798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:06.711152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:06.712684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:06.714040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-56132cd9-b4d5-4b37-9f64-2a27710c6ed8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.302666 Oct 04 11:18:06.714983 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2782/4016] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:06 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:06.719955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:06.720654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:06.727935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:06.728539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:06.729072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:06.729997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:06.730746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:06.731247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:06.948072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:06.960780 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1a41465-7bef-492b-ab08-0a004db0b8a6 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1502 microversion: 2.1 time: 0.244112 Oct 04 11:18:06.962973 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2783/4017] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:06 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:07.308047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4700a092-fce7-461f-a5b2-f98233627e83 tempest-QuotaClassesAdminTestJSON-542159945 tempest-QuotaClassesAdminTestJSON-542159945-project-admin] Calling method '.version_select at 0x7f71cf06f940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:07.319673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4700a092-fce7-461f-a5b2-f98233627e83 tempest-QuotaClassesAdminTestJSON-542159945 tempest-QuotaClassesAdminTestJSON-542159945-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.355519 Oct 04 11:18:07.327303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2784/4018] 10.222.0.23 () {58 vars in 1185 bytes} [Tue Oct 4 11:18:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:07.332736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:07.333773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:07.339631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:07.340122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:07.340555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:07.341306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:07.341792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:07.342219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:07.568999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:07.589412 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fdbd4dae-8ae5-48cf-9557-03245ff9192a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.260868 Oct 04 11:18:07.590621 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2785/4019] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:07 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:07.600965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:07.602398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:07.615720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:07.616256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:07.616704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:07.617464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:07.617964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:07.618399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:07.687234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lazy-loading 'flavor' on Instance uuid 8219af10-9131-46d1-a559-de9196299a29 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:18:07.804203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a693bbf8-fe5a-4a4b-b4d9-982ef0bd5d82 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "POST /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29/action" status: 202 len: 0 microversion: 2.1 time: 0.212119 Oct 04 11:18:07.808062 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2786/4020] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:18:07 2022] POST /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:18:07.811120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:07.811937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:07.819216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:07.823342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:07.823955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:07.824805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:07.825400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:07.826169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:08.014011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:08.022559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9f77df6-be30-45f2-a4d2-4ef43318d878 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1316 microversion: 2.1 time: 0.215790 Oct 04 11:18:08.025749 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2787/4021] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:07 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:08.031111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81ab31be-f224-46b9-b309-6f397ca2578f tempest-QuotaClassesAdminTestJSON-542159945 tempest-QuotaClassesAdminTestJSON-542159945-project-admin] Action: 'update', calling method: .version_select at 0x7f71cf069310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:08.219010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=11,nova_api:INSERT=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:08.322785 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81ab31be-f224-46b9-b309-6f397ca2578f tempest-QuotaClassesAdminTestJSON-542159945 tempest-QuotaClassesAdminTestJSON-542159945-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.295685 Oct 04 11:18:08.329728 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2788/4022] 10.222.0.23 () {60 vars in 1206 bytes} [Tue Oct 4 11:18:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:08.336761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:08.337421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:08.354141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:08.354653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:08.355095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:08.355817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:08.356279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:08.356696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:08.505245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:08.514168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:08.515853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:08.517278 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c6d84a8-ce4b-40e6-b2c5-e77020e558f9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.185446 Oct 04 11:18:08.518236 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2789/4023] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:08 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:08.523523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d00f8768-b4e3-4b91-9f60-909e918a612a req-9d4cdeda-2c37-40da-b3dd-45ac941045ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d5329f-b493-4a25-a450-823121e8358a", "name": "network-vif-plugged", "status": "completed", "tag": "e7754be9-28f5-4ac8-8494-76e4d61e21a4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:08.535143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d00f8768-b4e3-4b91-9f60-909e918a612a req-9d4cdeda-2c37-40da-b3dd-45ac941045ed service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:08.536075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d00f8768-b4e3-4b91-9f60-909e918a612a req-9d4cdeda-2c37-40da-b3dd-45ac941045ed service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:08.536885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d00f8768-b4e3-4b91-9f60-909e918a612a req-9d4cdeda-2c37-40da-b3dd-45ac941045ed service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:08.556781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d00f8768-b4e3-4b91-9f60-909e918a612a req-9d4cdeda-2c37-40da-b3dd-45ac941045ed service nova] Creating event network-vif-plugged:e7754be9-28f5-4ac8-8494-76e4d61e21a4 for instance 53d5329f-b493-4a25-a450-823121e8358a on n-h1-791135-8 Oct 04 11:18:08.570806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d00f8768-b4e3-4b91-9f60-909e918a612a req-9d4cdeda-2c37-40da-b3dd-45ac941045ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051183 Oct 04 11:18:08.571632 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2790/4024] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:08.577659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:08.578349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:08.587193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:08.587698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:08.588436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:08.589295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:08.590168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:08.590640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:08.855393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:08.868934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:08.869297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:08.870713 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94a34a73-5880-41a8-a5b2-8786e5268216 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.298074 Oct 04 11:18:08.880887 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2791/4025] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:08 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:08.886160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:08.886981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:08.895415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:08.895913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:08.896354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:08.897100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:08.897607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:08.898045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:09.159433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:09.167303 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-373a2024-ad57-42d4-87f0-f3b66114fa54 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1493 microversion: 2.1 time: 0.288511 Oct 04 11:18:09.181560 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2792/4026] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:08 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1493 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:09.181560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b044ce7-dc6f-475a-9e67-05feb0d5a167 tempest-QuotaClassesAdminTestJSON-542159945 tempest-QuotaClassesAdminTestJSON-542159945-project-admin] Calling method '.version_select at 0x7f71cf0708b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:09.193692 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b044ce7-dc6f-475a-9e67-05feb0d5a167 tempest-QuotaClassesAdminTestJSON-542159945 tempest-QuotaClassesAdminTestJSON-542159945-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.024710 Oct 04 11:18:09.194830 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2793/4027] 10.222.0.23 () {58 vars in 1185 bytes} [Tue Oct 4 11:18:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:09.203213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:09.204009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:09.211210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:09.211706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:09.212141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:09.213612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:09.214036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:09.214471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:09.442479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:09.451540 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-186149fb-0e9d-43b2-9414-4b5b481c48c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.255357 Oct 04 11:18:09.458121 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2794/4028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:09 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:09.464368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:09.465168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:09.478410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:09.478911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:09.479356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:09.480074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:09.480531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:09.480969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:09.646426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:09.655213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-269de2d7-6e72-4a27-a8ed-28c02a8ca8f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1316 microversion: 2.1 time: 0.195831 Oct 04 11:18:09.669381 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2795/4029] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:09 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:09.674456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:09.675154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:09.682767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:09.683322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:09.683774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:09.684919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:09.685451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:09.685882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:09.716641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:18:09.720073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:09.807686 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e8306ae-124e-4200-af22-a91432a8ad28 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 204 len: 0 microversion: 2.1 time: 0.150379 Oct 04 11:18:09.808566 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2796/4030] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:09 2022] DELETE /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:18:09.813944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bee08299-8dc0-423c-b143-38db0d2df86b tempest-QuotaClassesAdminTestJSON-542159945 tempest-QuotaClassesAdminTestJSON-542159945-project-admin] Action: 'update', calling method: .version_select at 0x7f71cef82670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:10.004434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bee08299-8dc0-423c-b143-38db0d2df86b tempest-QuotaClassesAdminTestJSON-542159945 tempest-QuotaClassesAdminTestJSON-542159945-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.194351 Oct 04 11:18:10.005051 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2797/4031] 10.222.0.23 () {60 vars in 1206 bytes} [Tue Oct 4 11:18:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:10.009812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:10.010542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:10.020609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.021802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.022579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.023303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.023766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.024215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.107727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:10.118826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:10.120530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:10.122574 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae3b996a-9f59-4862-8d8b-2a2d9e16fbd9 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.116514 Oct 04 11:18:10.123411 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2798/4032] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:10 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:10.128600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:10.129428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:10.145714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.146213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.146658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.147374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.147832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.148439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.316580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:10.325536 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba954d85-b455-4102-8680-2b75c4057840 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1499 microversion: 2.1 time: 0.201041 Oct 04 11:18:10.341123 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2799/4033] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:10 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1499 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:10.346428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:10.347170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:10.355267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.355764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.356196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.357514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.357971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.358461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.663815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:10.673456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:10.676550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:10.678187 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a52a71a0-2544-4ddb-8e92-e9346fb0d81d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.350817 Oct 04 11:18:10.679589 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2800/4034] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:10 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:10.690746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:10.691606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:10.699175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.699997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.701092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.702138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.702480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.702916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.901869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:10.911130 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11448cf5-acf6-4e65-8d94-eaab3bb08ec9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.229704 Oct 04 11:18:10.920857 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2801/4035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:10 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:10.927395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:10.928227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:10.937443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.937443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.937443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:10.937443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:10.938092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:10.939799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:11.159325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:11.168080 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f82521f-2118-4830-8212-bcdc487098aa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.245336 Oct 04 11:18:11.181561 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2802/4036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:10 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:11.181561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:11.181561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:11.181561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:11.181561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:11.181561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:11.182167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:11.182848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:11.183135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:11.386229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:11.401228 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-88432ffa-647c-488d-9f1b-f3c0c09c21d4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1316 microversion: 2.1 time: 0.230947 Oct 04 11:18:11.402141 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2803/4037] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:11 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:11.407847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:11.408580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:11.419790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:11.420425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:11.420995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:11.422160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:11.422883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:11.423424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:11.509200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:11.519831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:11.521278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:11.522557 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9dc60e9-bd40-43bb-90aa-24dfa75ee754 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.119022 Oct 04 11:18:11.523185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2804/4038] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:11 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:11.531709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:11.531709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:11.535354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:11.535814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:11.536280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:11.536996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:11.537550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:11.537905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:11.702273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:11.710413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12bd158e-c8d3-4247-a04c-44fccb23ec95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.186188 Oct 04 11:18:11.717422 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2805/4039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:11 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:11.717422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:11.717422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:11.723480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:11.723870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:11.724376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:11.725241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:11.725863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:11.726377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:12.415394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510d473de29b4d7d8bb303f64f1e17d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9347664341cd4b5abbf6bffd5a6da90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:12.425080 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69c2122a-7568-4e48-8b0d-2abef344cd3d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 200 len: 1499 microversion: 2.1 time: 0.712300 Oct 04 11:18:12.425682 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2806/4040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:11 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 1499 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:12.446001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:12.446812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:12.453195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:12.453970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:12.454570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:12.455475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:12.456078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:12.456647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:12.699374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:12.708951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:12.711418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:12.713228 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b77333e-32f1-4e9c-85b9-88619aa9ffed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.271203 Oct 04 11:18:12.726068 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2807/4041] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:12 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:12.740081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:12.740885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:12.762228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:12.763001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:12.763587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:12.764608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:12.765217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:12.765813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:13.125448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:13.139164 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd2c9463-b22f-4eb4-ad70-9de8aecf72dd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.409003 Oct 04 11:18:13.147784 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2808/4042] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:12 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:13.160338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:13.161004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:13.194514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:13.196932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:13.199577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:13.204421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:13.205126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:13.210908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:13.481463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:13.490553 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c3d3e2ee-352f-44b1-8de5-86eae6445421 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.341415 Oct 04 11:18:13.491154 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2809/4043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:13 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:13.516363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:13.517465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:13.528424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:13.529211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:13.530716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:13.531452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:13.532108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:13.532699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:13.802041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:13.817545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6488c3d-918a-4fff-9eea-b65c326f3d29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1316 microversion: 2.1 time: 0.310464 Oct 04 11:18:13.818756 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2810/4044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:13 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:13.826033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:13.827383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:13.838651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:13.839324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:13.840659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:13.842141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:13.842781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:13.843226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.027378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:14.043373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:14.046619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:14.048810 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f302c1c5-b627-4605-808d-5aa4342ed5d0 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.228062 Oct 04 11:18:14.050584 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2811/4045] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:13 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:14.072131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b0c57984-f66f-441f-b18b-4a72bb668877 req-064444b6-65dd-4c9c-9c88-999d2b54c3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219af10-9131-46d1-a559-de9196299a29", "name": "network-vif-deleted", "tag": "28513d2d-daee-4cdf-a162-adbe32ea4325"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:14.090418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b0c57984-f66f-441f-b18b-4a72bb668877 req-064444b6-65dd-4c9c-9c88-999d2b54c3b9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.097390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b0c57984-f66f-441f-b18b-4a72bb668877 req-064444b6-65dd-4c9c-9c88-999d2b54c3b9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.099286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b0c57984-f66f-441f-b18b-4a72bb668877 req-064444b6-65dd-4c9c-9c88-999d2b54c3b9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.126798 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b0c57984-f66f-441f-b18b-4a72bb668877 req-064444b6-65dd-4c9c-9c88-999d2b54c3b9 service nova] Creating event network-vif-deleted:28513d2d-daee-4cdf-a162-adbe32ea4325 for instance 8219af10-9131-46d1-a559-de9196299a29 on n-h2-791135-8 Oct 04 11:18:14.137838 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b0c57984-f66f-441f-b18b-4a72bb668877 req-064444b6-65dd-4c9c-9c88-999d2b54c3b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084511 Oct 04 11:18:14.140385 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2812/4046] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:14.148272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:14.149591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:14.157784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.158745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.159415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.161042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.162118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.163018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.185533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:14.402128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:14.413115 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d9665b3-48f9-4aaa-9b7d-b264530ccf69 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.269380 Oct 04 11:18:14.427796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2813/4047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:14 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:14.445585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:14.446534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:14.455889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.456506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.456950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.457714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.458165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.459488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.478065 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 HTTP/1.1 Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8219af10-9131-46d1-a559-de9196299a29'} Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:14.480661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.484205 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:14.484205 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:14.484205 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:14.484205 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:14.484205 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:14.484205 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.484205 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.487215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:14.488328 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6511d3e-f3d1-499a-8d91-1441dbd92a1b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 404 len: 111 microversion: 2.1 time: 0.059217 Oct 04 11:18:14.489197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2814/4048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:14 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:14.498666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:14.499283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:14.502596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:UPDATE=18,nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:14.506601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.507126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.507539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.508240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.509090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.509938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.684408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:14.695278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:14.697236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:14.698769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-213286a6-73f2-4a89-b02d-5ecc54f22500 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.208603 Oct 04 11:18:14.699844 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2815/4049] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:14 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:14.862423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-057d9731-b771-48ee-851c-4d2f756bc321 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:14.870985 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-057d9731-b771-48ee-851c-4d2f756bc321 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.169670 Oct 04 11:18:14.871712 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2816/4050] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:14.884802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:14.885044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:14.892324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.893370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.893822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.894523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.894977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.895394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.910109 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 HTTP/1.1 Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8219af10-9131-46d1-a559-de9196299a29'} Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:14.911992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf7cb72d-e1ad-4203-93db-dd37a180b54b tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 404 len: 111 microversion: 2.1 time: 0.032655 Oct 04 11:18:14.915368 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2817/4051] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:14 2022] DELETE /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:14.918717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:14.919318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:14.925994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.926482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.926948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:14.927651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:14.928106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:14.928531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:15.225857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:15.240009 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-05de63af-92b0-4689-b239-eb5407063346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.324698 Oct 04 11:18:15.245171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2818/4052] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:14 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:15.250587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1470421046", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:15.339731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] validate_networks() for [('b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:18:15.921459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:18:15.922007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:18:15.922365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:18:15.922782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:18:15.923204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:18:15.935356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:15.935857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:15.936471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:15.937216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:15.937715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:15.938208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:15.957277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:15.962726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for user 2e4e772e6a5b41a0b0f836b374bc69b4 and project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:15.976827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:18:15.979208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:18:16.030906 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-811bdaef-f916-4cf4-8696-1295e8cb91e4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784350 Oct 04 11:18:16.031734 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2819/4053] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:18:16.045078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:16.046130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:16.067538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.068039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.068478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.069190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.069680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.070107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.250887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:16.265650 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-288db630-cc2f-4b38-8bee-dc6c43bdfc97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.232391 Oct 04 11:18:16.267185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2820/4054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:16 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:16.276256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5c366d1-8ec7-444c-a644-d9d3762b7702 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:16.327528 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5c366d1-8ec7-444c-a644-d9d3762b7702 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.054273 Oct 04 11:18:16.329152 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2821/4055] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:18:16 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:16.344037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:16.345159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 8219af10-9131-46d1-a559-de9196299a29] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:16.353250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.353770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.354201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.355146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.355610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.356067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.383414 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 HTTP/1.1 Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8219af10-9131-46d1-a559-de9196299a29'} Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:16.385896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:16.389444 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:16.389444 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:16.389444 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:16.389444 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:16.389444 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:16.389444 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. Oct 04 11:18:16.389444 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:16.391565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 8219af10-9131-46d1-a559-de9196299a29 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:16.393179 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c05d6d4-fc48-47c9-b2c0-027157c91186 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29" status: 404 len: 111 microversion: 2.1 time: 0.052529 Oct 04 11:18:16.394538 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2822/4056] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:16 2022] GET /compute/v2.1/servers/8219af10-9131-46d1-a559-de9196299a29 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:16.407605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:16.408297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:16.415381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.416087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.416672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.417567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.418183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.418817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.522946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:16.532579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:16.534413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:16.536016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9d1bb44-c7f5-4639-8174-5e6a285e06c4 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.140175 Oct 04 11:18:16.536591 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2823/4057] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:16 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:16.541436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:16.542261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:16.548464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.549173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.549832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.550813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.551493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.552141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.787415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:16.802688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:16.804160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:16.805399 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1da7ed8-e80b-481d-94c6-88b7c2f370de tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.267691 Oct 04 11:18:16.806508 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2824/4058] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:16 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:16.813591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:16.814363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:16.822987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.823491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.823935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.824656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.825116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.825580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.929151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:16.941215 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-67ed2966-276a-4e5e-ab7f-87ccfe306320 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1219 microversion: 2.1 time: 0.133563 Oct 04 11:18:16.941836 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2825/4059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:16 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:16.947620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:16.948861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:16.956098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.956769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.957276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:16.958015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:16.958473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:16.958903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:17.195816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:17.204342 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-20c527b7-2e34-4261-a6d5-13011dd1d6b6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.261221 Oct 04 11:18:17.204939 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2826/4060] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:16 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:17.209795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b3c35bd6-38a0-457c-8c0e-ff53da17549a tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:17.217659 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b3c35bd6-38a0-457c-8c0e-ff53da17549a tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011384 Oct 04 11:18:17.228526 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2827/4061] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:17.233918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:17.234636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:17.242605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:17.243008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:17.243487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:17.244197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:17.244814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:17.245437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:17.265773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c HTTP/1.1 Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '640c0385-3b41-480f-8494-692f2fdd866c'} Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:17.267656 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:17.271352 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:17.274147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:17.275232 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0c2d25c-b237-410c-a43a-ac41c22e3029 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 404 len: 111 microversion: 2.1 time: 0.045414 Oct 04 11:18:17.276308 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2828/4062] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:17 2022] DELETE /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:17.281397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1675338488", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:17.341208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] validate_networks() for [('350c987a-5b2c-443d-b477-a345ff55756e', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:18:18.030252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:18:18.030801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:18:18.031322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:18:18.031866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:18:18.032352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:18:18.042265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.042758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.043203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.043935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.044394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.044950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.070007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Getting quotas for project 2031b742afb6490790401bc9da99e6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:18.076603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Getting quotas for user d9f8fec48e504ec4a91b7ee04bfdeadb and project 2031b742afb6490790401bc9da99e6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:18.092088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:18:18.095038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:18:18.143102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9ffca2c2-318d-4cbd-bf31-def43d850a0b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864921 Oct 04 11:18:18.143957 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2829/4063] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:18:18.148768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6014c3ae-a670-4a40-b214-498ec6e45595 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:18.157216 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6014c3ae-a670-4a40-b214-498ec6e45595 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011964 Oct 04 11:18:18.157821 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2830/4064] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:18.162593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:18.163142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 640c0385-3b41-480f-8494-692f2fdd866c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:18.173302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.173302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.174401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.174401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.174873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.175313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.193988 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c HTTP/1.1 Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '640c0385-3b41-480f-8494-692f2fdd866c'} Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:18.195870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:18.199686 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:18.199686 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:18.199686 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:18.199686 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:18.199686 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:18.199686 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. Oct 04 11:18:18.199686 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:18.201611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 640c0385-3b41-480f-8494-692f2fdd866c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:18.207066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9c9f44a7-065a-409a-a0cc-46372340f4fc tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c" status: 404 len: 111 microversion: 2.1 time: 0.048240 Oct 04 11:18:18.207649 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2831/4065] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:18 2022] GET /compute/v2.1/servers/640c0385-3b41-480f-8494-692f2fdd866c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:18.213645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:18.214324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:18.220341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.220927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.221888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.223959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.223959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.223959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.325491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:18.349393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:18.351289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:18.352443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e64ab67-f1df-4e46-a948-3714c875f490 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.143640 Oct 04 11:18:18.355773 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2832/4066] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:18 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:18.363808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:18.364734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:18.379056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.380246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.381133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.382206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.382874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.383511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.666709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:18.679061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:18.682420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:18.684229 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-100cd339-0d02-48f4-8a43-b950d78345f3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.324997 Oct 04 11:18:18.685658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2833/4067] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:18 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:18.691360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:18.692199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:18.699682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.700290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.701034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.701863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.702542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.703181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.835703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:18.844280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e883dc3b-28e0-4019-b2b4-63fd61f96dce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1273 microversion: 2.1 time: 0.157457 Oct 04 11:18:18.845050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2834/4068] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:18 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:18.850359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:18.850978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:18.857258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.857867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.858322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:18.859034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:18.859499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:18.860712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:19.359176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:19.372865 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-299b377d-4228-4f85-9d17-0421831fc1fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1213 microversion: 2.1 time: 0.525980 Oct 04 11:18:19.376859 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2835/4069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:18 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1213 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:19.385194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13c35d0e-b3b8-4c83-ad88-56e6ab3fa658 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:19.431772 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13c35d0e-b3b8-4c83-ad88-56e6ab3fa658 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.052516 Oct 04 11:18:19.433546 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2836/4070] 10.222.0.23 () {58 vars in 1165 bytes} [Tue Oct 4 11:18:19 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:19.439989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:19.440927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:19.451461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:19.452698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:19.453406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:19.454417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:19.455641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:19.456301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:19.481237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 HTTP/1.1 Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'ec51c0bd-aa08-4238-a45e-423092ecdd39'} Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:19.485596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:19.488954 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:19.490948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:19.494957 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b3dfc95-0d36-466c-9bfb-4222c6ce3b5e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 404 len: 111 microversion: 2.1 time: 0.058919 Oct 04 11:18:19.498042 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2837/4071] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:19 2022] DELETE /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:19.501097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:19.502342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:19.508667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:19.509220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:19.509698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:19.510418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:19.510882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:19.511363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:19.804672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:19.816559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfc08199-7191-416f-9b94-ee8a3be6cf6b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.320084 Oct 04 11:18:19.817427 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2838/4072] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:19 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:19.822413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:19.834416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:19.841796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:19.842642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:19.843290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:19.844288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:19.844967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:19.845712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:19.952328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:19.966879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:19.971389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:19.976757 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2cd8c0e5-c18f-4a62-b5fc-a26f2c730867 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.155489 Oct 04 11:18:19.977497 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2839/4073] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:19 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:19.988795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c256f70e-d1a4-422a-966b-91bf01b98f66 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:20.000170 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c256f70e-d1a4-422a-966b-91bf01b98f66 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021527 Oct 04 11:18:20.008122 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2840/4074] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:20.008122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:20.008122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: ec51c0bd-aa08-4238-a45e-423092ecdd39] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:20.014232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:20.014724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:20.015466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:20.016229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:20.016881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:20.017102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:20.034925 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 HTTP/1.1 Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'ec51c0bd-aa08-4238-a45e-423092ecdd39'} Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:20.036730 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance ec51c0bd-aa08-4238-a45e-423092ecdd39 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18708d72-9697-445e-b784-91c87bfe1142 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39" status: 404 len: 111 microversion: 2.1 time: 0.036054 Oct 04 11:18:20.041772 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2841/4075] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:20 2022] GET /compute/v2.1/servers/ec51c0bd-aa08-4238-a45e-423092ecdd39 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:20.045028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:20.045708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:20.060108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:20.060912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:20.062360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:20.063292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:20.063969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:20.067518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:20.074421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:20.395931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:20.411316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:20.413489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:20.415139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92f54a6e-9870-4b9e-b5a6-f7ec0164c1d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.373991 Oct 04 11:18:20.416019 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2842/4076] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:20 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:20.424841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:20.426548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:20.436851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:20.439641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:20.440391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:20.441649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:20.442760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:20.443533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:20.873740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:20.885857 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31484491-cddb-4736-a5c7-12734dcf43ec tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1315 microversion: 2.1 time: 0.468468 Oct 04 11:18:20.895519 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2843/4077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:20 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:20.895519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1b1fa50-0663-4628-9c92-ab5608dd6b94 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:20.952843 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1b1fa50-0663-4628-9c92-ab5608dd6b94 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.063046 Oct 04 11:18:20.967961 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2844/4078] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Oct 4 11:18:20 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:20.973572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:20.975704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:20.987546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:20.988860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:20.988860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:20.989418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:20.989869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:20.990305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.030716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 HTTP/1.1 Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '429321cb-fd5a-48ad-9bae-33c0b5b4e342'} Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:21.041336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:21.044831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:21.050921 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-26937741-c0e7-4114-a8a6-b66e86e52a43 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 404 len: 111 microversion: 2.1 time: 0.075170 Oct 04 11:18:21.054385 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2845/4079] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:20 2022] DELETE /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:21.074169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:21.074812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:21.087140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:21.087698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:21.089975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.092528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:21.092729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:21.094418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.252762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:21.262014 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4d9cc586-a361-4f74-9746-87a24f512c3c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1275 microversion: 2.1 time: 0.208176 Oct 04 11:18:21.263246 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2846/4080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:21 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:21.268694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:21.269747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:21.284814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:21.286084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:21.286927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.287889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:21.290025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:21.290845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.651277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:21.676008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ae88e11-8268-454d-b77b-0083b946c5d1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.410975 Oct 04 11:18:21.679448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2847/4081] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:21 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:21.695472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94fd7172-b625-4760-b504-d68990a65390 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:21.746156 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94fd7172-b625-4760-b504-d68990a65390 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.062690 Oct 04 11:18:21.748371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2848/4082] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 11:18:21 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:21.757001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:21.757924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:21.772127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:21.774838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:21.775356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.777952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:21.778525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:21.778978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.904924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:21.919037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:21.920471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:21.921735 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22a5999e-5082-438a-8eb5-2ce9e682b612 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.169848 Oct 04 11:18:21.922310 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2849/4083] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:21 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:21.942805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:21.943576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 429321cb-fd5a-48ad-9bae-33c0b5b4e342] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:21.958066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:21.958572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:21.959017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.959740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:21.960201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:21.960639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:21.992359 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 HTTP/1.1 Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '429321cb-fd5a-48ad-9bae-33c0b5b4e342'} Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:22.001311 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 429321cb-fd5a-48ad-9bae-33c0b5b4e342 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:22.005511 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1f65657c-0aca-4889-afca-8b7ca364f583 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342" status: 404 len: 111 microversion: 2.1 time: 0.079802 Oct 04 11:18:22.015684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2850/4084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:21 2022] GET /compute/v2.1/servers/429321cb-fd5a-48ad-9bae-33c0b5b4e342 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:22.020828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:22.021495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:22.024456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:22.028342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:22.028667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:22.029116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:22.029853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:22.030318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:22.030779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:22.397297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:22.454592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:22.458601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:22.460244 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-960af427-9d90-435c-85dc-50bd99b908d6 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.443447 Oct 04 11:18:22.467694 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2851/4085] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:22 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:22.477431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-12997d4d-70e5-4723-8460-5132541ad2af req-1b0bab6d-aedb-4f35-b0b4-0dd12c017ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6e745e-9cfe-4562-a91f-7fa25f3ad109", "name": "network-vif-plugged", "status": "completed", "tag": "8a5bddce-130d-4805-99d6-8f5074eab124"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:22.489533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-12997d4d-70e5-4723-8460-5132541ad2af req-1b0bab6d-aedb-4f35-b0b4-0dd12c017ed5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:22.495127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-12997d4d-70e5-4723-8460-5132541ad2af req-1b0bab6d-aedb-4f35-b0b4-0dd12c017ed5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:22.495809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-12997d4d-70e5-4723-8460-5132541ad2af req-1b0bab6d-aedb-4f35-b0b4-0dd12c017ed5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:22.512546 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-12997d4d-70e5-4723-8460-5132541ad2af req-1b0bab6d-aedb-4f35-b0b4-0dd12c017ed5 service nova] Creating event network-vif-plugged:8a5bddce-130d-4805-99d6-8f5074eab124 for instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 on n-h1-791135-8 Oct 04 11:18:22.520939 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-12997d4d-70e5-4723-8460-5132541ad2af req-1b0bab6d-aedb-4f35-b0b4-0dd12c017ed5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051156 Oct 04 11:18:22.524759 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2852/4086] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:22.537842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4360896d-22de-405c-bafc-dde0f44789a3 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:22.555168 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4360896d-22de-405c-bafc-dde0f44789a3 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026209 Oct 04 11:18:22.555785 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2853/4087] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:22.567050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:22.567817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:22.586418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:22.587307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:22.587990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:22.589105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:22.589822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:22.590474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:22.932438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:22.952216 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29f54687-49ac-4b71-bfe7-e3561f0e4269 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1315 microversion: 2.1 time: 0.395095 Oct 04 11:18:22.952592 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2854/4088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:22 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:22.980688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:22.981892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:22.989199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:22.989794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:22.991169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:22.992076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:23.003249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:23.003867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:23.030723 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 HTTP/1.1 Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'db8d07bc-542d-4a94-8d39-8a895efc5346'} Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:23.032489 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa812851-1067-4c05-bb38-3279c6d7d6ca tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 404 len: 111 microversion: 2.1 time: 0.058322 Oct 04 11:18:23.035947 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2855/4089] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:22 2022] DELETE /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:23.048202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:23.053568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:23.060112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:23.060605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:23.061045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:23.061782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:23.062239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:23.062669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:23.343192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:23.353293 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5fa9ec68-8ea4-49af-a131-fabbd3d767a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1317 microversion: 2.1 time: 0.313395 Oct 04 11:18:23.366530 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2856/4090] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:23 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:23.377501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-91663908-fd96-41d3-b0cc-420ffbcfc1af req-d13291df-9f09-4d3b-89c3-f07f89376537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbec6d8-d808-467b-af5e-8f1e745928b3", "tag": "e50fc86a-60ea-495c-a7aa-2a1369c1c8a6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:23.388394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91663908-fd96-41d3-b0cc-420ffbcfc1af req-d13291df-9f09-4d3b-89c3-f07f89376537 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:23.388998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91663908-fd96-41d3-b0cc-420ffbcfc1af req-d13291df-9f09-4d3b-89c3-f07f89376537 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:23.389562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91663908-fd96-41d3-b0cc-420ffbcfc1af req-d13291df-9f09-4d3b-89c3-f07f89376537 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:23.405167 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-91663908-fd96-41d3-b0cc-420ffbcfc1af req-d13291df-9f09-4d3b-89c3-f07f89376537 service nova] Creating event network-changed:e50fc86a-60ea-495c-a7aa-2a1369c1c8a6 for instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 on n-h1-791135-8 Oct 04 11:18:23.428806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-91663908-fd96-41d3-b0cc-420ffbcfc1af req-d13291df-9f09-4d3b-89c3-f07f89376537 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055476 Oct 04 11:18:23.429509 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2857/4091] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:23.436697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-204e84aa-ca6f-4797-a441-420f04c77709 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:23.503851 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-204e84aa-ca6f-4797-a441-420f04c77709 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.071209 Oct 04 11:18:23.510316 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2858/4092] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Oct 4 11:18:23 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:23.518132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:23.520436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:23.527358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:23.528063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:23.528713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:23.529698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:23.530503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:23.531014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:23.878932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:23.887030 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-83d0c901-1a1e-4e28-926a-9cdf978147c2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.376324 Oct 04 11:18:23.887701 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2859/4093] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:23 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:23.892593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:23.893328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:23.899757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:23.900048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:23.900864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:23.901386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:23.901823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:23.902356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:24.370322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:24.384489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:24.386228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:24.387525 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e31a2b1-c903-4ae8-bf6d-e97821a54747 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.498599 Oct 04 11:18:24.388262 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2860/4094] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:23 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:24.394034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:24.394848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: db8d07bc-542d-4a94-8d39-8a895efc5346] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:24.400756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:24.401247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:24.401994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:24.402860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:24.403843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:24.404431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:24.424406 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 HTTP/1.1 Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'db8d07bc-542d-4a94-8d39-8a895efc5346'} Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:24.426637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance db8d07bc-542d-4a94-8d39-8a895efc5346 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a809a987-2983-42ba-bf09-03689d076868 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346" status: 404 len: 111 microversion: 2.1 time: 0.039204 Oct 04 11:18:24.432637 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2861/4095] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:24 2022] GET /compute/v2.1/servers/db8d07bc-542d-4a94-8d39-8a895efc5346 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:24.435021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:24.435181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:24.442426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:24.442930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:24.443606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:24.444568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:24.445032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:24.445496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:24.787654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:24.801462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:24.803870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:24.805574 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f06acf13-8b52-498d-ab89-38fa9028a650 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1807 microversion: 2.20 time: 0.374998 Oct 04 11:18:24.806371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2862/4096] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:24 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:24.811444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-669ecab3-265e-4bc1-ba25-5c0f9fc8e971 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:24.824922 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-669ecab3-265e-4bc1-ba25-5c0f9fc8e971 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017288 Oct 04 11:18:24.828009 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2863/4097] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:24.833562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:24.834359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:24.840741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:24.841224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:24.841692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:24.842391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:24.842848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:24.843278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:24.982097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:24.990609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8d2e443-d560-4a18-bc08-5648e5b69441 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1315 microversion: 2.1 time: 0.161384 Oct 04 11:18:24.991554 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2864/4098] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:24 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:24.996581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:24.997190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:25.006185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:25.006688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:25.007134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:25.007841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:25.008460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:25.008775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:25.267154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:25.280180 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-463f3645-350a-470e-928b-401ee5395fcb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1317 microversion: 2.1 time: 0.287020 Oct 04 11:18:25.282215 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2865/4099] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:24 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:25.306468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d308fcca-b9a7-4425-be09-2edc3ffb1729 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:25.356765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d308fcca-b9a7-4425-be09-2edc3ffb1729 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.057000 Oct 04 11:18:25.362160 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2866/4100] 10.222.0.23 () {58 vars in 1144 bytes} [Tue Oct 4 11:18:25 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:25.379223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:25.380964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:25.392994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:25.396895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:25.397609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:25.399221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:25.399910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:25.400761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:25.756698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:25.771521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c16b72d9-495e-48fd-85ea-270e48a3c2b4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.397993 Oct 04 11:18:25.772948 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2867/4101] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:25 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:25.783554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bfd582fb-ff82-4ca9-85ba-406e86573006 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:25.797066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bfd582fb-ff82-4ca9-85ba-406e86573006 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022665 Oct 04 11:18:25.798070 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2868/4102] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:25.808194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:25.809641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:25.818998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:25.824036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:25.824989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:25.825939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:25.826582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:25.827715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:25.999770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:26.014722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:26.027268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:26.028790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:26.030051 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c78b0c9-e5fd-46ab-909c-d2b35bf0b9cb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.230077 Oct 04 11:18:26.042610 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2869/4103] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:25 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:26.042610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-77d514e9-170a-485c-83ba-a751dd9e0b32 req-c2327cfd-e579-4930-b40b-13cc70b4627e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f469e62-93a8-41b2-8db4-ae25e848974c", "tag": "6103a7c2-e4d2-4ecb-a391-983b2f4acc36"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:26.052859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77d514e9-170a-485c-83ba-a751dd9e0b32 req-c2327cfd-e579-4930-b40b-13cc70b4627e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.052859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77d514e9-170a-485c-83ba-a751dd9e0b32 req-c2327cfd-e579-4930-b40b-13cc70b4627e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.052859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-77d514e9-170a-485c-83ba-a751dd9e0b32 req-c2327cfd-e579-4930-b40b-13cc70b4627e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:26.064888 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-77d514e9-170a-485c-83ba-a751dd9e0b32 req-c2327cfd-e579-4930-b40b-13cc70b4627e service nova] Creating event network-changed:6103a7c2-e4d2-4ecb-a391-983b2f4acc36 for instance 8f469e62-93a8-41b2-8db4-ae25e848974c on n-h2-791135-8 Oct 04 11:18:26.069821 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-77d514e9-170a-485c-83ba-a751dd9e0b32 req-c2327cfd-e579-4930-b40b-13cc70b4627e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 Oct 04 11:18:26.073623 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2870/4104] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:26.078925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8633f875-257e-41fe-b4d3-43d91fc9c7f2 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:26.103014 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8633f875-257e-41fe-b4d3-43d91fc9c7f2 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.028070 Oct 04 11:18:26.113878 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2871/4105] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Oct 4 11:18:26 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:26.113878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:26.113878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:26.129245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.129808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.130214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:26.130930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.131892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.131892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:26.296755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:26.307823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:26.309866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:26.310916 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71271402-9bec-47fa-812f-791c28a8d2a3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1794 microversion: 2.20 time: 0.204446 Oct 04 11:18:26.317867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2872/4106] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:26 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:26.317867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:26.318093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:26.324261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.324994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.325193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:26.325945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.326405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.326923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:26.559030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:26.572333 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7bd36e52-f4eb-457b-a66b-f9c673a93323 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1315 microversion: 2.1 time: 0.259078 Oct 04 11:18:26.585471 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2873/4107] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:26 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:26.593059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb199bbc-41c1-4d60-8a95-7ac7c503ea2b tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:26.606490 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb199bbc-41c1-4d60-8a95-7ac7c503ea2b tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.019767 Oct 04 11:18:26.607083 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2874/4108] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Oct 4 11:18:26 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:26.619364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:26.621051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:26.628815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.629314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.629812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:26.630622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.631092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.631524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:26.878929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:26.891058 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02a4d980-f9d2-43bc-a9fe-82ff47f4ba97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1317 microversion: 2.1 time: 0.280084 Oct 04 11:18:26.899282 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2875/4109] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:26 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:26.911484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-15652c78-656d-4463-a523-0e037594ee79 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:26.925200 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-15652c78-656d-4463-a523-0e037594ee79 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023175 Oct 04 11:18:26.933132 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2876/4110] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:26.935262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:26.935899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:26.947158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.947666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.948409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:26.949436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:26.950078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:26.950523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:27.118041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:27.130063 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d9b1aa1-cb37-4c93-b6fd-aca13b51d1d5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.199584 Oct 04 11:18:27.130700 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2877/4111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:26 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:27.148500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbdc09bd-70b5-465a-8bbb-66c1c4a0f013 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:27.172844 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbdc09bd-70b5-465a-8bbb-66c1c4a0f013 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.035644 Oct 04 11:18:27.174565 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2878/4112] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:18:27 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:27.179440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:27.180058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:27.189753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:27.190578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:27.190742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:27.191453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:27.192054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:27.192540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:27.270956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:27.280296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:27.281912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:27.283643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-161a58db-ef5b-42f2-a7c9-cd469803f682 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.107455 Oct 04 11:18:27.284541 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2879/4113] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:27 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:27.289892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-215aef09-171e-49fe-a4ac-22421282ee04 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:27.321021 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-215aef09-171e-49fe-a4ac-22421282ee04 tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035065 Oct 04 11:18:27.322955 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2880/4114] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:18:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:27.342549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f786f5ab-285f-4a0c-abe4-1d0cd13a691d tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:27.352741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f786f5ab-285f-4a0c-abe4-1d0cd13a691d tempest-FlavorsV2TestJSON-461076955 tempest-FlavorsV2TestJSON-461076955-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014716 Oct 04 11:18:27.372920 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2881/4115] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:18:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:27.517049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d3b9ec6a-b2af-41e6-bbd9-e9742511abcd req-9b83dcfe-c167-47d2-8ba1-993ddfdb10ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbec6d8-d808-467b-af5e-8f1e745928b3", "name": "network-vif-plugged", "status": "completed", "tag": "e50fc86a-60ea-495c-a7aa-2a1369c1c8a6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:27.538177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d3b9ec6a-b2af-41e6-bbd9-e9742511abcd req-9b83dcfe-c167-47d2-8ba1-993ddfdb10ec service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:27.539014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d3b9ec6a-b2af-41e6-bbd9-e9742511abcd req-9b83dcfe-c167-47d2-8ba1-993ddfdb10ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:27.539666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d3b9ec6a-b2af-41e6-bbd9-e9742511abcd req-9b83dcfe-c167-47d2-8ba1-993ddfdb10ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:27.560112 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d3b9ec6a-b2af-41e6-bbd9-e9742511abcd req-9b83dcfe-c167-47d2-8ba1-993ddfdb10ec service nova] Creating event network-vif-plugged:e50fc86a-60ea-495c-a7aa-2a1369c1c8a6 for instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 on n-h1-791135-8 Oct 04 11:18:27.567770 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d3b9ec6a-b2af-41e6-bbd9-e9742511abcd req-9b83dcfe-c167-47d2-8ba1-993ddfdb10ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054943 Oct 04 11:18:27.568986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2882/4116] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:27.600304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:27.601831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:27.610625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:27.613631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:27.615386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:27.616829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:27.617497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:27.618391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:28.053213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:28.085067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=82,nova_cell0:UPDATE=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:28.210975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:28.223407 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aefcb9f4-6694-4096-b4ce-befcff556ebe tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1315 microversion: 2.1 time: 0.631856 Oct 04 11:18:28.224970 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2883/4117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:27 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:18:28.238598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:28.239232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:28.257823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:28.260929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:28.261923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:28.263864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:28.264356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:28.264790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:28.818034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:28.837107 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82ce905f-5e24-4559-ba9d-e3d40f09c5fe tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1317 microversion: 2.1 time: 0.610184 Oct 04 11:18:28.842382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2884/4118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:28 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:28.862478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:28.864128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:28.889804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:28.892590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:28.893602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:28.898705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:28.899624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:28.902047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.341279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:29.350789 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0a255d8-eb0e-4895-b8dd-8e51553fc7ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.505197 Oct 04 11:18:29.355139 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2885/4119] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:28 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:29.373505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:29.374241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:29.389807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:29.390431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:29.392675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.396463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:29.400740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:29.401547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.538811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:29.561996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:29.571561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:29.578682 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-67466523-fddc-4dfd-9c60-1f18e451754a tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.222424 Oct 04 11:18:29.588574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2886/4120] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:29 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:29.605137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:29.612841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:29.622674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:29.623650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:29.625426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.626395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:29.627077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:29.627721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.649331 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d HTTP/1.1 Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53c34390-7b46-48fa-abcd-67db6ce2a58d'} Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:29.651867 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.655934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:29.656986 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8306ffe-67d8-4af3-a176-8cc3ff76131d tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 404 len: 111 microversion: 2.1 time: 0.061891 Oct 04 11:18:29.657709 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2887/4121] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:29 2022] DELETE /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:29.664506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:29.665243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:29.672744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:29.674667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:29.675193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.676153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:29.676810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:29.677467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.886812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:29.920901 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c484cbcb-b2ff-4db1-9027-c4541780c11b tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1502 microversion: 2.1 time: 0.261183 Oct 04 11:18:29.931505 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2888/4122] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:29 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:29.943610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:29.945700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 53c34390-7b46-48fa-abcd-67db6ce2a58d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:29.958351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:29.959029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:29.959475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.960348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:29.966654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:29.967225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:29.984944 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d HTTP/1.1 Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53c34390-7b46-48fa-abcd-67db6ce2a58d'} Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:29.986946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.991156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:29.991156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:29.991156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:29.991156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:29.991156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:29.991156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. Oct 04 11:18:29.991156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:29.991783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 53c34390-7b46-48fa-abcd-67db6ce2a58d could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:29.992802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-154f29a3-7516-4f6d-adc2-c19d323e8c57 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d" status: 404 len: 111 microversion: 2.1 time: 0.060021 Oct 04 11:18:29.996820 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2889/4123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:29 2022] GET /compute/v2.1/servers/53c34390-7b46-48fa-abcd-67db6ce2a58d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:29.999766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:30.000501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:30.008138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:30.008748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:30.009295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:30.010306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:30.010977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:30.011528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:30.266498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:30.284443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8591ca3a-77d6-4abc-8b49-b5490de9870d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1317 microversion: 2.1 time: 0.289180 Oct 04 11:18:30.285591 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2890/4124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:29 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:30.291979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:30.292724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:30.308671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:30.309629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:30.310462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:30.311307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:30.312186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:30.312784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:30.559617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.security_group_api [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Removing security group 81850bc6-3209-4102-9803-4904b102e2b1 from port e50fc86a-60ea-495c-a7aa-2a1369c1c8a6 Oct 04 11:18:30.949809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5d019d7-5bcc-4acc-a1a7-d58db4ee6cc2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3/action" status: 202 len: 0 microversion: 2.1 time: 0.662869 Oct 04 11:18:30.953996 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2891/4125] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:18:30 2022] POST /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:18:30.956293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:30.956800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:30.969618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:30.970649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:30.971096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:30.972516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:30.973406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:30.974090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:30.995690 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf HTTP/1.1 Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf'} Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:30.997363 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:31.001725 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75170416-c863-446e-bd71-3d4fe642c807 tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 404 len: 111 microversion: 2.1 time: 0.047007 Oct 04 11:18:31.003189 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2892/4126] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:30 2022] DELETE /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:31.009297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:31.010753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:31.017344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.018099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.018551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.019374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.019957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.020250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.306894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:31.335420 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a63448f-3786-4a52-8157-317c1ab6bdf7 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.331122 Oct 04 11:18:31.349753 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2893/4127] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:31 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:31.356521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:31.357322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:31.364042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.364697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.365287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.366176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.366773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.367377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.458943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:31.467939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:31.469413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:31.471419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8ba2eb8-cb37-4f31-bc24-87c8127c41b1 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.120556 Oct 04 11:18:31.471994 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2894/4128] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:31 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:31.477621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecd21517-d50c-4c00-9499-eb18a898d87c tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Calling method '.version_select at 0x7f71cf179dc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:31.533759 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecd21517-d50c-4c00-9499-eb18a898d87c tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c" status: 200 len: 637 microversion: 2.1 time: 0.059964 Oct 04 11:18:31.535816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2895/4129] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:18:31 2022] GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c => generated 637 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:31.542149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:31.542692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:31.554943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.555697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.556521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.557837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.558528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.559716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.658029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:31.665724 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b764bb7d-ea70-4e51-84f7-cc87eb25b59e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1460 microversion: 2.1 time: 0.128701 Oct 04 11:18:31.666302 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2896/4130] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:31 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1460 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:31.670725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-06d4629c-773c-4f5d-9fc5-a6507a04bde2 req-a636b7db-df25-41de-8273-a638c8ff3e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbec6d8-d808-467b-af5e-8f1e745928b3", "tag": "e50fc86a-60ea-495c-a7aa-2a1369c1c8a6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:31.679987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-06d4629c-773c-4f5d-9fc5-a6507a04bde2 req-a636b7db-df25-41de-8273-a638c8ff3e90 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.680477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-06d4629c-773c-4f5d-9fc5-a6507a04bde2 req-a636b7db-df25-41de-8273-a638c8ff3e90 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.680893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-06d4629c-773c-4f5d-9fc5-a6507a04bde2 req-a636b7db-df25-41de-8273-a638c8ff3e90 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.684797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:31.693214 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-06d4629c-773c-4f5d-9fc5-a6507a04bde2 req-a636b7db-df25-41de-8273-a638c8ff3e90 service nova] Creating event network-changed:e50fc86a-60ea-495c-a7aa-2a1369c1c8a6 for instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 on n-h1-791135-8 Oct 04 11:18:31.698147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-06d4629c-773c-4f5d-9fc5-a6507a04bde2 req-a636b7db-df25-41de-8273-a638c8ff3e90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030721 Oct 04 11:18:31.698741 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2897/4131] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:31.703733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:31.704429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] [instance: 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:31.711203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.711630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.712070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.712764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.713222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.713678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.727029 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] HTTP exception thrown: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Request method failure captured: Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf HTTP/1.1 Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBUouKvs_FGVPPICkE-IoB8hcHg9RyMkBDWxyyzIpova8-ODzF_yq9vlQOjQA2SJHRfgkYsgUCe9X4GPnh8CYidhMd1PLq7DYzxj0gNuTbReOTFtwcZ0tnFS6sdGiFn-LZsu-mI_UZkTmTbOaC5s6ImqtOE01u7sfsDeO_n7snr3tRg Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9347664341cd4b5abbf6bffd5a6da90a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9347664341cd4b5abbf6bffd5a6da90a"}]}] Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 9347664341cd4b5abbf6bffd5a6da90a Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1087292872 Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 510d473de29b4d7d8bb303f64f1e17d4 Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1087292872-project Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf'} Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:31.728742 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] Returning 404 to user: Instance 5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfb60771-5d93-495e-82ba-b33d6fd2730e tempest-DeleteServersTestJSON-1087292872 tempest-DeleteServersTestJSON-1087292872-project] 10.222.0.23 "GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf" status: 404 len: 111 microversion: 2.1 time: 0.030382 Oct 04 11:18:31.732436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2898/4132] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:31 2022] GET /compute/v2.1/servers/5ac9f217-1e82-4e9f-8fc8-3c82aa9f6faf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:31.736879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4257cef1-80e0-451e-9693-1169c7ffc1e3 req-5235c001-8f8a-4e23-bd7e-1f37d0be2d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f469e62-93a8-41b2-8db4-ae25e848974c", "name": "network-vif-plugged", "status": "completed", "tag": "6103a7c2-e4d2-4ecb-a391-983b2f4acc36"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:31.746291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4257cef1-80e0-451e-9693-1169c7ffc1e3 req-5235c001-8f8a-4e23-bd7e-1f37d0be2d12 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.748490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4257cef1-80e0-451e-9693-1169c7ffc1e3 req-5235c001-8f8a-4e23-bd7e-1f37d0be2d12 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.748952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4257cef1-80e0-451e-9693-1169c7ffc1e3 req-5235c001-8f8a-4e23-bd7e-1f37d0be2d12 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.763025 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4257cef1-80e0-451e-9693-1169c7ffc1e3 req-5235c001-8f8a-4e23-bd7e-1f37d0be2d12 service nova] Creating event network-vif-plugged:6103a7c2-e4d2-4ecb-a391-983b2f4acc36 for instance 8f469e62-93a8-41b2-8db4-ae25e848974c on n-h2-791135-8 Oct 04 11:18:31.768647 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4257cef1-80e0-451e-9693-1169c7ffc1e3 req-5235c001-8f8a-4e23-bd7e-1f37d0be2d12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036829 Oct 04 11:18:31.769440 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2899/4133] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:31.774619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:31.775320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:31.783633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.784134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.784781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:31.785688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:31.786141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:31.786880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:32.099034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:32.108216 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31ba938e-d858-4758-a4c4-fb3bd64ecc14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1317 microversion: 2.1 time: 0.337276 Oct 04 11:18:32.125295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2900/4134] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:31 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:32.133680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e7751b1-158e-4b35-a802-a990a9434e65 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'update_all', calling method: .version_select at 0x7f71cf179940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:32.200330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:32.206233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5e7751b1-158e-4b35-a802-a990a9434e65 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:32.212808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5e7751b1-158e-4b35-a802-a990a9434e65 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:32.570265 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e7751b1-158e-4b35-a802-a990a9434e65 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.441745 Oct 04 11:18:32.570884 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2901/4135] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:18:32 2022] PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 61 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:32.578079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:32.578713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:32.585419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:32.586509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:32.587198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:32.587986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:32.588596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:32.589425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:33.327840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:33.335733 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5a1d52f-8031-4a3a-afd5-8257a7b2a9ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.762868 Oct 04 11:18:33.336409 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2902/4136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:32 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:33.349465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:33.349465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:33.349465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:33.349465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:33.349465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:33.350218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:33.350738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:33.351463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:33.811743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:33.820869 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c776574-1c92-43ab-b95b-2e40eba4043c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1521 microversion: 2.1 time: 0.483325 Oct 04 11:18:33.825513 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2903/4137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:33 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:33.831207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:33.832087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:33.846815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:33.847321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:33.848045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:33.849343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:33.849842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:33.850449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:34.008481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:34.025725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:34.028176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:34.030461 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d781e7c3-bb10-4131-90b0-88a4a5a15d70 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1366 microversion: 2.57 time: 0.203814 Oct 04 11:18:34.031784 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2904/4138] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:33 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:34.039065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8dd16b0a-f7f5-4de1-a71f-ceb6a98d7aea tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Calling method '.version_select at 0x7f71cf188700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:34.356205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8dd16b0a-f7f5-4de1-a71f-ceb6a98d7aea tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "DELETE /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.322660 Oct 04 11:18:34.356813 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2905/4139] 10.222.0.23 () {58 vars in 1296 bytes} [Tue Oct 4 11:18:34 2022] DELETE /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata/os_version => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:18:34.362610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:34.363243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:34.371000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:34.371504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:34.371948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:34.372839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:34.373780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:34.374379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:34.699707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:34.708705 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfbe14d4-a9ef-4203-b478-e1ea333da83a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1317 microversion: 2.1 time: 0.350724 Oct 04 11:18:34.759294 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2906/4140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:34 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:34.767578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:34.768195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:34.796839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:34.797980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:34.799402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:34.800510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:34.801223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:34.801967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:35.073290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:35.088321 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5df957fe-0c5c-4aaf-ae6c-d0ffd97b3f95 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.326485 Oct 04 11:18:35.108710 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2907/4141] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:34 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:35.114712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57487457-982e-4317-a8d1-0494fe7851f2 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Calling method '.version_select at 0x7f71cf1bb0d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:35.172513 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57487457-982e-4317-a8d1-0494fe7851f2 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.062280 Oct 04 11:18:35.173151 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2908/4142] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:18:35 2022] GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 37 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:35.177975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:35.182000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:35.191298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:35.192611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:35.193224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:35.194767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:35.195807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:35.196412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:35.515517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:35.525748 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d525751-2905-435b-9bed-e4bef6394c80 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1501 microversion: 2.1 time: 0.351357 Oct 04 11:18:35.538294 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2909/4143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:35 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1501 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:35.549888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:35.550518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:35.557268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:35.557865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:35.558589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:35.559442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:35.560042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:35.560606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:35.663514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:35.673945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:35.675526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:35.678691 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e011a85-649b-49b1-8704-6c5c58b47c47 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1372 microversion: 2.57 time: 0.137389 Oct 04 11:18:35.685897 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2910/4144] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:35 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:35.692575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:35.693193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:35.700522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:35.701081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:35.701566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:35.702304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:35.702767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:35.703198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:35.863416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:35.872073 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5aceaf92-2719-4144-9654-3a7617a7a987 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.184961 Oct 04 11:18:35.872783 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2911/4145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:35 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:35.891901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ef48fbe-a741-4fd7-b6c1-9f343ae12563 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'update_all', calling method: .version_select at 0x7f71cf097040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:35.945728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7ef48fbe-a741-4fd7-b6c1-9f343ae12563 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:35.953165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7ef48fbe-a741-4fd7-b6c1-9f343ae12563 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:36.225133 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ef48fbe-a741-4fd7-b6c1-9f343ae12563 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.338180 Oct 04 11:18:36.225930 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2912/4146] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:18:35 2022] PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 61 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:36.235860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:36.236864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:36.243457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:36.243962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:36.244771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:36.245107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:36.245596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:36.246030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:36.402356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:36.417986 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c2231c2-07a4-45fe-9b09-db1dc31b6768 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1515 microversion: 2.1 time: 0.186430 Oct 04 11:18:36.418592 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2913/4147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:36 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:36.423755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:36.424369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:36.430453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:36.430940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:36.431386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:36.432084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:36.432651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:36.433086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:36.571362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:36.580276 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cf1350d-1254-4cfa-a31d-9924c5e002f1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1506 microversion: 2.1 time: 0.160124 Oct 04 11:18:36.583926 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2914/4148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:36 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:36.589044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:36.589917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:36.597681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:36.598410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:36.598872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:36.599706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:36.600176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:36.600822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:36.762952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:36.778445 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0baa633d-cc2f-40d7-bc60-fee6c7494141 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.196109 Oct 04 11:18:36.779515 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2915/4149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:36 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:36.784911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f36905c1-54c9-4e2b-9561-13c397158a4a tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Calling method '.version_select at 0x7f71cf179b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:36.837384 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f36905c1-54c9-4e2b-9561-13c397158a4a tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.055188 Oct 04 11:18:36.839355 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2916/4150] 10.222.0.23 () {58 vars in 1290 bytes} [Tue Oct 4 11:18:36 2022] GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata/os_distro => generated 33 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:36.865430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59cb4900-916e-4559-aa50-b39ce73353ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:36.870642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-59cb4900-916e-4559-aa50-b39ce73353ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 2e120334-351e-4597-89b1-380b2d26d8c5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:36.886213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-59cb4900-916e-4559-aa50-b39ce73353ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Instance 2e120334-351e-4597-89b1-380b2d26d8c5 could not be found. Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59cb4900-916e-4559-aa50-b39ce73353ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/2e120334-351e-4597-89b1-380b2d26d8c5/action HTTP/1.1 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 14 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: {"rescue": {}} Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 2e120334-351e-4597-89b1-380b2d26d8c5 could not be found. Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2e120334-351e-4597-89b1-380b2d26d8c5', 'body': {'rescue': {}}} Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e120334-351e-4597-89b1-380b2d26d8c5 could not be found. Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e120334-351e-4597-89b1-380b2d26d8c5 could not be found. Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:36.897498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:36.901427 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:36.901427 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:36.901427 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:36.901427 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:36.901427 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e120334-351e-4597-89b1-380b2d26d8c5 could not be found. Oct 04 11:18:36.901427 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:36.901427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59cb4900-916e-4559-aa50-b39ce73353ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 404 to user: Instance 2e120334-351e-4597-89b1-380b2d26d8c5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:36.901427 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-59cb4900-916e-4559-aa50-b39ce73353ee tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/2e120334-351e-4597-89b1-380b2d26d8c5/action" status: 404 len: 111 microversion: 2.1 time: 0.058875 Oct 04 11:18:36.904976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2917/4151] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:18:36 2022] POST /compute/v2.1/servers/2e120334-351e-4597-89b1-380b2d26d8c5/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:36.912769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:36.915006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:36.926427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:36.927324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:36.928210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:36.929202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:36.929842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:36.930424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:36.959057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:18:37.056933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd784df6-f6e8-4b0f-bf20-d7ae60dfd768 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 204 len: 0 microversion: 2.1 time: 0.150405 Oct 04 11:18:37.057660 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2918/4152] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:18:36 2022] DELETE /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:18:37.063171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:37.064498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:37.071280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:37.071778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:37.072206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:37.072907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:37.073414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:37.073840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:37.168281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:37.178735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:37.180558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:37.182436 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe29268a-fd3f-472d-bdee-b625f6224c50 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1372 microversion: 2.57 time: 0.123518 Oct 04 11:18:37.183595 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2919/4153] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:37 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:37.188776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01946f4a-eb2d-4f10-94c8-df30a765f6d3 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'update_all', calling method: .version_select at 0x7f71cf19a3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:37.243105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-01946f4a-eb2d-4f10-94c8-df30a765f6d3 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:37.249920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-01946f4a-eb2d-4f10-94c8-df30a765f6d3 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:37.434399 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01946f4a-eb2d-4f10-94c8-df30a765f6d3 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.249340 Oct 04 11:18:37.439852 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2920/4154] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:18:37 2022] PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 61 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:37.440224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:37.441035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:37.447595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:37.448119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:37.448654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:37.449482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:37.450737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:37.450737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:37.472553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:37.538594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-188e440d-8f60-4a40-a0cc-91f3119e8a85 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action" status: 202 len: 0 microversion: 2.1 time: 0.102220 Oct 04 11:18:37.539611 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2921/4155] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:18:37 2022] POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:18:37.550893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1713786558", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:37.617045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] validate_networks() for [('b5ee45a8-c826-4a97-8885-1fb8ffdbd9ad', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:18:38.818560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:18:38.819156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:18:38.819677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:18:38.820221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:18:38.820644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:18:38.831521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:38.832004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:38.832412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:38.833209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:38.833697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:38.834179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:38.855155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:38.861232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Getting quotas for user 2e4e772e6a5b41a0b0f836b374bc69b4 and project df60449892d147adb43f4750c9b584d3. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:38.874838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:18:38.877847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:18:38.924582 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8514fd56-897f-4649-bb4b-d359707a36f7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383388 Oct 04 11:18:38.925238 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2922/4156] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:18:38.930075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:38.930727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:38.937111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:38.937633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:38.938127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:38.939415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:38.940129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:38.940766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:39.499467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:39.512623 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9323431a-768a-46a4-aed5-c0e4aac64db5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1512 microversion: 2.1 time: 0.586022 Oct 04 11:18:39.513929 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2923/4157] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:38 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1512 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:39.520271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-360087cc-768c-4a64-80b6-c779f396b262 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Calling method '.version_select at 0x7f71cf188790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:39.592262 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-360087cc-768c-4a64-80b6-c779f396b262 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.076907 Oct 04 11:18:39.593339 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2924/4158] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:18:39 2022] GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 61 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:39.598601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:39.599221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:39.606980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:39.607866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:39.609208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:39.609695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:39.610973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:39.611623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:39.988779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:39.996683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d77ce447-2462-40d3-b034-dd1362752abb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1500 microversion: 2.1 time: 0.402166 Oct 04 11:18:39.997627 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2925/4159] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:39 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1500 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:40.002811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:40.003627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:40.009863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:40.010656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:40.011335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:40.012308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:40.012976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:40.013660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:40.152192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:40.161166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:40.162755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:40.164029 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37506ea2-19ae-4bbd-aa62-9c9caa29debb tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1372 microversion: 2.57 time: 0.165007 Oct 04 11:18:40.173407 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2926/4160] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:39 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:40.173407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:40.173407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:40.176525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:40.177016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:40.177488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:40.178190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:40.178656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:40.179200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:40.391154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:40.405244 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80005c90-bd10-4c02-8dcd-f908289f1c87 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1211 microversion: 2.1 time: 0.239142 Oct 04 11:18:40.406271 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2927/4161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:40 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1211 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:40.411907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-866def10-d819-48b1-a515-340d9a204e4f tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'update_all', calling method: .version_select at 0x7f71cf179040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:40.476859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-866def10-d819-48b1-a515-340d9a204e4f tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:40.484500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-866def10-d819-48b1-a515-340d9a204e4f tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:40.719148 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-866def10-d819-48b1-a515-340d9a204e4f tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.311412 Oct 04 11:18:40.724078 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2928/4162] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:18:40 2022] PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 61 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:40.726615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:40.729944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:40.736838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:40.739864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:40.740424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:40.741911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:40.742660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:40.744008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:40.839814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lazy-loading 'flavor' on Instance uuid 77681c9a-5e04-4b84-a338-33360377e251 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:18:40.893716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Cannot 'rescue' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state paused Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action HTTP/1.1 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 14 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: {"rescue": {}} Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'rescue' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state paused Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '77681c9a-5e04-4b84-a338-33360377e251', 'body': {'rescue': {}}} Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77681c9a-5e04-4b84-a338-33360377e251 in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state paused Oct 04 11:18:40.902093 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state paused Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 409 to user: Cannot 'rescue' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state paused {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69b68f8e-68ec-48c6-ac3c-6922ee5bf44a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action" status: 409 len: 144 microversion: 2.1 time: 0.184557 Oct 04 11:18:40.906370 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2929/4163] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:18:40 2022] POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action => generated 144 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:18:40.925504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:40.926146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:40.948650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:40.949318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:40.954834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:40.956455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:40.957017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:40.957480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:41.107248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:41.122008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8bd8f57-c9e1-4e79-823c-3a577f516978 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 200 len: 1470 microversion: 2.1 time: 0.214586 Oct 04 11:18:41.123972 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2930/4164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:40 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:41.130156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d24e790-c270-46d2-ab4b-4d850eef1904 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'update_all', calling method: .version_select at 0x7f71cf0c2820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:41.193800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2d24e790-c270-46d2-ab4b-4d850eef1904 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:41.202160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2d24e790-c270-46d2-ab4b-4d850eef1904 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:41.207341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:41.883452 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d24e790-c270-46d2-ab4b-4d850eef1904 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.757984 Oct 04 11:18:41.885132 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2931/4165] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:18:41 2022] PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 64 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:41.891014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:41.891538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:41.910229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:41.911114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:41.911771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:41.912984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:41.913422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:41.917993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:42.070683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c16e60b-0b4f-40b4-b0ab-97ec3ad27ce4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action" status: 202 len: 0 microversion: 2.1 time: 0.183778 Oct 04 11:18:42.074361 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2932/4166] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:18:41 2022] POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:18:42.084332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-316b0150-475b-411a-ba4a-354892edb0a9 req-3ae870ff-7eb3-4adb-a45b-01bcce0668cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f469e62-93a8-41b2-8db4-ae25e848974c", "name": "network-vif-deleted", "tag": "6103a7c2-e4d2-4ecb-a391-983b2f4acc36"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:42.118944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-316b0150-475b-411a-ba4a-354892edb0a9 req-3ae870ff-7eb3-4adb-a45b-01bcce0668cf service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:42.119526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-316b0150-475b-411a-ba4a-354892edb0a9 req-3ae870ff-7eb3-4adb-a45b-01bcce0668cf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:42.119856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-316b0150-475b-411a-ba4a-354892edb0a9 req-3ae870ff-7eb3-4adb-a45b-01bcce0668cf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:42.133146 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-316b0150-475b-411a-ba4a-354892edb0a9 req-3ae870ff-7eb3-4adb-a45b-01bcce0668cf service nova] Creating event network-vif-deleted:6103a7c2-e4d2-4ecb-a391-983b2f4acc36 for instance 8f469e62-93a8-41b2-8db4-ae25e848974c on n-h2-791135-8 Oct 04 11:18:42.151237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-316b0150-475b-411a-ba4a-354892edb0a9 req-3ae870ff-7eb3-4adb-a45b-01bcce0668cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078436 Oct 04 11:18:42.155085 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2933/4167] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:42.179397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:42.180509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:42.188302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:42.189202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:42.189896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:42.200456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:42.201157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:42.201640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:42.327987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:42.337445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:42.339603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:42.341465 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46b12b82-2fce-4ecd-a752-ab85e26a9d5c tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1357 microversion: 2.57 time: 0.184200 Oct 04 11:18:42.353757 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2934/4168] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:42 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:42.372929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:42.372929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:42.380424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:42.381015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:42.381602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:42.382232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:42.382685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:42.389920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:42.505882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:42.515198 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84924d82-00ce-40bc-8376-019f1aaec36e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1273 microversion: 2.1 time: 0.160347 Oct 04 11:18:42.525414 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2935/4169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:42 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:42.525414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e1f61d5-6065-4625-8e39-1eceae8f39dc tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Calling method '.version_select at 0x7f71cf2b9ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:42.594976 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e1f61d5-6065-4625-8e39-1eceae8f39dc tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.077092 Oct 04 11:18:42.601562 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2936/4170] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:18:42 2022] GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:42.609298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:42.609965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:42.617732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:42.618238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:42.618738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:42.619467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:42.619934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:42.620370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:43.122295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:43.132102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-edef63d9-dd80-40f6-8820-090c6845baa8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1515 microversion: 2.1 time: 0.529224 Oct 04 11:18:43.133010 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2937/4171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:42 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1515 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:43.140222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:43.141058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:43.147805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:43.148621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:43.149417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:43.152873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:43.153561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:43.154154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:43.174184 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c HTTP/1.1 Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8f469e62-93a8-41b2-8db4-ae25e848974c'} Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:43.175893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:43.180877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-30b9f710-cfd2-40f5-8962-0724b6f6f390 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 404 len: 111 microversion: 2.1 time: 0.043137 Oct 04 11:18:43.183829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2938/4172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:43 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:18:43.188158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:43.189279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:43.196012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:43.196510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:43.196943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:43.197955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:43.198750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:43.199588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:43.227456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:18:43.338356 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9607ffe8-eb28-4ad9-8b5c-0ba0d5c37e29 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 204 len: 0 microversion: 2.57 time: 0.153761 Oct 04 11:18:43.342092 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2939/4173] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:18:43 2022] DELETE /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:18:43.353480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-86d0b876-653a-4d34-a3af-bbaffeeb7a34 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'update_all', calling method: .version_select at 0x7f71cf1bb3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:43.459985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-86d0b876-653a-4d34-a3af-bbaffeeb7a34 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:43.489196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-86d0b876-653a-4d34-a3af-bbaffeeb7a34 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:44.026478 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-86d0b876-653a-4d34-a3af-bbaffeeb7a34 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.685294 Oct 04 11:18:44.033993 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2940/4174] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:18:43 2022] PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 61 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:44.042520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:44.043687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:44.051954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:44.052731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:44.053321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:44.054250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:44.054865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:44.055445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:44.083522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:44.654791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:44.665311 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c6d9d19b-1197-4c87-a749-ec33cb2e4cdd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.629344 Oct 04 11:18:44.666045 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2941/4175] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:44 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:44.670780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:44.671392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:44.689906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:44.695010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:44.696890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:44.697720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:44.698203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:44.700086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:44.905874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:44.915667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:44.918360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:44.920271 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9885cc9-f9c4-48ac-aa27-2c9f31591f04 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1363 microversion: 2.57 time: 0.253128 Oct 04 11:18:44.934829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2942/4176] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:44 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:44.947512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:44.948157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:44.961288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:44.962351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:44.963094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:44.964156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:44.964835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:44.966082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:45.321391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:45.337272 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-deb800ff-f199-45ec-940f-91b09c0c04d0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1315 microversion: 2.1 time: 0.400223 Oct 04 11:18:45.339233 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2943/4177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:44 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:45.357101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5830bb2-e64c-4318-b2b7-f90fbcc4bce3 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'update', calling method: .version_select at 0x7f71cf173040>, body: {"meta": {"os_version": "alt"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:45.445229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b5830bb2-e64c-4318-b2b7-f90fbcc4bce3 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:45.451670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b5830bb2-e64c-4318-b2b7-f90fbcc4bce3 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:45.921260 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5830bb2-e64c-4318-b2b7-f90fbcc4bce3 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.580577 Oct 04 11:18:45.928362 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2944/4178] 10.222.0.23 () {60 vars in 1313 bytes} [Tue Oct 4 11:18:45 2022] PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata/os_version => generated 31 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:45.935495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1ac7dbb-cfa6-41b6-b39d-235e648655e6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1ac7dbb-cfa6-41b6-b39d-235e648655e6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 163 Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": 12345, "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 12345 Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:18:45.943443 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 11:18:45.948129 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:45.950490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1ac7dbb-cfa6-41b6-b39d-235e648655e6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:45.956362 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1ac7dbb-cfa6-41b6-b39d-235e648655e6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.025887 Oct 04 11:18:45.957119 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2945/4179] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:18:45 2022] POST /compute/v2.1/servers => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:18:45.970259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:45.978321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:45.991903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:45.993365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:45.993999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:45.994889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:45.995549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:45.995977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:46.034370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lazy-loading 'flavor' on Instance uuid 77681c9a-5e04-4b84-a338-33360377e251 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:18:46.169209 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e2237c7d-ebea-42f4-85e9-0948197f5b76 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action" status: 200 len: 32 microversion: 2.1 time: 0.209373 Oct 04 11:18:46.170572 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2946/4180] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:18:45 2022] POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:46.196397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d883dce-5c8a-4fef-bec4-bd641dc0eaad tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Calling method '.version_select at 0x7f71cf1cf700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:46.259769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d883dce-5c8a-4fef-bec4-bd641dc0eaad tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.087651 Oct 04 11:18:46.260635 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2947/4181] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:18:46 2022] GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 58 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:46.284086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:46.287523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:46.302955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:46.303497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:46.303932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:46.305908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:46.308410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:46.309541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:46.396340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:46.397907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:46.399231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:46.399956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lazy-loading 'fault' on Instance uuid a4352974-6413-41d7-a506-144d0fe072f3 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:18:46.546136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:46.563194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:46.569776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '364fb7f9f59d4c48b0ef063c69d4f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2ad14056014a80990a0653bdfdf164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:46.573915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e640faf9-570e-4e43-a500-6547ded24c99 tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 200 len: 1368 microversion: 2.57 time: 0.305146 Oct 04 11:18:46.574921 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2948/4182] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:46 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:18:46.586218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:46.586854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:46.625385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:46.626022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:46.626480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:46.627269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:46.627801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:46.628242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:46.987448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:46.997654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-407fd88c-8bfd-4e7d-8189-2f95b6a57328 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.420927 Oct 04 11:18:46.999096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2949/4183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:46 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:47.004219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:47.005059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:47.011975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:47.012776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:47.013467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:47.014480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:47.015373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:47.016033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:47.321106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:47.330039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4ec5b4a-3c85-4b96-8c35-03acbf91bba9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1521 microversion: 2.1 time: 0.329541 Oct 04 11:18:47.333830 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2950/4184] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:46 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:47.342970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ded62e3-d879-4da4-9124-27c962d0bc32 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'update_all', calling method: .version_select at 0x7f71cf2b9670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:47.432108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-1ded62e3-d879-4da4-9124-27c962d0bc32 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:47.445539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-1ded62e3-d879-4da4-9124-27c962d0bc32 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:47.919645 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ded62e3-d879-4da4-9124-27c962d0bc32 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.583578 Oct 04 11:18:47.921755 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2951/4185] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:18:47 2022] PUT /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 61 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:47.929679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:47.930405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:47.941650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:47.942153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:47.942598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:47.943362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:47.943830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:47.944399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:48.137423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:48.149834 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-376422f5-67a8-460f-b8c7-e4e3c63c0563 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1315 microversion: 2.1 time: 0.226680 Oct 04 11:18:48.151035 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2952/4186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:47 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:48.156595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-cb573eb6-deb3-486f-84f4-46dba523c6ce req-86675c16-3ef1-4881-a2ba-537cf38cac99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b", "tag": "bf485443-e440-4ed3-af41-fa8bafa8e9a0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:48.177781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cb573eb6-deb3-486f-84f4-46dba523c6ce req-86675c16-3ef1-4881-a2ba-537cf38cac99 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:48.180763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cb573eb6-deb3-486f-84f4-46dba523c6ce req-86675c16-3ef1-4881-a2ba-537cf38cac99 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:48.181430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cb573eb6-deb3-486f-84f4-46dba523c6ce req-86675c16-3ef1-4881-a2ba-537cf38cac99 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:48.203790 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-cb573eb6-deb3-486f-84f4-46dba523c6ce req-86675c16-3ef1-4881-a2ba-537cf38cac99 service nova] Creating event network-changed:bf485443-e440-4ed3-af41-fa8bafa8e9a0 for instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b on n-h2-791135-8 Oct 04 11:18:48.218594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-cb573eb6-deb3-486f-84f4-46dba523c6ce req-86675c16-3ef1-4881-a2ba-537cf38cac99 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064679 Oct 04 11:18:48.219476 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2953/4187] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:48.224933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:48.225972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:48.234623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:48.235241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:48.235753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:48.236534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:48.237080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:48.237717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:48.568518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:48.580286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ffd1647-c306-45c5-97c9-d2aa6c999788 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.356430 Oct 04 11:18:48.597436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2954/4188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:48 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:48.597436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:48.597436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] [instance: a4352974-6413-41d7-a506-144d0fe072f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:48.609653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:48.610279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:48.610718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:48.611460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:48.611917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:48.612402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:48.648220 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] HTTP exception thrown: Instance a4352974-6413-41d7-a506-144d0fe072f3 could not be found. Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Request method failure captured: Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 HTTP/1.1 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZih93XZi2gGCcPE42v3KyIdzhA7Ihq_uWrY9Y7QK6sJzxsnUjz5t4rufIZGKnwJwVDBXo6JbLgEsBrejS_iRZKtUtSpqqYW3knH57rfoZxFVYVxZYqfwwGG0v9PBZL4Z9eIgeQZ9emg66oEe3PI4stsxEoHOKUYF7RyYyI_aMWrcQ Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2f2ad14056014a80990a0653bdfdf164 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerShowV257Test-1519693696 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f2ad14056014a80990a0653bdfdf164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f2ad14056014a80990a0653bdfdf164"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f2ad14056014a80990a0653bdfdf164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f2ad14056014a80990a0653bdfdf164"}]}] Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerShowV257Test-1519693696 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2f2ad14056014a80990a0653bdfdf164 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerShowV257Test-1519693696 Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerShowV257Test-1519693696-project Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 364fb7f9f59d4c48b0ef063c69d4f93e Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerShowV257Test-1519693696-project Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a4352974-6413-41d7-a506-144d0fe072f3 could not be found. Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a4352974-6413-41d7-a506-144d0fe072f3'} Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4352974-6413-41d7-a506-144d0fe072f3 could not be found. Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4352974-6413-41d7-a506-144d0fe072f3 could not be found. Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:48.653148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4352974-6413-41d7-a506-144d0fe072f3 could not be found. Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] Returning 404 to user: Instance a4352974-6413-41d7-a506-144d0fe072f3 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e574685f-ac6b-429e-bae8-ff77aa0a24bd tempest-ServerShowV257Test-1519693696 tempest-ServerShowV257Test-1519693696-project] 10.222.0.23 "GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3" status: 404 len: 111 microversion: 2.57 time: 0.071186 Oct 04 11:18:48.658587 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2955/4189] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:18:48 2022] GET /compute/v2.1/servers/a4352974-6413-41d7-a506-144d0fe072f3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:18:48.674413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3395d170-3266-48af-825b-c00dcd4802e7 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Action: 'create', calling method: .version_select at 0x7f71cf1b5040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:48.769299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3395d170-3266-48af-825b-c00dcd4802e7 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:48.775207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3395d170-3266-48af-825b-c00dcd4802e7 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Getting quotas for user 0b51b6dc48c74d2c930a7954975c762e and project 54cf72c3dacd4e66a2f89cf347b55b16. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:48.845382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:49.464380 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3395d170-3266-48af-825b-c00dcd4802e7 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "POST /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.807127 Oct 04 11:18:49.469461 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2956/4190] 10.222.0.23 () {60 vars in 1281 bytes} [Tue Oct 4 11:18:48 2022] POST /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 85 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:49.475174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:49.475795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:49.492216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:49.494081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:49.494531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:49.499931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:49.502451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:49.502829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:49.933048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:49.943948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3fee0a52-7084-43ef-87b0-5e0c34ea67e2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1521 microversion: 2.1 time: 0.472621 Oct 04 11:18:49.946369 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2957/4191] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:49 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:49.960230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:49.961143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:49.972407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:49.973338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:49.974105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:49.975239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:49.975946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:49.976595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:50.264186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:50.280424 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95b5e487-df13-46ff-a74b-b55d02bfa070 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1315 microversion: 2.1 time: 0.331665 Oct 04 11:18:50.281300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2958/4192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:49 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:50.305431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ff46f89-4791-4a92-85a3-cde051a78a23 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] Calling method '.version_select at 0x7f71d86feb80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:50.413894 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ff46f89-4791-4a92-85a3-cde051a78a23 tempest-ImagesMetadataTestJSON-1997821206 tempest-ImagesMetadataTestJSON-1997821206-project] 10.222.0.23 "GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.129305 Oct 04 11:18:50.423237 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2959/4193] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:18:50 2022] GET /compute/v2.1/images/78bc1022-257b-467e-8d98-db4c614a2e8c/metadata => generated 85 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:18:50.644099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1664310709", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "c10fa64a-a2e2-460a-a3d9-66e12f498b2b"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:50.772749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] validate_networks() for [('c10fa64a-a2e2-460a-a3d9-66e12f498b2b', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:18:51.712306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:18:51.713566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:18:51.714790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:18:51.715356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:18:51.716002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:18:51.737017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:51.738198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:51.738995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:51.740393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:51.741104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:51.742092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:51.782691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Getting quotas for project 876aaf19cb424eb9b1249d8c9342260a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:51.789720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Getting quotas for user 4fa8721e039e4219ae2c2f5fe2a778a0 and project 876aaf19cb424eb9b1249d8c9342260a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:51.806103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Going to run 2 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:18:51.809181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:18:51.865564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:18:51.917971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:51.969259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a96507d8-88a4-46c1-aaed-6b486896916e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509669 Oct 04 11:18:51.977386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2960/4194] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:18:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:18:51.977780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:51.978609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:51.987629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:51.988749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:51.989571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:51.990770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:51.991459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:51.992179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:52.244985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:52.254628 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4912d729-a162-4be3-b6fe-51047587f0ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1521 microversion: 2.1 time: 0.281445 Oct 04 11:18:52.255752 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2961/4195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:51 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:52.270281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:52.273170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:52.292565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:52.294946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:52.295580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:52.299682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:52.300485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:52.307304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:52.696869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:52.714802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6629f212-5dab-4889-8c97-1714e6f3c531 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1315 microversion: 2.1 time: 0.457252 Oct 04 11:18:52.718098 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2962/4196] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:52 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:52.740567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-760e6e6f-859f-4ed0-968c-4089e2d3cf04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1035667341", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "3a744c9a-9018-490a-905b-efbcaf47fab1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:52.859489 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-760e6e6f-859f-4ed0-968c-4089e2d3cf04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Block Device 3a744c9a-9018-490a-905b-efbcaf47fab1 is not bootable. Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-760e6e6f-859f-4ed0-968c-4089e2d3cf04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 358 Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1035667341", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "3a744c9a-9018-490a-905b-efbcaf47fab1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: exception: Block Device 3a744c9a-9018-490a-905b-efbcaf47fab1 is not bootable. Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1035667341', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '3a744c9a-9018-490a-905b-efbcaf47fab1'}], 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 3a744c9a-9018-490a-905b-efbcaf47fab1 is not bootable. Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:18:52.873618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 3a744c9a-9018-490a-905b-efbcaf47fab1 is not bootable. Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 3a744c9a-9018-490a-905b-efbcaf47fab1 is not bootable. Oct 04 11:18:52.877156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:18:52.878917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-760e6e6f-859f-4ed0-968c-4089e2d3cf04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Block Device 3a744c9a-9018-490a-905b-efbcaf47fab1 is not bootable. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:18:52.879970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-760e6e6f-859f-4ed0-968c-4089e2d3cf04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.160576 Oct 04 11:18:52.880733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2963/4197] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:18:52 2022] POST /compute/v2.1/servers => generated 110 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:18:52.897801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:52.902723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:52.903508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Searching by: {'deleted': False, 'project_id': '876aaf19cb424eb9b1249d8c9342260a'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:18:52.936842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:52.938111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:52.939487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:52.940649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:52.941377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:52.942068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:52.983764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:18:52.989671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:18:53.063426 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e28d3a9-6ea3-4ad9-bb2e-5d1f96e2ed2d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.181158 Oct 04 11:18:53.064032 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2964/4198] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:18:52 2022] GET /compute/v2.1/servers => generated 677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:53.092802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:53.095199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:53.115562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:53.116948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:53.119940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:53.121024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:53.122678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:53.124263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:53.612083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:53.622087 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1c82c15-7719-4df7-8ab5-5e37ac01e0c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.540911 Oct 04 11:18:53.622691 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2965/4199] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:53 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:53.636101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:53.636969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:53.661156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:53.661706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:53.662154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:53.667275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:53.667746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:53.668200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:53.822996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:53.834069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-58442a97-c288-45d6-ab87-44f50b6174bf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1216 microversion: 2.1 time: 0.210054 Oct 04 11:18:53.835467 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2966/4200] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:53 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1216 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:53.840779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:53.841612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:53.848612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:53.849755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:53.850960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:53.851870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:53.852505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:53.853114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:54.153721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:54.163814 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf29999f-cf5a-4532-abc3-b26edc3609be tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1521 microversion: 2.1 time: 0.327050 Oct 04 11:18:54.170829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2967/4201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:53 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:54.186142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:54.188640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:54.212783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:54.213283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:54.213744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:54.214454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:54.214909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:54.215333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:54.834880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:54.845702 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7ac32fc-e9d9-4238-80a1-868f3346bbd4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.673647 Oct 04 11:18:54.856062 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2968/4202] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:54 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:54.871978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:54.872916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:54.887102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:54.887626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:54.897315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:54.898115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:54.900375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:54.901113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:56.034841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:56.046088 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c34071c2-1781-47a6-baad-a8d5c213a889 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1315 microversion: 2.1 time: 1.188682 Oct 04 11:18:56.054121 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2969/4203] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:54 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1315 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:56.322869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1328138166", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:56.424537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:18:57.344041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:18:57.347388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:18:57.349035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:18:57.349485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:18:57.349955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:18:57.367055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:57.368211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:57.374459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:57.375846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:57.376797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:57.378150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:57.415325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Getting quotas for project 7d2f6b04fa444d839c097a066d3cc896. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:18:57.426659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Getting quotas for user 9376a5065d204b49930796d6e3f17dc8 and project 7d2f6b04fa444d839c097a066d3cc896. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:18:57.455469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:18:57.459497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:18:57.551528 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02247fb9-d21a-4291-b404-76a6f820f7c8 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495875 Oct 04 11:18:57.552202 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2970/4204] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:18:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:18:57.567779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:57.569098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:57.585640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:57.586382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:57.586976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:57.588225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:57.588862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:57.590895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:58.306078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:58.360382 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0ad6a611-fb23-4810-b84f-c1d2dfcbef64 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1320 microversion: 2.1 time: 0.801260 Oct 04 11:18:58.363918 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2971/4205] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:57 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1320 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:58.376015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:58.377050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:58.384402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:58.385233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:58.385918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:58.386855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:58.388912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:58.389636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:58.880334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:58.891723 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7e27597-00cc-4c70-9bec-215ce6862a37 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1521 microversion: 2.1 time: 0.525823 Oct 04 11:18:58.902904 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2972/4206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:58 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:58.910950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-88aaf8fe-8c50-4001-aebd-651734aae3b4 req-bc3b7b22-3970-42c7-b579-a8c788011d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b", "name": "network-vif-plugged", "status": "completed", "tag": "bf485443-e440-4ed3-af41-fa8bafa8e9a0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:18:58.924486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88aaf8fe-8c50-4001-aebd-651734aae3b4 req-bc3b7b22-3970-42c7-b579-a8c788011d15 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:58.927719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88aaf8fe-8c50-4001-aebd-651734aae3b4 req-bc3b7b22-3970-42c7-b579-a8c788011d15 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:58.928348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88aaf8fe-8c50-4001-aebd-651734aae3b4 req-bc3b7b22-3970-42c7-b579-a8c788011d15 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:58.950506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-88aaf8fe-8c50-4001-aebd-651734aae3b4 req-bc3b7b22-3970-42c7-b579-a8c788011d15 service nova] Creating event network-vif-plugged:bf485443-e440-4ed3-af41-fa8bafa8e9a0 for instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b on n-h2-791135-8 Oct 04 11:18:58.965166 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-88aaf8fe-8c50-4001-aebd-651734aae3b4 req-bc3b7b22-3970-42c7-b579-a8c788011d15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060494 Oct 04 11:18:58.974512 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2973/4207] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:18:58.984805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:58.986137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:59.000505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:59.001419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:59.002063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:59.003226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:59.003872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:59.004480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:59.888533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:18:59.909098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bda04728-a56a-4d16-88c2-4429d1392fed tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1315 microversion: 2.1 time: 0.932506 Oct 04 11:18:59.912554 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2974/4208] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:58 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1315 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:18:59.931850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:18:59.932546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:18:59.948388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:59.953223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:59.953786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:18:59.954555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:18:59.955099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:18:59.955563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:00.211480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:00.223637 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06488a8a-cbbd-491f-9de6-164f6aea4fe5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1275 microversion: 2.1 time: 0.309481 Oct 04 11:19:00.229006 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2975/4209] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:18:59 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:00.238873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f6ebb2c-6705-46f3-b623-46c5e0b8f00f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1029205546", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c5abc5b2-fab0-47a3-992d-153996b39244", "destination_type": "local"}, {"source_type": "volume", "uuid": "d6d83acc-834c-4a08-9499-f99cb5b79706", "destination_type": "invalid"}], "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f6ebb2c-6705-46f3-b623-46c5e0b8f00f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 495 Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1029205546", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c5abc5b2-fab0-47a3-992d-153996b39244", "destination_type": "local"}, {"source_type": "volume", "uuid": "d6d83acc-834c-4a08-9499-f99cb5b79706", "destination_type": "invalid"}], "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1029205546', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd6d83acc-834c-4a08-9499-f99cb5b79706', 'destination_type': 'invalid'}], 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:00.256527 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 11:19:00.259753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:00.262314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f6ebb2c-6705-46f3-b623-46c5e0b8f00f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:00.263538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f6ebb2c-6705-46f3-b623-46c5e0b8f00f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.033228 Oct 04 11:19:00.264475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2976/4210] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:00 2022] POST /compute/v2.1/servers => generated 155 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:19:00.271559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:00.272621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:00.282701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:00.283583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:00.284277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:00.285471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:00.286159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:00.286854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:00.653100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:00.662640 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d7a9f8d-815b-488c-9af2-661d0f1e0bbf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1320 microversion: 2.1 time: 0.396663 Oct 04 11:19:00.663367 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2977/4211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:00 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1320 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:00.667822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f98683e9-54cb-4749-b58f-4cfc48e9e8af req-f6909cb4-f282-4258-bf86-7a853d89ed9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6917fd9-2425-4320-8d9e-a72beac87b21", "tag": "aa304280-0a42-42fa-8801-c726a918420f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:00.706688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f98683e9-54cb-4749-b58f-4cfc48e9e8af req-f6909cb4-f282-4258-bf86-7a853d89ed9f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:00.707100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f98683e9-54cb-4749-b58f-4cfc48e9e8af req-f6909cb4-f282-4258-bf86-7a853d89ed9f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:00.707536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f98683e9-54cb-4749-b58f-4cfc48e9e8af req-f6909cb4-f282-4258-bf86-7a853d89ed9f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:00.730575 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f98683e9-54cb-4749-b58f-4cfc48e9e8af req-f6909cb4-f282-4258-bf86-7a853d89ed9f service nova] Creating event network-changed:aa304280-0a42-42fa-8801-c726a918420f for instance c6917fd9-2425-4320-8d9e-a72beac87b21 on n-h2-791135-8 Oct 04 11:19:00.737772 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f98683e9-54cb-4749-b58f-4cfc48e9e8af req-f6909cb4-f282-4258-bf86-7a853d89ed9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072964 Oct 04 11:19:00.738970 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2978/4212] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:00.744881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:00.745921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:00.755916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:00.756743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:00.757511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:00.758574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:00.759251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:00.759836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:01.212344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:01.227891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ed15ca7a-069f-471d-9360-436d4654d696 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1521 microversion: 2.1 time: 0.487331 Oct 04 11:19:01.229684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2979/4213] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:00 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:01.237431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:01.238510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:01.247462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:01.248632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:01.249224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:01.250113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:01.251764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:01.252508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:01.656023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:01.696129 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71228141-3d1d-41d9-9f17-de80e900730c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.464338 Oct 04 11:19:01.696757 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2980/4214] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:01 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:01.714542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:01.715635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:01.731784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:01.732324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:01.735557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:01.737945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:01.738509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:01.741880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:01.984171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:01.992699 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8556bb9d-e909-4324-b2f5-be2cb017b7b2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1502 microversion: 2.1 time: 0.293010 Oct 04 11:19:02.006018 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2981/4215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:01 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1502 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:02.006018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:02.006018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:02.010465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:02.011139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:02.011740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:02.012609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:02.020355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:02.025304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:02.542132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:02.572795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea9747ee-8a6b-4f6e-9a7b-5cc291e53ce6 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1317 microversion: 2.1 time: 0.575576 Oct 04 11:19:02.575668 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2982/4216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:01 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:02.585821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:02.587881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:02.602254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:02.603007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:02.603490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:02.604234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:02.615578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:02.616305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:03.020482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:03.029975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:03.036313 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01279776-bc2a-4872-a558-8764e30a49e6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1320 microversion: 2.1 time: 0.458840 Oct 04 11:19:03.037933 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2983/4217] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:02 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:03.052751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-eb9a7f78-6989-45b8-89d6-af719769cf33 req-713e3639-8081-4b28-93f3-d3298d015846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3", "tag": "b0da3050-573d-4a9f-9e56-48d572b174b1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:03.082498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eb9a7f78-6989-45b8-89d6-af719769cf33 req-713e3639-8081-4b28-93f3-d3298d015846 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:03.082970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eb9a7f78-6989-45b8-89d6-af719769cf33 req-713e3639-8081-4b28-93f3-d3298d015846 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:03.083415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eb9a7f78-6989-45b8-89d6-af719769cf33 req-713e3639-8081-4b28-93f3-d3298d015846 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:03.107954 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-eb9a7f78-6989-45b8-89d6-af719769cf33 req-713e3639-8081-4b28-93f3-d3298d015846 service nova] Creating event network-changed:b0da3050-573d-4a9f-9e56-48d572b174b1 for instance b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3 on n-h2-791135-8 Oct 04 11:19:03.118098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-eb9a7f78-6989-45b8-89d6-af719769cf33 req-713e3639-8081-4b28-93f3-d3298d015846 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076897 Oct 04 11:19:03.121489 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2984/4218] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:03.130952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:03.131919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:03.140789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:03.141876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:03.142552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:03.150527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:03.151357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:03.151967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:03.945803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:03.955418 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4ee9cd7-cab3-477d-9f7c-388b144d275d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.832469 Oct 04 11:19:03.956196 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2985/4219] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:03 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:03.970521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:03.976190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:03.990914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:03.993279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:03.993789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:03.994552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:03.997839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:03.998573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:04.169115 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9aedb294-ec68-41a6-be8e-04d4354bd7b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b/action" status: 202 len: 0 microversion: 2.1 time: 0.203783 Oct 04 11:19:04.176729 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2986/4220] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:19:03 2022] POST /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:19:04.184238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:04.184937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:04.204554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:04.205390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:04.206060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:04.208328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:04.209030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:04.209737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:04.565283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:04.587216 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3589797-8e8c-42ed-9603-2fa09a5c2d56 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1521 microversion: 2.1 time: 0.408043 Oct 04 11:19:04.590115 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2987/4221] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:04 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:04.599075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:04.601669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:04.612039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:04.612589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:04.613028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:04.613760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:04.614215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:04.614804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:04.985595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:04.998938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-da6c8f35-32c1-434f-a69d-be547f48fb62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1317 microversion: 2.1 time: 0.407720 Oct 04 11:19:05.000829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2988/4222] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:04 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:05.010512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:05.011596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:05.021455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:05.022371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:05.023726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:05.024725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:05.039363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:05.040051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:05.523896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:05.541341 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-714b845f-3f09-4f30-be3a-c949bb1c7185 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1320 microversion: 2.1 time: 0.533908 Oct 04 11:19:05.543635 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2989/4223] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:05 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1320 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:05.552781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b617a17c-8ecd-4ff5-b839-4711794dadaf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1137280210", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b617a17c-8ecd-4ff5-b839-4711794dadaf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 492 Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1137280210", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1137280210', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:05.576148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b617a17c-8ecd-4ff5-b839-4711794dadaf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b617a17c-8ecd-4ff5-b839-4711794dadaf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.029340 Oct 04 11:19:05.579587 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2990/4224] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:05 2022] POST /compute/v2.1/servers => generated 624 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:19:05.586022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:05.586627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:05.597522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:05.598678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:05.599603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:05.601366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:05.602016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:05.602706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:05.970467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:05.987403 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52ae4d38-8018-4199-920a-2dab33e5248a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1507 microversion: 2.1 time: 0.407583 Oct 04 11:19:05.989641 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2991/4225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:05 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1507 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:06.022877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b9e431cd-e355-4f3f-85dd-8f2f771c37c3 req-3aa4f3b4-0ab7-423e-a998-e3419310449a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a52ace0-2ddb-4df5-90b7-e1625948d259", "tag": "66a6d253-8115-41c8-b225-8a1368275359"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:06.044173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b9e431cd-e355-4f3f-85dd-8f2f771c37c3 req-3aa4f3b4-0ab7-423e-a998-e3419310449a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.045030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b9e431cd-e355-4f3f-85dd-8f2f771c37c3 req-3aa4f3b4-0ab7-423e-a998-e3419310449a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.045707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b9e431cd-e355-4f3f-85dd-8f2f771c37c3 req-3aa4f3b4-0ab7-423e-a998-e3419310449a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:06.067957 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b9e431cd-e355-4f3f-85dd-8f2f771c37c3 req-3aa4f3b4-0ab7-423e-a998-e3419310449a service nova] Creating event network-changed:66a6d253-8115-41c8-b225-8a1368275359 for instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 on n-h1-791135-8 Oct 04 11:19:06.115285 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b9e431cd-e355-4f3f-85dd-8f2f771c37c3 req-3aa4f3b4-0ab7-423e-a998-e3419310449a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121913 Oct 04 11:19:06.118320 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2992/4226] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:06.141965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:06.143057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:06.153882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.155227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.155940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:06.157365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.158578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.159917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:06.237440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4397524d-672f-4f25-9bf4-a46ba7f3b12e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments/e06c4d68-e0cd-409b-8fc7-aa6031effebf" status: 200 len: 194 microversion: 2.20 time: 0.117172 Oct 04 11:19:06.238201 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2993/4227] 10.222.0.23 () {60 vars in 1454 bytes} [Tue Oct 4 11:19:06 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments/e06c4d68-e0cd-409b-8fc7-aa6031effebf => generated 194 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:19:06.248333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:06.250695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:06.263296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.263991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.264594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:06.267540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.268212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.277585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:06.553562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:06.570160 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-df2626b1-d16d-4432-9332-6a29ced1c07b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.330805 Oct 04 11:19:06.571072 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2994/4228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:06 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:06.575728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:06.576346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:06.582516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.583013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.583469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:06.584180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.584644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.585077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:06.832775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:06.842344 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61d6d23a-5726-4f71-8171-8a1beeca5925 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1501 microversion: 2.1 time: 0.270197 Oct 04 11:19:06.845400 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2995/4229] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:06 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1501 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:06.868083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:06.868707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:06.877891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.878397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.878837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:06.879546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:06.880708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:06.881715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.095646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:07.105430 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e037e42-32cd-461e-9100-ad39a5758590 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1317 microversion: 2.1 time: 0.260020 Oct 04 11:19:07.121436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2996/4230] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:06 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:07.121436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:07.121436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:07.121436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.121436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.121436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.122410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.123383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.124037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.216693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lazy-loading 'services' on Instance uuid 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:19:07.304492 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69b1c9f5-4e8b-4b5e-aff7-dcff2b7e10ad tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments/e06c4d68-e0cd-409b-8fc7-aa6031effebf" status: 202 len: 0 microversion: 2.20 time: 0.194628 Oct 04 11:19:07.309546 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2997/4231] 10.222.0.23 () {60 vars in 1457 bytes} [Tue Oct 4 11:19:07 2022] DELETE /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments/e06c4d68-e0cd-409b-8fc7-aa6031effebf => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:19:07.315120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:07.315828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:07.322616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.323540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.324399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.325398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.326085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.326726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.392536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:07.441735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=54 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:07.598242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:07.607393 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f63d487-aa00-4acd-b3b9-86ff771be5d6 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1320 microversion: 2.1 time: 0.296331 Oct 04 11:19:07.608243 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2998/4232] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:07 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1320 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:07.612689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:07.613299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:07.619290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.619779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.620216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.620910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.621483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.621830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.767645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:07.776596 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db277227-880a-4145-b2bb-979397180c0a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.167353 Oct 04 11:19:07.785470 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 2999/4233] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:07 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:07.785470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "641f81af-6061-46f6-b577-8931d703d0dd"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:07.785470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:07.792125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.792637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.793082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.793863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.794329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.794763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.833451 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Cannot 'attach_volume' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state rescued Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/os-volume_attachments HTTP/1.1 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 74 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: {"volumeAttachment": {"volumeId": "641f81af-6061-46f6-b577-8931d703d0dd"}} Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'attach_volume' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state rescued Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '77681c9a-5e04-4b84-a338-33360377e251', 'body': {'volumeAttachment': {'volumeId': '641f81af-6061-46f6-b577-8931d703d0dd'}}} Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77681c9a-5e04-4b84-a338-33360377e251 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 11:19:07.835681 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state rescued Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state rescued Oct 04 11:19:07.839615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:07.841762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 409 to user: Cannot 'attach_volume' instance 77681c9a-5e04-4b84-a338-33360377e251 while it is in vm_state rescued {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:07.843561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64741ec2-c195-4feb-b2c7-07273d677b00 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065234 Oct 04 11:19:07.844725 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3000/4234] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:19:07 2022] POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:19:07.850748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:07.851914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:07.860361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.860897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.861294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.862708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:07.863118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:07.863551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:07.891957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:08.078152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:08.086905 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e3d4d07-053a-4e75-bf69-2f6fe5d2043f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1487 microversion: 2.1 time: 0.240073 Oct 04 11:19:08.089229 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3001/4235] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:07 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1487 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:08.115821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:08.122710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:08.143657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:08.144374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:08.144960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:08.145840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:08.146441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:08.147047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:08.224301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8696ca0-e4f9-4205-8df8-16a9a7563ec1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112418 Oct 04 11:19:08.231367 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3002/4236] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:19:08 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:19:08.238262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:08.239076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:08.246565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:08.247374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:08.248295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:08.249375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:08.250228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:08.251074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:08.423895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35631140-3340-4f03-b4ff-36370dc89fb3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action" status: 202 len: 0 microversion: 2.1 time: 0.190935 Oct 04 11:19:08.424655 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3003/4237] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:19:08 2022] POST /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:19:08.430204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef830445-8275-4bb9-91d8-7d9313c41172 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef830445-8275-4bb9-91d8-7d9313c41172 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 416 Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:08.445573 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:08.448377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef830445-8275-4bb9-91d8-7d9313c41172 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:08.450307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ef830445-8275-4bb9-91d8-7d9313c41172 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.023226 Oct 04 11:19:08.453639 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3004/4238] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:08 2022] POST /compute/v2.1/servers => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:19:08.468325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:08.473096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:08.494911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:08.500385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:08.501998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:08.502476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:08.505822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:08.507153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:08.508669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:08.570369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lazy-loading 'flavor' on Instance uuid da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:19:08.901935 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-940346e1-6ced-45ce-8ed7-3572c0a06ec7 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b/action" status: 202 len: 0 microversion: 2.1 time: 0.446740 Oct 04 11:19:08.905999 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3005/4239] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:19:08 2022] POST /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:19:08.917154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:08.922243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:08.930626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:08.931549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:08.931549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:08.932294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:08.932757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:08.933333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:09.954922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:09.967294 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ba77705-f88d-4386-bfd8-54a56bbda942 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1317 microversion: 2.1 time: 1.059326 Oct 04 11:19:09.981567 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3006/4240] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:08 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1317 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:09.983278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:09.984082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:10.013126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:10.014205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:10.014680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:10.015495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:10.016475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:10.027887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:10.438720 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:19:10.439303 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:19:10.520877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:10.530340 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f6d3ded6-500c-4384-b835-6140d47b3c53 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1509 microversion: 2.1 time: 0.557306 Oct 04 11:19:10.554776 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3007/4241] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:09 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1509 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:10.574265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:10.575016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:10.589228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:10.592164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:10.592621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:10.593413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:10.594365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:10.594795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:11.367363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:11.388329 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d932f78d-0dea-4308-97b6-45308d3d5e3a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.830008 Oct 04 11:19:11.394205 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3008/4242] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:10 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:11.419586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:11.420547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:11.435948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:11.436620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:11.437168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:11.440722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:11.441745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:11.442441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:11.640012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:11.649656 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-463ffa22-cf16-4ee0-a4e3-0126e45fe749 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1320 microversion: 2.1 time: 0.240873 Oct 04 11:19:11.650615 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3009/4243] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:11 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:11.656317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:11.657000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:11.664544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:11.665234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:11.665841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:11.666736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:11.667368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:11.667971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:11.871497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:11.884810 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9c4e00c-1f89-481b-8b03-46ccccca342f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1514 microversion: 2.1 time: 0.230799 Oct 04 11:19:11.885996 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3010/4244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:11 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:11.898257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b5356250-3316-4cae-b986-922882017a80 req-30bce944-caa4-48a4-ac90-47f6f63c87d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6917fd9-2425-4320-8d9e-a72beac87b21", "name": "network-vif-plugged", "status": "completed", "tag": "aa304280-0a42-42fa-8801-c726a918420f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:11.933036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b5356250-3316-4cae-b986-922882017a80 req-30bce944-caa4-48a4-ac90-47f6f63c87d9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:11.933036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b5356250-3316-4cae-b986-922882017a80 req-30bce944-caa4-48a4-ac90-47f6f63c87d9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:11.933389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b5356250-3316-4cae-b986-922882017a80 req-30bce944-caa4-48a4-ac90-47f6f63c87d9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:11.965814 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b5356250-3316-4cae-b986-922882017a80 req-30bce944-caa4-48a4-ac90-47f6f63c87d9 service nova] Creating event network-vif-plugged:aa304280-0a42-42fa-8801-c726a918420f for instance c6917fd9-2425-4320-8d9e-a72beac87b21 on n-h2-791135-8 Oct 04 11:19:11.992962 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b5356250-3316-4cae-b986-922882017a80 req-30bce944-caa4-48a4-ac90-47f6f63c87d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105098 Oct 04 11:19:11.993710 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3011/4245] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:12.005515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:12.012821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:12.025465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:12.025981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:12.029429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:12.030275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:12.030755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:12.034001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:12.119617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db00ac7a-bd5d-47bf-bf31-dd9e86ff93c1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119785 Oct 04 11:19:12.120210 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3012/4246] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:19:11 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:19:12.128649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:12.129457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:12.144200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:12.150677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:12.151145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:12.151909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:12.152371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:12.152818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:12.545343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:12.557423 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-413105f9-cf63-4de1-a7c2-9d9c5ee305d5 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1317 microversion: 2.1 time: 0.436008 Oct 04 11:19:12.560131 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3013/4247] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:12 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:12.572662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:12.573628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:12.585767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:12.586263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:12.594108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:12.594843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:12.595325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:12.595764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:13.560100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:13.570590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c6ec3441-38a2-4627-851e-28d8058e5f14 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 1.008251 Oct 04 11:19:13.571199 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3014/4248] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:12 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:13.588178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:13.588813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:13.613734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:13.622750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:13.623485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:13.626189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:13.626682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:13.627129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:14.009248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:14.019593 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3eefd7fb-80ed-4543-a949-0d4eeb7f474f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1509 microversion: 2.1 time: 0.435301 Oct 04 11:19:14.026819 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3015/4249] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:13 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:14.034370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:14.036918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:14.059366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:14.060192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:14.060893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:14.061935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:14.063202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:14.063863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:14.884766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:14.889516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:14.900798 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69b87d59-ad5f-4962-8091-14116813ecb7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1320 microversion: 2.1 time: 0.870587 Oct 04 11:19:14.901796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3016/4250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:14 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1320 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:14.913226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:14.915328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:14.932511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:14.933398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:14.933935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:14.934921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:14.937070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:14.947238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:15.191714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:15.202212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e10c4b72-67eb-400d-91bd-81748add3d63 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1514 microversion: 2.1 time: 0.297905 Oct 04 11:19:15.202855 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3017/4251] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:14 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:15.207818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:15.215153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:15.225874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:15.226752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:15.255552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:15.256342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:15.256828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:15.257271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:15.299679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0c3e376-efb7-4818-a5c5-961a7618284d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095733 Oct 04 11:19:15.304853 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3018/4252] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:19:15 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:19:15.311145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:15.312853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:15.320047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:15.320851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:15.322479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:15.323404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:15.324062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:15.324692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:15.659278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:15.671698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6a8837f-1cee-4599-8f63-fa5ca0cc34ac tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1317 microversion: 2.1 time: 0.362134 Oct 04 11:19:15.673188 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3019/4253] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:15 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:15.686054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-146e2ff7-4855-4954-b371-834eb8aa5a63 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1726126170", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": -1, "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:15.701045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-146e2ff7-4855-4954-b371-834eb8aa5a63 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-146e2ff7-4855-4954-b371-834eb8aa5a63 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 206 Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1726126170", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": -1, "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: exception: Flavor -1 could not be found. Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1726126170', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': -1, 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:15.704626 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-146e2ff7-4855-4954-b371-834eb8aa5a63 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-146e2ff7-4855-4954-b371-834eb8aa5a63 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.026771 Oct 04 11:19:15.708386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3020/4254] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:15 2022] POST /compute/v2.1/servers => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:19:15.715586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-020dc224-08aa-4d0c-9dd6-06fe92d6e68e req-d926c942-fc26-4aa8-87fc-8b292f8017d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a52ace0-2ddb-4df5-90b7-e1625948d259", "name": "network-vif-plugged", "status": "completed", "tag": "66a6d253-8115-41c8-b225-8a1368275359"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:15.728449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-020dc224-08aa-4d0c-9dd6-06fe92d6e68e req-d926c942-fc26-4aa8-87fc-8b292f8017d3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:15.729203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-020dc224-08aa-4d0c-9dd6-06fe92d6e68e req-d926c942-fc26-4aa8-87fc-8b292f8017d3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:15.730098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-020dc224-08aa-4d0c-9dd6-06fe92d6e68e req-d926c942-fc26-4aa8-87fc-8b292f8017d3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:15.742040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-020dc224-08aa-4d0c-9dd6-06fe92d6e68e req-d926c942-fc26-4aa8-87fc-8b292f8017d3 service nova] Creating event network-vif-plugged:66a6d253-8115-41c8-b225-8a1368275359 for instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 on n-h1-791135-8 Oct 04 11:19:15.748550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-020dc224-08aa-4d0c-9dd6-06fe92d6e68e req-d926c942-fc26-4aa8-87fc-8b292f8017d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039754 Oct 04 11:19:15.749591 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3021/4255] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:15.757107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:15.758194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:15.766216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:15.766941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:15.767822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:15.768781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:15.769486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:15.770177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:16.128462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:16.137738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9fabaf7a-10bd-49a1-8b24-21bb64fe8f12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1515 microversion: 2.1 time: 0.386174 Oct 04 11:19:16.138961 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3022/4256] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:15 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1515 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:16.144298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:16.145159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:16.152374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:16.153107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:16.153805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:16.154736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:16.155401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:16.156639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:16.413007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:16.422001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1f726cd-629b-455f-a695-0a94ea78d363 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.281737 Oct 04 11:19:16.423258 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3023/4257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:16 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:16.428150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:16.432086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:16.446437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:16.449435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:16.450096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:16.451067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:16.451688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:16.452284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:16.963164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:16.972135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae9e63a3-7c86-4742-853e-a68c5fd1775b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1320 microversion: 2.1 time: 0.547585 Oct 04 11:19:16.995795 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3024/4258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:16 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1320 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:17.002173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:17.003049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:17.011783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:17.012590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:17.013197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:17.014279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:17.016144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:17.016797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:17.445473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:17.455996 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5767e8c8-0a1b-4608-915f-3d8dd5060d25 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1509 microversion: 2.1 time: 0.459162 Oct 04 11:19:17.456583 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3025/4259] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:16 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:17.486439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:17.494107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:17.511430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:17.512230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:17.513729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:17.517545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:17.518260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:17.518903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:17.588077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a98ae094-8480-44fc-a7e2-a00ff703efce tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.120634 Oct 04 11:19:17.593765 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3026/4260] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:19:17 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:17.603140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:17.603849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:17.618359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:17.618866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:17.619308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:17.620019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:17.620473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:17.620894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:18.078296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:18.088632 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-004960d0-984e-471b-9238-b7b564851711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.493794 Oct 04 11:19:18.094259 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3027/4261] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:17 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:18.099534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:18.103127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:18.119283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:18.124282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:18.125087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:18.127057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:18.129928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:18.130621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:18.490622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:18.500950 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1edad69-f38d-4f7a-94f5-9e4e2bdab76d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1467 microversion: 2.1 time: 0.405176 Oct 04 11:19:18.521780 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3028/4262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:18 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1467 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:18.750386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-439701400", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "b8ffaafd-6b8d-4389-b0bd-a9b2709ee6b0"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:18.849838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] validate_networks() for [('b8ffaafd-6b8d-4389-b0bd-a9b2709ee6b0', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:19:19.418712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:19:19.419144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:19:19.419629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:19:19.420056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:19:19.420662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:19:19.435168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:19.435821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:19.436391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:19.437794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:19.438314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:19.438745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:19.459702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Getting quotas for project ff34b1d535024550bd2351aff18dc50c. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:19:19.466617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Getting quotas for user 4febdeeed88947c79ac250237f22fd07 and project ff34b1d535024550bd2351aff18dc50c. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:19:19.483326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:19:19.487753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:19:19.586684 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4742d08-4717-4ad6-9b33-f0fa007db803 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063308 Oct 04 11:19:19.588125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3029/4263] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:19:19.610733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:19.611276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:19.645794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:19.653459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:19.654863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:19.657619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:19.661096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:19.661826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:19.720943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:19:19.932747 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b0af995-5468-4d72-b7a2-779626bd37a9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 204 len: 0 microversion: 2.20 time: 0.335284 Oct 04 11:19:19.936531 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3030/4264] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:19:19 2022] DELETE /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:19:19.941433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-cab5e383-1007-438a-a9fe-12383315d1ae req-4341c568-84ab-465a-b1f5-c89d14132284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3", "name": "network-vif-plugged", "status": "completed", "tag": "b0da3050-573d-4a9f-9e56-48d572b174b1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:19.955666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cab5e383-1007-438a-a9fe-12383315d1ae req-4341c568-84ab-465a-b1f5-c89d14132284 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:19.956788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cab5e383-1007-438a-a9fe-12383315d1ae req-4341c568-84ab-465a-b1f5-c89d14132284 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:19.957251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cab5e383-1007-438a-a9fe-12383315d1ae req-4341c568-84ab-465a-b1f5-c89d14132284 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:19.980287 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-cab5e383-1007-438a-a9fe-12383315d1ae req-4341c568-84ab-465a-b1f5-c89d14132284 service nova] Creating event network-vif-plugged:b0da3050-573d-4a9f-9e56-48d572b174b1 for instance b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3 on n-h2-791135-8 Oct 04 11:19:19.988197 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-cab5e383-1007-438a-a9fe-12383315d1ae req-4341c568-84ab-465a-b1f5-c89d14132284 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052688 Oct 04 11:19:19.989151 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3031/4265] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:19.997037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:19.998626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:20.009995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:20.010890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:20.012184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:20.013122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:20.014819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:20.016274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:20.289040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:20.298634 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0faaf3e-d876-44c3-86b7-8f60499ebfe9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 200 len: 1508 microversion: 2.1 time: 0.307877 Oct 04 11:19:20.300912 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3032/4266] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:19 2022] GET /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:20.313296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8f61b4d-7783-4655-995b-6813c9c819e0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-754443249", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8f61b4d-7783-4655-995b-6813c9c819e0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 172 Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-754443249", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-754443249', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi -1 Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:19:20.324667 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8f61b4d-7783-4655-995b-6813c9c819e0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:20.328998 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f8f61b4d-7783-4655-995b-6813c9c819e0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.024627 Oct 04 11:19:20.333709 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3033/4267] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:20 2022] POST /compute/v2.1/servers => generated 145 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:19:20.338729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:20.339337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:20.351717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:20.351924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:20.352353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:20.353154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:20.353920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:20.354061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:20.528700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:20.540978 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2091d520-13ad-4bf7-ac61-354b255d95ea tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1509 microversion: 2.1 time: 0.205040 Oct 04 11:19:20.544090 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3034/4268] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:20 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:20.568873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-67590321", "metadata": {"image_type": "test"}}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:20.571502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:20.578906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:20.579310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:20.579848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:20.580663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:20.581239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:20.582046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:20.623796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:20.627492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Getting quotas for project 7d2f6b04fa444d839c097a066d3cc896. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:19:20.634873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Getting quotas for user 9376a5065d204b49930796d6e3f17dc8 and project 7d2f6b04fa444d839c097a066d3cc896. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:19:21.039809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c7bd5dd-f5c1-4113-93b8-2b2e54448600 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "POST /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259/action" status: 202 len: 0 microversion: 2.1 time: 0.494242 Oct 04 11:19:21.052199 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3035/4269] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:19:20 2022] POST /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:19:21.062613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c612b3ee-c685-4374-92a0-2484b07e0c50 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'create', calling method: .version_select at 0x7f71cf6893a0>, body: {"keypair": {"name": "tempest-keypair-995352199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMswfif41I/+70tUly9tM5qWlGeSxGgy7FB/znjZMbhQS5egdIKd2pUaiDJC5MmMz3K2vnXFmqKGXtvBcLJRQWq/0SpA246cEvAFsKh2ow3OEt7EBzx/WMQGbbfbGnkK1A=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:21.148664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c612b3ee-c685-4374-92a0-2484b07e0c50 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Getting quotas for project 0313e8ab904049c58fd4c9d9a7adf40a. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:19:21.194832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c612b3ee-c685-4374-92a0-2484b07e0c50 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Getting quotas for user d5c346b48e674ad48fa6fd6aa2634361 and project 0313e8ab904049c58fd4c9d9a7adf40a. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:19:21.260879 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c612b3ee-c685-4374-92a0-2484b07e0c50 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.203977 Oct 04 11:19:21.261071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3036/4270] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:19:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:21.302662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:21.311107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:21.318082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:21.340101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:21.341524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:21.341971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:21.342715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:21.343711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:21.344143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:21.568477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4febdeeed88947c79ac250237f22fd07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff34b1d535024550bd2351aff18dc50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:21.579211 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5718798-153c-4e0f-873f-fac47e7179c1 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 200 len: 1223 microversion: 2.1 time: 0.293595 Oct 04 11:19:21.589596 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3037/4271] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:21 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 1223 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:21.615765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:21.616891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:21.639487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:21.640640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:21.641003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:21.641778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:21.642633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:21.643077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:22.437917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:22.453159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:22.466974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:22.468765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-706ecc33-dfdf-4555-8a0c-37fca555c586 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 200 len: 1722 microversion: 2.20 time: 0.866855 Oct 04 11:19:22.470128 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3038/4272] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:19:21 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 1722 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:19:22.500313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:22.502019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:22.534276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:22.536255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:22.536931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:22.539269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:22.541374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:22.549318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:24.109282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:24.128839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-778922aa-db8a-4c08-a45c-9865ce56f9f8 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3" status: 200 len: 1509 microversion: 2.1 time: 1.650223 Oct 04 11:19:24.129835 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3039/4273] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:22 2022] GET /compute/v2.1/servers/b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3 => generated 1509 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:24.137918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:24.137918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:24.148156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:24.148572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:24.149005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:24.149840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:24.158255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:24.158849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:24.811382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:24.827145 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8bcbd25-64d4-4e4e-97ae-867356d60ffd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.696595 Oct 04 11:19:24.839525 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3040/4274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:24 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:24.844587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8880f76-bcc6-4399-b688-82d9bcfc0470 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d41f5e50>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:29.449308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:31.212667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:34.147952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=7 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:34.817821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:36.892362 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8880f76-bcc6-4399-b688-82d9bcfc0470 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050" status: 200 len: 1420 microversion: 2.1 time: 12.051626 Oct 04 11:19:36.894432 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3041/4275] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:19:24 2022] GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050 => generated 1420 bytes in 12054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:36.900930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:36.901934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:36.912200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:36.912932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:36.913582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:36.914694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:36.915760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:36.916352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:37.389247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:37.413375 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77b2b12f-bf79-43ff-9134-e140efe17cf3 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1509 microversion: 2.1 time: 0.517506 Oct 04 11:19:37.434109 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3042/4276] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:36 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:37.441463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-cfd42a9f-49b9-4ff8-aba9-14d70d7513d9 req-8ffafd03-aef0-4296-bfb8-723753a718a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b", "name": "network-vif-plugged", "status": "completed", "tag": "bf485443-e440-4ed3-af41-fa8bafa8e9a0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:37.452712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cfd42a9f-49b9-4ff8-aba9-14d70d7513d9 req-8ffafd03-aef0-4296-bfb8-723753a718a4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:37.453543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cfd42a9f-49b9-4ff8-aba9-14d70d7513d9 req-8ffafd03-aef0-4296-bfb8-723753a718a4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:37.454178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cfd42a9f-49b9-4ff8-aba9-14d70d7513d9 req-8ffafd03-aef0-4296-bfb8-723753a718a4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:37.469767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-cfd42a9f-49b9-4ff8-aba9-14d70d7513d9 req-8ffafd03-aef0-4296-bfb8-723753a718a4 service nova] Creating event network-vif-plugged:bf485443-e440-4ed3-af41-fa8bafa8e9a0 for instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b on n-h2-791135-8 Oct 04 11:19:37.475506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-cfd42a9f-49b9-4ff8-aba9-14d70d7513d9 req-8ffafd03-aef0-4296-bfb8-723753a718a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038722 Oct 04 11:19:37.476791 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3043/4277] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:37.483468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:37.484384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:37.491198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:37.491963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:37.492625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:37.493463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:37.494061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:37.494566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:37.818170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4febdeeed88947c79ac250237f22fd07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff34b1d535024550bd2351aff18dc50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:37.828961 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfabeadc-8b1b-48de-9b40-f3e878d64c45 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 200 len: 1327 microversion: 2.1 time: 0.350675 Oct 04 11:19:37.851861 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3044/4278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:37 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 1327 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:37.860252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:37.862572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:37.880551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:37.881067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:37.881595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:37.882731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:37.883200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:37.883637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:37.906040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] HTTP exception thrown: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Request method failure captured: Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 HTTP/1.1 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBXiPY_G-bdBBtrLJ44bjZ03Rz6iree9N6yLOKfGY7TDAtoXLfnQrKZK6iJzwtvABsGKVoHY_DSnRbqJH2ueEDkHYFHpOEB2Dz1mRkZh8VIAhEWAJYusCqT8GbGVV_qyQV93fegmfJmguCZN9Aw-Wq5DPW-z8k_scR9zrjEffHEDI6U Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d71eb38ede4033ae37903456138987"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d71eb38ede4033ae37903456138987"}]}] Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 15409bd95f884840b4f3fe972ade15ef Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '0b6e745e-9cfe-4562-a91f-7fa25f3ad109'} Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:37.906699 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Returning 404 to user: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8545dff-86c4-4baa-b698-80550ad7688b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 404 len: 111 microversion: 2.20 time: 0.055447 Oct 04 11:19:37.913635 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3045/4279] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:19:37 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:19:37.914269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:37.914796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:37.922714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:37.923260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:37.923817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:37.924640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:37.925263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:37.925854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:37.962490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:19:38.081609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8de6d3f2-d21d-489d-8d59-7dbe0b69a399 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3" status: 204 len: 0 microversion: 2.1 time: 0.170958 Oct 04 11:19:38.082823 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3046/4280] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:19:37 2022] DELETE /compute/v2.1/servers/b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:19:38.089931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:38.091878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:38.104964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:38.107028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:38.107803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:38.110129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:38.110863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:38.111753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:38.402558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:38.411307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6bf4d1c-3935-4e07-9b28-bf54792372be tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.327179 Oct 04 11:19:38.411979 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3047/4281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:38 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:38.439399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-812af9fe-e9e7-4971-bfc1-37300879a4b3 req-3af9012e-3766-4678-a8f9-76f3e3b137e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6e745e-9cfe-4562-a91f-7fa25f3ad109", "name": "network-vif-deleted", "tag": "8a5bddce-130d-4805-99d6-8f5074eab124"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:38.449930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-812af9fe-e9e7-4971-bfc1-37300879a4b3 req-3af9012e-3766-4678-a8f9-76f3e3b137e1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:38.450526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-812af9fe-e9e7-4971-bfc1-37300879a4b3 req-3af9012e-3766-4678-a8f9-76f3e3b137e1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:38.451079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-812af9fe-e9e7-4971-bfc1-37300879a4b3 req-3af9012e-3766-4678-a8f9-76f3e3b137e1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:38.464349 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-812af9fe-e9e7-4971-bfc1-37300879a4b3 req-3af9012e-3766-4678-a8f9-76f3e3b137e1 service nova] Creating event network-vif-deleted:8a5bddce-130d-4805-99d6-8f5074eab124 for instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 on n-h1-791135-8 Oct 04 11:19:38.470194 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-812af9fe-e9e7-4971-bfc1-37300879a4b3 req-3af9012e-3766-4678-a8f9-76f3e3b137e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043192 Oct 04 11:19:38.471115 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3048/4282] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:38.477287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2074702841", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc8862a0-d086-4424-bebe-a8d7874e2d0c"}], "security_groups": [{"name": "tempest-securitygroup--754509253"}], "key_name": "tempest-keypair-995352199", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:38.669716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] validate_networks() for [('bc8862a0-d086-4424-bebe-a8d7874e2d0c', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:19:39.096156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:19:39.096764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:19:39.097050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:19:39.097845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:19:39.098283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:19:39.107640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:39.108924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:39.109562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:39.110326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:39.110786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:39.111215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:39.128203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Getting quotas for project 0313e8ab904049c58fd4c9d9a7adf40a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:19:39.134066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Getting quotas for user d5c346b48e674ad48fa6fd6aa2634361 and project 0313e8ab904049c58fd4c9d9a7adf40a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:19:39.146620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:19:39.149031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:19:39.197335 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-79a9fcf2-0baa-49ad-918d-af0806df8df3 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.724868 Oct 04 11:19:39.204195 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3049/4283] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:19:39.204195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3d651cfd-2c6f-4d04-91f5-a3920f6dd9d5 req-8c717b15-5c11-4428-b893-51322c0eb092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0383693-4fc1-47bb-929a-7bd781ab00a2", "tag": "604aac70-b9cd-4c71-b083-0963b5f94b00"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:39.213284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d651cfd-2c6f-4d04-91f5-a3920f6dd9d5 req-8c717b15-5c11-4428-b893-51322c0eb092 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:39.213808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d651cfd-2c6f-4d04-91f5-a3920f6dd9d5 req-8c717b15-5c11-4428-b893-51322c0eb092 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:39.214241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3d651cfd-2c6f-4d04-91f5-a3920f6dd9d5 req-8c717b15-5c11-4428-b893-51322c0eb092 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:39.225546 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3d651cfd-2c6f-4d04-91f5-a3920f6dd9d5 req-8c717b15-5c11-4428-b893-51322c0eb092 service nova] Creating event network-changed:604aac70-b9cd-4c71-b083-0963b5f94b00 for instance b0383693-4fc1-47bb-929a-7bd781ab00a2 on n-h1-791135-8 Oct 04 11:19:39.230841 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3d651cfd-2c6f-4d04-91f5-a3920f6dd9d5 req-8c717b15-5c11-4428-b893-51322c0eb092 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031578 Oct 04 11:19:39.231434 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3050/4284] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:39.237262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c27c3e0-631d-4e66-9b05-6d95ecbdd65e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d4414940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:39.292490 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c27c3e0-631d-4e66-9b05-6d95ecbdd65e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050" status: 200 len: 1429 microversion: 2.1 time: 0.059733 Oct 04 11:19:39.298039 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3051/4285] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:19:39 2022] GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050 => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:39.307269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae1b546c-081c-4e5a-881e-771824c8547b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '.version_select at 0x7f71d437d700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:39.347744 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae1b546c-081c-4e5a-881e-771824c8547b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-935841497" status: 204 len: 0 microversion: 2.20 time: 0.048224 Oct 04 11:19:39.349429 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3052/4286] 10.222.0.23 () {60 vars in 1259 bytes} [Tue Oct 4 11:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-935841497 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:19:39.357816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:39.359430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:39.368720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:39.369412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:39.370698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:39.371076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:39.371392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:39.372021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:39.403955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c6917fd9-2425-4320-8d9e-a72beac87b21] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:19:39.609105 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92fe0401-5d81-4e1c-ac2c-fe1ebdea39bd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21" status: 204 len: 0 microversion: 2.1 time: 0.258306 Oct 04 11:19:39.610191 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3053/4287] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:19:39 2022] DELETE /compute/v2.1/servers/c6917fd9-2425-4320-8d9e-a72beac87b21 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:19:39.625441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:39.627377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:39.635527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:39.636032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:39.636468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:39.637318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:39.637950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:39.638396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:39.970822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:39.985902 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95944566-44ca-407d-820e-ae1407b19ae9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1506 microversion: 2.1 time: 0.372578 Oct 04 11:19:39.986927 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3054/4288] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:39 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:39.995154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ffa88b1-6589-478d-9318-de79adbe1d26 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1817877990", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:40.002279 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7ffa88b1-6589-478d-9318-de79adbe1d26 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ffa88b1-6589-478d-9318-de79adbe1d26 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 216 Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1817877990", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1817877990', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:40.005856 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:40.009496 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:40.009496 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:40.009496 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:40.009496 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:40.009496 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:40.009496 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:40.009496 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 11:19:40.009496 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:40.012367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ffa88b1-6589-478d-9318-de79adbe1d26 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:40.013957 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ffa88b1-6589-478d-9318-de79adbe1d26 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.025689 Oct 04 11:19:40.015838 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3055/4289] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:39 2022] POST /compute/v2.1/servers => generated 123 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:19:40.022918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:40.023656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:40.034252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:40.035050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:40.035697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:40.036952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:40.037447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:40.037882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:40.331658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4febdeeed88947c79ac250237f22fd07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff34b1d535024550bd2351aff18dc50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:40.340690 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a35f704-67a6-43c3-953a-c8a43e45b20b tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 200 len: 1327 microversion: 2.1 time: 0.323529 Oct 04 11:19:40.357763 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3056/4290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:40 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 1327 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:40.363198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:40.363814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:40.371009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:40.371782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:40.372202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:40.387775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:40.388486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:40.388946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:40.514618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:40.528843 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2fcac070-6272-47d4-a15d-89dbccec898f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1249 microversion: 2.1 time: 0.169385 Oct 04 11:19:40.530846 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3057/4291] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:40 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1249 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:40.549476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3de5c7ec-aab4-4553-bb5d-293b33d7b6e3 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d450e5e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:40.627834 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3de5c7ec-aab4-4553-bb5d-293b33d7b6e3 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050" status: 200 len: 1429 microversion: 2.1 time: 0.095792 Oct 04 11:19:40.628638 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3058/4292] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:19:40 2022] GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050 => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:40.633109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b563ac84-bb3d-4b13-8fba-1fc9dfab894f req-ab172a4b-16e2-4fd8-836e-04ea7db9e0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a52ace0-2ddb-4df5-90b7-e1625948d259", "name": "network-vif-plugged", "status": "completed", "tag": "66a6d253-8115-41c8-b225-8a1368275359"}, {"server_uuid": "b0383693-4fc1-47bb-929a-7bd781ab00a2", "name": "network-vif-plugged", "status": "completed", "tag": "604aac70-b9cd-4c71-b083-0963b5f94b00"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:40.656565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b563ac84-bb3d-4b13-8fba-1fc9dfab894f req-ab172a4b-16e2-4fd8-836e-04ea7db9e0f5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:40.657066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b563ac84-bb3d-4b13-8fba-1fc9dfab894f req-ab172a4b-16e2-4fd8-836e-04ea7db9e0f5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:40.659811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b563ac84-bb3d-4b13-8fba-1fc9dfab894f req-ab172a4b-16e2-4fd8-836e-04ea7db9e0f5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:40.692571 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b563ac84-bb3d-4b13-8fba-1fc9dfab894f req-ab172a4b-16e2-4fd8-836e-04ea7db9e0f5 service nova] Creating event network-vif-plugged:66a6d253-8115-41c8-b225-8a1368275359 for instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 on n-h1-791135-8 Oct 04 11:19:40.693409 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b563ac84-bb3d-4b13-8fba-1fc9dfab894f req-ab172a4b-16e2-4fd8-836e-04ea7db9e0f5 service nova] Creating event network-vif-plugged:604aac70-b9cd-4c71-b083-0963b5f94b00 for instance b0383693-4fc1-47bb-929a-7bd781ab00a2 on n-h1-791135-8 Oct 04 11:19:40.700616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b563ac84-bb3d-4b13-8fba-1fc9dfab894f req-ab172a4b-16e2-4fd8-836e-04ea7db9e0f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070917 Oct 04 11:19:40.702011 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3059/4293] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:40.714028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1961756247", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "c10fa64a-a2e2-460a-a3d9-66e12f498b2b"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:40.810564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] validate_networks() for [('c10fa64a-a2e2-460a-a3d9-66e12f498b2b', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:19:42.349328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:19:42.349328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:19:42.351576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:19:42.351576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:19:42.351576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:19:42.375371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:42.376428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:42.377201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:42.378385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:42.379349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:42.380318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:42.425345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Getting quotas for project 876aaf19cb424eb9b1249d8c9342260a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:19:42.433641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Getting quotas for user 4fa8721e039e4219ae2c2f5fe2a778a0 and project 876aaf19cb424eb9b1249d8c9342260a. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:19:42.463865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Going to run 2 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:19:42.466797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:19:42.527422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: f35dfe9e-0202-46f6-a179-0cddaa252c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=c02e4f28-f6ed-44f7-96d7-eab5979699d0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:19:42.650109 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a06dd7a-cf06-4151-b74d-2753c8aa7e73 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.946560 Oct 04 11:19:42.651080 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3060/4294] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:40 2022] POST /compute/v2.1/servers => generated 32 bytes in 1948 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 11:19:42.660247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:42.660875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:42.675601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:42.676336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:42.676926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:42.678118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:42.678717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:42.679308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:43.046410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:43.065222 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-348785af-78f7-4200-ae87-8f0dbde12970 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.412736 Oct 04 11:19:43.065810 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3061/4295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:42 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:43.075012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:43.076233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:43.099767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:43.100596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:43.101057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:43.101841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:43.102432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:43.102732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:43.425325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:43.433761 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c9368be-11c4-49f2-9e71-8c2f1aac0747 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1467 microversion: 2.1 time: 0.366812 Oct 04 11:19:43.434385 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3062/4296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:43 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1467 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:43.457595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e22e8d76-c3e1-4cb0-99bb-58c0b12fdf0a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'create', calling method: .version_select at 0x7f71cf1bb3a0>, body: {"keypair": {"name": "tempest-keypair-976102537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWfY1h2/awg+QnaKMvtueQrKbJCfx+/mqyi68NxZDtO6AIGQWYeEzLl4cuKym6wGW20ZHczVWsjJ5bJsYbfmsxmy1qsiyqmA/L/pfYWvHZEHR2NX6aLsg2fs16RRCpY5Q=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:43.475269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e22e8d76-c3e1-4cb0-99bb-58c0b12fdf0a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Getting quotas for project 20d71eb38ede4033ae37903456138987. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:19:43.481024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e22e8d76-c3e1-4cb0-99bb-58c0b12fdf0a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Getting quotas for user 15409bd95f884840b4f3fe972ade15ef and project 20d71eb38ede4033ae37903456138987. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:19:43.510988 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e22e8d76-c3e1-4cb0-99bb-58c0b12fdf0a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.063689 Oct 04 11:19:43.511867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3063/4297] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Oct 4 11:19:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 11:19:43.517305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:43.518044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:43.526063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:43.526680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:43.527199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:43.528139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:43.528539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:43.529389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:43.828287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:43.843442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:43.854698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dabf6c48-4ecd-4985-9f78-182cd65e0bce tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1506 microversion: 2.1 time: 0.341767 Oct 04 11:19:43.856892 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3064/4298] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:43 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:43.866479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:43.868194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:43.874877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=10,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:43.893625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:43.894051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:43.894486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:43.895217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:43.895675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:43.896327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:44.537693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4febdeeed88947c79ac250237f22fd07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff34b1d535024550bd2351aff18dc50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:44.548018 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b3a1eb6-156c-465d-a679-38d5a73370ba tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 200 len: 1528 microversion: 2.1 time: 0.689862 Oct 04 11:19:44.567657 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3065/4299] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:43 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 1528 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:44.573919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:44.574572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:44.581849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:44.582620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:44.583056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:44.583761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:44.584371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:44.585442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:44.728519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:44.750549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-47483253-01ce-461d-94ff-c986dbd17887 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1303 microversion: 2.1 time: 0.181358 Oct 04 11:19:44.765763 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3066/4300] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:44 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:44.773133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0ed47fb1-552f-4c42-aa51-1437acbbc523 req-f3b76e97-839b-4c0d-b942-a2a34c39e9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6917fd9-2425-4320-8d9e-a72beac87b21", "name": "network-vif-deleted", "tag": "aa304280-0a42-42fa-8801-c726a918420f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:44.792201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ed47fb1-552f-4c42-aa51-1437acbbc523 req-f3b76e97-839b-4c0d-b942-a2a34c39e9b5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:44.792950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ed47fb1-552f-4c42-aa51-1437acbbc523 req-f3b76e97-839b-4c0d-b942-a2a34c39e9b5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:44.793616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0ed47fb1-552f-4c42-aa51-1437acbbc523 req-f3b76e97-839b-4c0d-b942-a2a34c39e9b5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:44.818127 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0ed47fb1-552f-4c42-aa51-1437acbbc523 req-f3b76e97-839b-4c0d-b942-a2a34c39e9b5 service nova] Creating event network-vif-deleted:aa304280-0a42-42fa-8801-c726a918420f for instance c6917fd9-2425-4320-8d9e-a72beac87b21 on n-h2-791135-8 Oct 04 11:19:44.826227 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0ed47fb1-552f-4c42-aa51-1437acbbc523 req-f3b76e97-839b-4c0d-b942-a2a34c39e9b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058843 Oct 04 11:19:44.838449 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3067/4301] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:44.844622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:44.849775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:44.857326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Searching by: {'deleted': False, 'project_id': '876aaf19cb424eb9b1249d8c9342260a'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:19:44.864336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:44.865089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:44.865787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:44.866689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:44.867317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:44.867753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:44.906089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:19:44.951091 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b49f378-75e2-4c3a-9873-4f10c2087acd tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.110997 Oct 04 11:19:44.961334 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3068/4302] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 11:19:44 2022] GET /compute/v2.1/servers => generated 1337 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:44.972358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-edadc53d-324e-45fc-a963-d156ceaae4e3 req-0944fc8c-3167-434b-9e3a-d632fa20b672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b", "name": "network-vif-unplugged", "status": "completed", "tag": "bf485443-e440-4ed3-af41-fa8bafa8e9a0"}, {"server_uuid": "0a52ace0-2ddb-4df5-90b7-e1625948d259", "name": "network-vif-unplugged", "status": "completed", "tag": "66a6d253-8115-41c8-b225-8a1368275359"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:44.987350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-edadc53d-324e-45fc-a963-d156ceaae4e3 req-0944fc8c-3167-434b-9e3a-d632fa20b672 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:44.988120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-edadc53d-324e-45fc-a963-d156ceaae4e3 req-0944fc8c-3167-434b-9e3a-d632fa20b672 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:44.988904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-edadc53d-324e-45fc-a963-d156ceaae4e3 req-0944fc8c-3167-434b-9e3a-d632fa20b672 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:45.012612 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-edadc53d-324e-45fc-a963-d156ceaae4e3 req-0944fc8c-3167-434b-9e3a-d632fa20b672 service nova] Creating event network-vif-unplugged:bf485443-e440-4ed3-af41-fa8bafa8e9a0 for instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b on n-h2-791135-8 Oct 04 11:19:45.013111 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-edadc53d-324e-45fc-a963-d156ceaae4e3 req-0944fc8c-3167-434b-9e3a-d632fa20b672 service nova] Creating event network-vif-unplugged:66a6d253-8115-41c8-b225-8a1368275359 for instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 on n-h1-791135-8 Oct 04 11:19:45.029037 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-edadc53d-324e-45fc-a963-d156ceaae4e3 req-0944fc8c-3167-434b-9e3a-d632fa20b672 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.065667 Oct 04 11:19:45.030176 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3069/4303] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:45.040952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:45.041689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:45.061863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:45.062890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:45.063579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:45.064731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:45.065800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:45.066620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:45.427245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:45.435789 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72677e58-6502-4db5-99f3-cf7c43f2d1a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.398898 Oct 04 11:19:45.456114 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3070/4304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:45 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:45.456114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-89110fd4-43da-4849-a6e0-c7a94472eb44 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d48e5940>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:45.494484 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-89110fd4-43da-4849-a6e0-c7a94472eb44 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c5abc5b2-fab0-47a3-992d-153996b39244" status: 200 len: 784 microversion: 2.1 time: 0.056513 Oct 04 11:19:45.495074 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3071/4305] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:19:45 2022] GET /compute/v2.1/images/c5abc5b2-fab0-47a3-992d-153996b39244 => generated 784 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:45.505139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:45.506338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:45.536533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:45.541303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:45.541995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:45.542585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:45.543154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:45.543545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:45.956432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4febdeeed88947c79ac250237f22fd07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff34b1d535024550bd2351aff18dc50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:45.966846 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8bc5d15-0ae9-4ab5-b45a-fd2b06df947d tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 200 len: 1528 microversion: 2.1 time: 0.470566 Oct 04 11:19:45.968459 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3072/4306] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:45 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 1528 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:45.975914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:45.977007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:45.985896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:45.986786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:45.987417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:45.988545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:45.989216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:45.990280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:46.299132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:46.315470 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c881fa5-5c01-42c6-90fc-9297700554d9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 200 len: 1449 microversion: 2.1 time: 0.340822 Oct 04 11:19:46.316327 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3073/4307] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:45 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 1449 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:46.330524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:46.330524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:46.338763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:46.339942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:46.340573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:46.344330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:46.344688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:46.345173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:46.462042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:46.472115 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4751b85d-d3cb-4e6b-bdb8-66bd84437d29 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1214 microversion: 2.1 time: 0.149531 Oct 04 11:19:46.473158 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3074/4308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:46 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:46.478915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-142144044", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7903534a-2cfe-47f8-9aed-6247c17a6f8d"}], "security_groups": [{"name": "tempest-securitygroup--1965610101"}], "key_name": "tempest-keypair-976102537", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:46.744707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] validate_networks() for [('7903534a-2cfe-47f8-9aed-6247c17a6f8d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:19:48.068879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:19:48.069504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:19:48.070081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:19:48.070694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:19:48.071119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:19:48.082083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:48.082743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:48.083356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:48.084464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:48.085203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:48.086098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:48.108766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Getting quotas for project 20d71eb38ede4033ae37903456138987. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:19:48.116821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Getting quotas for user 15409bd95f884840b4f3fe972ade15ef and project 20d71eb38ede4033ae37903456138987. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:19:48.131335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:19:48.134631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:19:48.190556 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46c9a34c-42d3-44ea-be34-295e557ea8b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.715786 Oct 04 11:19:48.192066 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3075/4309] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:19:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:19:48.196841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1de560fe-30e0-4a1e-aaa3-237ae3be628e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:48.206657 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1de560fe-30e0-4a1e-aaa3-237ae3be628e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013354 Oct 04 11:19:48.216500 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3076/4310] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:19:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:48.225500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a05d24d-25d0-40bb-b821-3040f063ac7a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1857674517", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-key-482970438", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:48.315686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-3a05d24d-25d0-40bb-b821-3040f063ac7a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] validate_networks() for [('350c987a-5b2c-443d-b477-a345ff55756e', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:19:48.558683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-3a05d24d-25d0-40bb-b821-3040f063ac7a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Invalid key_name provided. Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a05d24d-25d0-40bb-b821-3040f063ac7a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 246 Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1857674517", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-key-482970438", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid key_name provided. Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1857674517', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'key_name': 'tempest-key-482970438', 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-482970438 not found for user d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:48.566160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:48.571336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a05d24d-25d0-40bb-b821-3040f063ac7a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid key_name provided. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:48.575095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a05d24d-25d0-40bb-b821-3040f063ac7a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.356250 Oct 04 11:19:48.577908 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3077/4311] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 361 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:19:48.585639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:48.587114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:48.602780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:48.603201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:48.603647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:48.604364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:48.604827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:48.605261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:48.971189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:48.991744 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4415ae1-5adb-4483-ab57-6943a04cac41 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1370 microversion: 2.1 time: 0.412328 Oct 04 11:19:48.992839 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3078/4312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:48 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1370 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:49.060398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:49.061046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:49.078213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.079869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.080486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.081656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.082428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.084170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.112475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] HTTP exception thrown: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Request method failure captured: Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 HTTP/1.1 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBa1E6FZH-Y20u8jJyScm882ugT8EiCKQFdW6XCpCiYe9G4w3OX0BVbAqIWZO4NrXbXaLWz-j5m4IGDUZuly6jgHVUoPkW4D6IcScHydRReO-f3luTS4oUuS2_Ewc8wU1USZZwLNmM0OtpXesfOBqJycmC7VC7K2Ht1PdhkWdGM2t6s Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 5780d2d5513646818b4ed131016b6d85 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2089722512 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5780d2d5513646818b4ed131016b6d85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5780d2d5513646818b4ed131016b6d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5780d2d5513646818b4ed131016b6d85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5780d2d5513646818b4ed131016b6d85"}]}] Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2089722512 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 5780d2d5513646818b4ed131016b6d85 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2089722512 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2089722512-project Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0101250d868d4bcc8bec61e508554aa9 Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2089722512-project Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b0383693-4fc1-47bb-929a-7bd781ab00a2'} Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:19:49.114156 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Returning 404 to user: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96f210d4-2b69-460e-b31c-047bbd64d106 tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 404 len: 111 microversion: 2.1 time: 0.121313 Oct 04 11:19:49.124066 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3079/4313] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:19:48 2022] DELETE /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:19:49.129982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:49.130838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:49.140502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.141145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.142002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.143205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.143669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.144096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.287376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:49.297057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3947874-2b2b-4a03-ba77-0a876c104600 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.179894 Oct 04 11:19:49.332142 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3080/4314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:49 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:49.406356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-17de26d7-daaa-41d9-9372-3cf515ddb47f req-3ab09c27-a7eb-44af-a9c3-6ceb5df16844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3", "name": "network-vif-deleted", "tag": "b0da3050-573d-4a9f-9e56-48d572b174b1"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:49.417825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-17de26d7-daaa-41d9-9372-3cf515ddb47f req-3ab09c27-a7eb-44af-a9c3-6ceb5df16844 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.418364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-17de26d7-daaa-41d9-9372-3cf515ddb47f req-3ab09c27-a7eb-44af-a9c3-6ceb5df16844 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.419054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-17de26d7-daaa-41d9-9372-3cf515ddb47f req-3ab09c27-a7eb-44af-a9c3-6ceb5df16844 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.435321 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-17de26d7-daaa-41d9-9372-3cf515ddb47f req-3ab09c27-a7eb-44af-a9c3-6ceb5df16844 service nova] Creating event network-vif-deleted:b0da3050-573d-4a9f-9e56-48d572b174b1 for instance b68ba7cf-55c7-4e3c-b43f-373b2dbe45d3 on n-h2-791135-8 Oct 04 11:19:49.441085 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-17de26d7-daaa-41d9-9372-3cf515ddb47f req-3ab09c27-a7eb-44af-a9c3-6ceb5df16844 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107161 Oct 04 11:19:49.442101 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3081/4315] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:49.449092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:49.449830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:49.456334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.457003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.457631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.458337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.458785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.459372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.697262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:49.707651 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91f5bf23-bfff-443c-9b1c-ff9276cadaa7 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1318 microversion: 2.1 time: 0.264362 Oct 04 11:19:49.725168 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3082/4316] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:49 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:49.732778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:49.735680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:49.742109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.742808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.743542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.744425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:49.745123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:49.745733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:49.902979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:49.917948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:49.921198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:49.923827 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd74f3dc-d216-4903-9a91-20b5f5e0493a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1340 microversion: 2.20 time: 0.197115 Oct 04 11:19:49.925465 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3083/4317] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:19:49 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:19:49.931069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f246a16-04a1-4ee3-b06d-2bd5f14a2b48 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d44e3280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:50.435071 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f246a16-04a1-4ee3-b06d-2bd5f14a2b48 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "DELETE /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050" status: 204 len: 0 microversion: 2.1 time: 0.507418 Oct 04 11:19:50.440107 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3084/4318] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:49 2022] DELETE /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:19:50.446950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-392c5960-421d-4e32-81af-30926c5c9ffa req-784e6969-7dc1-4b8b-b2c4-08367f3d5c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0", "tag": "e19a409c-8a87-4928-9624-7ab08668b7f0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:50.459554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-392c5960-421d-4e32-81af-30926c5c9ffa req-784e6969-7dc1-4b8b-b2c4-08367f3d5c75 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:50.460355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-392c5960-421d-4e32-81af-30926c5c9ffa req-784e6969-7dc1-4b8b-b2c4-08367f3d5c75 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:50.461016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-392c5960-421d-4e32-81af-30926c5c9ffa req-784e6969-7dc1-4b8b-b2c4-08367f3d5c75 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:50.474364 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-392c5960-421d-4e32-81af-30926c5c9ffa req-784e6969-7dc1-4b8b-b2c4-08367f3d5c75 service nova] Creating event network-changed:e19a409c-8a87-4928-9624-7ab08668b7f0 for instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 on n-h2-791135-8 Oct 04 11:19:50.480066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-392c5960-421d-4e32-81af-30926c5c9ffa req-784e6969-7dc1-4b8b-b2c4-08367f3d5c75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037285 Oct 04 11:19:50.481218 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3085/4319] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:50.489419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:50.490642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:50.499517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:50.501215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:50.502419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:50.504009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:50.504714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:50.506248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:50.802002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:50.814128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af37233f-40d1-4580-8b9d-994a5d571cdc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.331299 Oct 04 11:19:50.815112 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3086/4320] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:50 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:50.824639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:50.828490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:50.837284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:50.837866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:50.838307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:50.839923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:50.840466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:50.840816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:51.197003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4febdeeed88947c79ac250237f22fd07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff34b1d535024550bd2351aff18dc50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:51.214845 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-844102d7-5b60-4e97-9d1c-24252ecba82e tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 200 len: 1528 microversion: 2.1 time: 0.398762 Oct 04 11:19:51.215450 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3087/4321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:50 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 1528 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:51.227147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:51.229573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:51.243088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:51.243815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:51.244416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:51.245292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:51.245939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:51.246636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:51.507106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:51.518894 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b26a4b92-6b99-4a4f-a29a-1fdb6d4a47a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.301400 Oct 04 11:19:51.519656 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3088/4322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:51 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:51.524093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:51.524695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:51.531322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:51.531891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:51.532335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:51.533036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:51.533523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:51.533967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:51.539220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:51.769684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:51.781948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9ffe3e0e-356e-4dfa-a6a4-69a08c424534 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1370 microversion: 2.1 time: 0.260975 Oct 04 11:19:51.784861 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3089/4323] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:51 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:51.792867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ce19e599-61a8-44ef-97c4-4ba6981a023e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d465aca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:51.825754 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ce19e599-61a8-44ef-97c4-4ba6981a023e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] HTTP exception thrown: Image not found. Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ce19e599-61a8-44ef-97c4-4ba6981a023e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Request method failure captured: Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050 HTTP/1.1 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBae4t35vhi_VcAJpZJU2ytiCsvLcO3P9nJ8PzBRWBcT4CZ-r10eIajwG3Zo_h6a7D8X2lnnV4NjTGQ3mUoBJXxkueLgug7vvEQb9PKqhrNV2WqxkjxG3BfFznrhk0GbrYqtcxc7tJorsmWTwGxKlvFA0zSp1Q8couJbt72UCSJOx-E Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7d2f6b04fa444d839c097a066d3cc896 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7d2f6b04fa444d839c097a066d3cc896"}]}] Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7d2f6b04fa444d839c097a066d3cc896 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerTestJSON-757128754-project Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 9376a5065d204b49930796d6e3f17dc8 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerTestJSON-757128754-project Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f43e43ae-5dbe-41fd-8916-907612da5050'} Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f43e43ae-5dbe-41fd-8916-907612da5050 Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 11:19:51.828882 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f43e43ae-5dbe-41fd-8916-907612da5050 could not be found. Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:19:51.833196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:51.839055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ce19e599-61a8-44ef-97c4-4ba6981a023e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:51.839721 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ce19e599-61a8-44ef-97c4-4ba6981a023e tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050" status: 404 len: 62 microversion: 2.1 time: 0.052836 Oct 04 11:19:51.847656 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3090/4324] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:19:51 2022] GET /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:19:51.854314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:51.855051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:51.868639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:51.869553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:51.870240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:51.871191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:51.871895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:51.872683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.386457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:52.398524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8201abb8-4c06-4f90-a874-2c6da70a2538 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1318 microversion: 2.1 time: 0.554008 Oct 04 11:19:52.401415 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3091/4325] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:51 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:52.404943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:52.405629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:52.415801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.416303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.416748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.417490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.417955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.418384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.605202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:52.616644 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a6c948bf-5705-4bb8-8774-01ab92535bc0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.215252 Oct 04 11:19:52.617814 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3092/4326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:52 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:52.636750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:52.637653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:52.646418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.646894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.647349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.648067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.648528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.648961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.803179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:52.812807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:52.814551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:52.815672 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6f7609e3-fb3a-4ffe-acf4-1de4b687a282 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1406 microversion: 2.20 time: 0.196668 Oct 04 11:19:52.816720 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3093/4327] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:19:52 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:19:52.821441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Action: 'update', calling method: >, body: {"server": {"name": "b0383693-4fc1-47bb-929a-7bd781ab00a2_new"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:52.824837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:52.835185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.836407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.837012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.838500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.839177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.839757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.856417 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] HTTP exception thrown: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Request method failure captured: Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 HTTP/1.1 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 64 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBa1E6FZH-Y20u8jJyScm882ugT8EiCKQFdW6XCpCiYe9G4w3OX0BVbAqIWZO4NrXbXaLWz-j5m4IGDUZuly6jgHVUoPkW4D6IcScHydRReO-f3luTS4oUuS2_Ewc8wU1USZZwLNmM0OtpXesfOBqJycmC7VC7K2Ht1PdhkWdGM2t6s Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 5780d2d5513646818b4ed131016b6d85 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2089722512 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5780d2d5513646818b4ed131016b6d85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5780d2d5513646818b4ed131016b6d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5780d2d5513646818b4ed131016b6d85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5780d2d5513646818b4ed131016b6d85"}]}] Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2089722512 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 5780d2d5513646818b4ed131016b6d85 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2089722512 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2089722512-project Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 0101250d868d4bcc8bec61e508554aa9 Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2089722512-project Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "b0383693-4fc1-47bb-929a-7bd781ab00a2_new"}} Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b0383693-4fc1-47bb-929a-7bd781ab00a2', 'body': {'server': {'name': 'b0383693-4fc1-47bb-929a-7bd781ab00a2_new'}}} Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:52.859569 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:52.863891 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:52.866076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] Returning 404 to user: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:52.867651 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b282c9d6-23ea-4892-b248-bc29bf6d0f6f tempest-ServersNegativeTestMultiTenantJSON-2089722512 tempest-ServersNegativeTestMultiTenantJSON-2089722512-project] 10.222.0.23 "PUT /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 404 len: 111 microversion: 2.1 time: 0.049803 Oct 04 11:19:52.868408 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3094/4328] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:19:52 2022] PUT /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:19:52.874267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-71f489da-9f0f-4286-9850-d72ef1569add req-cbb58e5a-adf4-47ba-bb55-73e13c2dc5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f35dfe9e-0202-46f6-a179-0cddaa252c45", "tag": "d0573629-40f6-4568-9780-14cd8f3298b6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:52.884792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-71f489da-9f0f-4286-9850-d72ef1569add req-cbb58e5a-adf4-47ba-bb55-73e13c2dc5a1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.885856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-71f489da-9f0f-4286-9850-d72ef1569add req-cbb58e5a-adf4-47ba-bb55-73e13c2dc5a1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.886479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-71f489da-9f0f-4286-9850-d72ef1569add req-cbb58e5a-adf4-47ba-bb55-73e13c2dc5a1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.902366 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-71f489da-9f0f-4286-9850-d72ef1569add req-cbb58e5a-adf4-47ba-bb55-73e13c2dc5a1 service nova] Creating event network-changed:d0573629-40f6-4568-9780-14cd8f3298b6 for instance f35dfe9e-0202-46f6-a179-0cddaa252c45 on n-h2-791135-8 Oct 04 11:19:52.907852 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-71f489da-9f0f-4286-9850-d72ef1569add req-cbb58e5a-adf4-47ba-bb55-73e13c2dc5a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037954 Oct 04 11:19:52.908447 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3095/4329] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:52.914664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:52.915522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:52.931967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.932635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.933089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:52.933991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:52.934612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:52.937062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:53.147290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:53.163930 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-935e59bd-d4a0-4339-b9e1-6cc124af7765 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.254102 Oct 04 11:19:53.165992 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3096/4330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:52 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:53.172427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-159058569"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:53.175250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:53.192508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:53.193296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:53.194118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:53.195037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:53.196289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:53.196890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:53.523284 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f21cb74b-3b85-4598-8058-544a913f3195 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "POST /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259/action" status: 202 len: 0 microversion: 2.1 time: 0.355362 Oct 04 11:19:53.547087 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3097/4331] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:19:53 2022] POST /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:19:53.555687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-804e7df7-f835-4589-b0cb-6b742fdcd26c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1389438153", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:53.692860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.security_group_api [None req-804e7df7-f835-4589-b0cb-6b742fdcd26c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Neutron security group does_not_exist not found {{(pid=122409) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 11:19:53.693468 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-804e7df7-f835-4589-b0cb-6b742fdcd26c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-804e7df7-f835-4589-b0cb-6b742fdcd26c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 258 Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1389438153", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1389438153', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 11:19:53.713929 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 11:19:53.718654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:53.730666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-804e7df7-f835-4589-b0cb-6b742fdcd26c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:53.731965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-804e7df7-f835-4589-b0cb-6b742fdcd26c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.183124 Oct 04 11:19:53.732907 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3098/4332] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:19:53 2022] POST /compute/v2.1/servers => generated 106 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:19:53.741315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:53.745385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:53.758523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:53.759666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:53.760299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:53.761054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:53.761550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:53.761991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:53.973002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:53.983739 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82ddd2d4-2db9-493b-a7b3-183cbaaf891b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1370 microversion: 2.1 time: 0.249438 Oct 04 11:19:53.984958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3099/4333] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:53 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:53.989781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:53.990515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:53.996888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:53.997641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:53.999086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:53.999769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.000219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.000792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.028306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:19:54.116273 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36270ae3-e253-4970-b87f-bc2a36988544 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 204 len: 0 microversion: 2.1 time: 0.129833 Oct 04 11:19:54.116979 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3100/4334] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:19:53 2022] DELETE /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:19:54.122314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:54.124099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:54.130118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.130612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.131054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.131985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.132199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.132804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.285189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:54.293549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d963f295-55a7-4140-a5cb-24e8509ab341 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.175273 Oct 04 11:19:54.295939 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3101/4335] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:54 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:54.301823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:54.302736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:54.311950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.313192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.313888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.315665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.316908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.318553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.474114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:54.484517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-556fc46e-7bc1-47de-b066-add1a878913b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1318 microversion: 2.1 time: 0.187181 Oct 04 11:19:54.485409 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3102/4336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:54 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:54.490751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3f26a65-7e98-4720-a062-0363ff511b8f tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d437d790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:54.552047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3f26a65-7e98-4720-a062-0363ff511b8f tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.060598 Oct 04 11:19:54.552047 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3103/4337] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:19:54 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:54.553116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:54.554014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:54.564998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.565566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.566392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.567149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.567610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.568042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.717586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:54.732316 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f9b758d0-2048-497e-97ea-90dd0cefd416 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.181940 Oct 04 11:19:54.734295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3104/4338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:54 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:54.741190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:54.742365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:54.757001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.757623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.758126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.758904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.759557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.760052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.898349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:54.907837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:54.909303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:54.910552 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4167660d-21c4-4460-ac29-97e66d9817aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1406 microversion: 2.20 time: 0.174961 Oct 04 11:19:54.911125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3105/4339] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:19:54 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:19:54.916089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:54.916901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:54.923476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.924178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.924806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:54.925973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:54.926619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:54.927252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.127388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4febdeeed88947c79ac250237f22fd07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff34b1d535024550bd2351aff18dc50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:55.141605 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d7adb91-17f0-4927-9059-5db408aa9107 tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 200 len: 1534 microversion: 2.1 time: 0.229383 Oct 04 11:19:55.142195 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3106/4340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:54 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 1534 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:55.147079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-108ae0db-2902-4ba9-823e-000382d0560e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:55.162928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:55.164800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-108ae0db-2902-4ba9-823e-000382d0560e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.165284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-108ae0db-2902-4ba9-823e-000382d0560e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.165944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-108ae0db-2902-4ba9-823e-000382d0560e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.177549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:55.239029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-108ae0db-2902-4ba9-823e-000382d0560e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Going to try to stop instance {{(pid=122409) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:19:55.338901 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-108ae0db-2902-4ba9-823e-000382d0560e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.194128 Oct 04 11:19:55.342859 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3107/4341] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:19:55 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:19:55.349949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:55.350663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:55.359477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.359967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.360407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.361257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.361791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.362217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.576593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:55.585637 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e641345f-783a-4976-8564-e515a3076e58 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.240386 Oct 04 11:19:55.586423 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3108/4342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:55 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:55.591377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-db1ec942-69ec-416e-a4fa-aa8f1248dde2 req-ee9d102e-1440-4ef6-abaf-3866d7b1cf70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c02e4f28-f6ed-44f7-96d7-eab5979699d0", "tag": "64151115-3f4d-45d0-aa5f-79f03650f294"}, {"name": "network-changed", "server_uuid": "e69337b0-3580-43cd-ac13-11f030e3804b", "tag": "a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:55.603204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db1ec942-69ec-416e-a4fa-aa8f1248dde2 req-ee9d102e-1440-4ef6-abaf-3866d7b1cf70 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.604019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db1ec942-69ec-416e-a4fa-aa8f1248dde2 req-ee9d102e-1440-4ef6-abaf-3866d7b1cf70 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.604467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-db1ec942-69ec-416e-a4fa-aa8f1248dde2 req-ee9d102e-1440-4ef6-abaf-3866d7b1cf70 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.618280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-db1ec942-69ec-416e-a4fa-aa8f1248dde2 req-ee9d102e-1440-4ef6-abaf-3866d7b1cf70 service nova] Creating event network-changed:64151115-3f4d-45d0-aa5f-79f03650f294 for instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 on n-h2-791135-8 Oct 04 11:19:55.618796 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-db1ec942-69ec-416e-a4fa-aa8f1248dde2 req-ee9d102e-1440-4ef6-abaf-3866d7b1cf70 service nova] Creating event network-changed:a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac for instance e69337b0-3580-43cd-ac13-11f030e3804b on n-h1-791135-8 Oct 04 11:19:55.628937 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-db1ec942-69ec-416e-a4fa-aa8f1248dde2 req-ee9d102e-1440-4ef6-abaf-3866d7b1cf70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041464 Oct 04 11:19:55.629599 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3109/4343] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:55.636027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:55.636914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:55.645490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.646078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.646526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.647394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.647997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.649023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.782476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:55.790415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-39489ff4-8ade-489a-bb4d-765bd3578d6c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1370 microversion: 2.1 time: 0.159183 Oct 04 11:19:55.790997 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3110/4344] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:55 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:55.855965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-26c85946-0534-450b-a5ec-d2ae13d54088 req-e1284c03-da2e-4dfc-8cbd-9a9d0e98d03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35dfe9e-0202-46f6-a179-0cddaa252c45", "name": "network-vif-plugged", "status": "completed", "tag": "d0573629-40f6-4568-9780-14cd8f3298b6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:55.866134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-26c85946-0534-450b-a5ec-d2ae13d54088 req-e1284c03-da2e-4dfc-8cbd-9a9d0e98d03a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.866607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-26c85946-0534-450b-a5ec-d2ae13d54088 req-e1284c03-da2e-4dfc-8cbd-9a9d0e98d03a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.867035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-26c85946-0534-450b-a5ec-d2ae13d54088 req-e1284c03-da2e-4dfc-8cbd-9a9d0e98d03a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.878451 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-26c85946-0534-450b-a5ec-d2ae13d54088 req-e1284c03-da2e-4dfc-8cbd-9a9d0e98d03a service nova] Creating event network-vif-plugged:d0573629-40f6-4568-9780-14cd8f3298b6 for instance f35dfe9e-0202-46f6-a179-0cddaa252c45 on n-h2-791135-8 Oct 04 11:19:55.883412 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-26c85946-0534-450b-a5ec-d2ae13d54088 req-e1284c03-da2e-4dfc-8cbd-9a9d0e98d03a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091312 Oct 04 11:19:55.884044 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3111/4345] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:55.889590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:55.890285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:55.896291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.896785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.897204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:55.897918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:55.898368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:55.898787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:56.064832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:56.079508 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0b19da2-dfbb-4eb6-bf56-bc877223074e tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.192539 Oct 04 11:19:56.080691 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3112/4346] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:55 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:56.086275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:56.087609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:56.099735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:56.100578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:56.101386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:56.102436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:56.103261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:56.104230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:56.256997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:56.265851 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b03b40ef-e297-403e-b2ad-06af1ca5c2c9 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1318 microversion: 2.1 time: 0.183805 Oct 04 11:19:56.266676 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3113/4347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:56 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:56.271743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c446f84-748b-43af-9aa7-11c9fc4ddd62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d4502790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:56.333781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c446f84-748b-43af-9aa7-11c9fc4ddd62 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.065655 Oct 04 11:19:56.341984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3114/4348] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:19:56 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:56.341984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e13d39ab-2dca-45d0-8a9d-64fff1015cac tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:56.341984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e13d39ab-2dca-45d0-8a9d-64fff1015cac tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 7b37fe7f-98ef-47e6-841f-22b7ada2ab57] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:56.345475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e13d39ab-2dca-45d0-8a9d-64fff1015cac tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 7b37fe7f-98ef-47e6-841f-22b7ada2ab57 could not be found. Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e13d39ab-2dca-45d0-8a9d-64fff1015cac tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/7b37fe7f-98ef-47e6-841f-22b7ada2ab57 HTTP/1.1 Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 7b37fe7f-98ef-47e6-841f-22b7ada2ab57 could not be found. Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '7b37fe7f-98ef-47e6-841f-22b7ada2ab57'} Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b37fe7f-98ef-47e6-841f-22b7ada2ab57 could not be found. Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b37fe7f-98ef-47e6-841f-22b7ada2ab57 could not be found. Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:56.346893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b37fe7f-98ef-47e6-841f-22b7ada2ab57 could not be found. Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e13d39ab-2dca-45d0-8a9d-64fff1015cac tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 7b37fe7f-98ef-47e6-841f-22b7ada2ab57 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e13d39ab-2dca-45d0-8a9d-64fff1015cac tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b37fe7f-98ef-47e6-841f-22b7ada2ab57" status: 404 len: 111 microversion: 2.1 time: 0.013175 Oct 04 11:19:56.351457 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3115/4349] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:19:56 2022] DELETE /compute/v2.1/servers/7b37fe7f-98ef-47e6-841f-22b7ada2ab57 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:19:56.356842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:56.357544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:56.365626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:56.365892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:56.366332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:56.367041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:56.367500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:56.367929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:56.527813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:56.536980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:56.538534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:56.539636 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b3a9217-b2b7-462e-a2ff-d6d94d9c779f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1406 microversion: 2.20 time: 0.188170 Oct 04 11:19:56.540520 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3116/4350] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:19:56 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:19:56.545418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:56.545973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:56.552190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:56.553186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:56.553668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:56.559330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:56.559330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:56.559330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:56.850281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4febdeeed88947c79ac250237f22fd07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff34b1d535024550bd2351aff18dc50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:56.861011 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea7ef4e4-f19b-4456-9476-b46545c835cb tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 200 len: 1534 microversion: 2.1 time: 0.319374 Oct 04 11:19:56.875248 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3117/4351] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:56 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 1534 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:56.886984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:56.888053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:56.894916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:56.896148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:56.896759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:56.897716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:56.898938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:56.899536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:57.320914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:57.340994 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e823d91-20b9-40d1-b985-4137d687c011 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.463669 Oct 04 11:19:57.342932 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3118/4352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:56 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:57.347952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:57.349035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:57.355362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:57.356099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:57.356744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:57.358274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:57.359429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:57.360130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:57.549508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:57.557419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d79d3fae-a049-4111-bd3c-37e576a24489 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1370 microversion: 2.1 time: 0.213201 Oct 04 11:19:57.558018 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3119/4353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:57 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:57.570419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:57.571866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:57.582388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:57.582943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:57.583429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:57.584262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:57.584617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:57.585115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:57.822066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:57.836757 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-54654650-6aef-4f27-8319-4d1fee3162cd tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.277540 Oct 04 11:19:57.850339 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3120/4354] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:57 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:57.862497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:57.863131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:57.874167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:57.874666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:57.875108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:57.875838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:57.876287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:57.876721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:58.065937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:58.075568 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f9eebfc-42cd-48c1-8f63-5da285746c97 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1318 microversion: 2.1 time: 0.217650 Oct 04 11:19:58.077152 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3121/4355] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:57 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:58.082051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2a15fcf-340b-40ae-bb50-c90b4a203922 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71cf2c7ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:58.096290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:58.126247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=22 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:58.154938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2a15fcf-340b-40ae-bb50-c90b4a203922 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.075506 Oct 04 11:19:58.161928 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3122/4356] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:19:58 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:58.171221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:58.171931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:58.179891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:58.180537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:58.181514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:58.182521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:58.184624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:58.185267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:58.504419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:58.512567 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff4da550-874e-477c-b1ce-d75e02daf6fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.355379 Oct 04 11:19:58.512994 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3123/4357] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:58 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:58.519844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:58.520482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:58.527847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:58.528336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:58.528773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:58.529642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:58.530076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:58.530660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:58.911280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:58.932622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:58.943625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:58.945023 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b9ff736-42be-40ce-9b26-d95a824b4d8f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1406 microversion: 2.20 time: 0.431063 Oct 04 11:19:58.981900 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3124/4358] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:19:58 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:19:58.987941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0201a75f-5d9f-40fc-886b-492c053beac7 req-27971e8c-7d40-4372-881f-df0d5fb1cb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0383693-4fc1-47bb-929a-7bd781ab00a2", "name": "network-vif-deleted", "tag": "604aac70-b9cd-4c71-b083-0963b5f94b00"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:59.016037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0201a75f-5d9f-40fc-886b-492c053beac7 req-27971e8c-7d40-4372-881f-df0d5fb1cb49 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.016783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0201a75f-5d9f-40fc-886b-492c053beac7 req-27971e8c-7d40-4372-881f-df0d5fb1cb49 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.017326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0201a75f-5d9f-40fc-886b-492c053beac7 req-27971e8c-7d40-4372-881f-df0d5fb1cb49 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.040638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0201a75f-5d9f-40fc-886b-492c053beac7 req-27971e8c-7d40-4372-881f-df0d5fb1cb49 service nova] Creating event network-vif-deleted:604aac70-b9cd-4c71-b083-0963b5f94b00 for instance b0383693-4fc1-47bb-929a-7bd781ab00a2 on n-h1-791135-8 Oct 04 11:19:59.054983 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0201a75f-5d9f-40fc-886b-492c053beac7 req-27971e8c-7d40-4372-881f-df0d5fb1cb49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069995 Oct 04 11:19:59.056158 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3125/4359] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:59.066474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:59.067478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] [instance: b0383693-4fc1-47bb-929a-7bd781ab00a2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:59.077502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.078146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.078688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.079503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.080062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.080595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.099430 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] HTTP exception thrown: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Request method failure captured: Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 HTTP/1.1 Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBao2svEzdXwNdmgRlfvgCNoZ1d5pYkpNk0nKPUXDQ0C2iz5fdEuVAhb99j06ZOnBZEB-ImnpEzQrrOPkAIs9Mx088ds-0RxLhCwP5cKhJ3l2T5m5thWd8zXxgIuRY1dQ7AZC8o50xacDOT4RYgRCpfVTLPOY9DCiO5HCh8H5UlIFBU Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ff34b1d535024550bd2351aff18dc50c Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-245254692 Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ff34b1d535024550bd2351aff18dc50c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff34b1d535024550bd2351aff18dc50c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ff34b1d535024550bd2351aff18dc50c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ff34b1d535024550bd2351aff18dc50c"}]}] Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-245254692 Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ff34b1d535024550bd2351aff18dc50c Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-245254692 Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestMultiTenantJSON-245254692-project Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4febdeeed88947c79ac250237f22fd07 Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-245254692-project Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b0383693-4fc1-47bb-929a-7bd781ab00a2'} Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:59.101600 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. Oct 04 11:19:59.105313 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.109088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] Returning 404 to user: Instance b0383693-4fc1-47bb-929a-7bd781ab00a2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:59.110217 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53f26257-799c-4e77-9e73-491d0ffd663a tempest-ServersNegativeTestMultiTenantJSON-245254692 tempest-ServersNegativeTestMultiTenantJSON-245254692-project] 10.222.0.23 "GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2" status: 404 len: 111 microversion: 2.1 time: 0.052850 Oct 04 11:19:59.111455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3126/4360] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:59 2022] GET /compute/v2.1/servers/b0383693-4fc1-47bb-929a-7bd781ab00a2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:19:59.122858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-485d8470-afb0-4fb7-a6d3-8a0500c37a9d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:59.122858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-485d8470-afb0-4fb7-a6d3-8a0500c37a9d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 11:19:59.122858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-485d8470-afb0-4fb7-a6d3-8a0500c37a9d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-485d8470-afb0-4fb7-a6d3-8a0500c37a9d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 9223372036854775808 could not be found. Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '9223372036854775808'} Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:19:59.125423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-485d8470-afb0-4fb7-a6d3-8a0500c37a9d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-485d8470-afb0-4fb7-a6d3-8a0500c37a9d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.012997 Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3127/4361] 10.222.0.23 () {58 vars in 1188 bytes} [Tue Oct 4 11:19:59 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:19:59.135968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:59.137630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:59.145765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.146265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.146708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.147423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.147890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.148327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.412065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:59.423756 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1500a7bc-84df-402a-b333-785f6004e5a0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1370 microversion: 2.1 time: 0.287760 Oct 04 11:19:59.426461 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3128/4362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:59 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:59.449128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-9d2b1a8f-584c-4443-9076-eda787ff0113 req-e1a3e4e5-0f2f-4bf8-80a3-681959435812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a52ace0-2ddb-4df5-90b7-e1625948d259", "name": "network-vif-plugged", "status": "completed", "tag": "66a6d253-8115-41c8-b225-8a1368275359"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:19:59.474041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d2b1a8f-584c-4443-9076-eda787ff0113 req-e1a3e4e5-0f2f-4bf8-80a3-681959435812 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.474650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d2b1a8f-584c-4443-9076-eda787ff0113 req-e1a3e4e5-0f2f-4bf8-80a3-681959435812 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.475344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d2b1a8f-584c-4443-9076-eda787ff0113 req-e1a3e4e5-0f2f-4bf8-80a3-681959435812 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.496116 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9d2b1a8f-584c-4443-9076-eda787ff0113 req-e1a3e4e5-0f2f-4bf8-80a3-681959435812 service nova] Creating event network-vif-plugged:66a6d253-8115-41c8-b225-8a1368275359 for instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 on n-h1-791135-8 Oct 04 11:19:59.514895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-9d2b1a8f-584c-4443-9076-eda787ff0113 req-e1a3e4e5-0f2f-4bf8-80a3-681959435812 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073994 Oct 04 11:19:59.523555 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3129/4363] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:19:59.533905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:59.538870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:59.546225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.546876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.547415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.548227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.548816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.549336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.554524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:19:59.865010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:19:59.877307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ae0f93d-f7f7-4c29-8431-c3f4da8ed099 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.351378 Oct 04 11:19:59.878118 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3130/4364] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:59 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:19:59.896449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:19:59.902071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:19:59.908819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.909568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.910172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:19:59.917295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:19:59.919495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:19:59.920655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:00.620205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:00.642898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0632551b-b56d-4ed4-bed7-a943ed45f92b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1318 microversion: 2.1 time: 0.750321 Oct 04 11:20:00.645282 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3131/4365] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:19:59 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:00.664549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:00.665479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:00.679422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:00.680191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:00.680786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:00.682130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:00.682742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:00.684472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:01.012730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:01.027471 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6559e726-b323-4b4f-a984-4486d90819c7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.378820 Oct 04 11:20:01.028618 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3132/4366] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:00 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:01.045412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5dedf26-4b1a-454a-9c14-11bf5e0b765c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d437dc10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:01.105267 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5dedf26-4b1a-454a-9c14-11bf5e0b765c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.075186 Oct 04 11:20:01.114785 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3133/4367] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:01 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:01.120272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:01.121125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:01.128388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:01.129076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:01.129706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:01.130579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:01.131208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:01.131847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:01.407802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:01.420319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:01.424907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:01.429891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c0266a73-81ec-4941-800c-ab7445dcf0ed tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1406 microversion: 2.20 time: 0.310905 Oct 04 11:20:01.430574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3134/4368] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:20:01 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:20:01.443776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:01.445493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:01.464550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:01.465118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:01.465602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:01.466305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:01.468065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:01.469033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:01.698054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:01.707178 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d70a48f3-2f44-4398-9ca8-ca36a01529c9 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1370 microversion: 2.1 time: 0.275365 Oct 04 11:20:01.723115 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3135/4369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:01 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:01.731816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:01.733828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:01.741219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:01.741852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:01.742667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:01.744197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:01.744761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:01.745189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:02.397345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:02.406225 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-38a78277-d469-461e-8e47-3863df801a03 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.681952 Oct 04 11:20:02.410069 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3136/4370] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:01 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:02.418503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:02.419326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:02.425798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:02.432396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:02.432864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:02.433779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:02.434116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:02.434546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:02.778844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:02.789786 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d96959a-f650-420b-a435-9ae5003fbfc1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.378263 Oct 04 11:20:02.790840 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3137/4371] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:02 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:02.806724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-236a26cd-8858-46b3-900e-b3a159cb8a15 req-21c477e2-cd2c-44da-8115-e8100387a2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69337b0-3580-43cd-ac13-11f030e3804b", "name": "network-vif-plugged", "status": "completed", "tag": "a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac"}, {"server_uuid": "62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0", "name": "network-vif-plugged", "status": "completed", "tag": "e19a409c-8a87-4928-9624-7ab08668b7f0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:02.831349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-236a26cd-8858-46b3-900e-b3a159cb8a15 req-21c477e2-cd2c-44da-8115-e8100387a2a6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:02.832491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-236a26cd-8858-46b3-900e-b3a159cb8a15 req-21c477e2-cd2c-44da-8115-e8100387a2a6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:02.832931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-236a26cd-8858-46b3-900e-b3a159cb8a15 req-21c477e2-cd2c-44da-8115-e8100387a2a6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:02.854774 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-236a26cd-8858-46b3-900e-b3a159cb8a15 req-21c477e2-cd2c-44da-8115-e8100387a2a6 service nova] Creating event network-vif-plugged:a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac for instance e69337b0-3580-43cd-ac13-11f030e3804b on n-h1-791135-8 Oct 04 11:20:02.861145 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-236a26cd-8858-46b3-900e-b3a159cb8a15 req-21c477e2-cd2c-44da-8115-e8100387a2a6 service nova] Creating event network-vif-plugged:e19a409c-8a87-4928-9624-7ab08668b7f0 for instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 on n-h2-791135-8 Oct 04 11:20:02.888299 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-236a26cd-8858-46b3-900e-b3a159cb8a15 req-21c477e2-cd2c-44da-8115-e8100387a2a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095987 Oct 04 11:20:02.888813 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3138/4372] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:02.907085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:02.910151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:02.928191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:02.934087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:02.935202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:02.941911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:02.942607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:02.944505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:03.842819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:03.859139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-249cc72f-5801-4b4b-8580-bbfe4c6a5a6e tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1318 microversion: 2.1 time: 0.968771 Oct 04 11:20:03.862785 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3139/4373] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:02 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1318 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:03.870630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2bcaa3a4-5285-44e2-8b1c-e0a940390fd7 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d4211790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:03.935124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2bcaa3a4-5285-44e2-8b1c-e0a940390fd7 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.070867 Oct 04 11:20:03.936523 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3140/4374] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:03 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:03.943173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:03.944405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:03.953772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:03.954493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:03.955452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:03.957195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:03.958709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:03.961556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:04.338256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:04.348690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:04.350590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:04.351983 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7d67908-1709-40db-8702-7403bcff40cf tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1406 microversion: 2.20 time: 0.414319 Oct 04 11:20:04.356508 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3141/4375] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:20:03 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:20:04.362591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:04.363317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:04.369856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:04.370646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:04.371310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:04.372239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:04.373560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:04.374237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:04.736174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:04.755023 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-714402e8-25e3-47da-ba57-781e431c645b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1370 microversion: 2.1 time: 0.395453 Oct 04 11:20:04.756310 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3142/4376] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:04 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:04.764176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18778df8-ca60-4212-b3d5-8cee33e89dfb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:04.766263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18778df8-ca60-4212-b3d5-8cee33e89dfb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Failed to fetch instance by id -1 {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 11:20:04.767927 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-18778df8-ca60-4212-b3d5-8cee33e89dfb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18778df8-ca60-4212-b3d5-8cee33e89dfb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance -1 could not be found. Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '-1'} Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:04.772892 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:04.779068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:04.779068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:04.779068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 11:20:04.779068 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:04.782833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18778df8-ca60-4212-b3d5-8cee33e89dfb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:04.783896 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18778df8-ca60-4212-b3d5-8cee33e89dfb tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.025925 Oct 04 11:20:04.784636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3143/4377] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:20:04 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:20:04.795757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:04.797699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:04.816345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:04.817113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:04.817841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:04.818729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:04.819354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:04.820513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:05.108042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:05.118511 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2aa5765d-0aab-4b83-8cde-21a59fdc01e8 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1681 microversion: 2.1 time: 0.332065 Oct 04 11:20:05.120905 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3144/4378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:04 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1681 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:05.127172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:05.132623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:05.148958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:05.149743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:05.150329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:05.151197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:05.151834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:05.152544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:05.445664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:05.454010 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22169fbc-eb02-4eac-87ae-f7fde6d02dfa tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.332061 Oct 04 11:20:05.456887 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3145/4379] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:05 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:05.471179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:05.472035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:05.484991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:05.485749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:05.486340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:05.487209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:05.487666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:05.488086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:05.775979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:05.789877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-274d2eb6-a13d-456b-bf09-7eb507e2ef0c tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1318 microversion: 2.1 time: 0.318830 Oct 04 11:20:05.790802 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3146/4380] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:05 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:05.807932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a2fb7122-f51c-4afc-8c22-8407ae6a0342 req-9e900813-8122-4a12-b14b-3ce45a0cb141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c02e4f28-f6ed-44f7-96d7-eab5979699d0", "name": "network-vif-plugged", "status": "completed", "tag": "64151115-3f4d-45d0-aa5f-79f03650f294"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:05.828355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a2fb7122-f51c-4afc-8c22-8407ae6a0342 req-9e900813-8122-4a12-b14b-3ce45a0cb141 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:05.828853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a2fb7122-f51c-4afc-8c22-8407ae6a0342 req-9e900813-8122-4a12-b14b-3ce45a0cb141 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:05.829286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a2fb7122-f51c-4afc-8c22-8407ae6a0342 req-9e900813-8122-4a12-b14b-3ce45a0cb141 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:05.843011 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a2fb7122-f51c-4afc-8c22-8407ae6a0342 req-9e900813-8122-4a12-b14b-3ce45a0cb141 service nova] Creating event network-vif-plugged:64151115-3f4d-45d0-aa5f-79f03650f294 for instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 on n-h2-791135-8 Oct 04 11:20:05.848289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a2fb7122-f51c-4afc-8c22-8407ae6a0342 req-9e900813-8122-4a12-b14b-3ce45a0cb141 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049017 Oct 04 11:20:05.849454 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3147/4381] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:05.855695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cb698ab-ab18-4ff6-9480-46043c4bb4ef tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d42845e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:05.906521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cb698ab-ab18-4ff6-9480-46043c4bb4ef tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.055941 Oct 04 11:20:05.908191 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3148/4382] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:05 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:05.913658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:05.914657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:05.923831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:05.924695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:05.925399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:05.926370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:05.926989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:05.927580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:06.297301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:06.318889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:06.324146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:06.327272 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbbf8829-0c59-47a8-8fe5-d37abeac9c94 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1598 microversion: 2.20 time: 0.416608 Oct 04 11:20:06.337441 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3149/4383] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:20:05 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1598 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:20:06.337441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:06.337441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:06.362302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:06.367028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:06.367776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:06.368738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:06.370961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:06.372408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:06.696180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:06.711413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ca70ac9-4f09-425a-826f-8e7c171cfcb7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.381170 Oct 04 11:20:06.714427 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3150/4384] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:06 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:06.737151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:06.737884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:06.746893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:06.747569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:06.749122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:06.751283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:06.751930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:06.753093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:07.117219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:07.128890 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-33f61e8f-80cb-4eb0-9213-61a923e18043 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1564 microversion: 2.1 time: 0.397692 Oct 04 11:20:07.130678 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3151/4385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:06 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1564 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:07.138006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:07.143840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:07.152692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:07.156168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:07.156741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:07.158378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:07.162081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:07.162636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:07.174174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:07.725012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:07.734110 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a68f796-0b23-43b4-bcbc-df00b6485ca6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1658 microversion: 2.1 time: 0.602662 Oct 04 11:20:07.738877 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3152/4386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:07 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1658 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:07.748905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:07.750836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:07.764465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:07.769919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:07.773083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:07.774261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:07.776079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:07.778063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:07.957340 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-21e6b53e-bddf-4d6f-86b2-dd728f3d609b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.215971 Oct 04 11:20:07.959851 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3153/4387] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Oct 4 11:20:07 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:20:07.965832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd30d35e-872b-4ec1-9fdb-bc460fc231a0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:07.966781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd30d35e-872b-4ec1-9fdb-bc460fc231a0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: eb66496c-6832-4b9c-bdab-5b48dbedd173] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:07.974555 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-dd30d35e-872b-4ec1-9fdb-bc460fc231a0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance eb66496c-6832-4b9c-bdab-5b48dbedd173 could not be found. Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd30d35e-872b-4ec1-9fdb-bc460fc231a0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/eb66496c-6832-4b9c-bdab-5b48dbedd173/action HTTP/1.1 Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 19 Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: {"forceDelete": {}} Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance eb66496c-6832-4b9c-bdab-5b48dbedd173 could not be found. Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'eb66496c-6832-4b9c-bdab-5b48dbedd173', 'body': {'forceDelete': {}}} Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb66496c-6832-4b9c-bdab-5b48dbedd173 could not be found. Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb66496c-6832-4b9c-bdab-5b48dbedd173 could not be found. Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:07.982566 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:07.987059 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:07.987059 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:07.987059 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb66496c-6832-4b9c-bdab-5b48dbedd173 could not be found. Oct 04 11:20:07.987059 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:07.987059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd30d35e-872b-4ec1-9fdb-bc460fc231a0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance eb66496c-6832-4b9c-bdab-5b48dbedd173 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:07.987059 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd30d35e-872b-4ec1-9fdb-bc460fc231a0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/eb66496c-6832-4b9c-bdab-5b48dbedd173/action" status: 404 len: 111 microversion: 2.1 time: 0.023393 Oct 04 11:20:07.987059 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3154/4388] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:07 2022] POST /compute/v2.1/servers/eb66496c-6832-4b9c-bdab-5b48dbedd173/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:08.001251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:08.004381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:08.020505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:08.021383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:08.024548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:08.025729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:08.028066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:08.028797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:08.398529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:08.412569 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d4429e4-13e6-428e-abb2-3f11817bbfe4 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 200 len: 1507 microversion: 2.1 time: 0.421168 Oct 04 11:20:08.413408 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3155/4389] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:07 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:08.426490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8a24646-28fa-4821-83e3-32e5ff7aedf4 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71cfa953a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:08.513966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8a24646-28fa-4821-83e3-32e5ff7aedf4 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.098171 Oct 04 11:20:08.514865 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3156/4390] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:08 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:08.519884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:08.530242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:08.537121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:08.539272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:08.543264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:08.544253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:08.548786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:08.550752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:08.804623 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-55411fe0-66c7-4b39-b86b-4b16fbe33346 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.288281 Oct 04 11:20:08.816430 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3157/4391] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:20:08 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-interface => generated 285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:08.823364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8798116c-cf7b-4897-b13d-2562dc2c9936 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:08.833009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8798116c-cf7b-4897-b13d-2562dc2c9936 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:08.833972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8798116c-cf7b-4897-b13d-2562dc2c9936 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:08.849915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8798116c-cf7b-4897-b13d-2562dc2c9936 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:08.910346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8798116c-cf7b-4897-b13d-2562dc2c9936 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Going to try to start instance {{(pid=122409) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 11:20:08.991251 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8798116c-cf7b-4897-b13d-2562dc2c9936 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.163728 Oct 04 11:20:09.001582 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3158/4392] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:08 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:20:09.017327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:09.018402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:09.025797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:09.026746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:09.028318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:09.029379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:09.030005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:09.030646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:09.788252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:09.805306 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5312c3c6-7b84-43be-820b-0eb24b0d98e9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.800890 Oct 04 11:20:09.806806 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3159/4393] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:09 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:09.813789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:09.814422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: f35dfe9e-0202-46f6-a179-0cddaa252c45] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:09.821121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:09.821647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:09.822262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:09.823134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:09.825281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:09.826811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:10.390449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:10.425168 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2fa346f9-ff45-4f6a-a254-2e66c3aa67cf tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45" status: 200 len: 1506 microversion: 2.1 time: 0.613659 Oct 04 11:20:10.427246 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3160/4394] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:09 2022] GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45 => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:10.440751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:10.441394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:10.463471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:10.463978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:10.468467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:10.470403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:10.474743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:10.475281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:11.625063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:11.636818 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-178bc0ac-703f-4919-bda4-e3239df620f5 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1667 microversion: 2.1 time: 1.207642 Oct 04 11:20:11.653376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3161/4395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:10 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1667 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:11.653376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a60faf1-6832-4565-93ff-1bfd8f604079 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d42841f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:11.801822 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a60faf1-6832-4565-93ff-1bfd8f604079 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.158676 Oct 04 11:20:11.802590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3162/4396] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:11 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:11.819824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:11.830377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:11.842197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:11.850900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:11.851820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:11.852592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:11.859318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:11.859936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:12.332615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:12.342654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c93a560-cf3a-4fbc-b45d-9d4285a7116b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.537048 Oct 04 11:20:12.344473 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3163/4397] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:11 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:12.360516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:12.361316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: f35dfe9e-0202-46f6-a179-0cddaa252c45] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:12.377001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:12.377814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:12.378611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:12.379375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:12.379834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:12.380261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:12.437724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: f35dfe9e-0202-46f6-a179-0cddaa252c45] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:20:12.659382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:12.672560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ed2d3dc2-fec5-4123-9c50-5d73ed1fa770 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45" status: 204 len: 0 microversion: 2.1 time: 0.325533 Oct 04 11:20:12.674095 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3164/4398] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:20:12 2022] DELETE /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:12.686480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0000fd56-296f-4987-9cfb-f9e163ba8319 req-f71596a1-51de-4cbb-98c5-7ac3bed0b9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0", "tag": "e19a409c-8a87-4928-9624-7ab08668b7f0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:12.716199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0000fd56-296f-4987-9cfb-f9e163ba8319 req-f71596a1-51de-4cbb-98c5-7ac3bed0b9ca service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:12.717282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0000fd56-296f-4987-9cfb-f9e163ba8319 req-f71596a1-51de-4cbb-98c5-7ac3bed0b9ca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:12.717748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0000fd56-296f-4987-9cfb-f9e163ba8319 req-f71596a1-51de-4cbb-98c5-7ac3bed0b9ca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:12.753342 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0000fd56-296f-4987-9cfb-f9e163ba8319 req-f71596a1-51de-4cbb-98c5-7ac3bed0b9ca service nova] Creating event network-changed:e19a409c-8a87-4928-9624-7ab08668b7f0 for instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 on n-h2-791135-8 Oct 04 11:20:12.767593 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0000fd56-296f-4987-9cfb-f9e163ba8319 req-f71596a1-51de-4cbb-98c5-7ac3bed0b9ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091859 Oct 04 11:20:12.772089 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3165/4399] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:12.798015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53e0453a-d807-49a6-834a-0930d6d18d50 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:12.813165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53e0453a-d807-49a6-834a-0930d6d18d50 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: ad267fe6-4b86-4026-8c8e-61014a7a1804] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:12.835317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-53e0453a-d807-49a6-834a-0930d6d18d50 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance ad267fe6-4b86-4026-8c8e-61014a7a1804 could not be found. Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53e0453a-d807-49a6-834a-0930d6d18d50 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/ad267fe6-4b86-4026-8c8e-61014a7a1804/action HTTP/1.1 Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 39 Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: {"os-getConsoleOutput": {"length": 10}} Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance ad267fe6-4b86-4026-8c8e-61014a7a1804 could not be found. Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'ad267fe6-4b86-4026-8c8e-61014a7a1804', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad267fe6-4b86-4026-8c8e-61014a7a1804 could not be found. Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad267fe6-4b86-4026-8c8e-61014a7a1804 could not be found. Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:12.848873 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad267fe6-4b86-4026-8c8e-61014a7a1804 could not be found. Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53e0453a-d807-49a6-834a-0930d6d18d50 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance ad267fe6-4b86-4026-8c8e-61014a7a1804 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53e0453a-d807-49a6-834a-0930d6d18d50 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/ad267fe6-4b86-4026-8c8e-61014a7a1804/action" status: 404 len: 111 microversion: 2.1 time: 0.077958 Oct 04 11:20:12.858958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3166/4400] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:12 2022] POST /compute/v2.1/servers/ad267fe6-4b86-4026-8c8e-61014a7a1804/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:12.870548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:12.877460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:12.908098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:12.908702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:12.909156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:12.909940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:12.910697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:12.911128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:13.339964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:13.357150 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a82e60ad-abc5-41ca-a513-ca1dcb31f826 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1667 microversion: 2.1 time: 0.500886 Oct 04 11:20:13.358377 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3167/4401] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:12 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1667 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:13.365182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:13.366284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:13.383956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:13.384932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:13.385750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:13.392042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:13.392758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:13.393965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:13.459051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:20:13.655662 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9739b395-0f1b-48a5-85b3-505ec655e717 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 204 len: 0 microversion: 2.1 time: 0.295080 Oct 04 11:20:13.660255 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3168/4402] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:20:13 2022] DELETE /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:13.668669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f8408aa3-f312-4400-9276-bc1672591eaa req-eac7e6a2-801c-4356-b933-9475fe1b8e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69337b0-3580-43cd-ac13-11f030e3804b", "tag": "a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:13.699580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f8408aa3-f312-4400-9276-bc1672591eaa req-eac7e6a2-801c-4356-b933-9475fe1b8e32 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:13.703152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f8408aa3-f312-4400-9276-bc1672591eaa req-eac7e6a2-801c-4356-b933-9475fe1b8e32 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:13.703853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f8408aa3-f312-4400-9276-bc1672591eaa req-eac7e6a2-801c-4356-b933-9475fe1b8e32 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:13.740454 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f8408aa3-f312-4400-9276-bc1672591eaa req-eac7e6a2-801c-4356-b933-9475fe1b8e32 service nova] Creating event network-changed:a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac for instance e69337b0-3580-43cd-ac13-11f030e3804b on n-h1-791135-8 Oct 04 11:20:13.751217 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f8408aa3-f312-4400-9276-bc1672591eaa req-eac7e6a2-801c-4356-b933-9475fe1b8e32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087580 Oct 04 11:20:13.757453 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3169/4403] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:13.771048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99fc2a14-4e60-44b9-a893-a19a881dac4b tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d437b4c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:13.907667 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99fc2a14-4e60-44b9-a893-a19a881dac4b tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.148479 Oct 04 11:20:13.908658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3170/4404] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:13 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:13.924175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:13.943883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:13.961169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:13.964750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:13.965544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:13.966514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:13.974175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:13.978592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:14.055260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:14.810996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:14.832580 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3017c61-30bd-4489-ab29-f87380650429 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.918992 Oct 04 11:20:14.835109 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3171/4405] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:13 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:14.847084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:14.851116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: f35dfe9e-0202-46f6-a179-0cddaa252c45] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:14.882984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:14.889658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:14.890562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:14.895283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:14.895994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:14.897181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:15.542826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:15.575955 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d83f898-2f75-441f-a199-f7e8053b376d tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45" status: 200 len: 1512 microversion: 2.1 time: 0.735487 Oct 04 11:20:15.581201 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3172/4406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:14 2022] GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45 => generated 1512 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:15.594603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:15.595513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:15.604093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:15.604848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:15.605515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:15.606507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:15.610240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:15.610772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:15.923101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:15.931064 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d50aa7e-7e5a-4c18-aff1-8fffc7f44c6d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.348573 Oct 04 11:20:15.941716 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3173/4407] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:15 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:15.948071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:15.949087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:15.964862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:15.965954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:15.966674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:15.969063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:15.971198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:15.971883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:16.410450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:16.422412 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-05f60cb8-cacd-43c6-b588-1c5c154758de tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.478977 Oct 04 11:20:16.426169 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3174/4408] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:15 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:16.431319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00ec5bc2-6566-43bc-a1fd-a1963a668bdb tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d405ddc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:16.486447 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00ec5bc2-6566-43bc-a1fd-a1963a668bdb tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.058908 Oct 04 11:20:16.487642 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3175/4409] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:16 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:16.494464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:16.495410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:16.503164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:16.504373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:16.505063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:16.506096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:16.506792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:16.507453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:16.726056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:16.750455 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ee9e611a-340a-4379-ad92-3f31b2a5183d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.261533 Oct 04 11:20:16.773214 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3176/4410] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:16 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:16.797951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31a446b8-7a3d-48d9-8d90-c6da50bd2294 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:16.799105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31a446b8-7a3d-48d9-8d90-c6da50bd2294 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 657d1a31-12e3-439d-babd-b2a08127e359] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:16.807643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-31a446b8-7a3d-48d9-8d90-c6da50bd2294 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 657d1a31-12e3-439d-babd-b2a08127e359 could not be found. Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31a446b8-7a3d-48d9-8d90-c6da50bd2294 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/657d1a31-12e3-439d-babd-b2a08127e359 HTTP/1.1 Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 657d1a31-12e3-439d-babd-b2a08127e359 could not be found. Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '657d1a31-12e3-439d-babd-b2a08127e359'} Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 657d1a31-12e3-439d-babd-b2a08127e359 could not be found. Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 657d1a31-12e3-439d-babd-b2a08127e359 could not be found. Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:16.810630 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:16.815232 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:16.815232 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:16.815232 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:16.815232 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 657d1a31-12e3-439d-babd-b2a08127e359 could not be found. Oct 04 11:20:16.815232 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:16.817028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31a446b8-7a3d-48d9-8d90-c6da50bd2294 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 657d1a31-12e3-439d-babd-b2a08127e359 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:16.818086 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31a446b8-7a3d-48d9-8d90-c6da50bd2294 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/657d1a31-12e3-439d-babd-b2a08127e359" status: 404 len: 111 microversion: 2.1 time: 0.043154 Oct 04 11:20:16.819178 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3177/4411] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:16 2022] GET /compute/v2.1/servers/657d1a31-12e3-439d-babd-b2a08127e359 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:16.825750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:16.826763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: f35dfe9e-0202-46f6-a179-0cddaa252c45] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:16.837167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:16.838034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:16.838650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:16.839524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:16.840174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:16.842023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:17.028072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:17.050137 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77a0e8ef-ab42-4036-bf5f-c3e5f4941210 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45" status: 200 len: 1512 microversion: 2.1 time: 0.227997 Oct 04 11:20:17.063234 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3178/4412] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:16 2022] GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:17.084678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:17.085320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:17.094480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:17.095002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:17.095680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:17.096599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:17.097611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:17.098222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:17.296317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:17.315109 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7dda7c6-0820-49f1-b67c-91f8bae97d84 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.243478 Oct 04 11:20:17.316050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3179/4413] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:17 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:17.329736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:17.330366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:17.348554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:17.349057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:17.349549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:17.350273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:17.350736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:17.351172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:18.352916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:18.365387 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a092aa0d-b339-4f00-b6f8-e6689978e1b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 1.048021 Oct 04 11:20:18.366731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3180/4414] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:17 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:18.380261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:18.381127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:18.390365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:18.394345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:18.394801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:18.395520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:18.395985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:18.396411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:18.671385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:18.690006 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d1468c9-0c89-4127-97b5-1d632db6d078 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.322025 Oct 04 11:20:18.690591 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3181/4415] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:18 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:18.695538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a4ef5638-bea2-473c-abfa-ec4fd1d69b44 req-6c2bd991-66a0-467a-95dd-59d133666cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c02e4f28-f6ed-44f7-96d7-eab5979699d0", "name": "network-vif-deleted", "tag": "64151115-3f4d-45d0-aa5f-79f03650f294"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:18.722062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4ef5638-bea2-473c-abfa-ec4fd1d69b44 req-6c2bd991-66a0-467a-95dd-59d133666cad service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:18.723259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4ef5638-bea2-473c-abfa-ec4fd1d69b44 req-6c2bd991-66a0-467a-95dd-59d133666cad service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:18.723721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4ef5638-bea2-473c-abfa-ec4fd1d69b44 req-6c2bd991-66a0-467a-95dd-59d133666cad service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:18.739259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a4ef5638-bea2-473c-abfa-ec4fd1d69b44 req-6c2bd991-66a0-467a-95dd-59d133666cad service nova] Creating event network-vif-deleted:64151115-3f4d-45d0-aa5f-79f03650f294 for instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 on n-h2-791135-8 Oct 04 11:20:18.749243 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a4ef5638-bea2-473c-abfa-ec4fd1d69b44 req-6c2bd991-66a0-467a-95dd-59d133666cad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056239 Oct 04 11:20:18.750833 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3182/4416] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:18.760022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-890e93af-e1c3-484b-af70-be88f9ea398f tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d437b8b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:18.816008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-890e93af-e1c3-484b-af70-be88f9ea398f tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1426 microversion: 2.1 time: 0.063526 Oct 04 11:20:18.817322 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3183/4417] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:18 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:18.823561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:18.825486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: f35dfe9e-0202-46f6-a179-0cddaa252c45] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:18.841963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:18.842514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:18.842958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:18.843774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:18.844939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:18.846026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:18.885653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:18.886517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:18.887116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:18.887730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lazy-loading 'fault' on Instance uuid f35dfe9e-0202-46f6-a179-0cddaa252c45 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:20:18.936931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa8721e039e4219ae2c2f5fe2a778a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876aaf19cb424eb9b1249d8c9342260a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:18.945083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84759983-80f6-4f0b-904a-f6a5ae26af7b tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45" status: 200 len: 1308 microversion: 2.1 time: 0.126336 Oct 04 11:20:18.946023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3184/4418] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:18 2022] GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45 => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:19.146428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30249ff1-105d-4067-9911-d6c4f83bf060 tempest-ExtensionsTest-362909926 tempest-ExtensionsTest-362909926-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:19.148103 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-30249ff1-105d-4067-9911-d6c4f83bf060 tempest-ExtensionsTest-362909926 tempest-ExtensionsTest-362909926-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.200760 Oct 04 11:20:19.148983 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3185/4419] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Oct 4 11:20:18 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:19.165748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:19.166796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:19.173921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:19.175585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:19.176261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:19.177096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:19.178591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:19.179299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:19.437771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:19.446235 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81b0c96b-58a7-4698-bdd3-6f5462964cd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.295990 Oct 04 11:20:19.449545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3186/4420] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:19 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:19.455257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:19.455873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:19.462615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:19.463323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:19.463917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:19.465442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:19.465942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:19.467033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:19.708152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:19.715908 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6c5df32e-40a9-4549-930c-5d4220424275 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.264531 Oct 04 11:20:19.716489 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3187/4421] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:19 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:19.721395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-679f9775-1798-42ff-9797-d2a3dac77a74 tempest-ExtensionsTest-362909926 tempest-ExtensionsTest-362909926-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:19.723500 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-679f9775-1798-42ff-9797-d2a3dac77a74 tempest-ExtensionsTest-362909926 tempest-ExtensionsTest-362909926-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005650 Oct 04 11:20:19.726173 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3188/4422] 10.222.0.23 () {58 vars in 1134 bytes} [Tue Oct 4 11:20:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:20:19.730852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e398bdd-3db7-4c28-89b3-0a7e55e7f44d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-286951301", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e398bdd-3db7-4c28-89b3-0a7e55e7f44d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 237 Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-286951301", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-286951301', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.759869 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 11:20:19.765057 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:19.767887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e398bdd-3db7-4c28-89b3-0a7e55e7f44d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:19.769177 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e398bdd-3db7-4c28-89b3-0a7e55e7f44d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042041 Oct 04 11:20:19.769869 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3189/4423] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:20:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:20:19.778541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:19.779074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:19.786227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:19.786718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:19.787375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:19.788098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:19.788556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:19.788983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:19.839135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lazy-loading 'flavor' on Instance uuid 549ab102-7419-4fc0-9aff-94764bc2bbd3 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:20:19.935283 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-81d24c97-3164-4686-aa46-3eb035eb9c86 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.160264 Oct 04 11:20:19.939880 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3190/4424] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:19 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:20:19.946735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:19.947839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:19.956261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:19.957168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:19.957783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:19.958514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:19.959167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:19.959759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.136843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:20.145300 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fcb82011-a8b8-4a72-91b7-e28fcd989bd8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.203797 Oct 04 11:20:20.146526 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3191/4425] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:19 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:20.151554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d5413d9-bb1e-4187-baee-148e8be85dc2 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d437b5e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:20.204141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d5413d9-bb1e-4187-baee-148e8be85dc2 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1435 microversion: 2.1 time: 0.056331 Oct 04 11:20:20.205448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3192/4426] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:20 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1435 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:20.211129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:20.211976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:20.219577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.220354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.220966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.221923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.222572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.223166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.405436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:20.413453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:20.423470 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-21626122-fa79-4f7a-a732-dda648aa6e5f tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1679 microversion: 2.1 time: 0.216351 Oct 04 11:20:20.424925 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3193/4427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:20 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:20.444777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:20.445646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: f35dfe9e-0202-46f6-a179-0cddaa252c45] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:20.453578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.454439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.455035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.455924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.456559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.457146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.486613 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] HTTP exception thrown: Instance f35dfe9e-0202-46f6-a179-0cddaa252c45 could not be found. Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Request method failure captured: Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45 HTTP/1.1 Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBaaSKAf_stN4e3N399OKVhk1BagKLztsFzcV5btwJaypcBcbXerL71yMXgwAhe96_zMkz4jca8GwSjKsPVfD6VPW_htdswZjwF5t2ovdABRYFqBZNS7y9ARNz6jAsfwnTXzvaJ-rfbUhTTKPpoOnM5eGbdhWsuGq9qU8g-P1Gwjx5M Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 876aaf19cb424eb9b1249d8c9342260a Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MultipleCreateTestJSON-628569198 Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_876aaf19cb424eb9b1249d8c9342260a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/876aaf19cb424eb9b1249d8c9342260a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/876aaf19cb424eb9b1249d8c9342260a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/876aaf19cb424eb9b1249d8c9342260a"}]}] Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MultipleCreateTestJSON-628569198 Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 876aaf19cb424eb9b1249d8c9342260a Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MultipleCreateTestJSON-628569198 Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MultipleCreateTestJSON-628569198-project Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4fa8721e039e4219ae2c2f5fe2a778a0 Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MultipleCreateTestJSON-628569198-project Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f35dfe9e-0202-46f6-a179-0cddaa252c45 could not be found. Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f35dfe9e-0202-46f6-a179-0cddaa252c45'} Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f35dfe9e-0202-46f6-a179-0cddaa252c45 could not be found. Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f35dfe9e-0202-46f6-a179-0cddaa252c45 could not be found. Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:20.490477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.495968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:20.495968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:20.495968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:20.495968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:20.495968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:20.495968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f35dfe9e-0202-46f6-a179-0cddaa252c45 could not be found. Oct 04 11:20:20.495968 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.500408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Returning 404 to user: Instance f35dfe9e-0202-46f6-a179-0cddaa252c45 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:20.502243 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ebc1b79a-37fe-4d16-bc69-21563cfa94eb tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45" status: 404 len: 111 microversion: 2.1 time: 0.074628 Oct 04 11:20:20.503045 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3194/4428] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:20 2022] GET /compute/v2.1/servers/f35dfe9e-0202-46f6-a179-0cddaa252c45 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:20.508485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:20.509310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:20.515738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.516226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.516817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.518399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.519041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.519629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.705579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:20.721970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1269abd6-e9cf-4011-958e-4988e9347f6e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.217599 Oct 04 11:20:20.722853 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3195/4429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:20 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:20.729615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-049ab2f7-ab8c-4201-b18e-407524a6f495 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d4211700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:20.805390 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-049ab2f7-ab8c-4201-b18e-407524a6f495 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 200 len: 1435 microversion: 2.1 time: 0.068486 Oct 04 11:20:20.805390 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3196/4430] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Oct 4 11:20:20 2022] GET /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 1435 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:20.806432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:20.807063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] [instance: c02e4f28-f6ed-44f7-96d7-eab5979699d0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:20.819672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.820936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.821733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.823873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.824541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.826011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.856824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] HTTP exception thrown: Instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 could not be found. Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Request method failure captured: Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 HTTP/1.1 Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBaaSKAf_stN4e3N399OKVhk1BagKLztsFzcV5btwJaypcBcbXerL71yMXgwAhe96_zMkz4jca8GwSjKsPVfD6VPW_htdswZjwF5t2ovdABRYFqBZNS7y9ARNz6jAsfwnTXzvaJ-rfbUhTTKPpoOnM5eGbdhWsuGq9qU8g-P1Gwjx5M Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 876aaf19cb424eb9b1249d8c9342260a Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MultipleCreateTestJSON-628569198 Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_876aaf19cb424eb9b1249d8c9342260a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/876aaf19cb424eb9b1249d8c9342260a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/876aaf19cb424eb9b1249d8c9342260a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/876aaf19cb424eb9b1249d8c9342260a"}]}] Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MultipleCreateTestJSON-628569198 Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 876aaf19cb424eb9b1249d8c9342260a Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MultipleCreateTestJSON-628569198 Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MultipleCreateTestJSON-628569198-project Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4fa8721e039e4219ae2c2f5fe2a778a0 Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MultipleCreateTestJSON-628569198-project Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 could not be found. Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c02e4f28-f6ed-44f7-96d7-eab5979699d0'} Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 could not be found. Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 could not be found. Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:20.858974 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.863344 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:20.863344 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:20.863344 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:20.863344 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:20.863344 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:20.863344 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 could not be found. Oct 04 11:20:20.863344 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:20.863344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] Returning 404 to user: Instance c02e4f28-f6ed-44f7-96d7-eab5979699d0 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:20.865424 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4cbd3c69-01e7-4919-9e1f-42727e538a81 tempest-MultipleCreateTestJSON-628569198 tempest-MultipleCreateTestJSON-628569198-project] 10.222.0.23 "GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0" status: 404 len: 111 microversion: 2.1 time: 0.069651 Oct 04 11:20:20.869619 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3197/4431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:20 2022] GET /compute/v2.1/servers/c02e4f28-f6ed-44f7-96d7-eab5979699d0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:20.872690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:20.874278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:20.883055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.887052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.888335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:20.889926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:20.890614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:20.891150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:21.270609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:21.281557 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d3a9a303-a0fe-4aa0-9692-f69340975f0c tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1467 microversion: 2.1 time: 0.412284 Oct 04 11:20:21.293511 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3198/4432] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:20 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1467 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:21.294249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-09ff296a-1038-4063-a9cc-a369ccd61465 req-3affe24d-5375-46f3-97d9-314725574a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35dfe9e-0202-46f6-a179-0cddaa252c45", "name": "network-vif-deleted", "tag": "d0573629-40f6-4568-9780-14cd8f3298b6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:21.316850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-09ff296a-1038-4063-a9cc-a369ccd61465 req-3affe24d-5375-46f3-97d9-314725574a59 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:21.317368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-09ff296a-1038-4063-a9cc-a369ccd61465 req-3affe24d-5375-46f3-97d9-314725574a59 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:21.317806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-09ff296a-1038-4063-a9cc-a369ccd61465 req-3affe24d-5375-46f3-97d9-314725574a59 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:21.335471 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-09ff296a-1038-4063-a9cc-a369ccd61465 req-3affe24d-5375-46f3-97d9-314725574a59 service nova] Creating event network-vif-deleted:d0573629-40f6-4568-9780-14cd8f3298b6 for instance f35dfe9e-0202-46f6-a179-0cddaa252c45 on n-h2-791135-8 Oct 04 11:20:21.340544 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-09ff296a-1038-4063-a9cc-a369ccd61465 req-3affe24d-5375-46f3-97d9-314725574a59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052816 Oct 04 11:20:21.342006 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3199/4433] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:21.348532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f3ca6e6-7dc0-458f-aa4e-4d7f44d52f23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-199356922", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f3ca6e6-7dc0-458f-aa4e-4d7f44d52f23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 234 Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-199356922", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-199356922', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.353860 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 11:20:21.359897 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:21.362967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f3ca6e6-7dc0-458f-aa4e-4d7f44d52f23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:21.364656 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f3ca6e6-7dc0-458f-aa4e-4d7f44d52f23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.021164 Oct 04 11:20:21.369171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3200/4434] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:20:21 2022] POST /compute/v2.1/servers => generated 133 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:20:21.376005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-befaf0c5-1fd0-42dd-b0a4-dcd1f3b55158 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71d8716ca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:22.504835 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-befaf0c5-1fd0-42dd-b0a4-dcd1f3b55158 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "DELETE /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172" status: 204 len: 0 microversion: 2.1 time: 1.134305 Oct 04 11:20:22.505648 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3201/4435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:21 2022] DELETE /compute/v2.1/images/c8f71d33-61a8-4186-910d-d833d49dc172 => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:22.513331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:22.514264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:22.529841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:22.532206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:22.533437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:22.536287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:22.536901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:22.537620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:23.131068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:23.140016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d08ddfa-a5b1-4357-bf3a-b3a7962de8ee tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.633178 Oct 04 11:20:23.162452 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3202/4436] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:22 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:23.187148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:23.190077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:23.217893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:23.224399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:23.225085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:23.230384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:23.231577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:23.232180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:23.779928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:23.790685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fcf4a06-85eb-4631-96e5-394344365294 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1662 microversion: 2.1 time: 0.626174 Oct 04 11:20:23.801782 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3203/4437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:23 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1662 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:23.806671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5b43f463-5cb3-4f30-906d-6f1487fa6800 req-cda790be-7a05-485a-b4b3-01690ffbc22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a52ace0-2ddb-4df5-90b7-e1625948d259", "name": "network-vif-unplugged", "status": "completed", "tag": "66a6d253-8115-41c8-b225-8a1368275359"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:23.847015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5b43f463-5cb3-4f30-906d-6f1487fa6800 req-cda790be-7a05-485a-b4b3-01690ffbc22b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:23.848423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5b43f463-5cb3-4f30-906d-6f1487fa6800 req-cda790be-7a05-485a-b4b3-01690ffbc22b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:23.848965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5b43f463-5cb3-4f30-906d-6f1487fa6800 req-cda790be-7a05-485a-b4b3-01690ffbc22b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:23.888904 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5b43f463-5cb3-4f30-906d-6f1487fa6800 req-cda790be-7a05-485a-b4b3-01690ffbc22b service nova] Creating event network-vif-unplugged:66a6d253-8115-41c8-b225-8a1368275359 for instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 on n-h1-791135-8 Oct 04 11:20:23.901951 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5b43f463-5cb3-4f30-906d-6f1487fa6800 req-cda790be-7a05-485a-b4b3-01690ffbc22b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098675 Oct 04 11:20:23.907534 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3204/4438] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:23.922803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2da5810-d848-4176-9c95-d98ecf256385 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '.version_select at 0x7f71cf242b80>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:23.950732 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c2da5810-d848-4176-9c95-d98ecf256385 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] HTTP exception thrown: Image not found. Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2da5810-d848-4176-9c95-d98ecf256385 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Request method failure captured: Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050 HTTP/1.1 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBae4t35vhi_VcAJpZJU2ytiCsvLcO3P9nJ8PzBRWBcT4CZ-r10eIajwG3Zo_h6a7D8X2lnnV4NjTGQ3mUoBJXxkueLgug7vvEQb9PKqhrNV2WqxkjxG3BfFznrhk0GbrYqtcxc7tJorsmWTwGxKlvFA0zSp1Q8couJbt72UCSJOx-E Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7d2f6b04fa444d839c097a066d3cc896 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7d2f6b04fa444d839c097a066d3cc896"}]}] Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7d2f6b04fa444d839c097a066d3cc896 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerTestJSON-757128754-project Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 9376a5065d204b49930796d6e3f17dc8 Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerTestJSON-757128754-project Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: exception: Image not found. Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f43e43ae-5dbe-41fd-8916-907612da5050'} Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f43e43ae-5dbe-41fd-8916-907612da5050 to delete Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f43e43ae-5dbe-41fd-8916-907612da5050 could not be found. Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:23.952727 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2da5810-d848-4176-9c95-d98ecf256385 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Returning 404 to user: Image not found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:23.958307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c2da5810-d848-4176-9c95-d98ecf256385 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "DELETE /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050" status: 404 len: 62 microversion: 2.1 time: 0.048270 Oct 04 11:20:23.963562 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3205/4439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:23 2022] DELETE /compute/v2.1/images/f43e43ae-5dbe-41fd-8916-907612da5050 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:20:23.975255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:23.976248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:23.984271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:23.985072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:23.985784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:23.986742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:23.987421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:23.988082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:24.212874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:24.226861 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0afc1551-58df-457a-8850-c10fe80d5213 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.262042 Oct 04 11:20:24.227931 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3206/4440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:23 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:24.252171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:24.253433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:24.269691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:24.270189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:24.270629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:24.271330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:24.271958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:24.272575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:24.410769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b7121e9-5bd5-4d58-94db-76668f539d76 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action" status: 202 len: 0 microversion: 2.1 time: 0.181405 Oct 04 11:20:24.411456 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3207/4441] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:24 2022] POST /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:20:24.425746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:24.428031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:24.441736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:24.442237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:24.442677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:24.443398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:24.443855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:24.444285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:24.502475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:20:24.671267 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf4e330d-9fb3-46b6-9139-4161eb8dde6d tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 204 len: 0 microversion: 2.1 time: 0.240762 Oct 04 11:20:24.671981 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3208/4442] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:20:24 2022] DELETE /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:24.679736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0dceeb10-5b0d-4ded-bf7c-a41d657ea924 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:24.690627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0dceeb10-5b0d-4ded-bf7c-a41d657ea924 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: ff724f22-eee1-4cc2-9257-d96b6ef65414] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:24.702404 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0dceeb10-5b0d-4ded-bf7c-a41d657ea924 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance ff724f22-eee1-4cc2-9257-d96b6ef65414 could not be found. Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0dceeb10-5b0d-4ded-bf7c-a41d657ea924 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/ff724f22-eee1-4cc2-9257-d96b6ef65414/action HTTP/1.1 Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 13 Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: {"pause": {}} Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance ff724f22-eee1-4cc2-9257-d96b6ef65414 could not be found. Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'ff724f22-eee1-4cc2-9257-d96b6ef65414', 'body': {'pause': {}}} Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff724f22-eee1-4cc2-9257-d96b6ef65414 could not be found. Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff724f22-eee1-4cc2-9257-d96b6ef65414 could not be found. Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:24.711698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:24.719098 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:24.719098 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:24.719098 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff724f22-eee1-4cc2-9257-d96b6ef65414 could not be found. Oct 04 11:20:24.719098 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:24.719098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0dceeb10-5b0d-4ded-bf7c-a41d657ea924 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance ff724f22-eee1-4cc2-9257-d96b6ef65414 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:24.719098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0dceeb10-5b0d-4ded-bf7c-a41d657ea924 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/ff724f22-eee1-4cc2-9257-d96b6ef65414/action" status: 404 len: 111 microversion: 2.1 time: 0.041821 Oct 04 11:20:24.734840 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3209/4443] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:24 2022] POST /compute/v2.1/servers/ff724f22-eee1-4cc2-9257-d96b6ef65414/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:24.908028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8814f4b0-7642-47f3-ab32-b1dc2bc915d9 tempest-ComputeTenantNetworksTest-1862115142 tempest-ComputeTenantNetworksTest-1862115142-project] Calling method '.version_select at 0x7f71d440e9d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:25.619882 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8814f4b0-7642-47f3-ab32-b1dc2bc915d9 tempest-ComputeTenantNetworksTest-1862115142 tempest-ComputeTenantNetworksTest-1862115142-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.881841 Oct 04 11:20:25.620487 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3210/4444] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 11:20:24 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:25.627337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:25.628268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:25.639384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:25.640929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:25.641835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:25.642852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:25.643320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:25.643754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:25.836514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:25.850606 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e64e660-03ed-4b74-a080-8c3324f77428 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1668 microversion: 2.1 time: 0.227588 Oct 04 11:20:25.851205 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3211/4445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:25 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1668 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:25.855668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:25.856809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:25.873657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:25.874161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:25.874598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:25.875325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:25.875785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:25.876218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:26.170539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:26.183978 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e507ea6-b7ae-4ef1-8ec4-2e45d9c48127 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1473 microversion: 2.1 time: 0.330650 Oct 04 11:20:26.187383 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3212/4446] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:25 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:26.193692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:26.194435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:26.201658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:26.202155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:26.202594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:26.203304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:26.203763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:26.204191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:26.649608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:26.661847 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-649e2e9b-3a34-4d00-870c-d68923eec789 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.472888 Oct 04 11:20:26.663014 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3213/4447] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:26 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:26.670010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d918ab10-211d-46ac-94f0-a621b368c1de tempest-ComputeTenantNetworksTest-1862115142 tempest-ComputeTenantNetworksTest-1862115142-project] Calling method '.version_select at 0x7f71d45275e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:26.905185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d918ab10-211d-46ac-94f0-a621b368c1de tempest-ComputeTenantNetworksTest-1862115142 tempest-ComputeTenantNetworksTest-1862115142-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/b6a67647-35ef-4226-bc56-ef9477d61c24" status: 200 len: 140 microversion: 2.1 time: 0.240860 Oct 04 11:20:26.905806 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3214/4448] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:20:26 2022] GET /compute/v2.1/os-tenant-networks/b6a67647-35ef-4226-bc56-ef9477d61c24 => generated 140 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:26.917686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:26.918551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:26.930476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:26.932869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:26.934072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:26.936697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:26.937386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:26.939519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:27.368227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:27.377887 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f39abce-218d-4d02-bb35-f9d998780966 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.470785 Oct 04 11:20:27.383008 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3215/4449] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:26 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:27.388658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:27.389271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:27.416252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:27.438220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:27.439186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:27.441236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:27.442177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:27.442799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:27.780235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:27.790236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49788e87-59d8-4f0d-a282-1ba091fcf5cb tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1668 microversion: 2.1 time: 0.405652 Oct 04 11:20:27.803603 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3216/4450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:27 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1668 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:27.815632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:27.816553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:27.826298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:27.827290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:27.828486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:27.829467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:27.830123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:27.830741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:27.879822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:28.227302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:28.237929 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dbb3915f-474f-4c2c-8189-e3e3572ec238 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1473 microversion: 2.1 time: 0.425433 Oct 04 11:20:28.241091 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3217/4451] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:27 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1473 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:28.261233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:28.261986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:28.272018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:28.276256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:28.277392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:28.281246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:28.282005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:28.284636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:28.409214 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78d6df47-db0d-4c7e-9139-023d31899536 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 202 len: 0 microversion: 2.1 time: 0.166555 Oct 04 11:20:28.417622 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3218/4452] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:28 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:20:28.433091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-60161448-f707-4f5b-9558-ac2bfc202e38 req-4602061e-8ac4-436b-bd1e-7378145c6eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a52ace0-2ddb-4df5-90b7-e1625948d259", "name": "network-vif-deleted", "tag": "66a6d253-8115-41c8-b225-8a1368275359"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:28.479751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=97 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:28.484035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-60161448-f707-4f5b-9558-ac2bfc202e38 req-4602061e-8ac4-436b-bd1e-7378145c6eea service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:28.484959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-60161448-f707-4f5b-9558-ac2bfc202e38 req-4602061e-8ac4-436b-bd1e-7378145c6eea service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:28.485672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-60161448-f707-4f5b-9558-ac2bfc202e38 req-4602061e-8ac4-436b-bd1e-7378145c6eea service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:28.553999 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-60161448-f707-4f5b-9558-ac2bfc202e38 req-4602061e-8ac4-436b-bd1e-7378145c6eea service nova] Creating event network-vif-deleted:66a6d253-8115-41c8-b225-8a1368275359 for instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 on n-h1-791135-8 Oct 04 11:20:28.571063 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-60161448-f707-4f5b-9558-ac2bfc202e38 req-4602061e-8ac4-436b-bd1e-7378145c6eea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146932 Oct 04 11:20:28.572426 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3219/4453] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:28.590690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:28.592137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:28.613129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:28.614036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:28.617736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:28.618798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:28.620426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:28.624880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:29.063360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:29.072854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a8b35a5-71b8-4ba5-8475-5ebffeedbef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1510 microversion: 2.1 time: 0.498974 Oct 04 11:20:29.077190 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3220/4454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:28 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:29.090334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:29.091167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:29.116293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:29.116802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:29.117247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:29.117999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:29.118459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:29.118885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:29.460776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:29.473833 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-912302e9-7eb2-4d88-b31f-d130e4209639 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.393658 Oct 04 11:20:29.478324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3221/4455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:29 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:29.485449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:29.493061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:29.518578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:29.520410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:29.521266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:29.522205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:29.522838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:29.525796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:29.602748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:29.603242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:29.603682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:29.604141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lazy-loading 'fault' on Instance uuid 0a52ace0-2ddb-4df5-90b7-e1625948d259 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:20:29.677524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9376a5065d204b49930796d6e3f17dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2f6b04fa444d839c097a066d3cc896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:29.688611 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5cf8d5b8-cf2a-4ff8-aa2b-70eec4d8fa19 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 200 len: 1307 microversion: 2.1 time: 0.207481 Oct 04 11:20:29.691147 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3222/4456] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:29 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:29.698653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:29.701620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:29.713396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:29.714115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:29.714731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:29.715649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:29.716274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:29.717039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:30.106816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:30.118214 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d61cc53-a603-43cb-9fd8-d03e79ab99a6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1671 microversion: 2.1 time: 0.425952 Oct 04 11:20:30.123330 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3223/4457] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:29 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1671 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:30.128397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:30.129292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:30.137658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:30.138497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:30.139147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:30.140572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:30.141635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:30.142280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:30.433396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:30.454609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-87fd4e79-01d6-4c75-a06d-c2ec82fcfa2d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1490 microversion: 2.1 time: 0.329523 Oct 04 11:20:30.473614 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3224/4458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:30 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1490 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:30.488508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:30.492004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:30.522303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:30.522812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:30.524734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:30.527251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:30.531975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:30.533592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:30.580221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:20:30.586886 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.api [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Working on deleting snapshot 46aee09c-298d-411a-99ac-859abedf56a1 from shelved instance... Oct 04 11:20:31.762071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Doing local delete in cell 6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) {{(pid=122409) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 11:20:31.762832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:31.763501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:31.763939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:31.764361 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.api [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 11:20:31.769140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] deallocate_for_instance() {{(pid=122409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 11:20:32.683930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Updating instance_info_cache with network_info: [] {{(pid=122409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 11:20:32.932156 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e5f1f4c-f0e8-4e4f-852b-6f0402e0d2e0 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 204 len: 0 microversion: 2.1 time: 2.455677 Oct 04 11:20:32.933448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3225/4459] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:20:30 2022] DELETE /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 0 bytes in 2458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:32.940211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:32.941323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:32.949804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:32.950333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:32.950961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:32.951953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:32.952602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:32.953096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:32.979288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Cannot 'pause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state paused Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action HTTP/1.1 Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 13 Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: {"pause": {}} Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'pause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state paused Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'pause': {}}} Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53d5329f-b493-4a25-a450-823121e8358a in vm_state paused. Cannot pause while the instance is in this state. Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state paused Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:32.982196 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:32.986899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:32.986899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:32.986899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:32.986899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state paused Oct 04 11:20:32.986899 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:32.988102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 409 to user: Cannot 'pause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state paused {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:32.989963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8e6c1b1-2aca-47e6-b042-b598b1fbc558 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 409 len: 143 microversion: 2.1 time: 0.054347 Oct 04 11:20:32.991209 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3226/4460] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:32 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 143 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:20:32.996487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:32.997381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] [instance: 0a52ace0-2ddb-4df5-90b7-e1625948d259] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:33.004360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.005015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.005647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.006491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.007100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.007679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.027169 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] HTTP exception thrown: Instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 could not be found. Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Request method failure captured: Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 HTTP/1.1 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBae4t35vhi_VcAJpZJU2ytiCsvLcO3P9nJ8PzBRWBcT4CZ-r10eIajwG3Zo_h6a7D8X2lnnV4NjTGQ3mUoBJXxkueLgug7vvEQb9PKqhrNV2WqxkjxG3BfFznrhk0GbrYqtcxc7tJorsmWTwGxKlvFA0zSp1Q8couJbt72UCSJOx-E Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7d2f6b04fa444d839c097a066d3cc896 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d2f6b04fa444d839c097a066d3cc896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7d2f6b04fa444d839c097a066d3cc896"}]}] Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7d2f6b04fa444d839c097a066d3cc896 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-757128754 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ImagesOneServerTestJSON-757128754-project Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 9376a5065d204b49930796d6e3f17dc8 Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ImagesOneServerTestJSON-757128754-project Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 could not be found. Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '0a52ace0-2ddb-4df5-90b7-e1625948d259'} Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 could not be found. Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 could not be found. Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:33.030582 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.034957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:33.034957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:33.034957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:33.034957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:33.034957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:33.034957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 could not be found. Oct 04 11:20:33.034957 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.037579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Returning 404 to user: Instance 0a52ace0-2ddb-4df5-90b7-e1625948d259 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:33.039139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259" status: 404 len: 111 microversion: 2.1 time: 0.046256 Oct 04 11:20:33.039976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3227/4461] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:32 2022] GET /compute/v2.1/servers/0a52ace0-2ddb-4df5-90b7-e1625948d259 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:33.041404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:33.043443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e594e85f-2f75-47c5-80c5-5e41fbb37b60 tempest-ImagesOneServerTestJSON-757128754 tempest-ImagesOneServerTestJSON-757128754-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001426 Oct 04 11:20:33.059365 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3228/4462] 10.222.0.23 () {56 vars in 886 bytes} [Tue Oct 4 11:20:33 2022] GET /compute/ => generated 377 bytes in 18 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 11:20:33.220465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-eef8f554-3b3a-47b6-9a85-cdce6368d15d req-dda381b7-70dd-4b52-8e49-1ebc0bf7253c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b", "name": "network-vif-deleted", "tag": "bf485443-e440-4ed3-af41-fa8bafa8e9a0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:33.233215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eef8f554-3b3a-47b6-9a85-cdce6368d15d req-dda381b7-70dd-4b52-8e49-1ebc0bf7253c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.234286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eef8f554-3b3a-47b6-9a85-cdce6368d15d req-dda381b7-70dd-4b52-8e49-1ebc0bf7253c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.234886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eef8f554-3b3a-47b6-9a85-cdce6368d15d req-dda381b7-70dd-4b52-8e49-1ebc0bf7253c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.240563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:33.254085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.server_external_events [req-eef8f554-3b3a-47b6-9a85-cdce6368d15d req-dda381b7-70dd-4b52-8e49-1ebc0bf7253c service nova] Unable to find a host for instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b. Dropping event network-vif-deleted {{(pid=122409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 11:20:33.255910 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-eef8f554-3b3a-47b6-9a85-cdce6368d15d req-dda381b7-70dd-4b52-8e49-1ebc0bf7253c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.195015 Oct 04 11:20:33.258022 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3229/4463] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 198 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 11:20:33.267450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:33.269055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:33.276734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.277595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.278785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.279810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.280426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.281009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.335005 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] HTTP exception thrown: Instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b could not be found. Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Request method failure captured: Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b HTTP/1.1 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTgBRUIG2PZwhMucIFfNOaJhTW8FRNIQ1AQlPUHsedqas9jqhU97pFlTmC2P_2shOaBN-8bL35S9FHJjJYbIeCD_ez18W4hC0WkHZcx5E4ieVl3tVGqOlHgOGrv88HoQLJEP_Q7QQgNCyQnnj2s-e36-frBPInLxKBQrBd3gNqVZkk Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df60449892d147adb43f4750c9b584d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df60449892d147adb43f4750c9b584d3"}]}] Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2e4e772e6a5b41a0b0f836b374bc69b4 Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b could not be found. Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b'} Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b could not be found. Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b could not be found. Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:33.338940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b could not be found. Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Returning 404 to user: Instance da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ebcc6cf-9fa6-42bc-bec4-388cdacb5419 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b" status: 404 len: 111 microversion: 2.1 time: 0.081181 Oct 04 11:20:33.343642 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3230/4464] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:33 2022] GET /compute/v2.1/servers/da6e2cb1-9ab7-4c14-9a1e-c2b233d3637b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:33.349643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:33.350780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:33.359726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.360932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.362263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.363583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.364228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.364992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.494755 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 202 len: 0 microversion: 2.1 time: 0.150238 Oct 04 11:20:33.495818 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3231/4465] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:33 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:20:33.497712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:33.500636 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-291d6d6b-83a0-4bee-b771-2ab522232c23 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003408 Oct 04 11:20:33.501340 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3232/4466] 10.222.0.23 () {54 vars in 1035 bytes} [Tue Oct 4 11:20:33 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 11:20:33.514483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:33.515363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:33.525603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.526028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.526627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.527363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.528736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.529311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.583610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:20:33.751078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0bd52676-e03c-406e-9896-397dd89837b1 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 204 len: 0 microversion: 2.1 time: 0.248236 Oct 04 11:20:33.751684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3233/4467] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:20:33 2022] DELETE /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:33.759956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:33.760665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:33.772598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.773406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.774012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:33.775118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:33.775904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:33.776630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:34.113110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:34.129201 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.374351 Oct 04 11:20:34.129867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3234/4468] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:33 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:34.155192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:34.159035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f004924a-b026-4992-aba9-e188b3ead13c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004277 Oct 04 11:20:34.159529 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3235/4469] 10.222.0.23 () {54 vars in 1041 bytes} [Tue Oct 4 11:20:34 2022] GET /compute/v2.1/ => generated 388 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:34.183738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:34.185235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:34.191886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:34.192752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:34.193469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:34.194430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:34.195107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:34.195757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:34.379705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:34.393825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5680899d-1989-4859-b38a-dbbc34d2ea4c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1466 microversion: 2.1 time: 0.226296 Oct 04 11:20:34.423902 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3236/4470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:34 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1466 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:34.438579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:34.440793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:34.462053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:34.463234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:34.463980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:34.464911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:34.466626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:34.468268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:35.179842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:35.188839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.763465 Oct 04 11:20:35.197437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3237/4471] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:34 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:35.197437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:35.197437 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb75e577-a94b-411c-ae3e-130ae4818673 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001163 Oct 04 11:20:35.197437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3238/4472] 10.222.0.23 () {56 vars in 886 bytes} [Tue Oct 4 11:20:35 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 11:20:35.219677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:35.228096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:35.242158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:35.243047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:35.246040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:35.247562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:35.249460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:35.250974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:35.284146 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c/action HTTP/1.1 Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 28 Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: {"reboot": {"type": "SOFT"}} Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8f469e62-93a8-41b2-8db4-ae25e848974c', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:35.288355 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b069d89-d87a-4b7e-b608-142123b2a90c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c/action" status: 404 len: 111 microversion: 2.1 time: 0.080943 Oct 04 11:20:35.295583 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3239/4473] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:35 2022] POST /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:35.310838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:35.311925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:35.332304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:35.333052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:35.334336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:35.339232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:35.339721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:35.343357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:35.724606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:35.734069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-74b4c6be-c157-4232-a818-e171f31fea34 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.438086 Oct 04 11:20:35.735469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3240/4474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:35 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:35.740142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:35.741169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:35.747806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:35.751144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:35.752013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:35.753083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:35.753775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:35.754396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:35.932661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:35.942754 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29933cd9-03e7-4d00-a4c2-1bb29cd6ab1a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1466 microversion: 2.1 time: 0.206214 Oct 04 11:20:35.946003 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3241/4475] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:35 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1466 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:35.954145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:35.954770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:35.974733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:35.975248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:35.977579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:35.981205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:35.982016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:35.982478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:36.323668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:36.340199 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cffeebe8-f63b-4460-adcd-42485688d13b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.390463 Oct 04 11:20:36.358032 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3242/4476] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:35 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:36.779289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c59ea5fd-9ff4-460e-a7f1-686a8600494b tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Action: 'create', calling method: .version_select at 0x7f71cfaad0d0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPHABOPZAHYh4ujdeM9kBr5zIOz5CD7Gy6DHAzRPNZoOsbA90yGiQvIuQQ5H9k2ZaxO1MqEmIXOxAn8LLSTuDBzWsRChWzkK7Ukh88eEcoYMbVY0jw6OZ9r0QVDMY8JLQ=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c59ea5fd-9ff4-460e-a7f1-686a8600494b tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Request method failure captured: Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 257 Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcDaofO7wQAtzG3T_diWftZiZ9xLRK5i3XxRhi_2QrArGHszAVgDl2pCyCaSmU_WR7uSlEH9QhkNKHhk87GO_qIXCHzqEHRknoPMzKXoP4pVlwgbayt9Dun2LmZSvGlb133VQqxHodtRcbT7xTrHOAuPP6xH1OWNQq2rkl8ogtsEmU Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fd8e0e5acf4c0cb475115d4c27197c"}]}] Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPHABOPZAHYh4ujdeM9kBr5zIOz5CD7Gy6DHAzRPNZoOsbA90yGiQvIuQQ5H9k2ZaxO1MqEmIXOxAn8LLSTuDBzWsRChWzkK7Ukh88eEcoYMbVY0jw6OZ9r0QVDMY8JLQ=="}} Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPHABOPZAHYh4ujdeM9kBr5zIOz5CD7Gy6DHAzRPNZoOsbA90yGiQvIuQQ5H9k2ZaxO1MqEmIXOxAn8LLSTuDBzWsRChWzkK7Ukh88eEcoYMbVY0jw6OZ9r0QVDMY8JLQ=='}}} Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 11:20:36.787024 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 11:20:36.791477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.797818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c59ea5fd-9ff4-460e-a7f1-686a8600494b tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:36.798971 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c59ea5fd-9ff4-460e-a7f1-686a8600494b tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.439174 Oct 04 11:20:36.799749 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3243/4477] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:20:36 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 441 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:20:36.808231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0314ca8c-d2f6-4d4a-a204-91097e077857 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:36.810849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0314ca8c-d2f6-4d4a-a204-91097e077857 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: d57d23d2-db6e-49fe-a58e-9d0b4185a0a1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:36.827385 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0314ca8c-d2f6-4d4a-a204-91097e077857 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance d57d23d2-db6e-49fe-a58e-9d0b4185a0a1 could not be found. Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0314ca8c-d2f6-4d4a-a204-91097e077857 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/d57d23d2-db6e-49fe-a58e-9d0b4185a0a1/action HTTP/1.1 Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 28 Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: {"reboot": {"type": "SOFT"}} Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance d57d23d2-db6e-49fe-a58e-9d0b4185a0a1 could not be found. Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'd57d23d2-db6e-49fe-a58e-9d0b4185a0a1', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d57d23d2-db6e-49fe-a58e-9d0b4185a0a1 could not be found. Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57d23d2-db6e-49fe-a58e-9d0b4185a0a1 could not be found. Oct 04 11:20:36.829251 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57d23d2-db6e-49fe-a58e-9d0b4185a0a1 could not be found. Oct 04 11:20:36.833813 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.835256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0314ca8c-d2f6-4d4a-a204-91097e077857 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance d57d23d2-db6e-49fe-a58e-9d0b4185a0a1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:36.836306 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0314ca8c-d2f6-4d4a-a204-91097e077857 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/d57d23d2-db6e-49fe-a58e-9d0b4185a0a1/action" status: 404 len: 111 microversion: 2.1 time: 0.035474 Oct 04 11:20:36.837445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3244/4478] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:36 2022] POST /compute/v2.1/servers/d57d23d2-db6e-49fe-a58e-9d0b4185a0a1/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:36.843122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-435f87c9-2228-4c61-9333-1c8d465bd938 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Action: 'create', calling method: .version_select at 0x7f71d87164c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-488724342", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:36.883731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-435f87c9-2228-4c61-9333-1c8d465bd938 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:20:36.890705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-435f87c9-2228-4c61-9333-1c8d465bd938 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for user 8eb3c95afbdf426194d4982eb2854a5f and project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:20:36.923244 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-435f87c9-2228-4c61-9333-1c8d465bd938 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-435f87c9-2228-4c61-9333-1c8d465bd938 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Request method failure captured: Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 2166 Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcDaofO7wQAtzG3T_diWftZiZ9xLRK5i3XxRhi_2QrArGHszAVgDl2pCyCaSmU_WR7uSlEH9QhkNKHhk87GO_qIXCHzqEHRknoPMzKXoP4pVlwgbayt9Dun2LmZSvGlb133VQqxHodtRcbT7xTrHOAuPP6xH1OWNQq2rkl8ogtsEmU Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fd8e0e5acf4c0cb475115d4c27197c"}]}] Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-488724342", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:36.942930 n-d-791135-8 devstack@n-api.service[122409]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-488724342', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:36.945469 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-435f87c9-2228-4c61-9333-1c8d465bd938 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:36.948674 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-435f87c9-2228-4c61-9333-1c8d465bd938 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.105990 Oct 04 11:20:36.953947 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3245/4479] 10.222.0.23 () {60 vars in 1160 bytes} [Tue Oct 4 11:20:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:20:36.961165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:36.961926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:36.989068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:36.989668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:36.992661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:36.993465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:36.993944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:36.994385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:37.749595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:37.760512 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4cef700-092b-4a89-832f-358b78b6552c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.805247 Oct 04 11:20:37.764758 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3246/4480] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:36 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:37.774551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fd99173-8543-4036-b712-b917cfd3cdb3 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Action: 'create', calling method: .version_select at 0x7f71cf1c5940>, body: {"keypair": {"name": "tempest-keypair-518401266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNez68Ze0zXDQ+paGeVJqORfySHP+O2bdm1KYX8V9Xd8FXP4i2xhTQpXH0Btp81057ECfc6d2SLpK3tHnb390hyHVWr24GMI8DrXON0IgIQrJXjFX3NHqP1C4DafpCc9EA=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:37.812805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-1fd99173-8543-4036-b712-b917cfd3cdb3 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:20:37.820700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-1fd99173-8543-4036-b712-b917cfd3cdb3 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for user 8eb3c95afbdf426194d4982eb2854a5f and project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:20:37.866417 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fd99173-8543-4036-b712-b917cfd3cdb3 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099998 Oct 04 11:20:37.880729 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3247/4481] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:20:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:37.897259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:37.898185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:37.910970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:37.911807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:37.912320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:37.913492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:37.913611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:37.914040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:37.995908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:37.999287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:38.000003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:38.000665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lazy-loading 'fault' on Instance uuid 3dbec6d8-d808-467b-af5e-8f1e745928b3 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:20:38.221050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:38.234593 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69adb5af-b416-4017-95fe-2675e5203718 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 200 len: 1305 microversion: 2.1 time: 0.349710 Oct 04 11:20:38.251367 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3248/4482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:37 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 1305 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:38.256791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f6576b2d-8081-4a4f-b432-3ac902cfa3f1 req-7952925e-b97b-4cf9-832d-7e288144061b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbec6d8-d808-467b-af5e-8f1e745928b3", "name": "network-vif-deleted", "tag": "e50fc86a-60ea-495c-a7aa-2a1369c1c8a6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:38.285298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6576b2d-8081-4a4f-b432-3ac902cfa3f1 req-7952925e-b97b-4cf9-832d-7e288144061b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:38.288116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6576b2d-8081-4a4f-b432-3ac902cfa3f1 req-7952925e-b97b-4cf9-832d-7e288144061b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:38.288639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6576b2d-8081-4a4f-b432-3ac902cfa3f1 req-7952925e-b97b-4cf9-832d-7e288144061b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:38.319858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f6576b2d-8081-4a4f-b432-3ac902cfa3f1 req-7952925e-b97b-4cf9-832d-7e288144061b service nova] Creating event network-vif-deleted:e50fc86a-60ea-495c-a7aa-2a1369c1c8a6 for instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 on n-h1-791135-8 Oct 04 11:20:38.341710 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f6576b2d-8081-4a4f-b432-3ac902cfa3f1 req-7952925e-b97b-4cf9-832d-7e288144061b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088422 Oct 04 11:20:38.345008 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3249/4483] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:38.357274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:38.358034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:38.397846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:38.398367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:38.398805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:38.399525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:38.399987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:38.400423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:38.793836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:38.805590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69080fb5-7816-4ef6-9509-2c5e38bd7aba tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.459089 Oct 04 11:20:38.808222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3250/4484] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:38 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:38.824741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e8948fe-8dc8-44d3-a58b-73a84a30349f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Action: 'create', calling method: .version_select at 0x7f71cfa953a0>, body: {"keypair": {"name": "tempest-keypair-518401266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODoDwec6md4OQZ7cVI0IplzMIGnT4kjFOEzQcDVNRKnEUYNgL373aeUOX9p/vU5EbeiCJDsN7eqiM9rGrr+SsbkjkqJ76z+1JNU3ygjZFXauAg90IAUahi8HsUFm0Z+rA=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:38.878373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5e8948fe-8dc8-44d3-a58b-73a84a30349f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:20:38.889889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-5e8948fe-8dc8-44d3-a58b-73a84a30349f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for user 8eb3c95afbdf426194d4982eb2854a5f and project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:20:38.947135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:38.963208 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5e8948fe-8dc8-44d3-a58b-73a84a30349f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] HTTP exception thrown: Key pair 'tempest-keypair-518401266' already exists. Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e8948fe-8dc8-44d3-a58b-73a84a30349f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Request method failure captured: Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 272 Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcDaofO7wQAtzG3T_diWftZiZ9xLRK5i3XxRhi_2QrArGHszAVgDl2pCyCaSmU_WR7uSlEH9QhkNKHhk87GO_qIXCHzqEHRknoPMzKXoP4pVlwgbayt9Dun2LmZSvGlb133VQqxHodtRcbT7xTrHOAuPP6xH1OWNQq2rkl8ogtsEmU Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fd8e0e5acf4c0cb475115d4c27197c"}]}] Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: {"keypair": {"name": "tempest-keypair-518401266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODoDwec6md4OQZ7cVI0IplzMIGnT4kjFOEzQcDVNRKnEUYNgL373aeUOX9p/vU5EbeiCJDsN7eqiM9rGrr+SsbkjkqJ76z+1JNU3ygjZFXauAg90IAUahi8HsUFm0Z+rA=="}} Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: exception: Key pair 'tempest-keypair-518401266' already exists. Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-518401266', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODoDwec6md4OQZ7cVI0IplzMIGnT4kjFOEzQcDVNRKnEUYNgL373aeUOX9p/vU5EbeiCJDsN7eqiM9rGrr+SsbkjkqJ76z+1JNU3ygjZFXauAg90IAUahi8HsUFm0Z+rA=='}}} Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result.read() Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '8eb3c95afbdf426194d4982eb2854a5f-tempest-keypair-518401266' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 11:20:38.969279 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result.read() Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 11:20:38.973610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '8eb3c95afbdf426194d4982eb2854a5f-tempest-keypair-518401266' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 11, 20, 38, 944962), 'updated_at': None, 'name': 'tempest-keypair-518401266', 'user_id': '8eb3c95afbdf426194d4982eb2854a5f', 'fingerprint': '1e:d1:cf:8f:52:da:4e:07:72:e1:7e:e3:ab:89:3a:db', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODoDwec6md4OQZ7cVI0IplzMIGnT4kjFOEzQcDVNRKnEUYNgL373aeUOX9p/vU5EbeiCJDsN7eqiM9rGrr+SsbkjkqJ76z+1JNU3ygjZFXauAg90IAUahi8HsUFm0Z+rA==', 'type': 'ssh'}] Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._create() Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-518401266' already exists. Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 11:20:38.977610 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-518401266' already exists. Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-518401266' already exists. Oct 04 11:20:38.982099 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:38.985372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e8948fe-8dc8-44d3-a58b-73a84a30349f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Returning 409 to user: Key pair 'tempest-keypair-518401266' already exists. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:38.985372 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e8948fe-8dc8-44d3-a58b-73a84a30349f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.174105 Oct 04 11:20:38.985883 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3251/4485] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:20:38 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:20:39.004813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:39.010208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:39.026880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:39.029982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:39.030695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:39.031642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:39.034276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:39.034917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:39.086515 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c/action HTTP/1.1 Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 65 Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8f469e62-93a8-41b2-8db4-ae25e848974c', 'body': {'rebuild': {'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244'}}} Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 11:20:39.090936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:20:39.095614 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.098330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:39.101539 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92fff591-2d4f-4e77-a1ec-1b468101d4c6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c/action" status: 404 len: 111 microversion: 2.1 time: 0.114490 Oct 04 11:20:39.110661 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3252/4486] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:38 2022] POST /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c/action => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:39.115822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c790e50a-c551-4f16-851a-e44c486223e1 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Calling method '.version_select at 0x7f71d440e3a0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:39.166891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c790e50a-c551-4f16-851a-e44c486223e1 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518401266" status: 202 len: 0 microversion: 2.1 time: 0.054832 Oct 04 11:20:39.167489 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3253/4487] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:20:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518401266 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:20:39.176872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:39.176872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:39.202916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:39.203420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:39.203860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:39.213257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:39.213785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:39.214232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:39.590202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:39.616566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfe1565a-7185-41ef-bc3b-529120b94e46 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.447478 Oct 04 11:20:39.618814 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3254/4488] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:39 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:39.625538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f57366f7-b137-4b1f-b6ff-cb7dd46fe5e9 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Action: 'create', calling method: .version_select at 0x7f71d4227ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhIUxvdh385VFUg9PhcSR3pXI6J97VWnVhA0bVl01RjYkv09FUsJF7WBJ1sCvvMCoZWZRLjktcYSt2Dq1GHtw8Wr9twmt3wgL5IwNQFPv3VZtCitjnnWWJqjyK+zPB9+g=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f57366f7-b137-4b1f-b6ff-cb7dd46fe5e9 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Request method failure captured: Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 247 Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcDaofO7wQAtzG3T_diWftZiZ9xLRK5i3XxRhi_2QrArGHszAVgDl2pCyCaSmU_WR7uSlEH9QhkNKHhk87GO_qIXCHzqEHRknoPMzKXoP4pVlwgbayt9Dun2LmZSvGlb133VQqxHodtRcbT7xTrHOAuPP6xH1OWNQq2rkl8ogtsEmU Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fd8e0e5acf4c0cb475115d4c27197c"}]}] Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhIUxvdh385VFUg9PhcSR3pXI6J97VWnVhA0bVl01RjYkv09FUsJF7WBJ1sCvvMCoZWZRLjktcYSt2Dq1GHtw8Wr9twmt3wgL5IwNQFPv3VZtCitjnnWWJqjyK+zPB9+g=="}} Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhIUxvdh385VFUg9PhcSR3pXI6J97VWnVhA0bVl01RjYkv09FUsJF7WBJ1sCvvMCoZWZRLjktcYSt2Dq1GHtw8Wr9twmt3wgL5IwNQFPv3VZtCitjnnWWJqjyK+zPB9+g=='}}} Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '' Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:20:39.639778 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:20:39.645069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.647773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f57366f7-b137-4b1f-b6ff-cb7dd46fe5e9 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:39.650009 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f57366f7-b137-4b1f-b6ff-cb7dd46fe5e9 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.029993 Oct 04 11:20:39.661839 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3255/4489] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:20:39 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:20:39.672797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:39.674392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 3dbec6d8-d808-467b-af5e-8f1e745928b3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:39.690192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:39.691180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:39.691930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:39.692833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:39.694702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:39.696465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:39.723573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:39.733410 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] HTTP exception thrown: Instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 could not be found. Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Request method failure captured: Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 HTTP/1.1 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTgBRUIG2PZwhMucIFfNOaJhTW8FRNIQ1AQlPUHsedqas9jqhU97pFlTmC2P_2shOaBN-8bL35S9FHJjJYbIeCD_ez18W4hC0WkHZcx5E4ieVl3tVGqOlHgOGrv88HoQLJEP_Q7QQgNCyQnnj2s-e36-frBPInLxKBQrBd3gNqVZkk Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df60449892d147adb43f4750c9b584d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df60449892d147adb43f4750c9b584d3"}]}] Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2e4e772e6a5b41a0b0f836b374bc69b4 Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 could not be found. Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '3dbec6d8-d808-467b-af5e-8f1e745928b3'} Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 could not be found. Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 could not be found. Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:39.739131 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.744330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:39.744330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:39.744330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:39.744330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:39.744330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:39.744330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 could not be found. Oct 04 11:20:39.744330 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:39.747678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Returning 404 to user: Instance 3dbec6d8-d808-467b-af5e-8f1e745928b3 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:39.749076 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a31cf43e-50e1-4600-b9f3-0bbaecf3c09c tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3" status: 404 len: 111 microversion: 2.1 time: 0.085436 Oct 04 11:20:39.753489 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3256/4490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:39 2022] GET /compute/v2.1/servers/3dbec6d8-d808-467b-af5e-8f1e745928b3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:39.768074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:39.768958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:39.776238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:39.777113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:39.777895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:39.778786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:39.779403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:39.780041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:40.416062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:40.430506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f65d3195-430c-4f4e-9670-2aa3251c44bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.675639 Oct 04 11:20:40.431118 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3257/4491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:39 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:40.443993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37de61ae-8afa-488a-8b9d-096b356c8383 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Action: 'create', calling method: .version_select at 0x7f71cef67d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-472425000", "public_key": " "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:40.502596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-37de61ae-8afa-488a-8b9d-096b356c8383 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:20:40.518275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-37de61ae-8afa-488a-8b9d-096b356c8383 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for user 8eb3c95afbdf426194d4982eb2854a5f and project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:20:40.558357 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-37de61ae-8afa-488a-8b9d-096b356c8383 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37de61ae-8afa-488a-8b9d-096b356c8383 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Request method failure captured: Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 94 Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcDaofO7wQAtzG3T_diWftZiZ9xLRK5i3XxRhi_2QrArGHszAVgDl2pCyCaSmU_WR7uSlEH9QhkNKHhk87GO_qIXCHzqEHRknoPMzKXoP4pVlwgbayt9Dun2LmZSvGlb133VQqxHodtRcbT7xTrHOAuPP6xH1OWNQq2rkl8ogtsEmU Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fd8e0e5acf4c0cb475115d4c27197c"}]}] Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-472425000", "public_key": " "}} Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-472425000', 'public_key': ' '}}} Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:40.560682 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37de61ae-8afa-488a-8b9d-096b356c8383 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37de61ae-8afa-488a-8b9d-096b356c8383 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.130081 Oct 04 11:20:40.564617 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3258/4492] 10.222.0.23 () {60 vars in 1158 bytes} [Tue Oct 4 11:20:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:20:40.576721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:40.577266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:40.601963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:40.602470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:40.603034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:40.603622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:40.609394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:40.610116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:40.672959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:20:40.890963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-44e4c920-cfc9-4e14-9a80-e799572566fa tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 204 len: 0 microversion: 2.1 time: 0.318656 Oct 04 11:20:40.896467 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3259/4493] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:20:40 2022] DELETE /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:40.912835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:40.913601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:40.930248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:40.931026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:40.932249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:40.935097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:40.935760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:40.936573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:41.014402 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6048139d-3722-40ee-a6f4-95596837a46e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/ips" status: 200 len: 151 microversion: 2.20 time: 0.115822 Oct 04 11:20:41.015019 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3260/4494] 10.222.0.23 () {60 vars in 1289 bytes} [Tue Oct 4 11:20:40 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/ips => generated 151 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:20:41.033206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f133167a-dc0b-44a6-b605-dc6e71ab1c4e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:41.042659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f133167a-dc0b-44a6-b605-dc6e71ab1c4e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: b718330c-bcf1-4d4c-9c09-d6b894f25914] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:41.055656 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f133167a-dc0b-44a6-b605-dc6e71ab1c4e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance b718330c-bcf1-4d4c-9c09-d6b894f25914 could not be found. Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f133167a-dc0b-44a6-b605-dc6e71ab1c4e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/b718330c-bcf1-4d4c-9c09-d6b894f25914/action HTTP/1.1 Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 65 Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b718330c-bcf1-4d4c-9c09-d6b894f25914 could not be found. Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b718330c-bcf1-4d4c-9c09-d6b894f25914', 'body': {'rebuild': {'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244'}}} Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b718330c-bcf1-4d4c-9c09-d6b894f25914 could not be found. Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 11:20:41.063416 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b718330c-bcf1-4d4c-9c09-d6b894f25914 could not be found. Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b718330c-bcf1-4d4c-9c09-d6b894f25914 could not be found. Oct 04 11:20:41.068220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.071176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f133167a-dc0b-44a6-b605-dc6e71ab1c4e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance b718330c-bcf1-4d4c-9c09-d6b894f25914 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:41.072460 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f133167a-dc0b-44a6-b605-dc6e71ab1c4e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/b718330c-bcf1-4d4c-9c09-d6b894f25914/action" status: 404 len: 111 microversion: 2.1 time: 0.056439 Oct 04 11:20:41.073258 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3261/4495] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:41 2022] POST /compute/v2.1/servers/b718330c-bcf1-4d4c-9c09-d6b894f25914/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:41.081667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5e3ab0a-5bb4-4d4c-9716-08e1b8dbecb6 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Action: 'create', calling method: .version_select at 0x7f71cef67790>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVPm0yRq6J2cunfN6FTVAeBGw4eDG+RsVtWWneOx/6bps+G+vmgFQe1x7vsQamJJrrfNdx6LR8CCJbKRJWiXu12MjVJmrAjm5Q4krHA/Q7/dePyEJ9DF/jUueUadREF9Q=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5e3ab0a-5bb4-4d4c-9716-08e1b8dbecb6 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Request method failure captured: Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 507 Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcDaofO7wQAtzG3T_diWftZiZ9xLRK5i3XxRhi_2QrArGHszAVgDl2pCyCaSmU_WR7uSlEH9QhkNKHhk87GO_qIXCHzqEHRknoPMzKXoP4pVlwgbayt9Dun2LmZSvGlb133VQqxHodtRcbT7xTrHOAuPP6xH1OWNQq2rkl8ogtsEmU Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fd8e0e5acf4c0cb475115d4c27197c"}]}] Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVPm0yRq6J2cunfN6FTVAeBGw4eDG+RsVtWWneOx/6bps+G+vmgFQe1x7vsQamJJrrfNdx6LR8CCJbKRJWiXu12MjVJmrAjm5Q4krHA/Q7/dePyEJ9DF/jUueUadREF9Q=="}} Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVPm0yRq6J2cunfN6FTVAeBGw4eDG+RsVtWWneOx/6bps+G+vmgFQe1x7vsQamJJrrfNdx6LR8CCJbKRJWiXu12MjVJmrAjm5Q4krHA/Q7/dePyEJ9DF/jUueUadREF9Q=='}}} Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 11:20:41.093391 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 11:20:41.097137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:41.100129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5e3ab0a-5bb4-4d4c-9716-08e1b8dbecb6 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:41.101538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5e3ab0a-5bb4-4d4c-9716-08e1b8dbecb6 tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.027111 Oct 04 11:20:41.103111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3262/4496] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:20:41 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:20:41.111261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:41.112273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:41.120142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:41.120817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:41.121467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:41.126747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:41.127462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:41.128063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:42.995302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:43.030294 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0167d8e7-70d4-4b9b-8e25-3232ad1175b4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 200 len: 1508 microversion: 2.1 time: 1.925858 Oct 04 11:20:43.038355 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3263/4497] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:41 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 1508 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:43.055397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:43.062713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:43.079669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:43.080384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:43.080939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:43.092819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:43.094190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:43.099395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:43.690010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:43.702125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-df4b9626-295a-4ffb-aec6-a679995151df tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.659988 Oct 04 11:20:43.707160 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3264/4498] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:43 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:43.719503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e1a820b-55e0-421e-82e8-1cec4e78a32f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Action: 'create', calling method: .version_select at 0x7f71d4c6c040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-210091415", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:43.765383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0e1a820b-55e0-421e-82e8-1cec4e78a32f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:20:43.779834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0e1a820b-55e0-421e-82e8-1cec4e78a32f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Getting quotas for user 8eb3c95afbdf426194d4982eb2854a5f and project d9fd8e0e5acf4c0cb475115d4c27197c. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:20:43.824165 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0e1a820b-55e0-421e-82e8-1cec4e78a32f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e1a820b-55e0-421e-82e8-1cec4e78a32f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Request method failure captured: Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 117 Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcDaofO7wQAtzG3T_diWftZiZ9xLRK5i3XxRhi_2QrArGHszAVgDl2pCyCaSmU_WR7uSlEH9QhkNKHhk87GO_qIXCHzqEHRknoPMzKXoP4pVlwgbayt9Dun2LmZSvGlb133VQqxHodtRcbT7xTrHOAuPP6xH1OWNQq2rkl8ogtsEmU Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fd8e0e5acf4c0cb475115d4c27197c"}]}] Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-210091415", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-210091415', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 11:20:43.830823 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 11:20:43.838428 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:43.843878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e1a820b-55e0-421e-82e8-1cec4e78a32f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:43.844788 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e1a820b-55e0-421e-82e8-1cec4e78a32f tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.136431 Oct 04 11:20:43.845438 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3265/4499] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:20:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:20:43.859823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:43.864053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:43.884820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:43.885380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:43.885836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:43.886555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:43.889714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:43.890371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:44.614985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:44.630877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe9faa71-b725-4ee4-aa46-c81064cab104 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.777916 Oct 04 11:20:44.631495 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3266/4500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:43 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:44.675722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4dddcee1-26f9-481c-8d4f-53d398fdd7da req-abf80ed6-e45f-4d7c-961c-d35f49249f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04da9dcb-a1e6-4e40-9bca-c5ad16b358eb", "name": "network-vif-deleted", "tag": "b2606441-a024-4be2-83b9-0cbe077c7576"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:44.697718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4dddcee1-26f9-481c-8d4f-53d398fdd7da req-abf80ed6-e45f-4d7c-961c-d35f49249f29 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:44.701881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4dddcee1-26f9-481c-8d4f-53d398fdd7da req-abf80ed6-e45f-4d7c-961c-d35f49249f29 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:44.705364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4dddcee1-26f9-481c-8d4f-53d398fdd7da req-abf80ed6-e45f-4d7c-961c-d35f49249f29 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:44.754145 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4dddcee1-26f9-481c-8d4f-53d398fdd7da req-abf80ed6-e45f-4d7c-961c-d35f49249f29 service nova] Creating event network-vif-deleted:b2606441-a024-4be2-83b9-0cbe077c7576 for instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb on n-h2-791135-8 Oct 04 11:20:44.775809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4dddcee1-26f9-481c-8d4f-53d398fdd7da req-abf80ed6-e45f-4d7c-961c-d35f49249f29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124243 Oct 04 11:20:44.777651 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3267/4501] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:44.791439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1ef6f8a-f301-4513-a223-9aefc45ecf5d tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Calling method '.version_select at 0x7f71d440e1f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:44.823907 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a1ef6f8a-f301-4513-a223-9aefc45ecf5d tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-291561628 not found for user 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1ef6f8a-f301-4513-a223-9aefc45ecf5d tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Request method failure captured: Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-291561628 HTTP/1.1 Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcDaofO7wQAtzG3T_diWftZiZ9xLRK5i3XxRhi_2QrArGHszAVgDl2pCyCaSmU_WR7uSlEH9QhkNKHhk87GO_qIXCHzqEHRknoPMzKXoP4pVlwgbayt9Dun2LmZSvGlb133VQqxHodtRcbT7xTrHOAuPP6xH1OWNQq2rkl8ogtsEmU Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9fd8e0e5acf4c0cb475115d4c27197c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9fd8e0e5acf4c0cb475115d4c27197c"}]}] Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: d9fd8e0e5acf4c0cb475115d4c27197c Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-495190907 Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-KeyPairsNegativeTestJSON-495190907-project Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: exception: Keypair tempest-keypair-non-existent-291561628 not found for user 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'tempest-keypair-non-existent-291561628'} Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-291561628 not found for user 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.826280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-291561628 not found for user 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-291561628 not found for user 8eb3c95afbdf426194d4982eb2854a5f Oct 04 11:20:44.831564 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.836334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1ef6f8a-f301-4513-a223-9aefc45ecf5d tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] Returning 404 to user: Keypair tempest-keypair-non-existent-291561628 not found for user 8eb3c95afbdf426194d4982eb2854a5f {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:44.837478 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1ef6f8a-f301-4513-a223-9aefc45ecf5d tempest-KeyPairsNegativeTestJSON-495190907 tempest-KeyPairsNegativeTestJSON-495190907-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-291561628" status: 404 len: 144 microversion: 2.1 time: 0.051561 Oct 04 11:20:44.838258 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3268/4502] 10.222.0.23 () {58 vars in 1257 bytes} [Tue Oct 4 11:20:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-291561628 => generated 144 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:44.846068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:44.847111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:44.857946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:44.858716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:44.859361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:44.860287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:44.861616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:44.862285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:44.895183 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] HTTP exception thrown: Instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb could not be found. Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Request method failure captured: Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb HTTP/1.1 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTgBRUIG2PZwhMucIFfNOaJhTW8FRNIQ1AQlPUHsedqas9jqhU97pFlTmC2P_2shOaBN-8bL35S9FHJjJYbIeCD_ez18W4hC0WkHZcx5E4ieVl3tVGqOlHgOGrv88HoQLJEP_Q7QQgNCyQnnj2s-e36-frBPInLxKBQrBd3gNqVZkk Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df60449892d147adb43f4750c9b584d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df60449892d147adb43f4750c9b584d3"}]}] Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2e4e772e6a5b41a0b0f836b374bc69b4 Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb could not be found. Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '04da9dcb-a1e6-4e40-9bca-c5ad16b358eb'} Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb could not be found. Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb could not be found. Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:44.897109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.901049 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:44.901049 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:44.901049 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:44.901049 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:44.901049 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:44.901049 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb could not be found. Oct 04 11:20:44.901049 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:44.906083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Returning 404 to user: Instance 04da9dcb-a1e6-4e40-9bca-c5ad16b358eb could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:44.909114 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1d6c17c-660b-4638-bc60-9a2a3158480a tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb" status: 404 len: 111 microversion: 2.1 time: 0.067297 Oct 04 11:20:44.914964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3269/4503] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:44 2022] GET /compute/v2.1/servers/04da9dcb-a1e6-4e40-9bca-c5ad16b358eb => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:44.927654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:44.928553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:44.941404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:44.943295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:44.946957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:44.947734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:44.948209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:44.948642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:44.975614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lazy-loading 'flavor' on Instance uuid e69337b0-3580-43cd-ac13-11f030e3804b {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:20:45.413912 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c97f3fb9-f58d-4400-acf4-ec3bb7f2906c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/action" status: 202 len: 0 microversion: 2.20 time: 0.496232 Oct 04 11:20:45.419542 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3270/4504] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:20:44 2022] POST /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:45.787776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-311079990", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "e777dc03-6f12-4ef1-9c8d-f5574c52363c"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:45.899561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] validate_networks() for [('e777dc03-6f12-4ef1-9c8d-f5574c52363c', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:20:47.815928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:20:47.818298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:20:47.819487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:20:47.820969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:20:47.821602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:20:47.883969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:47.896632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:47.897099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:47.909230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:47.910767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:47.911231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:48.013981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Getting quotas for project db18ff0e0db646b9accae7185441d58d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:20:48.024316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Getting quotas for user ee29e1d9407c499daf39d8e165d47ec9 and project db18ff0e0db646b9accae7185441d58d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:20:48.054462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:20:48.058392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:20:48.199952 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a97d0dec-1a6e-4a6f-ad77-de90162cec39 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.776725 Oct 04 11:20:48.203498 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3271/4505] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:20:48.216223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4c5ded9-2e34-432a-9c66-aa3b7c0d9ef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:48.221129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f4c5ded9-2e34-432a-9c66-aa3b7c0d9ef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: ee01ce84-4209-4e7d-ada0-03538b6f3088] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:48.242218 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f4c5ded9-2e34-432a-9c66-aa3b7c0d9ef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance ee01ce84-4209-4e7d-ada0-03538b6f3088 could not be found. Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4c5ded9-2e34-432a-9c66-aa3b7c0d9ef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/ee01ce84-4209-4e7d-ada0-03538b6f3088/action HTTP/1.1 Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: {"restore": {}} Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance ee01ce84-4209-4e7d-ada0-03538b6f3088 could not be found. Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'ee01ce84-4209-4e7d-ada0-03538b6f3088', 'body': {'restore': {}}} Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee01ce84-4209-4e7d-ada0-03538b6f3088 could not be found. Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee01ce84-4209-4e7d-ada0-03538b6f3088 could not be found. Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:48.244184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:48.251181 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:48.251181 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:48.251181 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee01ce84-4209-4e7d-ada0-03538b6f3088 could not be found. Oct 04 11:20:48.251181 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:48.252609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4c5ded9-2e34-432a-9c66-aa3b7c0d9ef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance ee01ce84-4209-4e7d-ada0-03538b6f3088 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:48.253727 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4c5ded9-2e34-432a-9c66-aa3b7c0d9ef7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/ee01ce84-4209-4e7d-ada0-03538b6f3088/action" status: 404 len: 111 microversion: 2.1 time: 0.049046 Oct 04 11:20:48.257837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3272/4506] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:48 2022] POST /compute/v2.1/servers/ee01ce84-4209-4e7d-ada0-03538b6f3088/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:48.272592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:48.277961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:48.296660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:48.298267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:48.304415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:48.307025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:48.311284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:48.311765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:48.401517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:20:48.688269 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-213989c6-62b0-4c25-b64a-06740539c0ee tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 204 len: 0 microversion: 2.1 time: 0.419878 Oct 04 11:20:48.691645 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3273/4507] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:20:48 2022] DELETE /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:49.195586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:49.196306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:49.212433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:49.215871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:49.216324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:49.217070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:49.224529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:49.230836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:49.632852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:49.648266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:49.651016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:49.656744 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6d14542-45d4-41f2-8fee-3831153a0d9a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1722 microversion: 2.20 time: 0.963490 Oct 04 11:20:49.657755 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3274/4508] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:20:48 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1722 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:20:49.663943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-afb8db60-6342-4f3e-b1b0-cf2cf50fb1e3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:49.668249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-afb8db60-6342-4f3e-b1b0-cf2cf50fb1e3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:49.847270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-afb8db60-6342-4f3e-b1b0-cf2cf50fb1e3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:49.858322 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-afb8db60-6342-4f3e-b1b0-cf2cf50fb1e3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1215 microversion: 2.1 time: 0.199212 Oct 04 11:20:49.869469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3275/4509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:49 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:49.888818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:49.897341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:49.904804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:49.906441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:49.908032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:49.908868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:49.909436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:49.909947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:50.147637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:50.161038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f57ea35-d55b-434c-8db2-8a3edcb4010c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.289448 Oct 04 11:20:50.163826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3276/4510] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:49 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:50.169812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:50.170622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:50.203514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:50.204101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:50.204446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:50.205150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:50.205760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:50.206038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:50.243210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:50.390084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:50.408917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4442f3d6-94cc-4174-9dd7-1c2a7d751928 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 200 len: 1453 microversion: 2.1 time: 0.242844 Oct 04 11:20:50.409916 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3277/4511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:50 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 1453 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:50.441588 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:20:50.442007 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:20:50.671212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eee57dd6-a708-4c12-a03d-1ffb98663b05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'create', calling method: .version_select at 0x7f71cef11ca0>, body: {"keypair": {"name": "tempest-keypair-732027173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjP/FoPdvdiU2slaPUFRSAhLPSyEOfcBLlhAx/Y5vx5KapBx600NW2480hm+ut8C9m7JBxyZA3ul0S4oYXsTlcwUdVICti71iLHpLuwwsTpqXrAKxV+LC5pKpRQpWmfw=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:50.709561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eee57dd6-a708-4c12-a03d-1ffb98663b05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Getting quotas for project bca571652d66413ab8000101c4e51262. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:20:50.720910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:50.727656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eee57dd6-a708-4c12-a03d-1ffb98663b05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Getting quotas for user 12f16f7befa14be687888f0b00588c6b and project bca571652d66413ab8000101c4e51262. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:20:50.788487 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eee57dd6-a708-4c12-a03d-1ffb98663b05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.377302 Oct 04 11:20:50.789191 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3278/4512] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:20:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:50.799474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:50.800358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:50.809977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:50.810745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:50.811441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:50.812352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:50.813222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:50.813908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:51.258500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:51.267981 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db2146ad-85eb-4b13-9dc0-a304fac93122 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.477636 Oct 04 11:20:51.278493 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3279/4513] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:50 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:51.285009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ad1a87c5-3815-44aa-bbba-7abcea3bf294 req-48063ef4-d8f3-43fe-a01e-de7d5388eb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4", "name": "network-vif-deleted", "tag": "ce3169e1-4dc2-4ba9-92e3-4875e77fa860"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:51.312904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ad1a87c5-3815-44aa-bbba-7abcea3bf294 req-48063ef4-d8f3-43fe-a01e-de7d5388eb8b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:51.313413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ad1a87c5-3815-44aa-bbba-7abcea3bf294 req-48063ef4-d8f3-43fe-a01e-de7d5388eb8b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:51.313856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ad1a87c5-3815-44aa-bbba-7abcea3bf294 req-48063ef4-d8f3-43fe-a01e-de7d5388eb8b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:51.336559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ad1a87c5-3815-44aa-bbba-7abcea3bf294 req-48063ef4-d8f3-43fe-a01e-de7d5388eb8b service nova] Creating event network-vif-deleted:ce3169e1-4dc2-4ba9-92e3-4875e77fa860 for instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 on n-h1-791135-8 Oct 04 11:20:51.353233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ad1a87c5-3815-44aa-bbba-7abcea3bf294 req-48063ef4-d8f3-43fe-a01e-de7d5388eb8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071699 Oct 04 11:20:51.356894 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3280/4514] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:51.364286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:51.365228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:51.390384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:51.403881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:51.404958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:51.405893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:51.407061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:51.407627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:51.717385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:51.725932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:51.727909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:51.729694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5602dfa1-04ad-48bd-99f1-08ecf3a31156 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1722 microversion: 2.20 time: 0.371307 Oct 04 11:20:51.745387 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3281/4515] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:20:51 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1722 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:20:51.751665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:51.752234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:51.764185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:51.765078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:51.766707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:51.782379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:51.788898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:51.789650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:51.959358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:51.979918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2c102784-0280-4801-879f-068c8a6d49fd tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1273 microversion: 2.1 time: 0.238039 Oct 04 11:20:51.980575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3282/4516] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:51 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:51.986206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:51.987144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:52.000943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.001470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.001947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.002618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.003071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.003495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.030638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Cannot 'restore' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action HTTP/1.1 Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: {"restore": {}} Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'restore' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'restore': {}}} Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53d5329f-b493-4a25-a450-823121e8358a in vm_state active. Cannot restore while the instance is in this state. Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:52.032613 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:52.036773 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:52.036773 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:52.036773 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:52.036773 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:20:52.036773 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.038558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 409 to user: Cannot 'restore' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:52.039651 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d890766b-e31e-4bbf-a8f0-fd1da37d141f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 409 len: 145 microversion: 2.1 time: 0.057965 Oct 04 11:20:52.040776 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3283/4517] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:51 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:20:52.045764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:52.046634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:52.053140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.054634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.055315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.056368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.057039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.057997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.074876 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] HTTP exception thrown: Instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 could not be found. Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Request method failure captured: Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 HTTP/1.1 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTgBRUIG2PZwhMucIFfNOaJhTW8FRNIQ1AQlPUHsedqas9jqhU97pFlTmC2P_2shOaBN-8bL35S9FHJjJYbIeCD_ez18W4hC0WkHZcx5E4ieVl3tVGqOlHgOGrv88HoQLJEP_Q7QQgNCyQnnj2s-e36-frBPInLxKBQrBd3gNqVZkk Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df60449892d147adb43f4750c9b584d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df60449892d147adb43f4750c9b584d3"}]}] Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2e4e772e6a5b41a0b0f836b374bc69b4 Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 could not be found. Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4'} Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 could not be found. Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 could not be found. Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:52.076931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.080963 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:52.080963 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:52.080963 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:52.080963 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:52.080963 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:52.080963 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 could not be found. Oct 04 11:20:52.080963 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:52.082960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Returning 404 to user: Instance 1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:52.084420 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-04f78ff9-ecb3-4733-97a4-775e7987a7d2 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4" status: 404 len: 111 microversion: 2.1 time: 0.042473 Oct 04 11:20:52.085585 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3284/4518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:52 2022] GET /compute/v2.1/servers/1e7eaf7c-dfb0-4828-8ff6-63563bc85ce4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:52.091238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:52.092181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:52.098772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.099559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.100218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.101265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.102060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.102735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.493159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:52.512093 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-43803415-847b-4543-8f03-15d604246003 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.424801 Oct 04 11:20:52.530121 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3285/4519] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:52 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:52.532020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:52.532754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:52.550077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.550869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.552189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.553174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.553843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.554445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.607929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:20:52.750858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd019ccc-c29a-488d-bb2f-4d7a36f2bbe4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 204 len: 0 microversion: 2.1 time: 0.223295 Oct 04 11:20:52.754683 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3286/4520] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:20:52 2022] DELETE /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:20:52.762646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:52.764054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:52.771485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.772714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.773596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:52.774580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:52.775926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:52.776365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:53.266023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:53.294765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-992a227c-8648-4b45-a3f4-243fb4200fa6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.523105 Oct 04 11:20:53.295451 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3287/4521] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:52 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:53.300336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:53.317149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:53.336632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:53.339561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:53.340754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:53.342766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:53.356602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:53.367476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:54.032473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:54.049663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:54.051109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:54.052419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-126dfa89-9506-42c0-91ea-c15ef815bbd4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1722 microversion: 2.20 time: 0.755992 Oct 04 11:20:54.066155 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3288/4522] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:20:53 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1722 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:20:54.083428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:54.084047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:54.104828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:54.105469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:54.105831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:54.106830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:54.107290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:54.107715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:54.962535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:54.975152 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6fb4e4e6-dac7-4279-bb4a-699a849b51f9 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1677 microversion: 2.1 time: 0.907336 Oct 04 11:20:54.977668 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3289/4523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:54 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1677 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:54.983423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:54.994898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:55.013304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:55.014107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:55.014777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:55.015728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:55.020306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:55.021044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:55.407518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:55.421580 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6aca4b49-a120-4ba6-937c-28b7c52e8afe tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1315 microversion: 2.1 time: 0.442473 Oct 04 11:20:55.422730 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3290/4524] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:54 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:55.427613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd110e28-35e1-4908-9797-20dd905b14a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:55.428434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd110e28-35e1-4908-9797-20dd905b14a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: af8b43ec-0a95-43c9-8ce7-652e8c2bca6f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:55.440844 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-fd110e28-35e1-4908-9797-20dd905b14a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance af8b43ec-0a95-43c9-8ce7-652e8c2bca6f could not be found. Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd110e28-35e1-4908-9797-20dd905b14a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/af8b43ec-0a95-43c9-8ce7-652e8c2bca6f/action HTTP/1.1 Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 14 Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: {"resume": {}} Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance af8b43ec-0a95-43c9-8ce7-652e8c2bca6f could not be found. Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'af8b43ec-0a95-43c9-8ce7-652e8c2bca6f', 'body': {'resume': {}}} Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af8b43ec-0a95-43c9-8ce7-652e8c2bca6f could not be found. Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af8b43ec-0a95-43c9-8ce7-652e8c2bca6f could not be found. Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:55.446952 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:55.452123 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:55.452123 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:55.452123 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af8b43ec-0a95-43c9-8ce7-652e8c2bca6f could not be found. Oct 04 11:20:55.452123 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:55.463971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd110e28-35e1-4908-9797-20dd905b14a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance af8b43ec-0a95-43c9-8ce7-652e8c2bca6f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:55.466326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd110e28-35e1-4908-9797-20dd905b14a8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/af8b43ec-0a95-43c9-8ce7-652e8c2bca6f/action" status: 404 len: 111 microversion: 2.1 time: 0.042536 Oct 04 11:20:55.467624 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3291/4525] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:55 2022] POST /compute/v2.1/servers/af8b43ec-0a95-43c9-8ce7-652e8c2bca6f/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:55.473698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:55.474947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:55.483316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:55.484186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:55.484809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:55.485873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:55.486516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:55.487290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:55.816852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:55.827584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:55.829567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:55.831244 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a9a70ea-362c-4426-bb6c-32b132401ce2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1722 microversion: 2.20 time: 0.362418 Oct 04 11:20:55.851509 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3292/4526] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:20:55 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:20:55.858585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:55.859519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:55.868416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:55.869295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:55.869983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:55.871605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:55.872285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:55.873181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:56.594402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:56.606523 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d12af935-9498-42f2-934d-129a70f9db13 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.753417 Oct 04 11:20:56.608065 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3293/4527] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:55 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:56.639553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:56.642239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:56.663354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:56.664284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:56.665098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:56.666463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:56.667421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:56.668845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:56.734034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:56.734923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:56.735592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:56.737790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lazy-loading 'fault' on Instance uuid 549ab102-7419-4fc0-9aff-94764bc2bbd3 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:20:56.936902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4e772e6a5b41a0b0f836b374bc69b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df60449892d147adb43f4750c9b584d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:56.950763 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9096927e-5f87-4994-8906-8a8251cee1f4 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 200 len: 1329 microversion: 2.1 time: 0.317708 Oct 04 11:20:56.951498 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3294/4528] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:56 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 1329 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:56.960108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-37394808-e325-4a15-8caf-4d1dec497a7b req-93fa88cd-b78b-44c0-b108-9d98e175b005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549ab102-7419-4fc0-9aff-94764bc2bbd3", "name": "network-vif-deleted", "tag": "d5e7a94f-c3f9-4b24-bd6c-caa943af3f60"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:56.984506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-37394808-e325-4a15-8caf-4d1dec497a7b req-93fa88cd-b78b-44c0-b108-9d98e175b005 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:56.987814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-37394808-e325-4a15-8caf-4d1dec497a7b req-93fa88cd-b78b-44c0-b108-9d98e175b005 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:56.999379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-37394808-e325-4a15-8caf-4d1dec497a7b req-93fa88cd-b78b-44c0-b108-9d98e175b005 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:57.049867 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-37394808-e325-4a15-8caf-4d1dec497a7b req-93fa88cd-b78b-44c0-b108-9d98e175b005 service nova] Creating event network-vif-deleted:d5e7a94f-c3f9-4b24-bd6c-caa943af3f60 for instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 on n-h1-791135-8 Oct 04 11:20:57.071647 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-37394808-e325-4a15-8caf-4d1dec497a7b req-93fa88cd-b78b-44c0-b108-9d98e175b005 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117846 Oct 04 11:20:57.080204 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3295/4529] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:20:57.092865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:57.105175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:57.127415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:57.132181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:57.133175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:57.134201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:57.134990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:57.138278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:57.177624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:57.518845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:57.533254 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-137be66f-729f-4c5e-a800-77551dac34f3 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1315 microversion: 2.1 time: 0.444052 Oct 04 11:20:57.536581 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3296/4530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:57 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:57.547164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:57.548087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:57.568732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:57.569643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:57.572803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:57.574012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:57.574770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:57.575770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:57.813001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:57.823502 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69d25136-ae52-4922-8e8a-444338e58bb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.285224 Oct 04 11:20:57.842517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3297/4531] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:57 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:20:57.848040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:57.849192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:57.857189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:57.858249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:57.858872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:57.860094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:57.860703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:57.861282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:57.998575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:58.060829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:58.071016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:58.072468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:20:58.073697 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b4bd05f-3895-4681-b385-19b93cab5a38 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1722 microversion: 2.20 time: 0.229813 Oct 04 11:20:58.074308 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3298/4532] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:20:57 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:20:58.096752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1574526511", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a1c1cda-67d7-4d42-a700-0c9a2c75d1a2"}], "security_groups": [{"name": "tempest-securitygroup--1546991960"}], "key_name": "tempest-keypair-732027173", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:58.385088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] validate_networks() for [('1a1c1cda-67d7-4d42-a700-0c9a2c75d1a2', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:20:59.584510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:20:59.585984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:20:59.586695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:20:59.587361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:20:59.588030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:20:59.597044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=33 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:20:59.613656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:59.615598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:59.616451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:59.618577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:59.621576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:59.624034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:59.666007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Getting quotas for project bca571652d66413ab8000101c4e51262. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:20:59.677642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Getting quotas for user 12f16f7befa14be687888f0b00588c6b and project bca571652d66413ab8000101c4e51262. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:20:59.712795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:20:59.722547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:20:59.818072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7903905-0df9-41a2-ac20-ad13bfe4ee1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.733381 Oct 04 11:20:59.819320 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3299/4533] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:20:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:20:59.832108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:20:59.834270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:59.843902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:59.844604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:59.845385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:59.846455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:59.847715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:59.848703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:59.876923 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Cannot 'resume' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action HTTP/1.1 Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 14 Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: {"resume": {}} Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'resume' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'resume': {}}} Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53d5329f-b493-4a25-a450-823121e8358a in vm_state active. Cannot resume while the instance is in this state. Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:59.879345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.883723 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:59.883723 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:59.883723 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:59.883723 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:59.883723 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:59.883723 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:20:59.883723 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.885566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 409 to user: Cannot 'resume' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:59.887141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d4fd2f4c-c43d-4ae4-bb9f-76b718041984 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 409 len: 144 microversion: 2.1 time: 0.066077 Oct 04 11:20:59.891272 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3300/4534] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:20:59 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 144 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:20:59.897165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:59.898390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] [instance: 549ab102-7419-4fc0-9aff-94764bc2bbd3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:59.906604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:59.907530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:59.908476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:59.909402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:59.910083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:59.910710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:59.927074 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] HTTP exception thrown: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 could not be found. Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Request method failure captured: Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 HTTP/1.1 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBTgBRUIG2PZwhMucIFfNOaJhTW8FRNIQ1AQlPUHsedqas9jqhU97pFlTmC2P_2shOaBN-8bL35S9FHJjJYbIeCD_ez18W4hC0WkHZcx5E4ieVl3tVGqOlHgOGrv88HoQLJEP_Q7QQgNCyQnnj2s-e36-frBPInLxKBQrBd3gNqVZkk Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df60449892d147adb43f4750c9b584d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df60449892d147adb43f4750c9b584d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df60449892d147adb43f4750c9b584d3"}]}] Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: df60449892d147adb43f4750c9b584d3 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1375002763 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2e4e772e6a5b41a0b0f836b374bc69b4 Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1375002763-project Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 could not be found. Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '549ab102-7419-4fc0-9aff-94764bc2bbd3'} Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 could not be found. Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 could not be found. Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:20:59.929045 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.934326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:20:59.934326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:20:59.934326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:20:59.934326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:20:59.934326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:20:59.934326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 could not be found. Oct 04 11:20:59.934326 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:20:59.935562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Returning 404 to user: Instance 549ab102-7419-4fc0-9aff-94764bc2bbd3 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:20:59.936794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c3d283b8-05a2-4b65-8d11-4a30160fe30d tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3" status: 404 len: 111 microversion: 2.1 time: 0.044231 Oct 04 11:20:59.941172 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3301/4535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:59 2022] GET /compute/v2.1/servers/549ab102-7419-4fc0-9aff-94764bc2bbd3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:20:59.946416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:20:59.947343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:20:59.954510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:59.955184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:59.956324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:20:59.957669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:20:59.958285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:20:59.958868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:00.229548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:00.241486 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5ee503f8-2f2c-4b26-ba2b-c280b27bbd24 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1315 microversion: 2.1 time: 0.298879 Oct 04 11:21:00.243120 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3302/4536] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:20:59 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:00.255883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:00.257935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:00.272438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:00.279450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:00.281293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:00.282340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:00.284372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:00.285692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:00.575328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:00.594153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:00.598894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:00.600172 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6480a4a9-58fb-4217-ad94-75a4c8e3d3e3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1722 microversion: 2.20 time: 0.353919 Oct 04 11:21:00.606886 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3303/4537] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:00 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:00.613511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-254bba5f-874d-42b4-a99e-fbb174f8fb8a req-933ae7be-1641-4218-ab45-f329f8ac6981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a92e38-7454-4d7f-84bd-056026c27be6", "tag": "dd8b90fa-963b-4011-a822-af38c7cf4918"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:00.643854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-254bba5f-874d-42b4-a99e-fbb174f8fb8a req-933ae7be-1641-4218-ab45-f329f8ac6981 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:00.644476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-254bba5f-874d-42b4-a99e-fbb174f8fb8a req-933ae7be-1641-4218-ab45-f329f8ac6981 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:00.644924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-254bba5f-874d-42b4-a99e-fbb174f8fb8a req-933ae7be-1641-4218-ab45-f329f8ac6981 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:00.661915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-254bba5f-874d-42b4-a99e-fbb174f8fb8a req-933ae7be-1641-4218-ab45-f329f8ac6981 service nova] Creating event network-changed:dd8b90fa-963b-4011-a822-af38c7cf4918 for instance 13a92e38-7454-4d7f-84bd-056026c27be6 on n-h2-791135-8 Oct 04 11:21:00.671430 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-254bba5f-874d-42b4-a99e-fbb174f8fb8a req-933ae7be-1641-4218-ab45-f329f8ac6981 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063016 Oct 04 11:21:00.672374 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3304/4538] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:00.688969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-faa0024e-d2e5-47a4-9ce9-49c3e8c4c020 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:00.690356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-faa0024e-d2e5-47a4-9ce9-49c3e8c4c020 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:00.830820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-faa0024e-d2e5-47a4-9ce9-49c3e8c4c020 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:00.838835 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-faa0024e-d2e5-47a4-9ce9-49c3e8c4c020 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1237 microversion: 2.1 time: 0.165022 Oct 04 11:21:00.858793 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3305/4539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:00 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1237 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:00.876559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:00.878095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:00.893701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:00.894676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:00.895390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:00.896799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:00.899209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:00.899965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:01.297553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:01.309574 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecfba409-68b4-46e6-b6a0-ca1778fdbd61 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.449280 Oct 04 11:21:01.310890 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3306/4540] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:00 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:01.324334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-288141d3-9b8b-4628-8052-261a586a22f6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] Calling method '.version_select at 0x7f71cf1ccdc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:01.375589 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-288141d3-9b8b-4628-8052-261a586a22f6 tempest-ServerActionsTestJSON-1375002763 tempest-ServerActionsTestJSON-1375002763-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114889091" status: 202 len: 0 microversion: 2.1 time: 0.063195 Oct 04 11:21:01.376632 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3307/4541] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:21:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114889091 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:21:01.476244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec8ddafb-f5a3-4fc0-ac7f-466fd18cebc5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Action: 'create', calling method: .version_select at 0x7f71cef38940>, body: {"keypair": {"name": "tempest-keypair-745833111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP23hUdaYU9xXqVNsvULpntjd2vrr8+2ltFnt1/XwhPWuZq7QesKs7wbb6fhDlGMRtGFhgZQZVT3h+sbwTEXW1oCGN0byhZ7BsCn+7akjPmi412IYsiE3WHcJjhLhdEkvw=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:01.500128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ec8ddafb-f5a3-4fc0-ac7f-466fd18cebc5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Getting quotas for project fc275d32d0924b5a9dbf627449391012. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:21:01.513002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-ec8ddafb-f5a3-4fc0-ac7f-466fd18cebc5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Getting quotas for user 865c85b1f3044ff092538d55abf5974b and project fc275d32d0924b5a9dbf627449391012. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:21:01.518935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:01.552004 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec8ddafb-f5a3-4fc0-ac7f-466fd18cebc5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173799 Oct 04 11:21:01.554313 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3308/4542] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:21:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:01.572715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:01.575011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:01.597074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:01.597736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:01.598100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:01.598839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:01.599637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:01.599755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:02.095594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:02.103970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28a1cd13-9ba7-4dc6-903b-fd0983c867dc tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1315 microversion: 2.1 time: 0.546139 Oct 04 11:21:02.124596 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3309/4543] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:01 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:02.129666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:02.130292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:02.142148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:02.142650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:02.143290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:02.144196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:02.144818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:02.145450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:02.359148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:02.372154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f6926ef7-183a-4653-a670-057c61bb5317 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.246124 Oct 04 11:21:02.387011 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3310/4544] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:02 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:02.393979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:02.394897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:02.414340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:02.415197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:02.415860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:02.416824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:02.420045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:02.422081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:02.652496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:02.666031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:02.667813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:02.669213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2edfefa4-732f-404f-8698-c2a8c85d5ae3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1743 microversion: 2.20 time: 0.281217 Oct 04 11:21:02.691865 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3311/4545] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:02 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1743 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:02.697100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:02.705602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:02.718227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:02.718897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:02.719521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:02.720389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:02.721330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:02.722050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:02.812791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:02.821683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbd50fa7-233c-4e91-b7dc-24b1f667bab6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1295 microversion: 2.1 time: 0.128335 Oct 04 11:21:02.822455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3312/4546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:02 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:02.827798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acd394c9-6fd1-4511-9786-254ab4f956f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acd394c9-6fd1-4511-9786-254ab4f956f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 160 Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "350c987a-5b2c-443d-b477-a345ff55756e"}]}} Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'networks': [{'uuid': '350c987a-5b2c-443d-b477-a345ff55756e'}]}}} Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '' Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:21:02.831596 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:21:02.835978 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:02.837582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acd394c9-6fd1-4511-9786-254ab4f956f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:02.838553 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-acd394c9-6fd1-4511-9786-254ab4f956f0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.014925 Oct 04 11:21:02.849096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3313/4547] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:21:02 2022] POST /compute/v2.1/servers => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:21:02.854707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:02.855733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:02.867691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:02.870805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:02.870805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:02.872005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:02.872682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:02.873690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:03.221463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:03.234255 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4d602cdf-7bfd-4854-9a5b-5802cc6698a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.383827 Oct 04 11:21:03.260995 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3314/4548] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:02 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:03.279091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:03.281637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:03.302386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:03.305328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:03.307219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:03.310551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:03.311098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:03.312110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:03.664845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:03.675577 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-83bc48b9-d4da-438a-a7e2-4b386d84f731 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1315 microversion: 2.1 time: 0.412706 Oct 04 11:21:03.694680 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3315/4549] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:03 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:03.708713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:03.710196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:03.725173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:03.725725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:03.726175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:03.732517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:03.733033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:03.733550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:04.069606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:04.087392 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18ebbbb6-2b31-4a72-8dcd-21a83223e520 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.391217 Oct 04 11:21:04.088215 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3316/4550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:03 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:04.093342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:04.093983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:04.111975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:04.112451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:04.112906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:04.113662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:04.114119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:04.114742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:04.561903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:04.580406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:04.586285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:04.587854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0dd6d0eb-8493-446e-91aa-67117e694c3c tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.498625 Oct 04 11:21:04.588875 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3317/4551] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:04 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:04.596226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:04.600295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:04.643516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:04.644165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:04.645872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:04.646959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:04.651013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:04.651815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:05.096252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:05.112494 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63374a49-6d27-459f-8e3c-d747432ae694 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1363 microversion: 2.1 time: 0.517765 Oct 04 11:21:05.113492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3318/4552] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:04 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:05.118234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-691f981c-2a2f-4db9-ac61-8657f4ab1706 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:05.122017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-691f981c-2a2f-4db9-ac61-8657f4ab1706 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: a7015308-3519-4d64-a013-071b7657313a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:05.132336 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-691f981c-2a2f-4db9-ac61-8657f4ab1706 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance a7015308-3519-4d64-a013-071b7657313a could not be found. Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-691f981c-2a2f-4db9-ac61-8657f4ab1706 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/a7015308-3519-4d64-a013-071b7657313a/action HTTP/1.1 Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 14 Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: {"shelve": {}} Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a7015308-3519-4d64-a013-071b7657313a could not be found. Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a7015308-3519-4d64-a013-071b7657313a', 'body': {'shelve': {}}} Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7015308-3519-4d64-a013-071b7657313a could not be found. Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7015308-3519-4d64-a013-071b7657313a could not be found. Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:05.147107 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:05.152420 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:21:05.152420 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:21:05.152420 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7015308-3519-4d64-a013-071b7657313a could not be found. Oct 04 11:21:05.152420 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:05.153477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-691f981c-2a2f-4db9-ac61-8657f4ab1706 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance a7015308-3519-4d64-a013-071b7657313a could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:05.154558 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-691f981c-2a2f-4db9-ac61-8657f4ab1706 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/a7015308-3519-4d64-a013-071b7657313a/action" status: 404 len: 111 microversion: 2.1 time: 0.040043 Oct 04 11:21:05.155665 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3319/4553] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:21:05 2022] POST /compute/v2.1/servers/a7015308-3519-4d64-a013-071b7657313a/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:21:05.160512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:05.161133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:05.179878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:05.180382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:05.180833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:05.181596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:05.182062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:05.182501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:05.220662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:05.678171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:05.688357 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10207994-c1ef-4254-9bc1-164d5930d166 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1315 microversion: 2.1 time: 0.531582 Oct 04 11:21:05.702686 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3320/4554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:05 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:05.711465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:05.712437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:05.720596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:05.723446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:05.724149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:05.725110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:05.728361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:05.729119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:06.774524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:06.790164 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d072071f-eb06-4a0b-8550-42f81bffc9d2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 1.083781 Oct 04 11:21:06.792049 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3321/4555] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:05 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:06.799070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:06.800008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:06.819185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:06.819933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:06.820485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:06.821319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:06.822002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:06.823830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:07.367545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:07.388819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:07.390640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:07.393078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1258a805-cc8d-4c59-8bb5-15af8ec7b8f4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.599237 Oct 04 11:21:07.397072 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3322/4556] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:06 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:07.407041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-9e3fc3b6-d6be-4e2f-8347-4c16c012b74c req-df71710b-4a00-47c7-aab6-72980cc69e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a92e38-7454-4d7f-84bd-056026c27be6", "name": "network-vif-plugged", "status": "completed", "tag": "dd8b90fa-963b-4011-a822-af38c7cf4918"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:07.426828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9e3fc3b6-d6be-4e2f-8347-4c16c012b74c req-df71710b-4a00-47c7-aab6-72980cc69e8c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:07.427746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9e3fc3b6-d6be-4e2f-8347-4c16c012b74c req-df71710b-4a00-47c7-aab6-72980cc69e8c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:07.428435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9e3fc3b6-d6be-4e2f-8347-4c16c012b74c req-df71710b-4a00-47c7-aab6-72980cc69e8c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:07.443570 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9e3fc3b6-d6be-4e2f-8347-4c16c012b74c req-df71710b-4a00-47c7-aab6-72980cc69e8c service nova] Creating event network-vif-plugged:dd8b90fa-963b-4011-a822-af38c7cf4918 for instance 13a92e38-7454-4d7f-84bd-056026c27be6 on n-h2-791135-8 Oct 04 11:21:07.456203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-9e3fc3b6-d6be-4e2f-8347-4c16c012b74c req-df71710b-4a00-47c7-aab6-72980cc69e8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056464 Oct 04 11:21:07.458249 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3323/4557] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:07.481459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:07.482184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:07.490175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:07.490752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:07.491462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:07.492195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:07.492666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:07.493210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:07.952456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:07.967418 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9877cb3-c758-47ba-8232-26feb1fc6dff tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1363 microversion: 2.1 time: 0.507632 Oct 04 11:21:07.982216 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3324/4558] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:07 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1363 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:07.994571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "46099594-bf16-4a4f-8f98-a2b4bfcf7e3f"}], "security_groups": [{"name": "tempest-securitygroup--171736173"}], "key_name": "tempest-keypair-745833111", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:08.452104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] validate_networks() for [('46099594-bf16-4a4f-8f98-a2b4bfcf7e3f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:21:09.497290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:21:09.498186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:21:09.498892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:21:09.499536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:21:09.500070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:21:09.522985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:09.523601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:09.524971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:09.525868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:09.526605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:09.527150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:09.558371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Getting quotas for project fc275d32d0924b5a9dbf627449391012. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:21:09.566715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Getting quotas for user 865c85b1f3044ff092538d55abf5974b and project fc275d32d0924b5a9dbf627449391012. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:21:09.587199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:21:09.589989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:21:09.681233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34252eb4-180e-4151-9365-0abd9cacf95d tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.696308 Oct 04 11:21:09.684986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3325/4559] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:21:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:21:09.697412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:09.698488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:09.709097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:09.709897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:09.710538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:09.711472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:09.712714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:09.713479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.032997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:10.043750 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1cd3653-d429-4b23-b082-4ccc670c41eb tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1315 microversion: 2.1 time: 0.356389 Oct 04 11:21:10.048605 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3326/4560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:09 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:10.069563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:10.070549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:10.076990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.077806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.078583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.079536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.080275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.081600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.328941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:10.343013 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d8143f5-1386-4715-91ba-eb901a150585 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.280101 Oct 04 11:21:10.343954 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3327/4561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:10 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:10.349491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a4823a07-060a-47f6-a751-f6c9d2d3cc3c req-77c6f411-61e5-4693-b893-dc8b741a8c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2", "tag": "9e055cbd-e1db-4998-bc21-f523ddd8968c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:10.360488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4823a07-060a-47f6-a751-f6c9d2d3cc3c req-77c6f411-61e5-4693-b893-dc8b741a8c33 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.361139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4823a07-060a-47f6-a751-f6c9d2d3cc3c req-77c6f411-61e5-4693-b893-dc8b741a8c33 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.361830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a4823a07-060a-47f6-a751-f6c9d2d3cc3c req-77c6f411-61e5-4693-b893-dc8b741a8c33 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.375875 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a4823a07-060a-47f6-a751-f6c9d2d3cc3c req-77c6f411-61e5-4693-b893-dc8b741a8c33 service nova] Creating event network-changed:9e055cbd-e1db-4998-bc21-f523ddd8968c for instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 on n-h1-791135-8 Oct 04 11:21:10.381794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a4823a07-060a-47f6-a751-f6c9d2d3cc3c req-77c6f411-61e5-4693-b893-dc8b741a8c33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036290 Oct 04 11:21:10.383297 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3328/4562] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:10.393178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:10.394171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:10.404461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.408007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.408705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.410532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.411198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.412262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.653632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:10.665170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:10.670818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:10.672768 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f15dd5a0-a348-4d9b-8203-062941297c5b tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.288078 Oct 04 11:21:10.673676 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3329/4563] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:10 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:10.683740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:10.684612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:10.697987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.700810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.701456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.702552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.704325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.704817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.883962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:10.895514 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a6fe4a4-84ce-4a7d-95c7-20b6b6f22250 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1363 microversion: 2.1 time: 0.219892 Oct 04 11:21:10.896127 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3330/4564] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:10 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:10.901611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-87b7cab0-a73c-4608-ad84-6b8cc1830540 req-0a883e37-1e34-499c-bfe9-3b6b52acf684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69337b0-3580-43cd-ac13-11f030e3804b", "name": "network-vif-plugged", "status": "completed", "tag": "a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:10.912945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-87b7cab0-a73c-4608-ad84-6b8cc1830540 req-0a883e37-1e34-499c-bfe9-3b6b52acf684 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.913826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-87b7cab0-a73c-4608-ad84-6b8cc1830540 req-0a883e37-1e34-499c-bfe9-3b6b52acf684 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.914413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-87b7cab0-a73c-4608-ad84-6b8cc1830540 req-0a883e37-1e34-499c-bfe9-3b6b52acf684 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.927331 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-87b7cab0-a73c-4608-ad84-6b8cc1830540 req-0a883e37-1e34-499c-bfe9-3b6b52acf684 service nova] Creating event network-vif-plugged:a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac for instance e69337b0-3580-43cd-ac13-11f030e3804b on n-h1-791135-8 Oct 04 11:21:10.945567 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-87b7cab0-a73c-4608-ad84-6b8cc1830540 req-0a883e37-1e34-499c-bfe9-3b6b52acf684 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038276 Oct 04 11:21:10.946372 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3331/4565] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:10.952400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:10.953183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:10.961020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.961646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.962307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:10.963040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:10.963551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:10.964091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:11.046818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:11.067434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7693cc18-5e3d-471d-9f67-e563340382f5 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1277 microversion: 2.1 time: 0.119405 Oct 04 11:21:11.071812 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3332/4566] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:10 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:11.077225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:11.078078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:11.084853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:11.085702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:11.086324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:11.087641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:11.088270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:11.088871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:11.129145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lazy-loading 'flavor' on Instance uuid 53d5329f-b493-4a25-a450-823121e8358a {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:21:11.561099 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-398688b2-504c-4f40-984a-158a4d8fbb8a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 202 len: 0 microversion: 2.1 time: 0.487475 Oct 04 11:21:11.567226 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3333/4567] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:21:11 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:21:11.583904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:11.585721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:11.596338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:11.597850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:11.598591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:11.599779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:11.600860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:11.601757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:12.407464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:12.425566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6160a6e1-df40-4b7f-9c97-e1ed8bbebb89 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1503 microversion: 2.1 time: 0.855438 Oct 04 11:21:12.439064 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3334/4568] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:11 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1503 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:12.458605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:12.459260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:12.473970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:12.477978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:12.478641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:12.479424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:12.482638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:12.483246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:12.859741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:12.878677 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-596eedfd-1e48-4aa1-b268-48034de16229 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1511 microversion: 2.1 time: 0.430471 Oct 04 11:21:12.879265 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3335/4569] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:12 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:12.884736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:12.890401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:12.899672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:12.903269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:12.903908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:12.904813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:12.905462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:12.906051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:13.821403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:13.834015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:13.835549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:13.836724 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9804596f-810a-439b-bde1-fb6efb356680 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.956257 Oct 04 11:21:13.845969 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3336/4570] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:12 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:13.850779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:13.851407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:13.866880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:13.867507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:13.868413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:13.869627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:13.870564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:13.870999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:14.251799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:14.257614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:14.270991 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9c7399e6-1072-4aa7-8725-fa4be7abacc8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1363 microversion: 2.1 time: 0.423118 Oct 04 11:21:14.271804 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3337/4571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:13 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:14.283090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:14.284007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:14.291515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:14.292052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:14.292487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:14.293188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:14.305057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:14.305610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:14.705852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:14.725061 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-42ae418a-6715-4e88-a653-fe7d92b0c170 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1350 microversion: 2.1 time: 0.451928 Oct 04 11:21:14.759909 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3338/4572] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:14 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1350 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:14.776026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:14.782921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:14.814079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:14.814594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:14.815044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:14.815773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:14.816231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:14.816655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:14.993037 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7ffb03b-ee4f-4b0c-818f-b8516f541f7f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.229748 Oct 04 11:21:14.993735 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3339/4573] 10.222.0.23 () {58 vars in 1296 bytes} [Tue Oct 4 11:21:14 2022] DELETE /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6/os-server-password => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:21:15.009599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:15.012260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:15.027924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.028357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.028802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:15.032022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.032510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.032957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:15.390279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:15.401589 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e116f351-4dad-4032-beb2-2ab2772d7025 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1511 microversion: 2.1 time: 0.401747 Oct 04 11:21:15.408159 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3340/4574] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:14 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:15.420871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:15.421951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:15.432499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.434077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.434893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:15.435946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.437044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.437796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:15.733867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:15.752428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:15.759170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:15.762186 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-05bc7d86-292f-43ff-b672-ee72e0ff6d67 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.350368 Oct 04 11:21:15.763802 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3341/4575] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:15 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:15.771128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f65b01c0-6c64-49d4-9520-228c8fcb3798 req-c765691e-9cd9-4484-9f82-76b3aeb9d5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2", "name": "network-vif-plugged", "status": "completed", "tag": "9e055cbd-e1db-4998-bc21-f523ddd8968c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:15.790964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f65b01c0-6c64-49d4-9520-228c8fcb3798 req-c765691e-9cd9-4484-9f82-76b3aeb9d5f4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.793118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f65b01c0-6c64-49d4-9520-228c8fcb3798 req-c765691e-9cd9-4484-9f82-76b3aeb9d5f4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.796033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f65b01c0-6c64-49d4-9520-228c8fcb3798 req-c765691e-9cd9-4484-9f82-76b3aeb9d5f4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:15.815599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f65b01c0-6c64-49d4-9520-228c8fcb3798 req-c765691e-9cd9-4484-9f82-76b3aeb9d5f4 service nova] Creating event network-vif-plugged:9e055cbd-e1db-4998-bc21-f523ddd8968c for instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 on n-h1-791135-8 Oct 04 11:21:15.821642 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f65b01c0-6c64-49d4-9520-228c8fcb3798 req-c765691e-9cd9-4484-9f82-76b3aeb9d5f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055382 Oct 04 11:21:15.824991 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3342/4576] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:15.833075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:15.833918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:15.846340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.847092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.847921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:15.849631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.850331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.851324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:15.885700 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9861c688-a023-4969-b33a-681fc063f62e tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.059037 Oct 04 11:21:15.887074 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3343/4577] 10.222.0.23 () {58 vars in 1293 bytes} [Tue Oct 4 11:21:15 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6/os-server-password => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:21:15.893672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:15.894598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:15.904596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.905195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.905748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:15.906563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:15.907227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:15.907577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:16.332115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:16.353286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a408018-fffc-40f1-9267-f85cc831374e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1363 microversion: 2.1 time: 0.464888 Oct 04 11:21:16.356043 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3344/4578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:15 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1363 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:16.370649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b1619e66-e5ea-4b31-8bce-a65e3f91cf17 req-93bd0a95-3843-4bbe-b2c0-7f94590a37cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a305ec7-6dc1-4d68-8b57-b0e9f7978813", "tag": "44570c15-3539-4d42-bab8-3e7a23e38f96"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:16.384113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1619e66-e5ea-4b31-8bce-a65e3f91cf17 req-93bd0a95-3843-4bbe-b2c0-7f94590a37cb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:16.384844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1619e66-e5ea-4b31-8bce-a65e3f91cf17 req-93bd0a95-3843-4bbe-b2c0-7f94590a37cb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:16.385503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b1619e66-e5ea-4b31-8bce-a65e3f91cf17 req-93bd0a95-3843-4bbe-b2c0-7f94590a37cb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:16.432658 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b1619e66-e5ea-4b31-8bce-a65e3f91cf17 req-93bd0a95-3843-4bbe-b2c0-7f94590a37cb service nova] Creating event network-changed:44570c15-3539-4d42-bab8-3e7a23e38f96 for instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 on n-h2-791135-8 Oct 04 11:21:16.444226 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b1619e66-e5ea-4b31-8bce-a65e3f91cf17 req-93bd0a95-3843-4bbe-b2c0-7f94590a37cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084236 Oct 04 11:21:16.445132 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3345/4579] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:16.453466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:16.460521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:16.472227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:16.472994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:16.476201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:16.477183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:16.477875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:16.478480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:16.971368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:16.984367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1da352c7-2764-49dc-9dc1-8a830af2a097 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1350 microversion: 2.1 time: 0.537743 Oct 04 11:21:16.985289 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3346/4580] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:16 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1350 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:16.989752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:16.990521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:16.996856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:16.997568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:16.998611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:16.999538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:17.000207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:17.001010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:17.032390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:21:17.166793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:17.177879 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5579c1f-0a86-401b-a6a6-519a081b0999 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 204 len: 0 microversion: 2.1 time: 0.191130 Oct 04 11:21:17.187861 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3347/4581] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:21:16 2022] DELETE /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:21:17.194558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:17.197203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:17.206691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:17.207570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:17.208242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:17.209205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:17.209914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:17.210574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:17.493466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:17.504761 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84f71ca4-d802-4052-94fb-704506f005c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1511 microversion: 2.1 time: 0.315322 Oct 04 11:21:17.529784 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3348/4582] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:17 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:17.534899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:17.535515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:17.552114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:17.552620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:17.553060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:17.553891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:17.554383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:17.554837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:17.752402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:17.763821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:17.765798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:17.767149 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4defc70-1a25-401f-b3fa-39f7e5e4d921 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.236297 Oct 04 11:21:17.780708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3349/4583] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:17 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:17.790533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:17.795339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:17.802929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:17.803823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:17.804481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:17.805600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:17.806279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:17.806993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:17.973889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:17.984372 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b995707b-9af6-49cc-97fb-4924631f100f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1509 microversion: 2.1 time: 0.202283 Oct 04 11:21:17.994867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3350/4584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:17 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:18.002493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:18.003429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:18.011549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:18.012125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:18.012633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:18.013470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:18.014022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:18.014508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:18.180270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:18.192856 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-10402d84-5f6f-49e4-a6c0-0fea756b69cb tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1549 microversion: 2.1 time: 0.196526 Oct 04 11:21:18.201488 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3351/4585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:17 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1549 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:18.215676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:18.221091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:18.231229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:18.231229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:18.231229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:18.234158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:18.234935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:18.235722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:18.434777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:18.450765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8832858-c36a-4ebb-957e-1126dfbfd223 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1350 microversion: 2.1 time: 0.246751 Oct 04 11:21:18.451754 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3352/4586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:18 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1350 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:18.459658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:18.460516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:18.474221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:18.475944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:18.476848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:18.478191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:18.478823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:18.479730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:18.503915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:18.648074 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfd57bc8-b113-4ff7-9f8f-ef4aaf227529 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194210 Oct 04 11:21:18.648786 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3353/4587] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:21:18 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:18.654799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:18.657593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:18.666639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:18.667910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:18.668055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:18.670366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:18.670914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:18.671558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:19.043528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:19.053385 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ef86ef75-ec1f-4a66-9e07-35401e263711 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1511 microversion: 2.1 time: 0.403421 Oct 04 11:21:19.069171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3354/4588] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:18 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:19.075567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:19.076378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:19.088277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:19.090011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:19.090606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:19.098132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:19.098823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:19.099455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:19.400498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:19.410686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:19.416560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:19.422727 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-74aab0c3-dad2-418a-96bc-ad26eaad431a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.348734 Oct 04 11:21:19.444725 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3355/4589] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:19 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:19.451692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:19.454080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:19.461116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:19.466798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:19.467506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:19.473770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:19.479888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:19.480377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:19.547567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:19.578219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=17 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:19.821766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:19.834424 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b1fe5e1c-6aec-4cf1-8e9f-3bbcb08a9dd2 tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1509 microversion: 2.1 time: 0.387117 Oct 04 11:21:19.840646 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3356/4590] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:19 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1509 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:19.863712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:19.866509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:19.880345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:19.881919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:19.883782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:19.884679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:19.888019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:19.890602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:20.650382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:20.660969 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aebe83c9-1008-415b-bd31-6e66141ce814 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1350 microversion: 2.1 time: 0.819152 Oct 04 11:21:20.668874 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3357/4591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:19 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1350 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:20.684623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:20.685243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:20.711664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:20.712169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:20.712609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:20.713333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:20.734223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:20.734972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:21.113202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:21.126147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b289baee-2232-42ae-8e12-398acba7ef31 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1511 microversion: 2.1 time: 0.456033 Oct 04 11:21:21.127188 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3358/4592] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:20 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1511 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:21.137311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:21.147376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:21.161054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:21.161590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:21.165040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:21.165805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:21.166279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:21.167267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:21.881702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:21.899787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:21.902708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:21.906642 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1986c0b5-6c04-40e3-92f0-9272b8a44efa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.777252 Oct 04 11:21:21.931564 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3359/4593] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:21 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:21.942117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:21.942810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:21.959093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:21.959612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:21.960028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:21.960824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:21.963133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:21.964341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:22.288551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee29e1d9407c499daf39d8e165d47ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db18ff0e0db646b9accae7185441d58d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:22.309529 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d738e23-9027-4ab8-8031-800b7a8b435c tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 200 len: 1467 microversion: 2.1 time: 0.376688 Oct 04 11:21:22.314909 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3360/4594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:21 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 1467 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:22.323431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-122ba6a6-5925-4226-a6f0-864b83ac3d79 req-5ad3a6e1-d9a1-46a7-a9ab-607722bcdced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2", "tag": "9e055cbd-e1db-4998-bc21-f523ddd8968c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:22.378170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-122ba6a6-5925-4226-a6f0-864b83ac3d79 req-5ad3a6e1-d9a1-46a7-a9ab-607722bcdced service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:22.378808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-122ba6a6-5925-4226-a6f0-864b83ac3d79 req-5ad3a6e1-d9a1-46a7-a9ab-607722bcdced service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:22.380044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-122ba6a6-5925-4226-a6f0-864b83ac3d79 req-5ad3a6e1-d9a1-46a7-a9ab-607722bcdced service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:22.402146 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-122ba6a6-5925-4226-a6f0-864b83ac3d79 req-5ad3a6e1-d9a1-46a7-a9ab-607722bcdced service nova] Creating event network-changed:9e055cbd-e1db-4998-bc21-f523ddd8968c for instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 on n-h1-791135-8 Oct 04 11:21:22.409045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-122ba6a6-5925-4226-a6f0-864b83ac3d79 req-5ad3a6e1-d9a1-46a7-a9ab-607722bcdced service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091751 Oct 04 11:21:22.410396 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3361/4595] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:22.441099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:22.443101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:22.456376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:22.457445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:22.458091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:22.459250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:22.461685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:22.462394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:23.391791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:23.409199 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a564064-64a9-4edc-9b4f-e9a2df23ec9f tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1350 microversion: 2.1 time: 0.992194 Oct 04 11:21:23.412658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3362/4596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:22 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1350 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:23.446645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:23.452832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:23.470035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:23.472571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:23.473255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:23.478596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:23.479956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:23.480591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:24.061239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:24.070525 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9fcc018a-83c7-4615-b269-cb67bfa5fa95 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1532 microversion: 2.1 time: 0.656434 Oct 04 11:21:24.071384 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3363/4597] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:23 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1532 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:24.078939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:24.079938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:24.087434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:24.088241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:24.089490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:24.090442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:24.091170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:24.091838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:24.102022 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:21:24.102815 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:21:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:21:24.361343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:24.371491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:24.379562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:24.381751 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-47b63395-7b24-4cdf-9f46-ef357ecf8829 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1738 microversion: 2.20 time: 0.308300 Oct 04 11:21:24.383178 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3364/4598] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:24 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:24.395649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:24.396338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] [instance: 13a92e38-7454-4d7f-84bd-056026c27be6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:24.411521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:24.412026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:24.414680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:24.415719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:24.419381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:24.420348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:24.465143 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] HTTP exception thrown: Instance 13a92e38-7454-4d7f-84bd-056026c27be6 could not be found. Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Request method failure captured: Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 HTTP/1.1 Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcMsthQDzGCMezUlCDp2BVClW7sPn5M5k9upO-xr1tcLrtfayU4C6gldVsHiypE2gyZCms-4GDo12b3Tu7GhiJo6Q2MOdn8vLI7HR1KvRxpNKIsBp7hF3MIpBGNaWAKFWDFxQta97dHzX6ZxBsLKTudPeBtd9uaXOPEp-ox_99vtSA Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: db18ff0e0db646b9accae7185441d58d Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerPasswordTestJSON-783004251 Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_db18ff0e0db646b9accae7185441d58d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db18ff0e0db646b9accae7185441d58d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/db18ff0e0db646b9accae7185441d58d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/db18ff0e0db646b9accae7185441d58d"}]}] Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerPasswordTestJSON-783004251 Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: db18ff0e0db646b9accae7185441d58d Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerPasswordTestJSON-783004251 Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerPasswordTestJSON-783004251-project Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: ee29e1d9407c499daf39d8e165d47ec9 Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerPasswordTestJSON-783004251-project Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 13a92e38-7454-4d7f-84bd-056026c27be6 could not be found. Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '13a92e38-7454-4d7f-84bd-056026c27be6'} Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a92e38-7454-4d7f-84bd-056026c27be6 could not be found. Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a92e38-7454-4d7f-84bd-056026c27be6 could not be found. Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:24.469383 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:24.474663 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:24.474663 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:24.474663 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:24.474663 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:21:24.474663 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:21:24.474663 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a92e38-7454-4d7f-84bd-056026c27be6 could not be found. Oct 04 11:21:24.474663 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:24.474663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] Returning 404 to user: Instance 13a92e38-7454-4d7f-84bd-056026c27be6 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:24.478357 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1899744-1580-427a-8466-bab5ac7c026f tempest-ServerPasswordTestJSON-783004251 tempest-ServerPasswordTestJSON-783004251-project] 10.222.0.23 "GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6" status: 404 len: 111 microversion: 2.1 time: 0.091143 Oct 04 11:21:24.480248 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3365/4599] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:24 2022] GET /compute/v2.1/servers/13a92e38-7454-4d7f-84bd-056026c27be6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:21:24.494246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db8c9f2b-43aa-447f-96d4-1e407651797e"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:24.501456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:24.517460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:24.519140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:24.520507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:24.522227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:24.524554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:24.527083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:25.108193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a18282f5-1b48-49d2-bab5-fec040818ca5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626573 Oct 04 11:21:25.108816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3366/4600] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:21:24 2022] POST /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:25.138077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:25.141459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:25.161576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:25.162435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:25.162991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:25.163896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:25.164519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:25.165835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:25.568450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:25.598117 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75d76934-396b-4d03-ab19-ee631a64173c tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1350 microversion: 2.1 time: 0.483757 Oct 04 11:21:25.598724 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3367/4601] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:25 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1350 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:25.624635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a8754c04-9033-45ed-aa94-6ed8b6a75824 req-b0094573-eb7d-4475-9876-54a73d49db20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a92e38-7454-4d7f-84bd-056026c27be6", "name": "network-vif-deleted", "tag": "dd8b90fa-963b-4011-a822-af38c7cf4918"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:25.652539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a8754c04-9033-45ed-aa94-6ed8b6a75824 req-b0094573-eb7d-4475-9876-54a73d49db20 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:25.653024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a8754c04-9033-45ed-aa94-6ed8b6a75824 req-b0094573-eb7d-4475-9876-54a73d49db20 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:25.653487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a8754c04-9033-45ed-aa94-6ed8b6a75824 req-b0094573-eb7d-4475-9876-54a73d49db20 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:25.681019 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a8754c04-9033-45ed-aa94-6ed8b6a75824 req-b0094573-eb7d-4475-9876-54a73d49db20 service nova] Creating event network-vif-deleted:dd8b90fa-963b-4011-a822-af38c7cf4918 for instance 13a92e38-7454-4d7f-84bd-056026c27be6 on n-h2-791135-8 Oct 04 11:21:25.694421 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a8754c04-9033-45ed-aa94-6ed8b6a75824 req-b0094573-eb7d-4475-9876-54a73d49db20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082790 Oct 04 11:21:25.696458 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3368/4602] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:25.706548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-eec2ee9b-617a-4146-8a5c-a32ebdadbbf7 req-744b67b1-804c-4cdc-8f24-3c74029e18a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a305ec7-6dc1-4d68-8b57-b0e9f7978813", "name": "network-vif-plugged", "status": "completed", "tag": "44570c15-3539-4d42-bab8-3e7a23e38f96"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:25.728894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eec2ee9b-617a-4146-8a5c-a32ebdadbbf7 req-744b67b1-804c-4cdc-8f24-3c74029e18a0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:25.729432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eec2ee9b-617a-4146-8a5c-a32ebdadbbf7 req-744b67b1-804c-4cdc-8f24-3c74029e18a0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:25.729861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eec2ee9b-617a-4146-8a5c-a32ebdadbbf7 req-744b67b1-804c-4cdc-8f24-3c74029e18a0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:25.757893 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-eec2ee9b-617a-4146-8a5c-a32ebdadbbf7 req-744b67b1-804c-4cdc-8f24-3c74029e18a0 service nova] Creating event network-vif-plugged:44570c15-3539-4d42-bab8-3e7a23e38f96 for instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 on n-h2-791135-8 Oct 04 11:21:25.770288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-eec2ee9b-617a-4146-8a5c-a32ebdadbbf7 req-744b67b1-804c-4cdc-8f24-3c74029e18a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071683 Oct 04 11:21:25.771491 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3369/4603] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:25.779101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:25.780069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:25.788691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:25.789435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:25.790023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:25.791129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:25.791785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:25.792365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:26.443260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:26.457981 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a512973-398a-4bc1-a603-e2655cb86281 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.685070 Oct 04 11:21:26.459133 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3370/4604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:25 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:26.469563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:26.479563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:26.486120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:26.486809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:26.489574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:26.490654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:26.493232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:26.493892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:26.569108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:26.834314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:26.851528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:26.853873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:26.855076 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bac1b6dd-bef0-4195-941c-112bde43201e tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1720 microversion: 2.20 time: 0.394691 Oct 04 11:21:26.888063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3371/4605] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:26 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1720 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:26.903517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:26.904141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:26.933661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:26.934155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:26.934588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:26.935295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:26.935745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:26.936168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:27.608402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:27.629605 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a95faf7e-972a-468a-aa30-958139079b72 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1350 microversion: 2.1 time: 0.740051 Oct 04 11:21:27.631341 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3372/4606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:26 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1350 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:27.645829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:27.646731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:27.668739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:27.670421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:27.672518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:27.673525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:27.674945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:27.675577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:28.759376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:28.768922 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-566ad2e1-2f78-4717-acbe-1694ddb3cf2a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 1.136147 Oct 04 11:21:28.775684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3373/4607] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:27 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:28.787130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:28.791384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:28.809387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:28.811703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:28.812158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:28.812879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:28.813337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:28.813784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:29.469570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:29.484132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:29.486087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:29.487482 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2354ee1-a3b3-4553-a06d-7d1112c9acf8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1720 microversion: 2.20 time: 0.710465 Oct 04 11:21:29.492190 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3374/4608] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:28 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1720 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:29.500051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:29.512684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:29.531420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:29.534791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:29.535417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:29.542175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:29.544508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:29.545146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:30.081618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:30.104765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c097b06f-a12d-4c7a-a818-605ac389f8d7 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1541 microversion: 2.1 time: 0.605611 Oct 04 11:21:30.121885 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3375/4609] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:29 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1541 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:30.128270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b093daeb-e227-47f6-83d7-f58c8145276e req-0f57e83d-e5cd-4043-93e8-086b300e78b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d5329f-b493-4a25-a450-823121e8358a", "name": "network-vif-plugged", "status": "completed", "tag": "e7754be9-28f5-4ac8-8494-76e4d61e21a4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:30.140596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b093daeb-e227-47f6-83d7-f58c8145276e req-0f57e83d-e5cd-4043-93e8-086b300e78b7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:30.141272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b093daeb-e227-47f6-83d7-f58c8145276e req-0f57e83d-e5cd-4043-93e8-086b300e78b7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:30.142300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b093daeb-e227-47f6-83d7-f58c8145276e req-0f57e83d-e5cd-4043-93e8-086b300e78b7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:30.167517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b093daeb-e227-47f6-83d7-f58c8145276e req-0f57e83d-e5cd-4043-93e8-086b300e78b7 service nova] Creating event network-vif-plugged:e7754be9-28f5-4ac8-8494-76e4d61e21a4 for instance 53d5329f-b493-4a25-a450-823121e8358a on n-h1-791135-8 Oct 04 11:21:30.173850 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b093daeb-e227-47f6-83d7-f58c8145276e req-0f57e83d-e5cd-4043-93e8-086b300e78b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050444 Oct 04 11:21:30.175063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3376/4610] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:30.182257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:30.183324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:30.199807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:30.200656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:30.201252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:30.202261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:30.205623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:30.206320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:30.629371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:30.642572 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4ac5aae-c05c-4a82-ae0a-e92b3c711e67 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.465935 Oct 04 11:21:30.649685 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3377/4611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:30 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:30.679237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:30.682212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:30.714878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:30.716301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:30.719407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:30.720454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:30.723690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:30.728686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:30.985736 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf830c2e-9a3f-4431-b0c1-42ae91493127 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.332030 Oct 04 11:21:30.986568 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3378/4612] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:21:30 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813/os-interface => generated 285 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:31.012034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:31.012034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:31.019121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:31.019619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:31.021464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:31.031345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:31.032996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:31.034267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:31.654251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:31.663709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:31.670856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:31.675485 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecd13c3f-ed98-46a3-b8cf-f596784e3cc9 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1663 microversion: 2.20 time: 0.680866 Oct 04 11:21:31.681859 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3379/4613] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:30 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1663 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:32.219941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-190377031", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "79c04f0c-f6fe-4565-926a-d28d8b9c77cb"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:32.350336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] validate_networks() for [('79c04f0c-f6fe-4565-926a-d28d8b9c77cb', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:21:33.667904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:21:33.669139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:21:33.669813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:21:33.670394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:21:33.671761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:21:33.690498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:33.692472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:33.693939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:33.694885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:33.698378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:33.699130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:33.757039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Getting quotas for project a88d5cab3f9c4df6923af8029d788b4d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:21:33.771513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Getting quotas for user 244a0f0ff30d47739825b781ee5cca12 and project a88d5cab3f9c4df6923af8029d788b4d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:21:33.806674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:21:33.810169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:21:33.911124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f778e9ae-1185-437e-b45e-fe535d8a1366 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.215961 Oct 04 11:21:33.920288 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3380/4614] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:21:33.932720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:33.933390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:33.941123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:33.941879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:33.942774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:33.943943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:33.944620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:33.945215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:34.383442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:34.394884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-305c8251-3ce6-4dc1-8ab2-cb8aa97bde81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.473413 Oct 04 11:21:34.411673 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3381/4615] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:33 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:34.436080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b579da7-3d03-49ae-afc1-5949f4badeda"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:34.449737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:34.462679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:34.467275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:34.468398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:34.469378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:34.472633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:34.474860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:35.372223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c904100e-548d-4831-a35e-3e6b49faadfc tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.952806 Oct 04 11:21:35.382063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3382/4616] 10.222.0.23 () {62 vars in 1364 bytes} [Tue Oct 4 11:21:34 2022] POST /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/os-volume_attachments => generated 188 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:21:35.388842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-944d577a-bd1e-44a9-b3fb-edc2dc313c1b req-68b750a5-99f2-4991-b8c8-1ce8a4eba5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69337b0-3580-43cd-ac13-11f030e3804b", "name": "network-vif-unplugged", "status": "completed", "tag": "a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:35.404215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-944d577a-bd1e-44a9-b3fb-edc2dc313c1b req-68b750a5-99f2-4991-b8c8-1ce8a4eba5b2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:35.405053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-944d577a-bd1e-44a9-b3fb-edc2dc313c1b req-68b750a5-99f2-4991-b8c8-1ce8a4eba5b2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:35.405773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-944d577a-bd1e-44a9-b3fb-edc2dc313c1b req-68b750a5-99f2-4991-b8c8-1ce8a4eba5b2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:35.423004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.server_external_events [req-944d577a-bd1e-44a9-b3fb-edc2dc313c1b req-68b750a5-99f2-4991-b8c8-1ce8a4eba5b2 service nova] Unable to find a host for instance e69337b0-3580-43cd-ac13-11f030e3804b. Dropping event network-vif-unplugged {{(pid=122409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 11:21:35.424296 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-944d577a-bd1e-44a9-b3fb-edc2dc313c1b req-68b750a5-99f2-4991-b8c8-1ce8a4eba5b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040967 Oct 04 11:21:35.426482 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3383/4617] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 11:21:35.432867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:35.433757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:35.441905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:35.443198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:35.443969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:35.444946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:35.445673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:35.446373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:35.752747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:35.785677 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e82eb1c6-79ec-44f3-84b8-4b32cff08271 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1212 microversion: 2.1 time: 0.354969 Oct 04 11:21:35.814951 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3384/4618] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:35 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1212 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:35.841099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c5b7d7af-ba41-4fc2-83a4-78a938169da0 req-8e7ab9ed-ee77-4e15-9925-e5ed0aa4aa03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a305ec7-6dc1-4d68-8b57-b0e9f7978813", "tag": "44570c15-3539-4d42-bab8-3e7a23e38f96"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:35.911794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5b7d7af-ba41-4fc2-83a4-78a938169da0 req-8e7ab9ed-ee77-4e15-9925-e5ed0aa4aa03 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:35.912222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5b7d7af-ba41-4fc2-83a4-78a938169da0 req-8e7ab9ed-ee77-4e15-9925-e5ed0aa4aa03 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:35.912653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5b7d7af-ba41-4fc2-83a4-78a938169da0 req-8e7ab9ed-ee77-4e15-9925-e5ed0aa4aa03 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:35.987401 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c5b7d7af-ba41-4fc2-83a4-78a938169da0 req-8e7ab9ed-ee77-4e15-9925-e5ed0aa4aa03 service nova] Creating event network-changed:44570c15-3539-4d42-bab8-3e7a23e38f96 for instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 on n-h2-791135-8 Oct 04 11:21:36.008483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c5b7d7af-ba41-4fc2-83a4-78a938169da0 req-8e7ab9ed-ee77-4e15-9925-e5ed0aa4aa03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190498 Oct 04 11:21:36.016569 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3385/4619] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:36.039934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:36.060000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:36.080089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:36.087154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:36.087722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:36.093186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:36.097068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:36.099684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:36.468022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:36.478782 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ed0575d-4fb8-45c2-811a-962a92235b29 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.457379 Oct 04 11:21:36.483479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3386/4620] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:36 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:36.499209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:36.516279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:36.545988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:36.549513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:36.550234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:36.551207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:36.553168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:36.554381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:36.921298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:37.484671 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1de0092-6d1c-4ae6-9175-c88f3359d183 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/os-volume_attachments/6b579da7-3d03-49ae-afc1-5949f4badeda" status: 202 len: 0 microversion: 2.20 time: 0.999839 Oct 04 11:21:37.486295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3387/4621] 10.222.0.23 () {60 vars in 1457 bytes} [Tue Oct 4 11:21:36 2022] DELETE /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/os-volume_attachments/6b579da7-3d03-49ae-afc1-5949f4badeda => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:21:37.496773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:37.497094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:37.525309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:37.526506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:37.526792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:37.527508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:37.527961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:37.535579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:37.797073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:37.817833 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-489578bf-a46c-457b-b2dc-202bd9acf2a6 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1274 microversion: 2.1 time: 0.325907 Oct 04 11:21:37.820608 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3388/4622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:37 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1274 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:37.836800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:37.851803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:37.880850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:37.886938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:37.888552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:37.890950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:37.893739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:37.896259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:37.897072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:38.534072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:38.577314 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2311118-c40e-46c4-a920-317f16bcaf91 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.752768 Oct 04 11:21:38.583794 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3389/4623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:37 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:38.590611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:38.591443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:38.600285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:38.601167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:38.602087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:38.602978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:38.604362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:38.605861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:39.382827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122409) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 11:21:39.658972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e5e511ee-c6e5-41d8-985c-4f0dddfa94ea tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "POST /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/action" status: 202 len: 0 microversion: 2.20 time: 1.071143 Oct 04 11:21:39.662800 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3390/4624] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:21:38 2022] POST /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/action => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:21:39.675694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:39.677823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:39.697700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:39.698364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:39.700359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:39.703798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:39.707888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:39.708643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:39.838568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:39.855275 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb9e4279-56f9-429c-ab78-b82d30f32eaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1274 microversion: 2.1 time: 0.191021 Oct 04 11:21:39.856572 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3391/4625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:39 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:39.874450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:39.875411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:39.887732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:39.888498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:39.889180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:39.890193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:39.890866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:39.891548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:40.121421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:40.132458 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49403dc1-91ab-439e-b614-9dc0e92342b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.274789 Oct 04 11:21:40.133056 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3392/4626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:39 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:40.139677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:40.140230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:40.149999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:40.150559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:40.151004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:40.154723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:40.163546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:40.164073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:40.535878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:40.580921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:40.584213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:40.588883 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1671 microversion: 2.20 time: 0.451534 Oct 04 11:21:40.590019 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3393/4627] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:40 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1671 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:40.592530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:40.595303 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd5cf10c-25e9-44ef-89d3-70239ff00bf3 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001375 Oct 04 11:21:40.595806 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3394/4628] 10.222.0.23 () {56 vars in 886 bytes} [Tue Oct 4 11:21:40 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 11:21:40.883622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:40.884174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:40.895297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:40.895807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:40.896260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:40.897065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:40.897527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:40.907717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:41.570378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:41.580126 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-080e99ed-e103-47b0-9eb0-96a297e5efef tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.701457 Oct 04 11:21:41.580728 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3395/4629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:40 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:21:41.620568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:41.628432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:41.644466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:41.644995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:41.645580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:41.646303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:41.653337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:41.654060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:42.131149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:42.146752 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1af8c51d-2fd9-440c-b013-78c105604628 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.534339 Oct 04 11:21:42.147928 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3396/4630] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:41 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:42.161234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:42.162161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:42.170806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:42.173957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:42.174638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:42.178246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:42.178905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:42.179640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:42.821115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:42.834467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:42.845892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:42.848707 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd939d8a-58a1-4135-8c54-b23a2e5dabbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1671 microversion: 2.20 time: 0.699534 Oct 04 11:21:42.853690 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3397/4631] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:42 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1671 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:42.865506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2edce9d2-d3e2-4918-865d-b56dc3594efa req-0f5a58f9-6584-4eaa-9dc8-82b6ebba40c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba7b0fd-23bc-43e8-90f2-84e6a985f90c", "tag": "ee64dc9a-defa-4fc3-9ee6-8b7f1f75ba0a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:42.901977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2edce9d2-d3e2-4918-865d-b56dc3594efa req-0f5a58f9-6584-4eaa-9dc8-82b6ebba40c9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:42.908811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2edce9d2-d3e2-4918-865d-b56dc3594efa req-0f5a58f9-6584-4eaa-9dc8-82b6ebba40c9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:42.915922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2edce9d2-d3e2-4918-865d-b56dc3594efa req-0f5a58f9-6584-4eaa-9dc8-82b6ebba40c9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:42.938907 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2edce9d2-d3e2-4918-865d-b56dc3594efa req-0f5a58f9-6584-4eaa-9dc8-82b6ebba40c9 service nova] Creating event network-changed:ee64dc9a-defa-4fc3-9ee6-8b7f1f75ba0a for instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c on n-h2-791135-8 Oct 04 11:21:42.949470 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2edce9d2-d3e2-4918-865d-b56dc3594efa req-0f5a58f9-6584-4eaa-9dc8-82b6ebba40c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093374 Oct 04 11:21:42.953130 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3398/4632] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:42.961133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:42.966110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:42.981667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:42.982507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:42.983207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:42.985375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:42.985989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:42.988376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:43.258153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:43.272266 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1eb8c466-c74b-4a1c-8e77-f21f90e717a8 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.314475 Oct 04 11:21:43.273076 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3399/4633] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:42 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:43.284160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:43.285187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:43.296842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:43.297806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:43.298493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:43.299521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:43.300506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:43.301418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:43.465568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:43.476358 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5fb306ad-b77b-41b4-a9bb-372d879f639d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.198929 Oct 04 11:21:43.477510 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3400/4634] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:43 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:43.880141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:43.880938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:43.884615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:43.885298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:43.904240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:43.904620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:43.905071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:43.914237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:43.914769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:43.915235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:44.252604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:44.261475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:44.262934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:44.264139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-54dee95e-fe49-4185-ae7d-34f71bc8eee0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.388105 Oct 04 11:21:44.265025 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3401/4635] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:43 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:21:44.276480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:44.278862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:44.298272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:44.303148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:44.303729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:44.309639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:44.310479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:44.311459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:44.345638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lazy-loading 'flavor' on Instance uuid 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:21:44.453921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:44.556595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-884aa110-bbb2-475d-9c1f-e8cbe895cf0d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/action" status: 200 len: 32 microversion: 2.1 time: 0.290141 Oct 04 11:21:44.558186 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3402/4636] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:21:44 2022] POST /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/action => generated 32 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:21:44.744158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4c9703d-909a-4d8c-9d6e-b326a0f2f75f tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Action: 'create', calling method: .version_select at 0x7f71d4580310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-886647694", "metadata": {"Type": "work"}}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4c9703d-909a-4d8c-9d6e-b326a0f2f75f tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Request method failure captured: Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 121 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdIvYzfzFmHskizlKwMo2sk82NTonWTGcXJ2FtYjrwmPTlknLM0xwZfLTwqvKpiXXjFEGgyHZI0Lg0wq7uaOPiCF6DhpY2WAXZn__PlZAR0O1SCAo9CoajAoLV1j5K45R9owOrJn9GqD89o8eBM3aqoJj6fq3uhKglrbmxmgfALOws Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd73d869df0b405787d2e89c5a245f29"}]}] Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f0ace6b6b90e421fb97693797ba5709f Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-886647694", "metadata": {"Type": "work"}}} Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-886647694', 'metadata': {'Type': 'work'}}}} Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:21:44.750425 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4c9703d-909a-4d8c-9d6e-b326a0f2f75f tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4c9703d-909a-4d8c-9d6e-b326a0f2f75f tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.193417 Oct 04 11:21:44.755581 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3403/4637] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Oct 4 11:21:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:21:44.766255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:44.767485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:44.781263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:44.782090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:44.782724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:44.783631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:44.784284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:44.784905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:44.990373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:45.000516 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ccd16dad-698d-4a1e-bbec-705cedaa838a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.243467 Oct 04 11:21:45.002273 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3404/4638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:44 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:45.008690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:45.009761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:45.019239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:45.020130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:45.020921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:45.022233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:45.022702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:45.023187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:45.309025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:45.324026 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82ba1ac1-dc63-47e8-9ac1-17edfcdd06b9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.319600 Oct 04 11:21:45.324765 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3405/4639] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:45 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:45.336966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:45.338436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:45.344964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:45.345857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:45.346475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:45.347400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:45.348040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:45.348640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:45.651948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:45.669934 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-17af7a05-eddb-4c59-986c-474dd489e07d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.338209 Oct 04 11:21:45.673225 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3406/4640] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:45 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:45.690769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d8bdb25-8ee4-42b2-80bc-f4b1292dc70a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Action: 'create', calling method: .version_select at 0x7f71cef110d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1353699637", "metadata": {"Type": "work"}}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d8bdb25-8ee4-42b2-80bc-f4b1292dc70a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Request method failure captured: Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 120 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdIvYzfzFmHskizlKwMo2sk82NTonWTGcXJ2FtYjrwmPTlknLM0xwZfLTwqvKpiXXjFEGgyHZI0Lg0wq7uaOPiCF6DhpY2WAXZn__PlZAR0O1SCAo9CoajAoLV1j5K45R9owOrJn9GqD89o8eBM3aqoJj6fq3uhKglrbmxmgfALOws Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd73d869df0b405787d2e89c5a245f29"}]}] Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f0ace6b6b90e421fb97693797ba5709f Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1353699637", "metadata": {"Type": "work"}}} Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1353699637', 'metadata': {'Type': 'work'}}}} Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '0' Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:21:45.703971 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 11:21:45.709005 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:45.710908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d8bdb25-8ee4-42b2-80bc-f4b1292dc70a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:45.713963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d8bdb25-8ee4-42b2-80bc-f4b1292dc70a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.039433 Oct 04 11:21:45.716303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3407/4641] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Oct 4 11:21:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:21:45.734430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:45.736356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:45.759305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:45.760801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:45.762982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:45.764599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:45.765980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:45.770081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:46.156830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:46.168544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:46.171472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:46.173096 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-118ed3ed-2780-4937-ac0c-2aa864e23062 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.454759 Oct 04 11:21:46.174201 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3408/4642] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:45 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:46.190121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33be07e1-4dd2-456d-ae4e-1309902d39eb tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Action: 'create', calling method: .version_select at 0x7f71d4eeda60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1841309958", "metadata": {"Type": "work"}}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33be07e1-4dd2-456d-ae4e-1309902d39eb tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Request method failure captured: Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 119 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdIvYzfzFmHskizlKwMo2sk82NTonWTGcXJ2FtYjrwmPTlknLM0xwZfLTwqvKpiXXjFEGgyHZI0Lg0wq7uaOPiCF6DhpY2WAXZn__PlZAR0O1SCAo9CoajAoLV1j5K45R9owOrJn9GqD89o8eBM3aqoJj6fq3uhKglrbmxmgfALOws Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd73d869df0b405787d2e89c5a245f29"}]}] Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f0ace6b6b90e421fb97693797ba5709f Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1841309958", "metadata": {"Type": "work"}}} Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1841309958', 'metadata': {'Type': 'work'}}}} Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '' Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:21:46.196096 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 11:21:46.200201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.204783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-33be07e1-4dd2-456d-ae4e-1309902d39eb tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:46.209953 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-33be07e1-4dd2-456d-ae4e-1309902d39eb tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033812 Oct 04 11:21:46.210860 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3409/4643] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Oct 4 11:21:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:21:46.221090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:46.225046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:46.239705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:46.240712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:46.241524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:46.242430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:46.243073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:46.243689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:46.489231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:46.500749 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f68e40c7-6948-4052-8a0e-da4bd8d0bcaa tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.288453 Oct 04 11:21:46.522141 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3410/4644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:46 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:46.529205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f684fe7c-7a59-46c0-9e38-1c746422e01a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Calling method '.version_select at 0x7f71d45804c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:46.600329 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f684fe7c-7a59-46c0-9e38-1c746422e01a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] HTTP exception thrown: Volume tempest-invalid-1375787660 could not be found. Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f684fe7c-7a59-46c0-9e38-1c746422e01a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Request method failure captured: Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1375787660 HTTP/1.1 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdIvYzfzFmHskizlKwMo2sk82NTonWTGcXJ2FtYjrwmPTlknLM0xwZfLTwqvKpiXXjFEGgyHZI0Lg0wq7uaOPiCF6DhpY2WAXZn__PlZAR0O1SCAo9CoajAoLV1j5K45R9owOrJn9GqD89o8eBM3aqoJj6fq3uhKglrbmxmgfALOws Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd73d869df0b405787d2e89c5a245f29"}]}] Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f0ace6b6b90e421fb97693797ba5709f Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: exception: Volume tempest-invalid-1375787660 could not be found. Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'tempest-invalid-1375787660'} Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1375787660 could not be found. (HTTP 404) (Request-ID: req-15c24063-0ce7-4edd-af98-4a0375fbb6f2) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:21:46.602472 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1375787660 could not be found. Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1375787660 could not be found. Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1375787660 could not be found. Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f684fe7c-7a59-46c0-9e38-1c746422e01a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Returning 404 to user: Volume tempest-invalid-1375787660 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f684fe7c-7a59-46c0-9e38-1c746422e01a tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1375787660" status: 404 len: 99 microversion: 2.1 time: 0.081070 Oct 04 11:21:46.607933 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3411/4645] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:21:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1375787660 => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:21:46.624428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:46.625148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:46.670973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:46.672156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:46.672890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:46.676654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:46.677767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:46.679238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:47.075868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:47.089090 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35c33837-a218-4515-ad60-e4338ce2efe8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.465005 Oct 04 11:21:47.092586 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3412/4646] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:46 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:47.106339 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d6c3a75-fb38-4e09-9d34-2e62529804b0 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009520 Oct 04 11:21:47.116885 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3413/4647] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Oct 4 11:21:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 11:21:47.130616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:47.136440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:47.148880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:47.151652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:47.153901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:47.155252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:47.158440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:47.159243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:47.691278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:47.711671 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-978eaf62-8942-4830-99aa-d8333dbf3942 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.583841 Oct 04 11:21:47.740912 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3414/4648] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:47 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:47.758574 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d876a32b-0580-42d7-8370-2868128f0912 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015646 Oct 04 11:21:47.759812 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3415/4649] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Oct 4 11:21:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 11:21:47.765123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:47.772084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:47.783744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:47.784610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:47.792577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:47.794503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:47.795338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:47.795916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:48.113899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:48.125709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:48.130368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:48.136016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-04400ee6-9246-4d4a-a08b-25cc3a28e930 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.374951 Oct 04 11:21:48.142019 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3416/4650] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:47 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:48.154089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:48.154988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:48.172893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:48.173499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:48.173943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:48.174656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:48.175122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:48.175542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:48.508224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:48.525857 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52badc56-4efa-43b1-a390-9e6b49936654 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.381942 Oct 04 11:21:48.568944 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3417/4651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:48 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:48.576704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14e7bf61-4175-4ab2-a5b9-63ead1d072d3 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Calling method '.version_select at 0x7f71cef11550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:48.633116 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-14e7bf61-4175-4ab2-a5b9-63ead1d072d3 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] HTTP exception thrown: Volume 324f4211-d458-4824-bb35-bf472a73d0ad could not be found. Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14e7bf61-4175-4ab2-a5b9-63ead1d072d3 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Request method failure captured: Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-volumes/324f4211-d458-4824-bb35-bf472a73d0ad HTTP/1.1 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdIvYzfzFmHskizlKwMo2sk82NTonWTGcXJ2FtYjrwmPTlknLM0xwZfLTwqvKpiXXjFEGgyHZI0Lg0wq7uaOPiCF6DhpY2WAXZn__PlZAR0O1SCAo9CoajAoLV1j5K45R9owOrJn9GqD89o8eBM3aqoJj6fq3uhKglrbmxmgfALOws Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd73d869df0b405787d2e89c5a245f29"}]}] Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f0ace6b6b90e421fb97693797ba5709f Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: exception: Volume 324f4211-d458-4824-bb35-bf472a73d0ad could not be found. Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '324f4211-d458-4824-bb35-bf472a73d0ad'} Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 324f4211-d458-4824-bb35-bf472a73d0ad could not be found. (HTTP 404) (Request-ID: req-83a66f7d-a147-401f-814c-4695029d23bd) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:21:48.636225 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 324f4211-d458-4824-bb35-bf472a73d0ad could not be found. Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 324f4211-d458-4824-bb35-bf472a73d0ad could not be found. Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 324f4211-d458-4824-bb35-bf472a73d0ad could not be found. Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14e7bf61-4175-4ab2-a5b9-63ead1d072d3 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Returning 404 to user: Volume 324f4211-d458-4824-bb35-bf472a73d0ad could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:48.644202 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14e7bf61-4175-4ab2-a5b9-63ead1d072d3 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/324f4211-d458-4824-bb35-bf472a73d0ad" status: 404 len: 109 microversion: 2.1 time: 0.069125 Oct 04 11:21:48.654920 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3418/4652] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:21:48 2022] DELETE /compute/v2.1/os-volumes/324f4211-d458-4824-bb35-bf472a73d0ad => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:21:48.666224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:48.667269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:48.689705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:48.690679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:48.692625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:48.694704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:48.697601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:48.699211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:49.031060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:49.047865 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de77c4f1-4787-44f5-99ae-121cc78cca9e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.398439 Oct 04 11:21:49.077310 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3419/4653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:48 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:49.088085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4a75738-ddde-45c0-b310-3b7191276740 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Calling method '.version_select at 0x7f71cef118b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:49.189870 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f4a75738-ddde-45c0-b310-3b7191276740 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] HTTP exception thrown: Volume 044db1d2-a2b5-4287-abcf-53fa8100fac9 could not be found. Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4a75738-ddde-45c0-b310-3b7191276740 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Request method failure captured: Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-volumes/044db1d2-a2b5-4287-abcf-53fa8100fac9 HTTP/1.1 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdIvYzfzFmHskizlKwMo2sk82NTonWTGcXJ2FtYjrwmPTlknLM0xwZfLTwqvKpiXXjFEGgyHZI0Lg0wq7uaOPiCF6DhpY2WAXZn__PlZAR0O1SCAo9CoajAoLV1j5K45R9owOrJn9GqD89o8eBM3aqoJj6fq3uhKglrbmxmgfALOws Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cd73d869df0b405787d2e89c5a245f29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cd73d869df0b405787d2e89c5a245f29"}]}] Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: cd73d869df0b405787d2e89c5a245f29 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesNegativeTest-554958734 Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f0ace6b6b90e421fb97693797ba5709f Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesNegativeTest-554958734-project Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: exception: Volume 044db1d2-a2b5-4287-abcf-53fa8100fac9 could not be found. Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '044db1d2-a2b5-4287-abcf-53fa8100fac9'} Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 044db1d2-a2b5-4287-abcf-53fa8100fac9 could not be found. (HTTP 404) (Request-ID: req-c8fa0033-1e9c-415c-840c-3a0bc602e290) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:21:49.193211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 044db1d2-a2b5-4287-abcf-53fa8100fac9 could not be found. Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 044db1d2-a2b5-4287-abcf-53fa8100fac9 could not be found. Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 044db1d2-a2b5-4287-abcf-53fa8100fac9 could not be found. Oct 04 11:21:49.202127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:21:49.209382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4a75738-ddde-45c0-b310-3b7191276740 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] Returning 404 to user: Volume 044db1d2-a2b5-4287-abcf-53fa8100fac9 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:21:49.209861 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4a75738-ddde-45c0-b310-3b7191276740 tempest-VolumesNegativeTest-554958734 tempest-VolumesNegativeTest-554958734-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/044db1d2-a2b5-4287-abcf-53fa8100fac9" status: 404 len: 109 microversion: 2.1 time: 0.133094 Oct 04 11:21:49.214900 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3420/4654] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:21:49 2022] GET /compute/v2.1/os-volumes/044db1d2-a2b5-4287-abcf-53fa8100fac9 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:21:49.216883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:49.217294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:49.243804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:49.244217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:49.244664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:49.245804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:49.246461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:49.247531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:49.564187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:49.575333 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71c8a86e-bf5a-46ce-bf16-90db548c121c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.363647 Oct 04 11:21:49.580012 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3421/4655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:49 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:49.594280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:49.594902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:49.607839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:49.608411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:49.609054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:49.613496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:49.614580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:49.615241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:49.860102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:49.876600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:49.881500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:49.883199 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a0f4b2e7-48aa-4e30-9367-d8d3ba4d5d1d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.302006 Oct 04 11:21:49.910828 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3422/4656] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:49 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:49.921152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:49.922402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:49.939506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:49.940863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:49.944535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:49.945842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:49.947235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:49.948019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:50.249086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:50.260193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f72d951-1a5f-4bc8-bbcf-a9a402c4128b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.347247 Oct 04 11:21:50.263211 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3423/4657] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:49 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:50.282562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:50.283541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:50.294488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:50.295168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:50.295663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:50.296547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:50.297012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:50.299258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:50.685242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:50.695817 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-567d6ee2-52f7-4055-8a65-a13be9edd56b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.431256 Oct 04 11:21:50.696725 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3424/4658] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:50 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:50.720177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:50.720956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:50.728293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:50.728789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:50.729596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:50.730680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:50.731523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:50.732325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:51.112343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:51.125905 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a882c31-52ae-4a01-ada8-e44431ee59e1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.426481 Oct 04 11:21:51.126671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3425/4659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:50 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:51.157319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:51.158811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:51.165786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:51.166359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:51.166908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:51.167935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:51.169169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:51.169640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:51.175967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:51.356130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:51.374222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:51.375836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:51.379537 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c56cf62-f3bc-44e9-a136-3b9f19ba01aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.239505 Oct 04 11:21:51.381852 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3426/4660] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:51 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:51.391704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:51.393065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:51.404638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:51.406498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:51.407928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:51.409177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:51.410072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:51.410962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:51.682263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:51.691595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64dcc728-a8d1-40e8-a5d3-1bcf0b95923e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.308496 Oct 04 11:21:51.705392 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3427/4661] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:51 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:51.724668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:51.725566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:51.734666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:51.735395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:51.735947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:51.736922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:51.737654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:51.738192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:52.016498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:52.028130 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b70a1093-88ce-45c7-a57d-3a85c95f6cdf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1527 microversion: 2.1 time: 0.309059 Oct 04 11:21:52.041748 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3428/4662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:51 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1527 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:21:52.156723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:52.158521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:52.182753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:52.183256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:52.183708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:52.184516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:52.185058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:52.187861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:52.495324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:52.505594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14c582b3-54c9-480d-a251-82e6778f538d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.356732 Oct 04 11:21:52.516099 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3429/4663] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:52 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:21:52.528669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c5db0791-e995-47cc-9c5e-08ce0260e968 req-8de740b1-0b9b-4f44-9b75-be56eb43c27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba7b0fd-23bc-43e8-90f2-84e6a985f90c", "name": "network-vif-plugged", "status": "completed", "tag": "ee64dc9a-defa-4fc3-9ee6-8b7f1f75ba0a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:52.539877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5db0791-e995-47cc-9c5e-08ce0260e968 req-8de740b1-0b9b-4f44-9b75-be56eb43c27b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:52.540372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5db0791-e995-47cc-9c5e-08ce0260e968 req-8de740b1-0b9b-4f44-9b75-be56eb43c27b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:52.541462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c5db0791-e995-47cc-9c5e-08ce0260e968 req-8de740b1-0b9b-4f44-9b75-be56eb43c27b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:52.574503 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c5db0791-e995-47cc-9c5e-08ce0260e968 req-8de740b1-0b9b-4f44-9b75-be56eb43c27b service nova] Creating event network-vif-plugged:ee64dc9a-defa-4fc3-9ee6-8b7f1f75ba0a for instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c on n-h2-791135-8 Oct 04 11:21:52.580807 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c5db0791-e995-47cc-9c5e-08ce0260e968 req-8de740b1-0b9b-4f44-9b75-be56eb43c27b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056303 Oct 04 11:21:52.587096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3430/4664] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:52.599208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:52.599921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:52.608274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:52.609211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:52.610284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:52.610980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:52.611404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:52.611840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:52.863477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:52.876146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:52.880533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:52.883937 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0d51327e-24b2-4468-b88f-d888039802b4 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.293072 Oct 04 11:21:52.885309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3431/4665] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:52 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:52.917896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:52.918741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:52.932918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:52.933969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:52.934658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:52.935575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:52.936254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:52.937145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:53.146111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:53.155436 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1dedeff6-0af9-4503-9439-4ea0cb37a87d tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.268514 Oct 04 11:21:53.173162 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3432/4666] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:52 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:53.182591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:53.183799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:53.190940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:53.191445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:53.191952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:53.192751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:53.193786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:53.194416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:53.454065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:53.468331 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9484d189-fb2a-4e9f-b228-13eaff6c9376 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1509 microversion: 2.1 time: 0.293907 Oct 04 11:21:53.473448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3433/4667] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:53 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:53.531294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:53.532117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:53.541178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:53.543030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:53.544341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:53.546017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:53.549052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:53.549612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:53.776126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:53.788437 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-650c3f8c-5e79-4e03-bc32-42de8647ae25 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.260787 Oct 04 11:21:53.790285 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3434/4668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:53 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:53.914239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:53.915148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:53.922667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:53.923673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:53.924498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:53.925936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:53.926638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:53.927244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:54.187662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:54.199032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:54.201175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:54.202813 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc2baa3e-1ba2-4aa3-906b-389fc43cccbb tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.293291 Oct 04 11:21:54.217381 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3435/4669] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:53 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:54.223906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:54.225459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:54.232564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:54.233213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:54.233885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:54.234737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:54.235307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:54.235850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:54.571948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:54.583799 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4f8b508b-5226-4c7f-8058-363558927f7a tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1316 microversion: 2.1 time: 0.372196 Oct 04 11:21:54.600116 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3436/4670] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:54 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:54.608838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:54.610172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:54.618206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:54.620104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:54.620734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:54.621711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:54.622340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:54.623191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:54.890715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:54.903180 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ad96bf7a-982f-4951-92b5-6389c8ad2473 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1509 microversion: 2.1 time: 0.301577 Oct 04 11:21:54.905054 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3437/4671] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:54 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:54.921739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:54.922698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:54.930522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:54.931795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:54.932707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:54.933999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:54.934635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:54.935070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:55.141000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:55.156789 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46c49faf-90ef-4de1-8e68-73dcdef44333 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.250570 Oct 04 11:21:55.169375 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3438/4672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:54 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:55.231798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:55.232594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:55.242411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:55.254276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:55.255016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:55.256134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:55.256777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:55.257687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:55.563204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:55.583503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:55.586561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:55.587857 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-15f80f57-a0f6-4fda-952e-e33a3120845d tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.361500 Oct 04 11:21:55.588436 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3439/4673] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:55 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:55.612312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:55.614180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:55.629564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:55.630634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:55.632196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:55.632949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:55.633664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:55.635019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:55.943948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:55.964432 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ef228345-9cb9-4b5c-855f-3e539fcdc16e tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1505 microversion: 2.1 time: 0.356163 Oct 04 11:21:55.966493 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3440/4674] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:55 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:21:55.984401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:55.986189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:56.002330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.003206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.008798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.010499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.012203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.013508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.281788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:56.302132 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5ad209f-d144-47f7-82e7-0e82260b4d0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1509 microversion: 2.1 time: 0.332965 Oct 04 11:21:56.305334 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3441/4675] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:55 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:56.310923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:56.311629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:56.322189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.323094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.323846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.324735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.325210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.325673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.357148 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e62e18bc-07ac-4a31-8649-9dd0d5cbdae4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c/ips" status: 200 len: 109 microversion: 2.1 time: 0.050284 Oct 04 11:21:56.360337 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3442/4676] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:21:56 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c/ips => generated 109 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:56.363970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:56.364884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:56.372044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.372549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.373265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.374022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.374486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.374925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.552412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:56.552412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:56.562439 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b53f63b3-26e1-4244-992c-b7f794e68ebf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.202365 Oct 04 11:21:56.577400 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3443/4677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:56 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:56.577400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:56.577400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:56.577400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.577400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.577914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.578383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.579525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.580344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.654638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a58ee2d-4b5c-4174-8091-412489786cc9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/ips" status: 200 len: 145 microversion: 2.1 time: 0.090077 Oct 04 11:21:56.657513 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3444/4678] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:21:56 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/ips => generated 145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:56.669702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:56.669702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:56.676933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.677480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.677919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.679056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.679521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.680221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.709949 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ccd9e053-8389-41ab-8c42-8d2c9d3d7db3 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c/ips" status: 200 len: 109 microversion: 2.1 time: 0.049708 Oct 04 11:21:56.710708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3445/4679] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:21:56 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c/ips => generated 109 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:56.715344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-9779990c-e223-4dc0-b715-f897f072a615 req-f3bfdb77-62e9-44c5-9ccc-0541b3319360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d5329f-b493-4a25-a450-823121e8358a", "name": "network-vif-unplugged", "status": "completed", "tag": "e7754be9-28f5-4ac8-8494-76e4d61e21a4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:56.725929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:21:56.728476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9779990c-e223-4dc0-b715-f897f072a615 req-f3bfdb77-62e9-44c5-9ccc-0541b3319360 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.729394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9779990c-e223-4dc0-b715-f897f072a615 req-f3bfdb77-62e9-44c5-9ccc-0541b3319360 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.729831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9779990c-e223-4dc0-b715-f897f072a615 req-f3bfdb77-62e9-44c5-9ccc-0541b3319360 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.744769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9779990c-e223-4dc0-b715-f897f072a615 req-f3bfdb77-62e9-44c5-9ccc-0541b3319360 service nova] Creating event network-vif-unplugged:e7754be9-28f5-4ac8-8494-76e4d61e21a4 for instance 53d5329f-b493-4a25-a450-823121e8358a on n-h1-791135-8 Oct 04 11:21:56.750567 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-9779990c-e223-4dc0-b715-f897f072a615 req-f3bfdb77-62e9-44c5-9ccc-0541b3319360 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038569 Oct 04 11:21:56.751449 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3446/4680] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:56.757102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:56.757861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:56.765797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.766340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.766631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.767373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.767848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.768273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.946356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:56.955183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:56.956650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:56.957880 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0dc6b7b9-9b9a-4c95-b9bf-799bc0e4c95f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.205363 Oct 04 11:21:56.969851 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3447/4681] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:56 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:56.982985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:56.983501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:56.990063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.990549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.991012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:56.991698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:56.992990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:56.993488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.021839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aab82a2b-0936-4776-8000-32684b77d6e4 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c/ips/tempest-ServerAddressesTestJSON-1301218505-network" status: 200 len: 94 microversion: 2.1 time: 0.050862 Oct 04 11:21:57.022447 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3448/4682] 10.222.0.23 () {58 vars in 1401 bytes} [Tue Oct 4 11:21:56 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c/ips/tempest-ServerAddressesTestJSON-1301218505-network => generated 94 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:21:57.035049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:57.035562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:57.042237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.043008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:57.043512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.044162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.044630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:57.045065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.071605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:21:57.162284 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d673616e-db22-4b3f-a44e-d099725b0fa0 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 204 len: 0 microversion: 2.1 time: 0.131049 Oct 04 11:21:57.163514 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3449/4683] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:21:57 2022] DELETE /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:21:57.173007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:57.176709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:57.183622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.184354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:57.184871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.186006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.186536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:57.187044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.397225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:57.407210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e3af961-c15d-4c1d-bf9a-fa524d0c0a1b tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1511 microversion: 2.1 time: 0.238442 Oct 04 11:21:57.407832 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3450/4684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:57 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:57.412315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:57.412916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:57.419172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.419664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:57.420133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.421009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.421493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:57.422314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.580569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:57.591808 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a818681c-230d-4e85-abc8-fb5a66572f3b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1509 microversion: 2.1 time: 0.182851 Oct 04 11:21:57.592767 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3451/4685] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:57 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:57.613099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:57.614217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:57.627755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.628976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:57.630497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.632956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.633596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:57.634662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:57.841297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:57.866377 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fb887e3-50e5-4819-909d-8ab3b3f79707 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.272446 Oct 04 11:21:57.866950 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3452/4686] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:57 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:57.985399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:57.986021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:57.998861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:57.999353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:58.005625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:58.006369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:58.006838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:58.007275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:58.171701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:58.180798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:58.183193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:58.184607 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6483f162-5504-4e50-b0fb-ad84897d16f2 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.204238 Oct 04 11:21:58.197965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3453/4687] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:57 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:21:58.431806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:58.432477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:58.443928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:58.447076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:58.447576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:58.448337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:58.448811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:58.449244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:58.641037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:58.649092 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe1c75b7-013c-4710-845a-3c0dd695d044 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1511 microversion: 2.1 time: 0.221701 Oct 04 11:21:58.653693 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3454/4688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:58 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:21:58.661279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:58.662493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:58.670903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:58.671408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:58.671839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:58.674109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:58.674993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:58.675498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:58.898371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:58.908940 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8d3307d-c859-46a9-b129-70b53144add1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1509 microversion: 2.1 time: 0.253700 Oct 04 11:21:58.918993 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3455/4689] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:58 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:58.930340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:58.930997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:58.939403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:58.939922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:58.940371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:58.941106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:58.942207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:58.942207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:59.207902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:59.218965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af8135a0-dd74-4bc1-ba74-53e4f31f2ac6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.298695 Oct 04 11:21:59.220023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3456/4690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:58 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:21:59.225038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:59.226019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:59.238550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:59.239108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:59.239721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:59.240625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:59.241179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:59.241729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:59.418934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:59.435870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:59.442412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:59.445804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f468e513-0bbc-46fa-9ef6-4c2c2c03df21 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.223254 Oct 04 11:21:59.448585 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3457/4691] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:21:59 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:21:59.515161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7bacba4f-7a4f-44a1-986e-ccaf8a61f5f2 req-3ab73ded-51fa-4b5f-97fc-1aa0062bd98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba7b0fd-23bc-43e8-90f2-84e6a985f90c", "name": "network-vif-deleted", "tag": "ee64dc9a-defa-4fc3-9ee6-8b7f1f75ba0a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:21:59.542329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7bacba4f-7a4f-44a1-986e-ccaf8a61f5f2 req-3ab73ded-51fa-4b5f-97fc-1aa0062bd98c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:59.542826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7bacba4f-7a4f-44a1-986e-ccaf8a61f5f2 req-3ab73ded-51fa-4b5f-97fc-1aa0062bd98c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:59.543268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7bacba4f-7a4f-44a1-986e-ccaf8a61f5f2 req-3ab73ded-51fa-4b5f-97fc-1aa0062bd98c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:59.570096 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7bacba4f-7a4f-44a1-986e-ccaf8a61f5f2 req-3ab73ded-51fa-4b5f-97fc-1aa0062bd98c service nova] Creating event network-vif-deleted:ee64dc9a-defa-4fc3-9ee6-8b7f1f75ba0a for instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c on n-h2-791135-8 Oct 04 11:21:59.579337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7bacba4f-7a4f-44a1-986e-ccaf8a61f5f2 req-3ab73ded-51fa-4b5f-97fc-1aa0062bd98c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077581 Oct 04 11:21:59.580623 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3458/4692] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:21:59.679316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:59.680252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:59.687534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:59.687954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:59.688587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:59.689490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:59.690125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:59.690562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:59.725582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:59.726075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:59.726698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:59.727308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lazy-loading 'fault' on Instance uuid 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:21:59.781536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244a0f0ff30d47739825b781ee5cca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88d5cab3f9c4df6923af8029d788b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:21:59.789848 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2080ca72-ba04-430c-820f-2ef37f528d3c tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 200 len: 1306 microversion: 2.1 time: 0.114979 Oct 04 11:21:59.790964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3459/4693] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:59 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:21:59.933103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:21:59.938155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:21:59.945607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:59.946387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:59.952552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:21:59.955099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:21:59.955598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:21:59.956055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:00.192926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:00.201233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:00.209878 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9d292af-c4fb-4d78-b00a-30c3dfdf506a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1512 microversion: 2.1 time: 0.281764 Oct 04 11:22:00.210469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3460/4694] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:21:59 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:00.234596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8dc8b6e-f7e1-4058-81bb-fddd4d154163"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:00.237052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:00.248572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:00.250638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:00.251876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:00.252922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:00.255061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:00.255514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:00.630216 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-39f1ae86-5c45-4403-a386-a7e63ff5071c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401884 Oct 04 11:22:00.631052 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3461/4695] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:22:00 2022] POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:00.648539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:00.652877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:00.664997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:00.669204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:00.669452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:00.670204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:00.670678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:00.671117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:00.917438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:00.935849 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e08f72b7-cb04-491f-8ed1-9ca9ef10cf79 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1452 microversion: 2.1 time: 0.303218 Oct 04 11:22:00.947739 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3462/4696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:00 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1452 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:00.955171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:00.957042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:00.965370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:00.965931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:00.966987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:00.967728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:00.968188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:00.968619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.356701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:01.366507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-437439a2-e7fd-48ed-8d3d-e31fe410360f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.417304 Oct 04 11:22:01.368034 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3463/4697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:00 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:01.387092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:01.387806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:01.395347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.395979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.396584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.397436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.398013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.398592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.594498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:01.606249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:01.608557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:01.609999 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f1c61d1-ca85-41a5-a66d-b7b2a8d8f5b0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.229381 Oct 04 11:22:01.611023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3464/4698] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:01 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:01.617846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:01.619063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] [instance: 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:01.625486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.626281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.626955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.627865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.628319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.628755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.644150 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] HTTP exception thrown: Instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c could not be found. Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Request method failure captured: Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c HTTP/1.1 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBc6FO_N7iIUZuFxjUT0GzrZl471brIM0x8BwUONpGIUW_HMDFJxJaozsoSJ2pnvta76EOm16zynupSTwcBS6qemPeoRcB9MKY_xbWmZGZDNbLRo1q8bNYCYZQn_jjYzSMLg94a0-ET1TKGLbuRr69PHr9tgNEGqgdLEtgRD2X0GEA0 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a88d5cab3f9c4df6923af8029d788b4d Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerAddressesTestJSON-671438710 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a88d5cab3f9c4df6923af8029d788b4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a88d5cab3f9c4df6923af8029d788b4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a88d5cab3f9c4df6923af8029d788b4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a88d5cab3f9c4df6923af8029d788b4d"}]}] Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerAddressesTestJSON-671438710 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a88d5cab3f9c4df6923af8029d788b4d Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerAddressesTestJSON-671438710 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerAddressesTestJSON-671438710-project Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 244a0f0ff30d47739825b781ee5cca12 Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerAddressesTestJSON-671438710-project Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c could not be found. Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2ba7b0fd-23bc-43e8-90f2-84e6a985f90c'} Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c could not be found. Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c could not be found. Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:01.646233 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c could not be found. Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] Returning 404 to user: Instance 2ba7b0fd-23bc-43e8-90f2-84e6a985f90c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:01.650433 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4057f991-b7f0-4d80-9015-dd3b31c6f087 tempest-ServerAddressesTestJSON-671438710 tempest-ServerAddressesTestJSON-671438710-project] 10.222.0.23 "GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c" status: 404 len: 111 microversion: 2.1 time: 0.035509 Oct 04 11:22:01.652456 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3465/4699] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:01 2022] GET /compute/v2.1/servers/2ba7b0fd-23bc-43e8-90f2-84e6a985f90c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:01.658306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:01.658861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:01.665646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.666143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.666884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.667624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.668067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.668495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.697101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lazy-loading 'flavor' on Instance uuid 53d5329f-b493-4a25-a450-823121e8358a {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:22:01.712066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Cannot 'shelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state shelved_offloaded Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action HTTP/1.1 Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 14 Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: {"shelve": {}} Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'shelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state shelved_offloaded Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'shelve': {}}} Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53d5329f-b493-4a25-a450-823121e8358a in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:22:01.714133 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state shelved_offloaded Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state shelved_offloaded Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 409 to user: Cannot 'shelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state shelved_offloaded {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d165191f-a225-457f-b81a-23d4f4740e75 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 409 len: 155 microversion: 2.1 time: 0.062164 Oct 04 11:22:01.718268 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3466/4700] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:01 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 155 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:22:01.724997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:01.725644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:01.731905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.732407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.733326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.734074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.734539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.735005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.778263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122409) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 11:22:01.940600 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5bc3b5d1-c19f-431f-ae4c-cfe36787b12b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 202 len: 0 microversion: 2.1 time: 0.219954 Oct 04 11:22:01.942565 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3467/4701] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:01 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:22:01.959819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:01.963469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:01.979887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.980708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.981410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:01.985246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:01.985805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:01.987562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:02.318053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:02.329859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6997837e-139c-44ed-8001-62f904229d97 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1460 microversion: 2.1 time: 0.382262 Oct 04 11:22:02.331309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3468/4702] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:01 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1460 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:02.391964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:02.393222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:02.406538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:02.407372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:02.408723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:02.411672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:02.412410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:02.413878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:02.717071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:02.733186 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec81a40b-1d93-4e6a-b0ae-ddb658262035 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.345332 Oct 04 11:22:02.745449 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3469/4703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:02 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:02.750352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:02.751765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:02.768071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:02.769317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:02.769989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:02.770886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:02.771481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:02.772014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:02.976069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:02.988573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:02.990543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:02.994570 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d174393a-a967-469f-9a14-2b162bb58128 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.256648 Oct 04 11:22:02.997181 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3470/4704] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:02 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:03.033887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-352ea248-1d56-4ed1-b42e-a5c34db1dad3 req-102f62d8-722d-4eba-a45f-a51510b82379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69337b0-3580-43cd-ac13-11f030e3804b", "name": "network-vif-plugged", "status": "completed", "tag": "a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:03.060581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-352ea248-1d56-4ed1-b42e-a5c34db1dad3 req-102f62d8-722d-4eba-a45f-a51510b82379 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:03.062826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-352ea248-1d56-4ed1-b42e-a5c34db1dad3 req-102f62d8-722d-4eba-a45f-a51510b82379 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:03.063327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-352ea248-1d56-4ed1-b42e-a5c34db1dad3 req-102f62d8-722d-4eba-a45f-a51510b82379 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:03.095914 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-352ea248-1d56-4ed1-b42e-a5c34db1dad3 req-102f62d8-722d-4eba-a45f-a51510b82379 service nova] Creating event network-vif-plugged:a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac for instance e69337b0-3580-43cd-ac13-11f030e3804b on n-h1-791135-8 Oct 04 11:22:03.109702 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-352ea248-1d56-4ed1-b42e-a5c34db1dad3 req-102f62d8-722d-4eba-a45f-a51510b82379 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105165 Oct 04 11:22:03.112937 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3471/4705] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:03.357757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:03.359091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:03.372424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:03.375454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:03.375919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:03.376674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:03.377144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:03.382790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:03.664689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:03.675008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-26ad6dc2-5656-4b35-ac13-1e0f860bc39a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1460 microversion: 2.1 time: 0.322653 Oct 04 11:22:03.675606 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3472/4706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:03 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1460 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:03.759631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:03.761493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:03.776668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:03.777907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:03.778369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:03.782025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:03.782510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:03.782953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:04.178756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:04.189555 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-23c75e43-9a61-481d-a76d-79789e0664f0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.433767 Oct 04 11:22:04.192353 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3473/4707] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:03 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:04.211447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:04.212665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:04.227678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:04.228221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:04.228650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:04.233193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:04.235761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:04.235761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:04.597571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:04.612395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:04.616909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:04.618895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9154966d-3ec9-4822-8c72-b36ce9b96a23 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.424192 Oct 04 11:22:04.619633 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3474/4708] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:04 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:04.709625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:04.711384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:04.726760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:04.728301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:04.730581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:04.733745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:04.734425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:04.736257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:05.002168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:05.015671 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-312eed8f-31a7-4bba-ac3e-b82a7d266885 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.311555 Oct 04 11:22:05.016855 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3475/4709] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:04 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:05.220558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:05.221087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:05.230918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:05.233501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:05.233981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:05.234740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:05.238987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:05.239500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:05.329901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:05.667177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:05.676809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0f99aed-ddff-400c-8833-4b1a58b9c7de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.460626 Oct 04 11:22:05.682125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3476/4710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:05 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:05.687336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:05.688218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:05.718917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:05.720011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:05.722514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:05.723514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:05.724343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:05.724911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:06.586894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:06.608597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:06.610105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:06.612630 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-988c0e62-82af-470f-9a7d-fd7c5928b0aa tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1729 microversion: 2.20 time: 0.927898 Oct 04 11:22:06.639935 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3477/4711] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:05 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1729 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:06.652870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:06.654126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:06.672954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:06.674957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:06.677063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:06.683815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:06.685394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:06.687742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:07.218506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:07.237698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a763cd88-4fcd-487f-b4c3-89e6bebc65d8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.591830 Oct 04 11:22:07.239595 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3478/4712] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:06 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:07.253526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:07.253526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:07.274372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:07.275398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:07.279594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:07.282473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:07.283452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:07.284649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:07.653616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:07.663633 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d635292-c887-47bd-9ab7-d1bb3cfd52ce tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.422924 Oct 04 11:22:07.668968 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3479/4713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:07 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:07.685230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-9d7f917d-435d-4d26-961f-708f02c5977c req-2d0e2b41-46f0-41ce-bd0a-41784674e4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d5329f-b493-4a25-a450-823121e8358a", "tag": "e7754be9-28f5-4ac8-8494-76e4d61e21a4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:07.704387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d7f917d-435d-4d26-961f-708f02c5977c req-2d0e2b41-46f0-41ce-bd0a-41784674e4b2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:07.705285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d7f917d-435d-4d26-961f-708f02c5977c req-2d0e2b41-46f0-41ce-bd0a-41784674e4b2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:07.705980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9d7f917d-435d-4d26-961f-708f02c5977c req-2d0e2b41-46f0-41ce-bd0a-41784674e4b2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:07.728867 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9d7f917d-435d-4d26-961f-708f02c5977c req-2d0e2b41-46f0-41ce-bd0a-41784674e4b2 service nova] Creating event network-changed:e7754be9-28f5-4ac8-8494-76e4d61e21a4 for instance 53d5329f-b493-4a25-a450-823121e8358a on n-h2-791135-8 Oct 04 11:22:07.745174 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-9d7f917d-435d-4d26-961f-708f02c5977c req-2d0e2b41-46f0-41ce-bd0a-41784674e4b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074545 Oct 04 11:22:07.748813 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3480/4714] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:07.763143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:07.764187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:07.782958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:07.785141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:07.786553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:07.787544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:07.788008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:07.788470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:08.305385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:08.315898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:08.324361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:08.325643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea4c1c38-e56a-45da-939a-c241b3d2f356 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1716 microversion: 2.20 time: 0.575038 Oct 04 11:22:08.331069 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3481/4715] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:07 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1716 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:08.353675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:08.354647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:08.366191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:08.367587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:08.368266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:08.369192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:08.369869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:08.370633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:08.836714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:08.859054 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-997cc542-5a92-42b8-a159-367b5db2bce1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.524745 Oct 04 11:22:08.860048 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3482/4716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:08 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:08.889399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:08.890086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:08.912289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:08.916018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:08.916478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:08.917214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:08.917712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:08.918145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:09.665365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:09.685775 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8b2c282-29eb-4675-a4cd-63653eacbf72 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.824258 Oct 04 11:22:09.692709 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3483/4717] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:08 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:09.885912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:09.887458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:09.902073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:09.904294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:09.906218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:09.917697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:09.918196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:09.918789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:10.361802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:10.374559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97abdf12-f703-4a2c-86f5-7e76636dbaa7 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.493994 Oct 04 11:22:10.393773 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3484/4718] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:09 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:10.714760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:10.716556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:10.729250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:10.731941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:10.734148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:10.736807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:10.738646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:10.739620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:11.085195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:11.126692 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06caa00c-6752-42f7-8f21-11b1db84917b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.419424 Oct 04 11:22:11.128880 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3485/4719] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:10 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:11.407930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:11.408556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:11.418179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:11.418741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:11.419296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:11.420004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:11.422382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:11.427553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:11.843741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:11.860888 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-420dcb18-8797-4edd-9f65-459963d2ba04 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.453398 Oct 04 11:22:11.865616 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3486/4720] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:11 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:12.158292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:12.159062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:12.173247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:12.174472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:12.175655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:12.176762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:12.183573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:12.184798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:12.488552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:12.500948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e35393e8-2fa7-45ac-9807-3542b4abd909 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.347536 Oct 04 11:22:12.520614 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3487/4721] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:12 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:12.891383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:12.892084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:12.906727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:12.907522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:12.908982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:12.911120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:12.911998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:12.913871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:13.640089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:13.655260 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ad3f189a-a02b-4fde-b9a1-d6dcbdd32797 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.772288 Oct 04 11:22:13.656818 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3488/4722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:12 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:13.662890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:13.664306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:13.675729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:13.677794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:13.678669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:13.679465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:13.681128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:13.681882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:13.682967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:13.957895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:13.967566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecc0495b-65eb-42d7-b768-d60eca047ba2 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.309236 Oct 04 11:22:13.987544 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3489/4723] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:13 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:14.684165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:14.685519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:14.702408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:14.703113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:14.703736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:14.704743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:14.705483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:14.706172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:15.399813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:15.410206 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8975262b-64dd-4616-8970-2eae5f466eb8 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.730654 Oct 04 11:22:15.434086 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3490/4724] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:14 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:15.466906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:15.467547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:15.501497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:15.504566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:15.505197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:15.505975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:15.506446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:15.506886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:16.348758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:16.360257 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-554d79ed-7b24-401f-a6d8-7ac06ba46e62 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.925081 Oct 04 11:22:16.377926 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3491/4725] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:15 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:16.390732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ca813939-9a51-45ea-88d9-15edbeb49b1c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:16.402425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca813939-9a51-45ea-88d9-15edbeb49b1c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:16.406142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca813939-9a51-45ea-88d9-15edbeb49b1c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:16.408836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ca813939-9a51-45ea-88d9-15edbeb49b1c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:16.450970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ca813939-9a51-45ea-88d9-15edbeb49b1c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Going to try to stop instance {{(pid=122409) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:22:16.513161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:16.545521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ca813939-9a51-45ea-88d9-15edbeb49b1c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/action" status: 202 len: 0 microversion: 2.1 time: 0.156258 Oct 04 11:22:16.546249 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3492/4726] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:16 2022] POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:22:16.580472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:16.585091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:16.596718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:16.597518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:16.598156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:16.599442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:16.600080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:16.601021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:17.297103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:17.322591 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2acaf33-c8e7-4efe-b63d-a9c6ae209a3f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.765353 Oct 04 11:22:17.326324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3493/4727] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:16 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:17.390776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:17.391543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:17.421280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:17.421810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:17.422250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:17.422957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:17.423417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:17.423849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:17.791023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:17.812211 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-02fe00c3-d706-4af5-b45a-439f80561fe9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.486483 Oct 04 11:22:17.812816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3494/4728] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:17 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:17.817425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:17.818038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:17.830478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:17.831200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:17.831863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:17.833144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:17.833799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:17.838423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:18.066808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:18.080458 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0424e6b3-c197-4df7-8ae0-04237114cbc1 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.266555 Oct 04 11:22:18.098816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3495/4729] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:17 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:18.359700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:18.361058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:18.369519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:18.370463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:18.371151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:18.372108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:18.373210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:18.373912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:18.651850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:18.671424 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d181bf7-d13f-40ce-99a5-3b0bd2bcb7b0 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.315836 Oct 04 11:22:18.694568 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3496/4730] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:18 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:18.841762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:18.842953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:18.880539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:18.881801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:18.883685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:18.884694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:18.885419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:18.886078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:19.283569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:19.303384 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-50ba29a0-a9df-4013-93c6-7b288ca42a40 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.468002 Oct 04 11:22:19.304879 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3497/4731] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:18 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:19.324246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:19.342682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:19.359584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:19.367354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:19.371746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:19.375057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:19.381137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:19.382018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:19.817118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:19.829572 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4dd2ef1d-352b-4f3b-87c6-96e1c084fa9f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.522333 Oct 04 11:22:19.831037 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3498/4732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:19 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:19.840813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:19.864211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:19.898651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:19.899783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:19.904416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:19.905753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:19.936981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:19.938267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:20.417502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:20.433609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b146fc1-e07a-4608-b510-64825b5eb5d9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.601249 Oct 04 11:22:20.454942 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3499/4733] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:19 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:20.460304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:20.461218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:20.468846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:20.469764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:20.470428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:20.471384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:20.472668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:20.473916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:20.804844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:20.815164 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8db246c-745b-48c7-b6b3-c3e6e6f6e89b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.358651 Oct 04 11:22:20.818419 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3500/4734] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:20 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:20.856298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:20.857930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:20.870905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:20.873707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:20.874211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:20.874985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:20.875469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:20.875909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:21.212132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:21.221536 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-826bfad7-f9ee-433e-871c-91d791d3813a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1735 microversion: 2.1 time: 0.371123 Oct 04 11:22:21.226944 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3501/4735] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:20 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1735 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:21.463383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:21.464905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:21.478115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:21.480050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:21.482331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:21.485442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:21.486792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:21.490281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:21.961626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:21.973044 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d412a46a-3058-441a-889e-6e75d6e3faf6 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.515229 Oct 04 11:22:22.003352 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3502/4736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:21 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:22.009264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:22.012021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:22.019009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:22.019958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:22.020679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:22.021813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:22.022545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:22.023487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:22.347673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:22.365746 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4d6fdac7-0cd4-4ff4-86ce-ae5830f9b77d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.360908 Oct 04 11:22:22.366996 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3503/4737] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:22 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:22.379917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:22.385748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:22.402899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:22.403794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:22.405013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:22.409669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:22.410603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:22.411759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:22.673954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:22.691842 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2de78f8a-8348-43ca-98c4-ca1fcf659d12 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1715 microversion: 2.1 time: 0.322856 Oct 04 11:22:22.693071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3504/4738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:22 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1715 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:22.921156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:22.922131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:22.933392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:22.937068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:22.939537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:22.942114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:22.949212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:22.958625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:23.217714 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Cannot 'detach_volume' instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 while it is in vm_state rescued Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments/db8c9f2b-43aa-447f-96d4-1e407651797e HTTP/1.1 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'detach_volume' instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 while it is in vm_state rescued Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0', 'id': 'db8c9f2b-43aa-447f-96d4-1e407651797e'} Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 while it is in vm_state rescued Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:23.219387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:23.224066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:23.224066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:23.224066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:23.224066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:23.224066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 while it is in vm_state rescued Oct 04 11:22:23.224066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:23.224066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 409 to user: Cannot 'detach_volume' instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 while it is in vm_state rescued {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:23.224066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbc0b07a-18b2-45d2-859d-6d96b9d08c26 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "DELETE /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments/db8c9f2b-43aa-447f-96d4-1e407651797e" status: 409 len: 152 microversion: 2.1 time: 0.319880 Oct 04 11:22:23.225102 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3505/4739] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:22:22 2022] DELETE /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments/db8c9f2b-43aa-447f-96d4-1e407651797e => generated 152 bytes in 325 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:22:23.246513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:23.247423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:23.257513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:23.258667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:23.259465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:23.260756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:23.261700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:23.262369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:23.503379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:23.514498 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4846cc2-3d8f-486b-9990-719e9d089159 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.287632 Oct 04 11:22:23.522042 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3506/4740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:23 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:23.534802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:23.544419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:23.560228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:23.561496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:23.564285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:23.566979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:23.569803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:23.571440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:23.718464 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7549a3a-0173-4dfc-a1a2-c08cc2c4781f tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/action" status: 202 len: 0 microversion: 2.1 time: 0.194818 Oct 04 11:22:23.722955 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3507/4741] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:23 2022] POST /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:22:23.732129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:23.733126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:23.741080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:23.741609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:23.742861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:23.743908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:23.744472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:23.744839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:23.763795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:23.925553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:23.935706 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24fb2153-536d-41df-b5a2-822e2b02414f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.209169 Oct 04 11:22:23.936290 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3508/4742] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:23 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:24.153575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eab3b40b-5182-4e92-9376-d4c38e4b728b tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Action: 'create', calling method: .version_select at 0x7f71d4493ca0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-918910944", "policies": ["affinity"]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:24.171348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eab3b40b-5182-4e92-9376-d4c38e4b728b tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:24.177054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eab3b40b-5182-4e92-9376-d4c38e4b728b tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:24.223372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eab3b40b-5182-4e92-9376-d4c38e4b728b tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:24.231068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-eab3b40b-5182-4e92-9376-d4c38e4b728b tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:24.247790 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eab3b40b-5182-4e92-9376-d4c38e4b728b tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.309647 Oct 04 11:22:24.249185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3509/4743] 10.222.0.23 () {60 vars in 1174 bytes} [Tue Oct 4 11:22:23 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:24.254808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:24.255437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:24.262381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:24.262877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:24.263506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:24.264225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:24.264693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:24.265184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:24.482859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:24.493471 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bfabf627-ca59-44bb-9261-e5a2aa7389de tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1723 microversion: 2.1 time: 0.242111 Oct 04 11:22:24.494069 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3510/4744] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:24 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:24.499264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bcf7111f-4103-456f-aa97-73426f916e2f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Action: 'create', calling method: .version_select at 0x7f71cfa95e50>, body: {"server_group": {"name": "tempest-server-group-1592463562", "policies": ["affinity"]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:24.517851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-bcf7111f-4103-456f-aa97-73426f916e2f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:24.523832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-bcf7111f-4103-456f-aa97-73426f916e2f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:24.592407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-bcf7111f-4103-456f-aa97-73426f916e2f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:24.597918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-bcf7111f-4103-456f-aa97-73426f916e2f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:24.614837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bcf7111f-4103-456f-aa97-73426f916e2f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.119640 Oct 04 11:22:24.615926 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3511/4745] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Oct 4 11:22:24 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:24.628088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:24.629030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:24.637162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:24.637698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:24.638134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:24.639162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:24.639490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:24.639962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:24.844668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:24.864955 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2924d8f-88de-4e1b-b0a2-34357f4e9019 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.248425 Oct 04 11:22:24.871477 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3512/4746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:24 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:24.884641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f5c56c2-8533-49c3-a2c2-388771f9cdd8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Action: 'create', calling method: .version_select at 0x7f71cf242dc0>, body: {"server_group": {"name": "tempest-server-group-1592463562", "policies": ["affinity"]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:24.912737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:24.934117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9f5c56c2-8533-49c3-a2c2-388771f9cdd8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:24.954440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9f5c56c2-8533-49c3-a2c2-388771f9cdd8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:25.069626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9f5c56c2-8533-49c3-a2c2-388771f9cdd8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:25.085168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9f5c56c2-8533-49c3-a2c2-388771f9cdd8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:25.118363 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f5c56c2-8533-49c3-a2c2-388771f9cdd8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.245121 Oct 04 11:22:25.120034 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3513/4747] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Oct 4 11:22:24 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:25.128865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:25.129852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:25.137732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:25.138344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:25.138791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:25.139653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:25.141566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:25.141566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:25.427309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:25.439521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d418c2b5-74c7-48fc-a8f3-5fd03bcf5a7b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.317164 Oct 04 11:22:25.447229 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3514/4748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:25 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:25.459147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af5ce2df-918f-41eb-98d2-cc7bdee03ce8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:25.509417 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af5ce2df-918f-41eb-98d2-cc7bdee03ce8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/aa56cb03-7666-403c-9c7d-f960b2c08322" status: 204 len: 0 microversion: 2.1 time: 0.060977 Oct 04 11:22:25.519157 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3515/4749] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:25 2022] DELETE /compute/v2.1/os-server-groups/aa56cb03-7666-403c-9c7d-f960b2c08322 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:22:25.536262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:25.537042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:25.544910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:25.545554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:25.546018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:25.546888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:25.547688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:25.548005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:25.743356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:25.756685 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af0ea418-3bc2-4bc4-9fad-4f57f94722c4 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1723 microversion: 2.1 time: 0.236344 Oct 04 11:22:25.766380 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3516/4750] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:25 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:25.781911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e308610b-40ae-424a-ab7f-79f862d84af0 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:25.798576 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e308610b-40ae-424a-ab7f-79f862d84af0 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.030003 Oct 04 11:22:25.798851 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3517/4751] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:22:25 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:25.810239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf650eec-affe-4724-84f3-dead8308889c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:25.841621 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf650eec-affe-4724-84f3-dead8308889c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/1f5d45df-a37c-43d8-a634-26bcc1e2d32e" status: 204 len: 0 microversion: 2.1 time: 0.034711 Oct 04 11:22:25.842978 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3518/4752] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:25 2022] DELETE /compute/v2.1/os-server-groups/1f5d45df-a37c-43d8-a634-26bcc1e2d32e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:22:25.854000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f5962a6-b686-4c63-a34a-189858fd9404 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:25.868295 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f5962a6-b686-4c63-a34a-189858fd9404 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.020021 Oct 04 11:22:25.870283 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3519/4753] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:22:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:25.890620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e958d78-76fb-43ed-80f8-305cd4292e58 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Action: 'create', calling method: .version_select at 0x7f71d437bee0>, body: {"server_group": {"name": "tempest-server-group-230529651", "policies": ["affinity"]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:25.915235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3e958d78-76fb-43ed-80f8-305cd4292e58 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:25.923063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3e958d78-76fb-43ed-80f8-305cd4292e58 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:25.969599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3e958d78-76fb-43ed-80f8-305cd4292e58 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:25.975003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-3e958d78-76fb-43ed-80f8-305cd4292e58 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:25.989392 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e958d78-76fb-43ed-80f8-305cd4292e58 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.109439 Oct 04 11:22:25.993529 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3520/4754] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Oct 4 11:22:25 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:25.999278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:26.000201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:26.008114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:26.009014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:26.009674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:26.010627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:26.011267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:26.011871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:26.201637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:26.210953 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-107b4b69-6768-4533-8927-fe4023821b9c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.219278 Oct 04 11:22:26.212264 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3521/4755] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:25 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:26.231003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-015be666-cf5d-4448-b0be-30ddb485d9ca tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:26.271074 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-015be666-cf5d-4448-b0be-30ddb485d9ca tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/a0448730-3a65-4a9f-9df7-cc5c98cd9883" status: 204 len: 0 microversion: 2.1 time: 0.057419 Oct 04 11:22:26.276221 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3522/4756] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:26 2022] DELETE /compute/v2.1/os-server-groups/a0448730-3a65-4a9f-9df7-cc5c98cd9883 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:22:26.283449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2bb1413c-6e4f-4c12-9ade-12234c76d466 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:26.304166 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2bb1413c-6e4f-4c12-9ade-12234c76d466 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025445 Oct 04 11:22:26.313311 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3523/4757] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:22:26 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:22:26.318842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9fc99cbc-cd7e-421b-9ef0-586208b4e93f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Action: 'create', calling method: .version_select at 0x7f71d4284a60>, body: {"server_group": {"name": "tempest-server-group-1888080972", "policies": ["anti-affinity"]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:26.349573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9fc99cbc-cd7e-421b-9ef0-586208b4e93f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:26.360588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9fc99cbc-cd7e-421b-9ef0-586208b4e93f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:26.407987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:26.455593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9fc99cbc-cd7e-421b-9ef0-586208b4e93f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:26.463163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9fc99cbc-cd7e-421b-9ef0-586208b4e93f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_groups'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:26.479231 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9fc99cbc-cd7e-421b-9ef0-586208b4e93f tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.164560 Oct 04 11:22:26.480748 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3524/4758] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Oct 4 11:22:26 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:26.496792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:26.498493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:26.508105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:26.508847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:26.509487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:26.510785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:26.511680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:26.512784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:26.729786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:26.739697 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-318a7119-3a58-42bb-8e4d-acfcd6dde13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.257557 Oct 04 11:22:26.740667 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3525/4759] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:26 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:26.762188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2d951b8-25d0-4ade-900c-84c74fb5ba05 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:26.801047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2d951b8-25d0-4ade-900c-84c74fb5ba05 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/d252e9c8-c9d8-425c-b299-219f2a21b2e1" status: 204 len: 0 microversion: 2.1 time: 0.046041 Oct 04 11:22:26.801956 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3526/4760] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:26 2022] DELETE /compute/v2.1/os-server-groups/d252e9c8-c9d8-425c-b299-219f2a21b2e1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:22:26.809128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:26.809789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:26.816408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:26.816912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:26.817525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:26.818253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:26.818719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:26.819158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:27.038977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:27.055487 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22c9ccf0-61df-4efd-909f-e5f490c058dc tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1723 microversion: 2.1 time: 0.251972 Oct 04 11:22:27.056109 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3527/4761] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:26 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:27.062866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c96b30bf-54bb-4e46-80dc-bf1df847766e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:27.079519 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c96b30bf-54bb-4e46-80dc-bf1df847766e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.022225 Oct 04 11:22:27.089186 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3528/4762] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:22:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:27.211877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1182883231", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "f1a6343f-f8ba-4d4f-888a-a088f5ae3d20"}]}, "os:scheduler_hints": {"group": "a47a5ed4-c529-479f-bcec-6c3b586c0ada"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:27.304452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] validate_networks() for [('f1a6343f-f8ba-4d4f-888a-a088f5ae3d20', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:22:27.899746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:22:27.900410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:22:27.900626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:22:27.901043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:22:27.901507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:22:27.920219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:27.920791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:27.921304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:27.922218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:27.922754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:27.923253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:27.946472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:27.954857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:27.979461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:22:27.983057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:22:28.043397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122409) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 11:22:28.069632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_group_members'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:28.075562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_group_members'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:28.141088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_group_members'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:22:28.147212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Getting quotas for user 3972617498ba4b7dace9cff9d59a54ef and project 3eb7a8ff4d9b499bb41f5bbc834b0f4e. Resources: {'server_group_members'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:22:28.194935 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e732233c-a870-47b2-a3c7-4e1115721da4 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989166 Oct 04 11:22:28.196260 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3529/4763] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:22:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:22:28.202194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:28.202907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:28.217086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:28.217754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:28.220359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:28.221161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:28.221667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:28.223960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:28.428187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:28.437893 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-275e0ce8-48a4-44b0-9c53-302be36cbed5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.240373 Oct 04 11:22:28.438629 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3530/4764] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:28 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:28.443521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:28.444196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:28.450800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:28.451469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:28.452094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:28.453528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:28.454172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:28.454618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:28.656539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:28.665698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9baafe7f-b9c5-4838-87b4-8778db086a10 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.226135 Oct 04 11:22:28.666612 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3531/4765] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:28 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:28.934602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:28.935396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:28.944204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:28.944703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:28.945337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:28.946644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:28.947107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:28.947919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:29.236632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:29.250433 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ddc2c139-d169-40c8-a821-aaa824e50eda tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1723 microversion: 2.1 time: 0.582660 Oct 04 11:22:29.254776 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3532/4766] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:28 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1723 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:29.269120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:29.270092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:29.276697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:29.277556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:29.278209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:29.279042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:29.279878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:29.280420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:29.399024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:29.409209 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77b6d28e-b07d-45e0-a523-383ad55b56cc tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1265 microversion: 2.1 time: 0.152714 Oct 04 11:22:29.409841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3533/4767] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:29 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:29.462851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:29.464138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:29.471555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:29.472260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:29.472728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:29.473785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:29.474216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:29.474949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:29.645748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:29.656220 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ed030ab4-45f4-4be1-a132-207604dff251 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.198796 Oct 04 11:22:29.661777 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3534/4768] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:29 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:29.699999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:29.700661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:29.709144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:29.709804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:29.710257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:29.711011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:29.711485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:29.711914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:29.915233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:29.925921 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-120e1373-0c8f-4e29-be70-03ab7e265405 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.240925 Oct 04 11:22:29.926843 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3535/4769] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:29 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:30.285782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:30.286549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:30.302005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:30.303785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:30.304490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:30.307552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:30.308593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:30.314337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:30.450488 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:22:30.451253 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:22:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:22:30.571535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:30.584607 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9120a869-1118-4b79-bb23-a6705c0dd8a5 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1723 microversion: 2.1 time: 0.307333 Oct 04 11:22:30.586922 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3536/4770] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:30 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:30.592440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:30.593567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:30.600701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:30.601443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:30.602097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:30.603250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:30.603879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:30.604472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.075353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:31.092648 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2cf08cfa-8e78-4c19-aeda-594aca6cfdf8 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1271 microversion: 2.1 time: 0.504389 Oct 04 11:22:31.112323 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3537/4771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:30 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1271 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:31.118490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:31.119119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:31.125746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:31.126248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:31.126698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.127422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:31.127886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:31.128320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.313376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:31.315630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:31.324037 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ad2d490-ab44-4a5e-8ce4-1b1416dd82a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.210322 Oct 04 11:22:31.324642 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3538/4772] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:31 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:31.331580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:31.333203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:31.343108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:31.343898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:31.344234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.345099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:31.345656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:31.346098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.611161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:31.620029 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b285514-51a5-49f5-8ea5-8db05ca10de8 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.294188 Oct 04 11:22:31.633855 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3539/4773] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:31 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:31.641922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:31.642754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:31.649886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:31.650620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:31.651220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.652095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:31.652714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:31.653758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.823331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:31.833632 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f6b00184-e261-4b75-8f36-6d6419f37216 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1729 microversion: 2.1 time: 0.198264 Oct 04 11:22:31.845376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3540/4774] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:31 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:31.860716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:31.861609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:31.871271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:31.872089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:31.872725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.873809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:31.874463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:31.875012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:31.989072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba257c79-3539-432c-bd91-3848be952f6d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134181 Oct 04 11:22:31.990415 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3541/4775] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:22:31 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:32.002944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-eeace7ca-9a3b-427b-a093-1e00447d295e req-f576e701-1f50-47cf-8637-598a888beda8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41a1e3c-e5a4-446c-8113-34366fa39465", "tag": "0a16151c-ac6b-4c9b-9331-f602fc283917"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:32.020410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eeace7ca-9a3b-427b-a093-1e00447d295e req-f576e701-1f50-47cf-8637-598a888beda8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:32.021142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eeace7ca-9a3b-427b-a093-1e00447d295e req-f576e701-1f50-47cf-8637-598a888beda8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:32.021834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eeace7ca-9a3b-427b-a093-1e00447d295e req-f576e701-1f50-47cf-8637-598a888beda8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:32.070087 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-eeace7ca-9a3b-427b-a093-1e00447d295e req-f576e701-1f50-47cf-8637-598a888beda8 service nova] Creating event network-changed:0a16151c-ac6b-4c9b-9331-f602fc283917 for instance b41a1e3c-e5a4-446c-8113-34366fa39465 on n-h1-791135-8 Oct 04 11:22:32.075233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-eeace7ca-9a3b-427b-a093-1e00447d295e req-f576e701-1f50-47cf-8637-598a888beda8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083048 Oct 04 11:22:32.080053 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3542/4776] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:32.119989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:32.121055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:32.137742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:32.138584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:32.139319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:32.141165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:32.142371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:32.144599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:32.755404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:32.764441 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9837e8b-b569-498f-8410-0e5aa60478eb tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1313 microversion: 2.1 time: 0.648712 Oct 04 11:22:32.765023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3543/4777] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:32 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:32.769798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:32.770407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:32.772265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=92,nova_api:DELETE=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:32.777889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:32.778382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:32.778820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:32.779526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:32.779990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:32.780663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:33.006710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:33.017341 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-384d4759-614e-4dc7-b6d7-643b24c4b94c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.251083 Oct 04 11:22:33.029558 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3544/4778] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:32 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:33.029558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a8314fa9-f981-4040-bc50-77bbff50e7cc req-06f30dbc-ee14-44fc-a5b8-afb46427dcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d5329f-b493-4a25-a450-823121e8358a", "name": "network-vif-plugged", "status": "completed", "tag": "e7754be9-28f5-4ac8-8494-76e4d61e21a4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:33.034165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a8314fa9-f981-4040-bc50-77bbff50e7cc req-06f30dbc-ee14-44fc-a5b8-afb46427dcf4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:33.034645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a8314fa9-f981-4040-bc50-77bbff50e7cc req-06f30dbc-ee14-44fc-a5b8-afb46427dcf4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:33.035076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a8314fa9-f981-4040-bc50-77bbff50e7cc req-06f30dbc-ee14-44fc-a5b8-afb46427dcf4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:33.050758 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a8314fa9-f981-4040-bc50-77bbff50e7cc req-06f30dbc-ee14-44fc-a5b8-afb46427dcf4 service nova] Creating event network-vif-plugged:e7754be9-28f5-4ac8-8494-76e4d61e21a4 for instance 53d5329f-b493-4a25-a450-823121e8358a on n-h2-791135-8 Oct 04 11:22:33.058113 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a8314fa9-f981-4040-bc50-77bbff50e7cc req-06f30dbc-ee14-44fc-a5b8-afb46427dcf4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038548 Oct 04 11:22:33.059300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3545/4779] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:33.067519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:33.068446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:33.075203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:33.075787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:33.076318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:33.077099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:33.077665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:33.078170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:33.400153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:33.409327 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-86e68ff6-4574-4b4d-9cbb-4d6f53f06799 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.348704 Oct 04 11:22:33.422419 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3546/4780] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:33 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:33.629978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-790c6629-ba84-426f-87fd-74da372b01eb req-0dd1a58e-4248-4a61-94ed-f27a36786f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0", "tag": "e19a409c-8a87-4928-9624-7ab08668b7f0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:33.653946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-790c6629-ba84-426f-87fd-74da372b01eb req-0dd1a58e-4248-4a61-94ed-f27a36786f09 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:33.654532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-790c6629-ba84-426f-87fd-74da372b01eb req-0dd1a58e-4248-4a61-94ed-f27a36786f09 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:33.654980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-790c6629-ba84-426f-87fd-74da372b01eb req-0dd1a58e-4248-4a61-94ed-f27a36786f09 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:33.682473 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-790c6629-ba84-426f-87fd-74da372b01eb req-0dd1a58e-4248-4a61-94ed-f27a36786f09 service nova] Creating event network-changed:e19a409c-8a87-4928-9624-7ab08668b7f0 for instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 on n-h2-791135-8 Oct 04 11:22:33.689226 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-790c6629-ba84-426f-87fd-74da372b01eb req-0dd1a58e-4248-4a61-94ed-f27a36786f09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063232 Oct 04 11:22:33.690743 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3547/4781] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:33.790358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:33.791050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:33.810399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:33.811836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:33.817006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:33.818667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:33.819281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:33.820065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:34.206442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:34.219758 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-813204e7-89a6-4ee8-8210-471ab22bf6f5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1313 microversion: 2.1 time: 0.433545 Oct 04 11:22:34.235208 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3548/4782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:33 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:34.244053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:34.244936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:34.253577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:34.254378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:34.255120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:34.256051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:34.257118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:34.258857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:34.429686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:34.440387 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f8eba353-3930-48c7-88e6-c9992cd63389 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.203446 Oct 04 11:22:34.441732 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3549/4783] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:34 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:34.448346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:34.449296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:34.456340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:34.457482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:34.458229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:34.459394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:34.460209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:34.461600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:34.667384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:34.681852 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8044c85-5c70-4696-9cf7-ac610fb7a155 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.237400 Oct 04 11:22:34.682986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3550/4784] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:34 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:35.247409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:35.249756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:35.264872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:35.265446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:35.265924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:35.266641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:35.267451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:35.268092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:35.828724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:35.846769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3062729-5f77-4891-9c28-e9a1d6d09a91 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1313 microversion: 2.1 time: 0.606263 Oct 04 11:22:35.850245 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3551/4785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:35 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:35.855872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:35.856492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:35.889829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:35.890337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:35.890781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:35.891504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:35.891967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:35.892405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:36.137703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:36.149236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-625d8fac-4be5-4d82-87bd-e7dc06479500 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1518 microversion: 2.1 time: 0.297267 Oct 04 11:22:36.154496 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3552/4786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:35 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1518 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:36.176025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:36.176025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:36.183366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:36.184055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:36.184519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:36.185291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:36.185970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:36.186416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:36.395355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:36.405157 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1fcdedc-4252-4b08-9ead-bf6fa3803dfd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.249331 Oct 04 11:22:36.406047 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3553/4787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:36 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:36.414391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e0ad7273-8b07-46a2-b846-88951e0c488e req-ebf9b682-1065-48a5-b06a-48ef43ded4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0", "tag": "e19a409c-8a87-4928-9624-7ab08668b7f0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:36.426712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e0ad7273-8b07-46a2-b846-88951e0c488e req-ebf9b682-1065-48a5-b06a-48ef43ded4a3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:36.427208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e0ad7273-8b07-46a2-b846-88951e0c488e req-ebf9b682-1065-48a5-b06a-48ef43ded4a3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:36.427651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e0ad7273-8b07-46a2-b846-88951e0c488e req-ebf9b682-1065-48a5-b06a-48ef43ded4a3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:36.440652 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e0ad7273-8b07-46a2-b846-88951e0c488e req-ebf9b682-1065-48a5-b06a-48ef43ded4a3 service nova] Creating event network-changed:e19a409c-8a87-4928-9624-7ab08668b7f0 for instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 on n-h2-791135-8 Oct 04 11:22:36.447973 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e0ad7273-8b07-46a2-b846-88951e0c488e req-ebf9b682-1065-48a5-b06a-48ef43ded4a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037130 Oct 04 11:22:36.448911 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3554/4788] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:36.875357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:36.876394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:36.886109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:36.886727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:36.887257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:36.888735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:36.889303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:36.889859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:37.237683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:37.253451 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13f7d800-991a-4f18-aca3-ff589564e39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1313 microversion: 2.1 time: 0.382726 Oct 04 11:22:37.272041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3555/4789] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:36 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:37.285767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:37.289889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:37.309779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:37.311089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:37.313117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:37.315400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:37.317282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:37.318250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:37.699090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:37.717277 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-609e1165-cb8e-473e-99b0-b2c0238b9562 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.443982 Oct 04 11:22:37.717931 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3556/4790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:37 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:37.743045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:37.743666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:37.754868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:37.755357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:37.755996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:37.757102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:37.758329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:37.758943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:37.932059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:38.001772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:38.018533 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c0b09de6-cf11-4163-ae5a-2d293f7502a6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.279891 Oct 04 11:22:38.021531 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3557/4791] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:37 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:38.027789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:38.028704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:38.037489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:38.038279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:38.040220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:38.041911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:38.042805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:38.043758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:38.070182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:38.159267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=54 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:38.293973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:38.305130 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09dd6e1c-7604-489c-b863-41cee91c1893 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.281483 Oct 04 11:22:38.305858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3558/4792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:38 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:38.311661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:38.314740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:38.322390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:38.323314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:38.324021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:38.325029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:38.325900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:38.326501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:38.369391 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-475fe7c7-2f8f-462a-9bee-cc06480c6057 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062005 Oct 04 11:22:38.370357 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3559/4793] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Oct 4 11:22:38 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:38.376330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:38.377168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:38.384972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:38.385795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:38.386390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:38.387265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:38.387904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:38.388493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:39.271933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:39.294073 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f79d8e4f-1145-4ec8-8eac-221cfff57d99 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1313 microversion: 2.1 time: 0.922027 Oct 04 11:22:39.294821 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3560/4794] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:38 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1313 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:39.304955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:39.307099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:39.321821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:39.326899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:39.328180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:39.332013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:39.332528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:39.332993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:39.614060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:39.623139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a14e12e1-111c-488f-b8ad-959dac0b7636 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.326866 Oct 04 11:22:39.624487 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3561/4795] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:39 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:39.630224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:39.630909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:39.637289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:39.637982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:39.638656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:39.639591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:39.640253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:39.640920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:39.672238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:22:39.794271 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c5acdf3-f287-49b3-ba7e-f59da318de81 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 204 len: 0 microversion: 2.20 time: 0.167490 Oct 04 11:22:39.794889 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3562/4796] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:22:39 2022] DELETE /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:22:39.800833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f42fecf2-4fd9-4765-ae64-a2fdf4f47164 req-33ec38bc-4172-4785-a390-fc7441149911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41a1e3c-e5a4-446c-8113-34366fa39465", "name": "network-vif-plugged", "status": "completed", "tag": "0a16151c-ac6b-4c9b-9331-f602fc283917"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:39.822674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f42fecf2-4fd9-4765-ae64-a2fdf4f47164 req-33ec38bc-4172-4785-a390-fc7441149911 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:39.823167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f42fecf2-4fd9-4765-ae64-a2fdf4f47164 req-33ec38bc-4172-4785-a390-fc7441149911 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:39.823751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f42fecf2-4fd9-4765-ae64-a2fdf4f47164 req-33ec38bc-4172-4785-a390-fc7441149911 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:39.838925 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f42fecf2-4fd9-4765-ae64-a2fdf4f47164 req-33ec38bc-4172-4785-a390-fc7441149911 service nova] Creating event network-vif-plugged:0a16151c-ac6b-4c9b-9331-f602fc283917 for instance b41a1e3c-e5a4-446c-8113-34366fa39465 on n-h1-791135-8 Oct 04 11:22:39.852997 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f42fecf2-4fd9-4765-ae64-a2fdf4f47164 req-33ec38bc-4172-4785-a390-fc7441149911 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056650 Oct 04 11:22:39.854174 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3563/4797] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:39.860133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:39.861005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:39.869568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:39.870235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:39.870825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:39.871666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:39.872601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:39.874067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:40.094160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:40.103948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14364fea-17d7-4b34-ac9a-675cc493de93 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.248540 Oct 04 11:22:40.104686 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3564/4798] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:39 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:40.110016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-816ac572-2584-4696-a366-e1172c85ff99 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:40.115599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-816ac572-2584-4696-a366-e1172c85ff99 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance fdcda494-0de0-4137-90ba-5caaadd5aa41 has no mapping to a cell. Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-816ac572-2584-4696-a366-e1172c85ff99 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/fdcda494-0de0-4137-90ba-5caaadd5aa41/action HTTP/1.1 Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: {"os-stop": {}} Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance fdcda494-0de0-4137-90ba-5caaadd5aa41 has no mapping to a cell. Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'fdcda494-0de0-4137-90ba-5caaadd5aa41', 'body': {'os-stop': {}}} Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance fdcda494-0de0-4137-90ba-5caaadd5aa41 has no mapping to a cell. Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:40.121898 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcda494-0de0-4137-90ba-5caaadd5aa41 has no mapping to a cell. Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcda494-0de0-4137-90ba-5caaadd5aa41 has no mapping to a cell. Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:40.127051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-816ac572-2584-4696-a366-e1172c85ff99 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance fdcda494-0de0-4137-90ba-5caaadd5aa41 has no mapping to a cell. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:40.127970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-816ac572-2584-4696-a366-e1172c85ff99 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/fdcda494-0de0-4137-90ba-5caaadd5aa41/action" status: 404 len: 117 microversion: 2.1 time: 0.019678 Oct 04 11:22:40.128444 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3565/4799] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:40 2022] POST /compute/v2.1/servers/fdcda494-0de0-4137-90ba-5caaadd5aa41/action => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:40.135699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:40.136548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:40.143637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:40.144173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:40.144719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:40.145567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:40.146022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:40.146629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:40.342701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:40.351706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:40.353201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:40.354397 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d724e29a-157d-4d0e-a77f-e988d9f8f8f1 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1722 microversion: 2.20 time: 0.223892 Oct 04 11:22:40.354964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3566/4800] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:40 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:40.359687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:40.360290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:40.370175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:40.370658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:40.371085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:40.371789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:40.372254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:40.372688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:40.623194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:40.631378 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1030256-824a-4cf5-9f3b-28c58e2b86c2 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.275152 Oct 04 11:22:40.634083 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3567/4801] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:40 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:40.639501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:40.642684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:40.653225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:40.657928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:40.660886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:40.662941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:40.663606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:40.665580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:40.948471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:40.957869 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-655d3a04-c14c-4a61-a681-d2d392b68c4e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1313 microversion: 2.1 time: 0.321919 Oct 04 11:22:40.983050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3568/4802] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:40 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:40.990687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:40.996389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:41.011876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:41.012391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:41.012842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:41.034030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:41.034649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:41.035109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:41.296493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:41.323458 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96f6e895-e634-4bb0-9952-ef71f260d4a4 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.328975 Oct 04 11:22:41.324155 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3569/4803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:40 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:41.358738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:41.359427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:41.387258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:41.388436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:41.389118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:41.390160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:41.390865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:41.391527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:41.653878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:41.667669 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46ba6175-6a7e-4038-a997-9be19ea5d5e3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1723 microversion: 2.1 time: 0.335959 Oct 04 11:22:41.673037 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3570/4804] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:41 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:41.692363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94587b11-eeb0-4ec6-aa4f-027a45b41641 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:41.696142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94587b11-eeb0-4ec6-aa4f-027a45b41641 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 1bcb93fb-c454-4088-9573-dcc614c0f94f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:41.714066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-94587b11-eeb0-4ec6-aa4f-027a45b41641 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 1bcb93fb-c454-4088-9573-dcc614c0f94f could not be found. Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94587b11-eeb0-4ec6-aa4f-027a45b41641 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/1bcb93fb-c454-4088-9573-dcc614c0f94f/action HTTP/1.1 Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: {"suspend": {}} Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1bcb93fb-c454-4088-9573-dcc614c0f94f could not be found. Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1bcb93fb-c454-4088-9573-dcc614c0f94f', 'body': {'suspend': {}}} Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bcb93fb-c454-4088-9573-dcc614c0f94f could not be found. Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bcb93fb-c454-4088-9573-dcc614c0f94f could not be found. Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:41.716637 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:41.720931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:41.720931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:41.720931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bcb93fb-c454-4088-9573-dcc614c0f94f could not be found. Oct 04 11:22:41.720931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:41.727214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94587b11-eeb0-4ec6-aa4f-027a45b41641 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 1bcb93fb-c454-4088-9573-dcc614c0f94f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:41.728875 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94587b11-eeb0-4ec6-aa4f-027a45b41641 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/1bcb93fb-c454-4088-9573-dcc614c0f94f/action" status: 404 len: 111 microversion: 2.1 time: 0.054536 Oct 04 11:22:41.732394 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3571/4805] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:41 2022] POST /compute/v2.1/servers/1bcb93fb-c454-4088-9573-dcc614c0f94f/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:41.746652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:41.749268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:41.769393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:41.769906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:41.771662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:41.773331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:41.774969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:41.775419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.031043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:42.043406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:42.044525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:42.045767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eec35d6b-01f4-47fd-a905-a6b8f722139f tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1722 microversion: 2.20 time: 0.311856 Oct 04 11:22:42.046553 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3572/4806] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:41 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:42.067532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:42.068164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:42.075419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.076094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.076543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.077265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.077916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.078465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.335090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:42.363399 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-efb5646d-5eb5-44d5-8505-93bbab9fe00d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.301051 Oct 04 11:22:42.365881 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3573/4807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:42 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:42.371780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:42.372533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:42.379272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.380160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.380887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.381970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.383338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.384367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.564979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:42.575056 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c96d7d6-1c97-44e2-88eb-9c346de0dde5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1498 microversion: 2.1 time: 0.207418 Oct 04 11:22:42.575304 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3574/4808] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:42 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1498 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:42.585037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:42.587069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:42.599328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.599908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.600462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.601397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.602092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.603220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.820964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:42.842408 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-edbacc91-2b03-48df-8c2e-06367825577a tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.265964 Oct 04 11:22:42.861739 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3575/4809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:42 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:42.867865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d0b1cc9-eb39-462c-82d7-2efd8df3bada tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:42.883561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.server_groups [None req-1d0b1cc9-eb39-462c-82d7-2efd8df3bada tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Querying cell 6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) for 1 instances {{(pid=122409) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 11:22:42.884420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d0b1cc9-eb39-462c-82d7-2efd8df3bada tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.884902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d0b1cc9-eb39-462c-82d7-2efd8df3bada tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.885335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d0b1cc9-eb39-462c-82d7-2efd8df3bada tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.890271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:42.925210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d0b1cc9-eb39-462c-82d7-2efd8df3bada tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/a47a5ed4-c529-479f-bcec-6c3b586c0ada" status: 200 len: 221 microversion: 2.1 time: 0.055296 Oct 04 11:22:42.938166 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3576/4810] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:22:42 2022] GET /compute/v2.1/os-server-groups/a47a5ed4-c529-479f-bcec-6c3b586c0ada => generated 221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:42.938166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:42.938166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:42.944076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.944696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.945702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:42.946415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:42.946872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:42.947690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.186614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:43.202442 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb1745e3-c8fb-401f-84e5-e0c8cc648d1b tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1700 microversion: 2.1 time: 0.274405 Oct 04 11:22:43.204028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3577/4811] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:42 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1700 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:43.212084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:43.212912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:43.224191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:43.224927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:43.225811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.228134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:43.229195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:43.231176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.269454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lazy-loading 'flavor' on Instance uuid 53d5329f-b493-4a25-a450-823121e8358a {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:22:43.377655 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dbcbc45d-6651-40d3-8aee-723905b0eba1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 202 len: 0 microversion: 2.1 time: 0.170587 Oct 04 11:22:43.379647 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3578/4812] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:43 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:22:43.388642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:43.393120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:43.407650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:43.408154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:43.409989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.411096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:43.412040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:43.412193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.487430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:22:43.733887 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97af2711-4297-48fb-97b0-c98b2c6be935 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 204 len: 0 microversion: 2.1 time: 0.351915 Oct 04 11:22:43.735657 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3579/4813] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:22:43 2022] DELETE /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:22:43.749285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:43.750181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:43.764962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:43.766052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:43.767051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.768552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:43.771650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:43.772928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.833905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:43.834720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:43.835340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.836689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lazy-loading 'fault' on Instance uuid e69337b0-3580-43cd-ac13-11f030e3804b {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:22:43.891261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:43.900623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:43.902296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:43.903538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-79eef16a-cdd4-495e-a2fa-45e1459c9079 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1370 microversion: 2.20 time: 0.164340 Oct 04 11:22:43.904410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3580/4814] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:43 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:43.928578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8a9531c-edb2-4c25-8ea5-3b7fbb3369fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:43.936384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a9531c-edb2-4c25-8ea5-3b7fbb3369fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:43.936886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a9531c-edb2-4c25-8ea5-3b7fbb3369fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:43.937452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a9531c-edb2-4c25-8ea5-3b7fbb3369fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:43.978661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8a9531c-edb2-4c25-8ea5-3b7fbb3369fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Going to try to start instance {{(pid=122409) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 11:22:44.044501 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8a9531c-edb2-4c25-8ea5-3b7fbb3369fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/action" status: 202 len: 0 microversion: 2.1 time: 0.119222 Oct 04 11:22:44.045317 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3581/4815] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:43 2022] POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:22:44.052668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b03d72c3-7c3f-4008-bd53-bc908fe6c629 req-f9b01b88-28a2-48dc-8831-6b15354b6cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69337b0-3580-43cd-ac13-11f030e3804b", "name": "network-vif-deleted", "tag": "a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:44.065818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b03d72c3-7c3f-4008-bd53-bc908fe6c629 req-f9b01b88-28a2-48dc-8831-6b15354b6cb8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.066365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b03d72c3-7c3f-4008-bd53-bc908fe6c629 req-f9b01b88-28a2-48dc-8831-6b15354b6cb8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.066805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b03d72c3-7c3f-4008-bd53-bc908fe6c629 req-f9b01b88-28a2-48dc-8831-6b15354b6cb8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:44.082714 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b03d72c3-7c3f-4008-bd53-bc908fe6c629 req-f9b01b88-28a2-48dc-8831-6b15354b6cb8 service nova] Creating event network-vif-deleted:a163483a-7e42-4c5a-bbbe-d8bfcb89b1ac for instance e69337b0-3580-43cd-ac13-11f030e3804b on n-h1-791135-8 Oct 04 11:22:44.090746 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b03d72c3-7c3f-4008-bd53-bc908fe6c629 req-f9b01b88-28a2-48dc-8831-6b15354b6cb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042088 Oct 04 11:22:44.093614 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3582/4816] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:44.100817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:44.102332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:44.109942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.110475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.110921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:44.111732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.112591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.113012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:44.350929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:44.366264 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2f67948-a4ec-4627-8c9e-0622cb8691fc tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1513 microversion: 2.1 time: 0.271167 Oct 04 11:22:44.367747 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3583/4817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:44 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1513 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:44.386190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:44.387456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:44.398690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.399013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.399488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:44.400143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.406245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.406946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:44.641231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:44.650802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-67814b40-fb7d-4fac-9814-b6d866a8a74d tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1504 microversion: 2.1 time: 0.281712 Oct 04 11:22:44.651648 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3584/4818] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:44 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:44.656919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:44.657896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:44.673340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.675595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.676140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:44.677129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.677958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.678607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:44.913319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:44.928494 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2c81f2f4-4ad5-40b3-8856-8220a01aa2c0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1709 microversion: 2.1 time: 0.275477 Oct 04 11:22:44.948881 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3585/4819] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:44 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1709 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:44.948881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:44.948881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:44.960253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:44.964978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.965393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.965839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:44.966587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:44.967070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:44.967504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:45.035829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:45.036425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:45.036928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:45.037495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lazy-loading 'fault' on Instance uuid e69337b0-3580-43cd-ac13-11f030e3804b {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:22:45.262052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:45.272424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:45.277337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15409bd95f884840b4f3fe972ade15ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20d71eb38ede4033ae37903456138987', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:45.281643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e87d9f3-686f-4881-8d7c-de5555249340 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 200 len: 1370 microversion: 2.20 time: 0.346238 Oct 04 11:22:45.287458 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3586/4820] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:44 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:22:45.402235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:45.403060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:45.415946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:45.416691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:45.417289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:45.430607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:45.431318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:45.431947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:45.753223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:45.761999 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e81bce28-08cd-4478-97f7-7ab8dd47933e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1496 microversion: 2.1 time: 0.372760 Oct 04 11:22:45.766250 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3587/4821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:45 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1496 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:45.778360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:45.778360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:45.788437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:45.789219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:45.789849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:45.790722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:45.791322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:45.791892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.041675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3972617498ba4b7dace9cff9d59a54ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eb7a8ff4d9b499bb41f5bbc834b0f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:46.044614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:46.052373 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d4635bb7-283c-4e33-948e-ed46023ea39c tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 200 len: 1504 microversion: 2.1 time: 0.284972 Oct 04 11:22:46.053406 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3588/4822] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:45 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:46.059225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:46.060090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:46.068201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.068967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.069648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.071108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.087757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.088608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.136140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lazy-loading 'flavor' on Instance uuid 53d5329f-b493-4a25-a450-823121e8358a {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:22:46.162240 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Cannot 'suspend' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state suspended Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action HTTP/1.1 Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: {"suspend": {}} Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'suspend' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state suspended Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'suspend': {}}} Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53d5329f-b493-4a25-a450-823121e8358a in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 11:22:46.164636 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state suspended Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state suspended Oct 04 11:22:46.169249 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.173300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 409 to user: Cannot 'suspend' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state suspended {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:46.174481 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5e87282-7566-4295-885f-f6b07bb3fdf1 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 409 len: 148 microversion: 2.1 time: 0.119317 Oct 04 11:22:46.175289 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3589/4823] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:46 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 148 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:22:46.181113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:46.182332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:46.189687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.190515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.191372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.192661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.193323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.193971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.641544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:46.660965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ced4e62-681c-4010-972f-a573de355f05 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1709 microversion: 2.1 time: 0.484404 Oct 04 11:22:46.661925 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3590/4824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:46 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1709 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:46.675474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:46.676026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:46.696354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.701298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.701774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.710118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.711303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.711851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.806188 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9745a468-218c-495e-802f-60f17301bb0e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 202 len: 0 microversion: 2.1 time: 0.142771 Oct 04 11:22:46.807428 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3591/4825] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:46 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:22:46.816596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:46.817333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:46.830404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.830913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.832015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.832423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.832890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.833327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.848895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] HTTP exception thrown: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Request method failure captured: Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b HTTP/1.1 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBXiPY_G-bdBBtrLJ44bjZ03Rz6iree9N6yLOKfGY7TDAtoXLfnQrKZK6iJzwtvABsGKVoHY_DSnRbqJH2ueEDkHYFHpOEB2Dz1mRkZh8VIAhEWAJYusCqT8GbGVV_qyQV93fegmfJmguCZN9Aw-Wq5DPW-z8k_scR9zrjEffHEDI6U Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d71eb38ede4033ae37903456138987"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d71eb38ede4033ae37903456138987"}]}] Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 15409bd95f884840b4f3fe972ade15ef Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'e69337b0-3580-43cd-ac13-11f030e3804b'} Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.852148 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Returning 404 to user: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5539ce1-b354-4a57-8e01-d6702e4505b8 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 404 len: 111 microversion: 2.20 time: 0.043818 Oct 04 11:22:46.857641 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3592/4826] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:46 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:22:46.861862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b2f48bd0-ee80-4e10-a439-26e5b691d5c7 req-e314d898-e586-4350-b9a9-13c26f85a9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41a1e3c-e5a4-446c-8113-34366fa39465", "name": "network-vif-deleted", "tag": "0a16151c-ac6b-4c9b-9331-f602fc283917"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:46.898960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b2f48bd0-ee80-4e10-a439-26e5b691d5c7 req-e314d898-e586-4350-b9a9-13c26f85a9d1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.901714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b2f48bd0-ee80-4e10-a439-26e5b691d5c7 req-e314d898-e586-4350-b9a9-13c26f85a9d1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.902168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b2f48bd0-ee80-4e10-a439-26e5b691d5c7 req-e314d898-e586-4350-b9a9-13c26f85a9d1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.931853 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b2f48bd0-ee80-4e10-a439-26e5b691d5c7 req-e314d898-e586-4350-b9a9-13c26f85a9d1 service nova] Creating event network-vif-deleted:0a16151c-ac6b-4c9b-9331-f602fc283917 for instance b41a1e3c-e5a4-446c-8113-34366fa39465 on n-h1-791135-8 Oct 04 11:22:46.937530 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b2f48bd0-ee80-4e10-a439-26e5b691d5c7 req-e314d898-e586-4350-b9a9-13c26f85a9d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079380 Oct 04 11:22:46.938721 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3593/4827] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:46.959368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:46.960144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:46.971654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.975180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.976422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:46.978491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:46.981530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:46.982179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:47.036632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:22:47.206130 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d191293e-274c-4173-9e58-00a6d7d2728b tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 204 len: 0 microversion: 2.1 time: 0.265105 Oct 04 11:22:47.213475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3594/4828] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:22:46 2022] DELETE /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:22:47.219815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:47.220678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:47.230287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:47.230791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:47.231847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:47.232707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:47.233316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:47.234691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:47.477223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:47.489328 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b30d86fb-dbab-4e5c-baab-6f8962d11373 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1502 microversion: 2.1 time: 0.274424 Oct 04 11:22:47.494479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3595/4829] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:47 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:47.506585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cdca4a7d-2a11-4e0e-8551-3cc627eff91a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '.version_select at 0x7f71d488fd30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:47.562323 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cdca4a7d-2a11-4e0e-8551-3cc627eff91a tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976102537" status: 204 len: 0 microversion: 2.20 time: 0.066045 Oct 04 11:22:47.563338 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3596/4830] 10.222.0.23 () {60 vars in 1259 bytes} [Tue Oct 4 11:22:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976102537 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:22:47.569248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:47.570418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:47.577689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:47.578454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:47.579150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:47.580232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:47.580879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:47.581599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:47.612640 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] HTTP exception thrown: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Request method failure captured: Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 HTTP/1.1 Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdvr-faMiWI_73hkOqqnNc5NZbETp3T_6xxxsrnMWuLB0ojJJOa5_OE-et5BXlgTLVqruY6Kg_mcKNq4EcJ6sB8gu7Z_lkARsirIrFH22l4BcKWYxt2Uz_UN3uxAjg0x1ji-K6t3xJoCg9HaIjtCeQaRz0_OPW8tY9lvWVNr4DRbdE Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}] Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3972617498ba4b7dace9cff9d59a54ef Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b41a1e3c-e5a4-446c-8113-34366fa39465'} Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:47.614889 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:47.621184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:47.621184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:47.621184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:47.621184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:47.621184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:47.621184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:47.621184 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:47.621184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Returning 404 to user: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:47.623161 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6f70d6b5-52ce-4452-aa90-76f11afe07f3 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 404 len: 111 microversion: 2.1 time: 0.058182 Oct 04 11:22:47.623927 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3597/4831] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:47 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:47.635598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:47.639749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:47.649860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:47.651123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:47.651754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:47.652961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:47.653951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:47.654583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:48.194431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:48.211483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7b4449c-6f60-4397-82ae-8bae040a7ac4 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1665 microversion: 2.1 time: 0.586156 Oct 04 11:22:48.213796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3598/4832] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:47 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1665 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:48.227990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6aff352d-0cc2-4998-b821-8adecb2487ca tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:48.277717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.server_groups [None req-6aff352d-0cc2-4998-b821-8adecb2487ca tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Querying cell 6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) for 1 instances {{(pid=122409) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 11:22:48.277717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aff352d-0cc2-4998-b821-8adecb2487ca tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:48.277717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aff352d-0cc2-4998-b821-8adecb2487ca tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:48.277717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6aff352d-0cc2-4998-b821-8adecb2487ca tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:48.293006 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6aff352d-0cc2-4998-b821-8adecb2487ca tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.077933 Oct 04 11:22:48.294358 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3599/4833] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:22:48 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:48.303291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:48.304851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:48.312597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:48.313890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:48.314550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:48.315439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:48.316114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:48.316741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:48.764201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:48.778897 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57b311da-4c7f-4fc7-b634-cf0d62f193ce tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1713 microversion: 2.1 time: 0.483207 Oct 04 11:22:48.780626 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3600/4834] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:48 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1713 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:48.795719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f41fde2-8e3d-4bc7-926d-862f9a95a5e6 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:48.820216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.server_groups [None req-8f41fde2-8e3d-4bc7-926d-862f9a95a5e6 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Querying cell 6cc6fbec-876d-44b6-94f9-b28a0a237215(cell1) for 1 instances {{(pid=122409) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 11:22:48.825344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f41fde2-8e3d-4bc7-926d-862f9a95a5e6 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:48.826250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f41fde2-8e3d-4bc7-926d-862f9a95a5e6 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:48.826982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f41fde2-8e3d-4bc7-926d-862f9a95a5e6 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:48.849042 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f41fde2-8e3d-4bc7-926d-862f9a95a5e6 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/a47a5ed4-c529-479f-bcec-6c3b586c0ada" status: 200 len: 183 microversion: 2.1 time: 0.067292 Oct 04 11:22:48.852005 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3601/4835] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:22:48 2022] GET /compute/v2.1/os-server-groups/a47a5ed4-c529-479f-bcec-6c3b586c0ada => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:48.864590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:48.865532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:48.883917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:48.884414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:48.884851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:48.885655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:48.886039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:48.886470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:49.083939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:49.098040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1709ed4b-9564-404d-8ff9-c5d80d49ff38 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1502 microversion: 2.1 time: 0.236421 Oct 04 11:22:49.114671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3602/4836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:48 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:49.120470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:49.121211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:49.130555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:49.131309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:49.131912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:49.133315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:49.133942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:49.134545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:49.150369 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] HTTP exception thrown: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Request method failure captured: Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 HTTP/1.1 Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdvr-faMiWI_73hkOqqnNc5NZbETp3T_6xxxsrnMWuLB0ojJJOa5_OE-et5BXlgTLVqruY6Kg_mcKNq4EcJ6sB8gu7Z_lkARsirIrFH22l4BcKWYxt2Uz_UN3uxAjg0x1ji-K6t3xJoCg9HaIjtCeQaRz0_OPW8tY9lvWVNr4DRbdE Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}] Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3972617498ba4b7dace9cff9d59a54ef Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b41a1e3c-e5a4-446c-8113-34366fa39465'} Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:49.152579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.157106 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.159078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Returning 404 to user: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:49.160245 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-509b023e-6e71-4a63-bb09-7c8077bc48f1 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 404 len: 111 microversion: 2.1 time: 0.044327 Oct 04 11:22:49.160967 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3603/4837] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:22:49 2022] DELETE /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:49.169145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:49.170134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] [instance: b41a1e3c-e5a4-446c-8113-34366fa39465] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:49.176623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:49.177329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:49.179278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:49.180223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:49.180688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:49.181309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:49.208594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] HTTP exception thrown: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Request method failure captured: Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 HTTP/1.1 Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdvr-faMiWI_73hkOqqnNc5NZbETp3T_6xxxsrnMWuLB0ojJJOa5_OE-et5BXlgTLVqruY6Kg_mcKNq4EcJ6sB8gu7Z_lkARsirIrFH22l4BcKWYxt2Uz_UN3uxAjg0x1ji-K6t3xJoCg9HaIjtCeQaRz0_OPW8tY9lvWVNr4DRbdE Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}] Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3972617498ba4b7dace9cff9d59a54ef Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b41a1e3c-e5a4-446c-8113-34366fa39465'} Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.210054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Returning 404 to user: Instance b41a1e3c-e5a4-446c-8113-34366fa39465 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:49.215294 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-65a85513-6146-4d38-97ca-4dc697f1ada5 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465" status: 404 len: 111 microversion: 2.1 time: 0.046907 Oct 04 11:22:49.222411 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3604/4838] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:49 2022] GET /compute/v2.1/servers/b41a1e3c-e5a4-446c-8113-34366fa39465 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:49.227536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c60e8df2-6533-460f-bee6-0eced04b3bbe tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:49.244226 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c60e8df2-6533-460f-bee6-0eced04b3bbe tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] HTTP exception thrown: Instance group d252e9c8-c9d8-425c-b299-219f2a21b2e1 could not be found. Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c60e8df2-6533-460f-bee6-0eced04b3bbe tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Request method failure captured: Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-server-groups/d252e9c8-c9d8-425c-b299-219f2a21b2e1 HTTP/1.1 Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdvr-faMiWI_73hkOqqnNc5NZbETp3T_6xxxsrnMWuLB0ojJJOa5_OE-et5BXlgTLVqruY6Kg_mcKNq4EcJ6sB8gu7Z_lkARsirIrFH22l4BcKWYxt2Uz_UN3uxAjg0x1ji-K6t3xJoCg9HaIjtCeQaRz0_OPW8tY9lvWVNr4DRbdE Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}] Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3972617498ba4b7dace9cff9d59a54ef Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance group d252e9c8-c9d8-425c-b299-219f2a21b2e1 could not be found. Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'd252e9c8-c9d8-425c-b299-219f2a21b2e1'} Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d252e9c8-c9d8-425c-b299-219f2a21b2e1 could not be found. Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d252e9c8-c9d8-425c-b299-219f2a21b2e1 could not be found. Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.245932 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.251384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.251384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.251384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:49.251384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:49.251384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d252e9c8-c9d8-425c-b299-219f2a21b2e1 could not be found. Oct 04 11:22:49.251384 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.253031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c60e8df2-6533-460f-bee6-0eced04b3bbe tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Returning 404 to user: Instance group d252e9c8-c9d8-425c-b299-219f2a21b2e1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:49.254977 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c60e8df2-6533-460f-bee6-0eced04b3bbe tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/d252e9c8-c9d8-425c-b299-219f2a21b2e1" status: 404 len: 117 microversion: 2.1 time: 0.031241 Oct 04 11:22:49.255849 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3605/4839] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:49 2022] DELETE /compute/v2.1/os-server-groups/d252e9c8-c9d8-425c-b299-219f2a21b2e1 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:49.267114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:49.267930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:49.281619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:49.282336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:49.283558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:49.284433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:49.285075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:49.296907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:49.538473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:49.569477 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac4ed8fb-1a45-4417-a232-04788a6564e8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1665 microversion: 2.1 time: 0.308438 Oct 04 11:22:49.570736 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3606/4840] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:49 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1665 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:49.576072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9949548c-f385-4dd0-a648-1a696141bb0e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:49.601625 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9949548c-f385-4dd0-a648-1a696141bb0e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] HTTP exception thrown: Instance group a0448730-3a65-4a9f-9df7-cc5c98cd9883 could not be found. Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9949548c-f385-4dd0-a648-1a696141bb0e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Request method failure captured: Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-server-groups/a0448730-3a65-4a9f-9df7-cc5c98cd9883 HTTP/1.1 Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdvr-faMiWI_73hkOqqnNc5NZbETp3T_6xxxsrnMWuLB0ojJJOa5_OE-et5BXlgTLVqruY6Kg_mcKNq4EcJ6sB8gu7Z_lkARsirIrFH22l4BcKWYxt2Uz_UN3uxAjg0x1ji-K6t3xJoCg9HaIjtCeQaRz0_OPW8tY9lvWVNr4DRbdE Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}] Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3972617498ba4b7dace9cff9d59a54ef Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance group a0448730-3a65-4a9f-9df7-cc5c98cd9883 could not be found. Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a0448730-3a65-4a9f-9df7-cc5c98cd9883'} Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a0448730-3a65-4a9f-9df7-cc5c98cd9883 could not be found. Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a0448730-3a65-4a9f-9df7-cc5c98cd9883 could not be found. Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.605735 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.611634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.611634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.611634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:49.611634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:49.611634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a0448730-3a65-4a9f-9df7-cc5c98cd9883 could not be found. Oct 04 11:22:49.611634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.611634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9949548c-f385-4dd0-a648-1a696141bb0e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Returning 404 to user: Instance group a0448730-3a65-4a9f-9df7-cc5c98cd9883 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:49.612542 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9949548c-f385-4dd0-a648-1a696141bb0e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/a0448730-3a65-4a9f-9df7-cc5c98cd9883" status: 404 len: 117 microversion: 2.1 time: 0.040774 Oct 04 11:22:49.618045 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3607/4841] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:49 2022] DELETE /compute/v2.1/os-server-groups/a0448730-3a65-4a9f-9df7-cc5c98cd9883 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:49.624399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01176e9e-bdcc-4a63-b68a-00c6ddffca76 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:49.632918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-01176e9e-bdcc-4a63-b68a-00c6ddffca76 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] HTTP exception thrown: Instance group 1f5d45df-a37c-43d8-a634-26bcc1e2d32e could not be found. Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01176e9e-bdcc-4a63-b68a-00c6ddffca76 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Request method failure captured: Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-server-groups/1f5d45df-a37c-43d8-a634-26bcc1e2d32e HTTP/1.1 Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdvr-faMiWI_73hkOqqnNc5NZbETp3T_6xxxsrnMWuLB0ojJJOa5_OE-et5BXlgTLVqruY6Kg_mcKNq4EcJ6sB8gu7Z_lkARsirIrFH22l4BcKWYxt2Uz_UN3uxAjg0x1ji-K6t3xJoCg9HaIjtCeQaRz0_OPW8tY9lvWVNr4DRbdE Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}] Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3972617498ba4b7dace9cff9d59a54ef Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance group 1f5d45df-a37c-43d8-a634-26bcc1e2d32e could not be found. Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1f5d45df-a37c-43d8-a634-26bcc1e2d32e'} Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1f5d45df-a37c-43d8-a634-26bcc1e2d32e could not be found. Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1f5d45df-a37c-43d8-a634-26bcc1e2d32e could not be found. Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.634843 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.640345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.640345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.640345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:49.640345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:49.640345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1f5d45df-a37c-43d8-a634-26bcc1e2d32e could not be found. Oct 04 11:22:49.640345 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.642398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01176e9e-bdcc-4a63-b68a-00c6ddffca76 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Returning 404 to user: Instance group 1f5d45df-a37c-43d8-a634-26bcc1e2d32e could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:49.643599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01176e9e-bdcc-4a63-b68a-00c6ddffca76 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/1f5d45df-a37c-43d8-a634-26bcc1e2d32e" status: 404 len: 117 microversion: 2.1 time: 0.024165 Oct 04 11:22:49.644206 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3608/4842] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:49 2022] DELETE /compute/v2.1/os-server-groups/1f5d45df-a37c-43d8-a634-26bcc1e2d32e => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:49.654149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7df86224-c4cb-453d-992c-9eb31045ad2e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:49.660636 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7df86224-c4cb-453d-992c-9eb31045ad2e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] HTTP exception thrown: Instance group aa56cb03-7666-403c-9c7d-f960b2c08322 could not be found. Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7df86224-c4cb-453d-992c-9eb31045ad2e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Request method failure captured: Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-server-groups/aa56cb03-7666-403c-9c7d-f960b2c08322 HTTP/1.1 Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBdvr-faMiWI_73hkOqqnNc5NZbETp3T_6xxxsrnMWuLB0ojJJOa5_OE-et5BXlgTLVqruY6Kg_mcKNq4EcJ6sB8gu7Z_lkARsirIrFH22l4BcKWYxt2Uz_UN3uxAjg0x1ji-K6t3xJoCg9HaIjtCeQaRz0_OPW8tY9lvWVNr4DRbdE Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3eb7a8ff4d9b499bb41f5bbc834b0f4e"}]}] Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3eb7a8ff4d9b499bb41f5bbc834b0f4e Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerGroupTestJSON-70533402 Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3972617498ba4b7dace9cff9d59a54ef Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerGroupTestJSON-70533402-project Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance group aa56cb03-7666-403c-9c7d-f960b2c08322 could not be found. Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'aa56cb03-7666-403c-9c7d-f960b2c08322'} Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group aa56cb03-7666-403c-9c7d-f960b2c08322 could not be found. Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group aa56cb03-7666-403c-9c7d-f960b2c08322 could not be found. Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.662508 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group aa56cb03-7666-403c-9c7d-f960b2c08322 could not be found. Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7df86224-c4cb-453d-992c-9eb31045ad2e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Returning 404 to user: Instance group aa56cb03-7666-403c-9c7d-f960b2c08322 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7df86224-c4cb-453d-992c-9eb31045ad2e tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/aa56cb03-7666-403c-9c7d-f960b2c08322" status: 404 len: 117 microversion: 2.1 time: 0.014443 Oct 04 11:22:49.666546 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3609/4843] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:49 2022] DELETE /compute/v2.1/os-server-groups/aa56cb03-7666-403c-9c7d-f960b2c08322 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:49.674174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfbe5c4b-2f0a-48c1-b1a0-ba8c243a8c48 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:49.706230 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfbe5c4b-2f0a-48c1-b1a0-ba8c243a8c48 tempest-ServerGroupTestJSON-70533402 tempest-ServerGroupTestJSON-70533402-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/a47a5ed4-c529-479f-bcec-6c3b586c0ada" status: 204 len: 0 microversion: 2.1 time: 0.036768 Oct 04 11:22:49.711089 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3610/4844] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 4 11:22:49 2022] DELETE /compute/v2.1/os-server-groups/a47a5ed4-c529-479f-bcec-6c3b586c0ada => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:22:50.128561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:50.129922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:50.135905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:50.136396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:50.136836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:50.137641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:50.138100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:50.138528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:51.208083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:51.216697 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4e8b017-5f34-40b0-addd-53c29df9cd68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1502 microversion: 2.1 time: 1.092154 Oct 04 11:22:51.233295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3611/4845] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:50 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1502 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:51.237387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:51.239373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:51.259318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:51.259795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:51.260243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:51.260978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:51.261474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:51.261914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:51.510569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865c85b1f3044ff092538d55abf5974b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc275d32d0924b5a9dbf627449391012', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:51.520434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aec83b1a-0bd4-4b53-b4c2-5fe21ab52991 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 200 len: 1598 microversion: 2.1 time: 0.294385 Oct 04 11:22:51.525277 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3612/4846] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:51 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 1598 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:51.530152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-47996deb-312c-46da-ba66-d2aedd9b7426 req-0c785d91-c824-4664-866c-ab3e91ec2963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a305ec7-6dc1-4d68-8b57-b0e9f7978813", "name": "network-vif-deleted", "tag": "44570c15-3539-4d42-bab8-3e7a23e38f96"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:51.555426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-47996deb-312c-46da-ba66-d2aedd9b7426 req-0c785d91-c824-4664-866c-ab3e91ec2963 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:51.556202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-47996deb-312c-46da-ba66-d2aedd9b7426 req-0c785d91-c824-4664-866c-ab3e91ec2963 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:51.556790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-47996deb-312c-46da-ba66-d2aedd9b7426 req-0c785d91-c824-4664-866c-ab3e91ec2963 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:51.578733 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-47996deb-312c-46da-ba66-d2aedd9b7426 req-0c785d91-c824-4664-866c-ab3e91ec2963 service nova] Creating event network-vif-deleted:44570c15-3539-4d42-bab8-3e7a23e38f96 for instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 on n-h2-791135-8 Oct 04 11:22:51.605141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-47996deb-312c-46da-ba66-d2aedd9b7426 req-0c785d91-c824-4664-866c-ab3e91ec2963 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078314 Oct 04 11:22:51.609745 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3613/4847] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:22:52.242641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:52.245891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:52.264237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:52.279097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:52.280485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:52.283664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:52.285799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:52.287647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:52.302633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:53.123328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:53.143484 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-833e5594-83bb-4b36-8fa6-16cae9eca3fd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.906898 Oct 04 11:22:53.194742 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3614/4848] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:52 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:53.221107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:53.224473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] [instance: 6a305ec7-6dc1-4d68-8b57-b0e9f7978813] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:53.252644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:53.253851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:53.254907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:53.255828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:53.269972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:53.270476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:53.319712 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] HTTP exception thrown: Instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 could not be found. Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Request method failure captured: Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 HTTP/1.1 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBccAkiEmzSqzcj3KZr9O0RJKwfm18ogzrFsIkg0uJ5hgk0CTEtEqrKEzRi7e8clLUjl_g496PRzsT8qLMbOlo41XPqQ6ut_qGo72fDySukYo0cGEJJRUTwdGo-3b4bUzrROt-46CLv-Uvq-vjEcqL8w6F_hwmcgw06n1Szd0XoxPhI Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: fc275d32d0924b5a9dbf627449391012 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersTestFqdnHostnames-792968350 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc275d32d0924b5a9dbf627449391012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc275d32d0924b5a9dbf627449391012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc275d32d0924b5a9dbf627449391012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc275d32d0924b5a9dbf627449391012"}]}] Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersTestFqdnHostnames-792968350 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: fc275d32d0924b5a9dbf627449391012 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-792968350 Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersTestFqdnHostnames-792968350-project Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 865c85b1f3044ff092538d55abf5974b Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersTestFqdnHostnames-792968350-project Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 could not be found. Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '6a305ec7-6dc1-4d68-8b57-b0e9f7978813'} Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 could not be found. Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 could not be found. Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:53.321717 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.326633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:53.326633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:53.326633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:53.326633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:53.326633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:53.326633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 could not be found. Oct 04 11:22:53.326633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.329287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Returning 404 to user: Instance 6a305ec7-6dc1-4d68-8b57-b0e9f7978813 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:53.330638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7814c2c0-09f6-4368-b225-f2b5bda0a0c8 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813" status: 404 len: 111 microversion: 2.1 time: 0.134457 Oct 04 11:22:53.331459 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3615/4849] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:53 2022] GET /compute/v2.1/servers/6a305ec7-6dc1-4d68-8b57-b0e9f7978813 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:53.340978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:53.341831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:53.349584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:53.350395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:53.351656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:53.352666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:53.353424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:53.354144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:53.785034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:53.813246 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-21350f3e-7ab3-406e-b404-719ec163053c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.480373 Oct 04 11:22:53.830138 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3616/4850] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:53 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:53.837235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1160d584-7dd7-4847-87aa-934296499c48 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] Calling method '.version_select at 0x7f71cf6894c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:53.872286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1160d584-7dd7-4847-87aa-934296499c48 tempest-ServersTestFqdnHostnames-792968350 tempest-ServersTestFqdnHostnames-792968350-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-745833111" status: 202 len: 0 microversion: 2.1 time: 0.040831 Oct 04 11:22:53.875049 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3617/4851] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-745833111 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:22:53.891310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e91db7b1-70b0-4ff9-b590-d739e2002279 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:53.892967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e91db7b1-70b0-4ff9-b590-d739e2002279 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 45e8d4f4-ced7-4f2a-a081-3b6b51935c87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:53.926250 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e91db7b1-70b0-4ff9-b590-d739e2002279 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 45e8d4f4-ced7-4f2a-a081-3b6b51935c87 could not be found. Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e91db7b1-70b0-4ff9-b590-d739e2002279 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/45e8d4f4-ced7-4f2a-a081-3b6b51935c87/action HTTP/1.1 Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: {"unpause": {}} Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 45e8d4f4-ced7-4f2a-a081-3b6b51935c87 could not be found. Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '45e8d4f4-ced7-4f2a-a081-3b6b51935c87', 'body': {'unpause': {}}} Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e8d4f4-ced7-4f2a-a081-3b6b51935c87 could not be found. Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e8d4f4-ced7-4f2a-a081-3b6b51935c87 could not be found. Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:53.928246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:53.932404 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:53.932404 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:53.932404 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e8d4f4-ced7-4f2a-a081-3b6b51935c87 could not be found. Oct 04 11:22:53.932404 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:53.936301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e91db7b1-70b0-4ff9-b590-d739e2002279 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 45e8d4f4-ced7-4f2a-a081-3b6b51935c87 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:53.937190 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e91db7b1-70b0-4ff9-b590-d739e2002279 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/45e8d4f4-ced7-4f2a-a081-3b6b51935c87/action" status: 404 len: 111 microversion: 2.1 time: 0.060879 Oct 04 11:22:53.937820 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3618/4852] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:53 2022] POST /compute/v2.1/servers/45e8d4f4-ced7-4f2a-a081-3b6b51935c87/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:53.949206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:53.951427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:53.973510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:53.978144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:53.979609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:53.982241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:53.982880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:53.984238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:54.505737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:54.525515 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2fe39393-c607-4200-a1d6-ef8ca806d178 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.581912 Oct 04 11:22:54.546913 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3619/4853] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:53 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:54.556056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:54.562253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:54.571750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:54.572252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:54.582174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:54.582969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:54.583454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:54.584073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:54.922174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:54.932544 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8318875-52d8-40c0-a64c-f47ba41eeb98 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.380426 Oct 04 11:22:54.938169 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3620/4854] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:54 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:54.953931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:54.954442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:54.977238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:54.977774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:54.985537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:54.986507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:54.987001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:54.987446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:55.022650 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] HTTP exception thrown: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Request method failure captured: Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b HTTP/1.1 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBXiPY_G-bdBBtrLJ44bjZ03Rz6iree9N6yLOKfGY7TDAtoXLfnQrKZK6iJzwtvABsGKVoHY_DSnRbqJH2ueEDkHYFHpOEB2Dz1mRkZh8VIAhEWAJYusCqT8GbGVV_qyQV93fegmfJmguCZN9Aw-Wq5DPW-z8k_scR9zrjEffHEDI6U Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d71eb38ede4033ae37903456138987"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d71eb38ede4033ae37903456138987"}]}] Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 15409bd95f884840b4f3fe972ade15ef Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'e69337b0-3580-43cd-ac13-11f030e3804b'} Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:55.033368 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.038066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Returning 404 to user: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:55.047289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2498c99e-3bfd-46fd-a08c-422c2b2f7593 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 404 len: 111 microversion: 2.20 time: 0.095612 Oct 04 11:22:55.048212 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3621/4855] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:22:54 2022] DELETE /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:22:55.054348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:55.054900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:55.061372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:55.061966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:55.062355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:55.063067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:55.063875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:55.064313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:55.126047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Cannot 'unpause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action HTTP/1.1 Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 15 Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: {"unpause": {}} Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'unpause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'unpause': {}}} Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53d5329f-b493-4a25-a450-823121e8358a in vm_state active. Cannot unpause while the instance is in this state. Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.127724 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:55.132695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:55.132695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:55.132695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:55.132695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:22:55.132695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.132695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 409 to user: Cannot 'unpause' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:55.132695 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9015e950-e355-408f-b8d6-613a7c94a9b3 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 409 len: 145 microversion: 2.1 time: 0.083197 Oct 04 11:22:55.136641 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3622/4856] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:55 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 145 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:22:55.144218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:55.145933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: e69337b0-3580-43cd-ac13-11f030e3804b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:55.160595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:55.160893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:55.162979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:55.164603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:55.169665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:55.172458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:55.193792 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] HTTP exception thrown: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Request method failure captured: Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b HTTP/1.1 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBXiPY_G-bdBBtrLJ44bjZ03Rz6iree9N6yLOKfGY7TDAtoXLfnQrKZK6iJzwtvABsGKVoHY_DSnRbqJH2ueEDkHYFHpOEB2Dz1mRkZh8VIAhEWAJYusCqT8GbGVV_qyQV93fegmfJmguCZN9Aw-Wq5DPW-z8k_scR9zrjEffHEDI6U Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d71eb38ede4033ae37903456138987"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d71eb38ede4033ae37903456138987"}]}] Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 15409bd95f884840b4f3fe972ade15ef Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'e69337b0-3580-43cd-ac13-11f030e3804b'} Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.199390 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:55.206043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.206043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:55.206043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:55.206043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:55.206043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:55.206043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:55.206043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. Oct 04 11:22:55.206043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:55.208141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Returning 404 to user: Instance e69337b0-3580-43cd-ac13-11f030e3804b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:55.209257 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34a4c161-e7d2-4a1c-9745-afca5f557cf7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b" status: 404 len: 111 microversion: 2.20 time: 0.073984 Oct 04 11:22:55.210148 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3623/4857] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:22:55 2022] GET /compute/v2.1/servers/e69337b0-3580-43cd-ac13-11f030e3804b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:22:55.216437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:55.217562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:55.228637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:55.229579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:55.230252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:55.231297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:55.232057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:55.232720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:56.135227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:56.147900 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-542adc53-87a9-4387-949d-2065f513ab81 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.936440 Oct 04 11:22:56.150872 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3624/4858] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:55 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:56.179946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:56.180888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:56.191688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:22:56.193519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:56.202082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:56.202829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:56.203785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:56.206551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:56.207226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:56.724102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:56.732910 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d12920dc-bf21-4273-8095-70e7e4935396 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.558412 Oct 04 11:22:56.739773 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3625/4859] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:56 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:56.762367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c774ecc-fb24-4f6a-87be-e382aafb5b09 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:56.773899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6c774ecc-fb24-4f6a-87be-e382aafb5b09 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 40b1f02d-9090-4b90-aaec-41f90473a04a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:56.783071 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6c774ecc-fb24-4f6a-87be-e382aafb5b09 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 40b1f02d-9090-4b90-aaec-41f90473a04a could not be found. Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c774ecc-fb24-4f6a-87be-e382aafb5b09 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/40b1f02d-9090-4b90-aaec-41f90473a04a/action HTTP/1.1 Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 18 Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: {"unshelve": null} Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 40b1f02d-9090-4b90-aaec-41f90473a04a could not be found. Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '40b1f02d-9090-4b90-aaec-41f90473a04a', 'body': {'unshelve': None}} Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b1f02d-9090-4b90-aaec-41f90473a04a could not be found. Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b1f02d-9090-4b90-aaec-41f90473a04a could not be found. Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:56.786757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:56.791840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:56.791840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:56.791840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:56.791840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:56.791840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:56.791840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:56.791840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b1f02d-9090-4b90-aaec-41f90473a04a could not be found. Oct 04 11:22:56.791840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:56.794229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c774ecc-fb24-4f6a-87be-e382aafb5b09 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 40b1f02d-9090-4b90-aaec-41f90473a04a could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:56.795366 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6c774ecc-fb24-4f6a-87be-e382aafb5b09 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/40b1f02d-9090-4b90-aaec-41f90473a04a/action" status: 404 len: 111 microversion: 2.1 time: 0.037036 Oct 04 11:22:56.799646 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3626/4860] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:56 2022] POST /compute/v2.1/servers/40b1f02d-9090-4b90-aaec-41f90473a04a/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:22:56.809027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:56.810434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:56.821025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:56.823159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:56.824747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:56.825759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:56.826752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:56.827398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:57.103692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:57.144278 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-23a1a024-65e7-4a96-9085-742ca30c06bd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.340328 Oct 04 11:22:57.146751 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3627/4861] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:56 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:57.173410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:57.174324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:57.182161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:57.182931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:57.183525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:57.184389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:57.185005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:57.185611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:58.292856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:58.306468 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe0443bb-c2c7-4976-b791-07a4c841cc68 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 1.137406 Oct 04 11:22:58.323800 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3628/4862] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:57 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:58.334691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:58.336359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:58.345068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:58.345872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:58.346522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:58.348121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:58.348770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:58.349428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:58.388205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Cannot 'unshelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action HTTP/1.1 Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 18 Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: {"unshelve": null} Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'unshelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'unshelve': None}} Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53d5329f-b493-4a25-a450-823121e8358a in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:22:58.389756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 409 to user: Cannot 'unshelve' instance 53d5329f-b493-4a25-a450-823121e8358a while it is in vm_state active {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd07c630-e15b-4e84-9970-2a5aa54d6459 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action" status: 409 len: 146 microversion: 2.1 time: 0.062394 Oct 04 11:22:58.393834 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3629/4863] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:22:58 2022] POST /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a/action => generated 146 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:22:58.414060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:58.417520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:58.431742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:58.432254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:58.432713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:58.433975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:58.434461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:58.434903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:58.916323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:58.927927 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7e6d591-f9b8-4b6f-854d-90b961c54a4b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.524863 Oct 04 11:22:58.931033 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3630/4864] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:58 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:58.957215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:58.958194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:58.971816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:58.973709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:58.976635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:58.977848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:58.979542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:58.980336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:59.306499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:59.320725 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28ff96db-0ad7-4be6-bcec-81c4ceea7d1d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.367877 Oct 04 11:22:59.321335 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3631/4865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:58 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:22:59.356075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1337173-c4bf-490e-bc95-56201069a0dd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089396359_updated"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:22:59.368486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1337173-c4bf-490e-bc95-56201069a0dd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 5307469c-c611-4b00-83bb-1e17c56ab98d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:59.388316 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f1337173-c4bf-490e-bc95-56201069a0dd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 5307469c-c611-4b00-83bb-1e17c56ab98d could not be found. Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1337173-c4bf-490e-bc95-56201069a0dd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/servers/5307469c-c611-4b00-83bb-1e17c56ab98d HTTP/1.1 Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 81 Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2089396359_updated"}} Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5307469c-c611-4b00-83bb-1e17c56ab98d could not be found. Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5307469c-c611-4b00-83bb-1e17c56ab98d', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2089396359_updated'}}} Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5307469c-c611-4b00-83bb-1e17c56ab98d could not be found. Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 11:22:59.396329 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5307469c-c611-4b00-83bb-1e17c56ab98d could not be found. Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5307469c-c611-4b00-83bb-1e17c56ab98d could not be found. Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1337173-c4bf-490e-bc95-56201069a0dd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 5307469c-c611-4b00-83bb-1e17c56ab98d could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1337173-c4bf-490e-bc95-56201069a0dd tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "PUT /compute/v2.1/servers/5307469c-c611-4b00-83bb-1e17c56ab98d" status: 404 len: 111 microversion: 2.1 time: 0.059206 Oct 04 11:22:59.401151 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3632/4866] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:22:59 2022] PUT /compute/v2.1/servers/5307469c-c611-4b00-83bb-1e17c56ab98d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:22:59.416751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:59.417330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:59.433409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:59.433929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:59.434378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:59.435106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:59.435594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:59.436003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:59.666238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:22:59.687425 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6a43a9b-27b4-47de-b043-47d077b3552b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.263837 Oct 04 11:22:59.688479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3633/4867] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:59 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:22:59.719372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:22:59.720346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:22:59.728662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:59.728980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:59.732533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:22:59.733559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:22:59.741674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:22:59.742405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:00.087330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:00.098276 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dece50c4-43b4-4b9d-abe6-8a35568ff18c tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.383541 Oct 04 11:23:00.104158 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3634/4868] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:22:59 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:23:00.129819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8eec1114-c401-43d3-a8a5-22589af61acf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8eec1114-c401-43d3-a8a5-22589af61acf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a HTTP/1.1 Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 280 Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:00.136797 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 11:23:00.140910 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:00.157340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8eec1114-c401-43d3-a8a5-22589af61acf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:00.163914 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8eec1114-c401-43d3-a8a5-22589af61acf tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "PUT /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 400 len: 619 microversion: 2.1 time: 0.033389 Oct 04 11:23:00.170182 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3635/4869] 10.222.0.23 () {60 vars in 1257 bytes} [Tue Oct 4 11:23:00 2022] PUT /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 619 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:23:00.181434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:00.183239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:00.217850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:00.218662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:00.223007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:00.226252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:00.227891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:00.228722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:00.601444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:00.621774 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-50fb29eb-955a-4215-8896-863187019d5b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.446150 Oct 04 11:23:00.625689 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3636/4870] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:00 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:00.654827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:00.655756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:00.664711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:00.665559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:00.666230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:00.667153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:00.667767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:00.668355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:01.078531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:01.144389 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-209f37f3-8e3f-4cf7-8da3-655268419d3d tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.496401 Oct 04 11:23:01.145015 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3637/4871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:00 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:01.168788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:01.169226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:01.211872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:01.225787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:01.226485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:01.227421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:01.228038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:01.228626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:01.313170 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] HTTP exception thrown: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Request method failure captured: Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 HTTP/1.1 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBXiPY_G-bdBBtrLJ44bjZ03Rz6iree9N6yLOKfGY7TDAtoXLfnQrKZK6iJzwtvABsGKVoHY_DSnRbqJH2ueEDkHYFHpOEB2Dz1mRkZh8VIAhEWAJYusCqT8GbGVV_qyQV93fegmfJmguCZN9Aw-Wq5DPW-z8k_scR9zrjEffHEDI6U Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d71eb38ede4033ae37903456138987"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d71eb38ede4033ae37903456138987"}]}] Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 15409bd95f884840b4f3fe972ade15ef Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '0b6e745e-9cfe-4562-a91f-7fa25f3ad109'} Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:23:01.317207 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.324628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.326641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Returning 404 to user: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:01.330368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52f18c56-ef51-4e78-a3e4-9cb95f8873c0 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 404 len: 111 microversion: 2.20 time: 0.181236 Oct 04 11:23:01.330978 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3638/4872] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:23:01 2022] DELETE /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:23:01.356367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6039ba6-97f5-4a83-b041-973190d3d5c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6039ba6-97f5-4a83-b041-973190d3d5c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: request: PUT /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a HTTP/1.1 Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 24 Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": ""}} Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a', 'body': {'server': {'name': ''}}} Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi '' Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:23:01.373857 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 11:23:01.378753 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.385226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6039ba6-97f5-4a83-b041-973190d3d5c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:01.386430 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c6039ba6-97f5-4a83-b041-973190d3d5c5 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "PUT /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 400 len: 108 microversion: 2.1 time: 0.048654 Oct 04 11:23:01.395271 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3639/4873] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:23:01 2022] PUT /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 108 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:23:01.414444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:01.421252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] [instance: 0b6e745e-9cfe-4562-a91f-7fa25f3ad109] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:01.474394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:01.476385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:01.482004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:01.484374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:01.485471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:01.497865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:01.520349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:01.589421 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] HTTP exception thrown: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Request method failure captured: Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 HTTP/1.1 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBXiPY_G-bdBBtrLJ44bjZ03Rz6iree9N6yLOKfGY7TDAtoXLfnQrKZK6iJzwtvABsGKVoHY_DSnRbqJH2ueEDkHYFHpOEB2Dz1mRkZh8VIAhEWAJYusCqT8GbGVV_qyQV93fegmfJmguCZN9Aw-Wq5DPW-z8k_scR9zrjEffHEDI6U Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20d71eb38ede4033ae37903456138987"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20d71eb38ede4033ae37903456138987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20d71eb38ede4033ae37903456138987"}]}] Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 20d71eb38ede4033ae37903456138987 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-203975098 Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 15409bd95f884840b4f3fe972ade15ef Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-203975098-project Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '0b6e745e-9cfe-4562-a91f-7fa25f3ad109'} Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.595936 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:01.601204 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.601204 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:01.601204 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:01.601204 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:01.601204 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:23:01.601204 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:23:01.601204 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. Oct 04 11:23:01.601204 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:01.607664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] Returning 404 to user: Instance 0b6e745e-9cfe-4562-a91f-7fa25f3ad109 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:01.608756 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-59fa770a-490a-4f83-84d7-3bd6bf1c91c7 tempest-AttachVolumeShelveTestJSON-203975098 tempest-AttachVolumeShelveTestJSON-203975098-project] 10.222.0.23 "GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109" status: 404 len: 111 microversion: 2.20 time: 0.207029 Oct 04 11:23:01.626294 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3640/4874] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:01 2022] GET /compute/v2.1/servers/0b6e745e-9cfe-4562-a91f-7fa25f3ad109 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:23:01.650716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:01.650716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:01.667679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:01.674103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:01.674449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:01.675191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:01.676008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:01.676462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:02.056269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:02.072184 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91f048a6-e386-4a93-a43f-40c9ae09797b tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1505 microversion: 2.1 time: 0.440520 Oct 04 11:23:02.086995 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3641/4875] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:01 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:12.820194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:12.821639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:12.832865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=29 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:12.839749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=7 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:12.848075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:12.848591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:12.851306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:12.852234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:12.854490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:12.854969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:12.890946 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c HTTP/1.1 Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8f469e62-93a8-41b2-8db4-ae25e848974c'} Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:23:12.896054 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:12.900664 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c9370e1-e19f-47d4-90c2-b85fb773c57f tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 404 len: 111 microversion: 2.1 time: 0.084999 Oct 04 11:23:12.902047 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3642/4876] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:23:12 2022] DELETE /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:23:12.912579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:12.914577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 8f469e62-93a8-41b2-8db4-ae25e848974c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:12.927074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:12.931385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:12.932045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:12.933678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:12.936195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:12.936948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:12.977708 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c HTTP/1.1 Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8f469e62-93a8-41b2-8db4-ae25e848974c'} Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:12.981767 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.986076 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:12.986076 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:12.986076 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:12.986076 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:23:12.986076 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:23:12.986076 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. Oct 04 11:23:12.986076 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:12.986076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 8f469e62-93a8-41b2-8db4-ae25e848974c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:12.986848 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-848accb8-5972-4afd-8e0d-d6466dbf585e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c" status: 404 len: 111 microversion: 2.1 time: 0.080128 Oct 04 11:23:12.987718 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3643/4877] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:12 2022] GET /compute/v2.1/servers/8f469e62-93a8-41b2-8db4-ae25e848974c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:23:13.000563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:13.001501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:13.016409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:13.020561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:13.021108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:13.022651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:13.023191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:13.023628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:13.071454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:23:13.220501 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e61f4ad-8203-4224-96ce-116bb45e90c9 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 204 len: 0 microversion: 2.1 time: 0.227166 Oct 04 11:23:13.222422 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3644/4878] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:23:12 2022] DELETE /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:23:13.242197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:13.243439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:13.258783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:13.261848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:13.262602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:13.265170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:13.266061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:13.268061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:13.826605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:13.844444 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-42b0441c-005b-4303-be2b-c3e850801613 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1511 microversion: 2.1 time: 0.616928 Oct 04 11:23:13.864264 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3645/4879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:13 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:14.868646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:14.869327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:14.886181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:14.886703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:14.887154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:14.887887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:14.888347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:14.888866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:15.196769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f8fec48e504ec4a91b7ee04bfdeadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2031b742afb6490790401bc9da99e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:15.208420 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d7bb644-ba9d-4583-80b9-dce76701fa2e tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 200 len: 1511 microversion: 2.1 time: 0.340608 Oct 04 11:23:15.228867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3646/4880] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:14 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:15.519080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1214816931", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:15.628158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] validate_networks() for [('6a0ec4e4-e688-466d-9fdf-74d258bd1cc8', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:23:18.305014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:23:18.305742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:23:18.306237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:23:18.306654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:23:18.307126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:23:18.330227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:18.332455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:18.332987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:18.336076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:18.336562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:18.337655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:18.387154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Getting quotas for project f829c02cff75406896dbc4c16ad43a46. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:23:18.399996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Getting quotas for user d9c82357fe154bec8bab1152fc57e0e9 and project f829c02cff75406896dbc4c16ad43a46. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:23:18.426136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:23:18.430583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:23:18.510365 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b33f38a9-3ac8-449b-a74a-e4734d718a2a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.252097 Oct 04 11:23:18.512367 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3647/4881] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:23:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:23:18.535642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:18.537050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] [instance: 53d5329f-b493-4a25-a450-823121e8358a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:18.544870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:18.545670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:18.546567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:18.548370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:18.549096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:18.549730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:18.588418 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] HTTP exception thrown: Instance 53d5329f-b493-4a25-a450-823121e8358a could not be found. Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Request method failure captured: Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a HTTP/1.1 Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZfX63ecVLoPcDhFUW8ZqOhZ7vJaqeHxu768d2SBV6tkPjxS-dRuC_GOJdnVCQZpi7SEvE8Mo5aQMinkzZa40mSvIcQmchOsIkMhtL0noFkpIgBJ3e8vtIwj_-4eorvirY23KEoMUvCW5oHdzucoALdXuy_xa_KHWWNb11o7WvXa5k Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2031b742afb6490790401bc9da99e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2031b742afb6490790401bc9da99e6bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2031b742afb6490790401bc9da99e6bb"}]}] Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 2031b742afb6490790401bc9da99e6bb Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1408516775 Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9f8fec48e504ec4a91b7ee04bfdeadb Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1408516775-project Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 53d5329f-b493-4a25-a450-823121e8358a could not be found. Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '53d5329f-b493-4a25-a450-823121e8358a'} Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d5329f-b493-4a25-a450-823121e8358a could not be found. Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d5329f-b493-4a25-a450-823121e8358a could not be found. Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:18.590920 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d5329f-b493-4a25-a450-823121e8358a could not be found. Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] Returning 404 to user: Instance 53d5329f-b493-4a25-a450-823121e8358a could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:18.597247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2353672-33f3-402a-b5c3-4cec71372027 tempest-ServersNegativeTestJSON-1408516775 tempest-ServersNegativeTestJSON-1408516775-project] 10.222.0.23 "GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a" status: 404 len: 111 microversion: 2.1 time: 0.082266 Oct 04 11:23:18.602594 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3648/4882] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:18 2022] GET /compute/v2.1/servers/53d5329f-b493-4a25-a450-823121e8358a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:23:18.606975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-73524574-ea19-416f-bee2-d80238d3d991 req-b58dd4f5-affd-44ed-b629-b509175b2f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d5329f-b493-4a25-a450-823121e8358a", "name": "network-vif-deleted", "tag": "e7754be9-28f5-4ac8-8494-76e4d61e21a4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:18.636897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-73524574-ea19-416f-bee2-d80238d3d991 req-b58dd4f5-affd-44ed-b629-b509175b2f6d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:18.638915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-73524574-ea19-416f-bee2-d80238d3d991 req-b58dd4f5-affd-44ed-b629-b509175b2f6d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:18.639782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-73524574-ea19-416f-bee2-d80238d3d991 req-b58dd4f5-affd-44ed-b629-b509175b2f6d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:18.666376 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-73524574-ea19-416f-bee2-d80238d3d991 req-b58dd4f5-affd-44ed-b629-b509175b2f6d service nova] Creating event network-vif-deleted:e7754be9-28f5-4ac8-8494-76e4d61e21a4 for instance 53d5329f-b493-4a25-a450-823121e8358a on n-h2-791135-8 Oct 04 11:23:18.679382 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-73524574-ea19-416f-bee2-d80238d3d991 req-b58dd4f5-affd-44ed-b629-b509175b2f6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078838 Oct 04 11:23:18.681273 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3649/4883] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:18.697811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:18.698612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:18.725613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:18.726399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:18.727025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:18.729114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:18.730783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:18.734689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:19.049271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lazy-loading 'services' on Instance uuid 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:23:19.187547 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f874f41-6def-429c-b5fb-2ff304b267fe tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/os-volume_attachments/b8dc8b6e-f7e1-4058-81bb-fddd4d154163" status: 202 len: 0 microversion: 2.1 time: 0.502265 Oct 04 11:23:19.192661 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3650/4884] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:23:18 2022] DELETE /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/os-volume_attachments/b8dc8b6e-f7e1-4058-81bb-fddd4d154163 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:23:19.206187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f648f509-85af-4f83-83a6-5b12d857db11 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:19.207708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f648f509-85af-4f83-83a6-5b12d857db11 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:19.447642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f648f509-85af-4f83-83a6-5b12d857db11 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:19.456483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f648f509-85af-4f83-83a6-5b12d857db11 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1214 microversion: 2.1 time: 0.261657 Oct 04 11:23:19.460008 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3651/4885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:19 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:20.485995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:20.487601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:20.504056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:20.512781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:20.513674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:20.514845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:20.519957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:20.521230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:20.939781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:20.953040 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-88ed8f7e-a996-4d73-855d-ca00a9a4f3a5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1266 microversion: 2.1 time: 0.472585 Oct 04 11:23:20.966982 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3652/4886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:20 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1266 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:21.984020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:21.984659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:22.000832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:22.002176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:22.003066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:22.005637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:22.009518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:22.010231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:22.187816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:22.202552 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77fe8203-45e5-48c9-9f7f-a4e3b63d88e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1272 microversion: 2.1 time: 0.224761 Oct 04 11:23:22.204089 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3653/4887] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:21 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:23.231083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:23.232409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:23.244757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:23.245282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:23.250232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:23.251496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:23.254176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:23.257183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:23.465672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:23.484548 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7f00aa91-76cb-428f-b26a-a730b2fc2347 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1272 microversion: 2.1 time: 0.258790 Oct 04 11:23:23.485386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3654/4888] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:23 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:23:24.510540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:24.512887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:24.545307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:24.549780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:24.551949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:24.555345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:24.556046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:24.556881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:25.116072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:25.125710 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24ac4656-8824-4c7f-9fb9-96dfd09a83e8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.621342 Oct 04 11:23:25.144081 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3655/4889] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:24 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:23:26.155117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:26.155896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:26.172484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:26.178682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:26.184293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:26.185265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:26.186144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:26.194122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:26.900741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:26.910065 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a884cfd0-f4ec-4a38-9112-37440c9dd232 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.758908 Oct 04 11:23:26.925997 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3656/4890] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:26 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:23:27.944673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:27.945586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:27.966532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:27.967331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:27.976062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:27.977139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:27.977773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:27.978620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:28.371256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:28.709342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:28.725391 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbc1ab90-88b0-40d1-a48e-81d2680375ae tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.784810 Oct 04 11:23:28.731395 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3657/4891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:27 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:23:29.250458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1265118418", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "0507285f-627c-48e4-a6c6-0bc4be54021f"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:29.385921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] validate_networks() for [('0507285f-627c-48e4-a6c6-0bc4be54021f', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:23:29.454475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:30.427864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:23:30.428957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:23:30.429804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:23:30.430397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:23:30.430964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:23:30.446587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:30.448830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:30.451372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:30.452409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:30.455043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:30.458430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:30.518269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Getting quotas for project eaec20a5ce964a899a1bfef2e6d1fc3b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:23:30.542814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Getting quotas for user 8d11a58d99ce4fcd974700c8600bac97 and project eaec20a5ce964a899a1bfef2e6d1fc3b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:23:30.581265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:23:30.590020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:23:30.708630 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-423bea11-9a0d-483c-9e7d-17fbb3eed005 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.839624 Oct 04 11:23:30.719239 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3658/4892] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:23:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 11:23:30.730220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:30.743390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:30.764472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:30.765569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:30.766295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:30.767261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:30.767948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:30.768594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:30.925086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lazy-loading 'services' on Instance uuid 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:23:31.073158 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29a71e1d-e0e7-4a91-b290-dbc8157728c6 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "DELETE /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments/db8c9f2b-43aa-447f-96d4-1e407651797e" status: 202 len: 0 microversion: 2.1 time: 0.351324 Oct 04 11:23:31.083688 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3659/4893] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:23:30 2022] DELETE /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments/db8c9f2b-43aa-447f-96d4-1e407651797e => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:23:31.093689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c26e0c7-fb93-419e-af51-e751a82afd33 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:31.113047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c26e0c7-fb93-419e-af51-e751a82afd33 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:31.127766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c26e0c7-fb93-419e-af51-e751a82afd33 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:31.131692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c26e0c7-fb93-419e-af51-e751a82afd33 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:31.192108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:31.226447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c26e0c7-fb93-419e-af51-e751a82afd33 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Going to try to stop instance {{(pid=122409) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:23:31.333205 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c26e0c7-fb93-419e-af51-e751a82afd33 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/action" status: 202 len: 0 microversion: 2.1 time: 0.243687 Oct 04 11:23:31.335272 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3660/4894] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:23:31 2022] POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:23:31.351213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:31.353990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:31.371865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:31.373684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:31.374146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:31.376276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:31.377822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:31.378297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:31.840555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:31.855898 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a27d0a2-8112-43a7-b88f-1b60f862bd14 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.518561 Oct 04 11:23:31.865603 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3661/4895] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:31 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:31.872163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-547c616a-0fe4-4a5a-bcc3-93c93f3f333c req-4b44ef35-e61d-48ff-a761-f7902ebaf201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34", "tag": "42eff900-fecb-4890-8d51-247c26bb30ef"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:31.905570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-547c616a-0fe4-4a5a-bcc3-93c93f3f333c req-4b44ef35-e61d-48ff-a761-f7902ebaf201 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:31.926998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-547c616a-0fe4-4a5a-bcc3-93c93f3f333c req-4b44ef35-e61d-48ff-a761-f7902ebaf201 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:31.928572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-547c616a-0fe4-4a5a-bcc3-93c93f3f333c req-4b44ef35-e61d-48ff-a761-f7902ebaf201 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:31.966129 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-547c616a-0fe4-4a5a-bcc3-93c93f3f333c req-4b44ef35-e61d-48ff-a761-f7902ebaf201 service nova] Creating event network-changed:42eff900-fecb-4890-8d51-247c26bb30ef for instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 on n-h2-791135-8 Oct 04 11:23:31.998420 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-547c616a-0fe4-4a5a-bcc3-93c93f3f333c req-4b44ef35-e61d-48ff-a761-f7902ebaf201 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137239 Oct 04 11:23:32.004871 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3662/4896] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:32.022446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:32.023456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:32.052068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:32.060971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:32.062707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:32.064916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:32.067191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:32.069038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:32.499389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:32.517923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:32.530233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:32.534264 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c14d4f4-fcfe-4a6a-be7d-3c9dba827b31 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1255 microversion: 2.21 time: 0.525717 Oct 04 11:23:32.540865 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3663/4897] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:32 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1255 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:32.575747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:32.590944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:32.622436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:32.623743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:32.624593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:32.625501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:32.626117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:32.626706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:32.710217 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4d2551a-68cd-4ff9-b639-6c6e026bcf7a tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154880 Oct 04 11:23:32.713908 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3664/4898] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:23:32 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:32.731799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:32.733109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:32.744568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:32.745220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:32.747882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:32.749526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:32.751125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:32.752027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:33.384925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:33.393544 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6c450a22-1f4a-4dc5-a51d-a44dfdbc8f61 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1677 microversion: 2.1 time: 0.677932 Oct 04 11:23:33.414009 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3665/4899] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:32 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1677 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:33.433023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:33.434578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:33.453086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:33.453972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:33.455033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:33.457688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:33.458396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:33.460191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:34.034428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:34.048842 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d5cb129-e205-4cee-8f93-d23efae95a4b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.631493 Oct 04 11:23:34.057825 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3666/4900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:33 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:34.251956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-161111a1-2806-4118-b56d-64985ac078d4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: .version_select at 0x7f71d41f5e50>, body: {"keypair": {"name": "tempest-keypair-692489698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrP9OAkkeVoxCqTLjrd//fJR7pFplqJ9NdyHJH0Gm7YeljPCEEqGi7r0Qt25TcMjMk0wzq3BcuNruIhJuJkjo3eJ9hcF00z2Gm40IywiuH3nssnfU/SqIsKH7w89YLO5Q=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:34.315485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-161111a1-2806-4118-b56d-64985ac078d4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:23:34.340273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-161111a1-2806-4118-b56d-64985ac078d4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for user e91bdb8e1e364219bc1fa98517eb19d9 and project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:23:34.421171 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-161111a1-2806-4118-b56d-64985ac078d4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.360833 Oct 04 11:23:34.430673 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3667/4901] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:23:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:34.445484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:34.446159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:34.466246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:34.471621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:34.472143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:34.477647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:34.478488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:34.478980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:34.483678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:34.780492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:34.796962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:34.806509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:34.810429 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c3846bf3-45c2-402f-b5d3-d05c6af84d05 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1317 microversion: 2.21 time: 0.378957 Oct 04 11:23:34.830161 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3668/4902] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:34 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:34.836772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:34.839705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:34.867674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:34.868418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:34.869037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:34.869989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:34.872531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:34.873678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:34.955166 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-098a7d5a-7cb8-471c-a2e4-7b7c19700148 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123308 Oct 04 11:23:34.956171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3669/4903] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:23:34 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:34.967440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:34.968453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:34.987408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:34.996658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:34.999240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:35.000325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:35.001852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:35.008552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:35.570614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:35.584655 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-88645639-6862-4ad6-b06d-ae18d175282a tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1677 microversion: 2.1 time: 0.626442 Oct 04 11:23:35.602189 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3670/4904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:34 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1677 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:35.607366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:35.608010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:35.627055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:35.627544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:35.629092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:35.632603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:35.633543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:35.634164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:36.020252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:36.033877 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a5301e4-b861-4469-a287-301b83f87951 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.430247 Oct 04 11:23:36.047474 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3671/4905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:35 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:36.076292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:36.083208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:36.098492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:36.100745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:36.101537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:36.105416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:36.107270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:36.110479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:36.283508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:36.303701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:36.308335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:36.310746 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e349cd6c-77a5-4777-b7d6-448e6617f9fb tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1317 microversion: 2.21 time: 0.238754 Oct 04 11:23:36.316943 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3672/4906] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:36 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:36.329119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:36.339923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:36.353004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:36.357852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:36.358815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:36.359823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:36.360466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:36.362210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:36.463939 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd22ddba-423b-4469-8bd4-d9a56cb77c4c tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144249 Oct 04 11:23:36.475601 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3673/4907] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:23:36 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:36.614881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:36.616871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:36.650041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:36.650580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:36.651030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:36.651785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:36.652244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:36.657148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:37.355529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:37.367687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-67804357-fdb8-491f-bd1f-d47cf7c2b086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1677 microversion: 2.1 time: 0.759081 Oct 04 11:23:37.386611 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3674/4908] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:36 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1677 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:37.392248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:37.393331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:37.400429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:37.401409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:37.402731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:37.404605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:37.406082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:37.411300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:39.529990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:39.538556 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5da29966-3adf-4879-a7a9-e2755345a06a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 2.150392 Oct 04 11:23:39.553615 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3675/4909] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:37 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:39.558011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:39.562402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:39.586573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:39.594161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:39.598550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:39.600093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:39.600571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:39.601003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:40.492172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:40.854312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:40.888164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:40.895676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:40.901197 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e48d48ee-9953-4405-9afd-f4a70107d7be tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1359 microversion: 2.21 time: 1.354640 Oct 04 11:23:40.902130 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3676/4910] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:39 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1359 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:40.931351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:40.939152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:40.964828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:40.968169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:40.969251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:40.970315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:40.971038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:40.973642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:41.066862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:41.077610 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7415978-fdd5-4593-a2fb-138cc8c26bde tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172215 Oct 04 11:23:41.082486 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3677/4911] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:23:40 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:41.095996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:41.104126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:41.119258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:41.120442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:41.127932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:41.129127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:41.129732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:41.130915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:42.085647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:42.099228 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b910367-68d0-4694-8d52-e382478c955e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1677 microversion: 2.1 time: 1.013725 Oct 04 11:23:42.105647 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3678/4912] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:41 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1677 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:42.134703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:42.139354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:42.155203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:42.159571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:42.160089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:42.167617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:42.168461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:42.170498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:43.239589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:43.265731 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b04d4fd5-4b0b-4485-9f7a-ba140112cf53 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 1.156489 Oct 04 11:23:43.277207 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3679/4913] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:42 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:43.282976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2bdf4bbf-6f54-4fa7-aa9c-5837ee7a0cdf req-5fb5fea3-57e0-4c26-912b-ad4129ae5462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dd1287-3998-4904-ad1b-d6d3c5260cfc", "tag": "6eea92a0-2deb-41d4-8a5b-b3b33d0e6510"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:43.315215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2bdf4bbf-6f54-4fa7-aa9c-5837ee7a0cdf req-5fb5fea3-57e0-4c26-912b-ad4129ae5462 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:43.318407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2bdf4bbf-6f54-4fa7-aa9c-5837ee7a0cdf req-5fb5fea3-57e0-4c26-912b-ad4129ae5462 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:43.319462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2bdf4bbf-6f54-4fa7-aa9c-5837ee7a0cdf req-5fb5fea3-57e0-4c26-912b-ad4129ae5462 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:43.361657 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2bdf4bbf-6f54-4fa7-aa9c-5837ee7a0cdf req-5fb5fea3-57e0-4c26-912b-ad4129ae5462 service nova] Creating event network-changed:6eea92a0-2deb-41d4-8a5b-b3b33d0e6510 for instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc on n-h1-791135-8 Oct 04 11:23:43.377579 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2bdf4bbf-6f54-4fa7-aa9c-5837ee7a0cdf req-5fb5fea3-57e0-4c26-912b-ad4129ae5462 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096167 Oct 04 11:23:43.379624 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3680/4914] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:43.396167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:43.398155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:43.418394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:43.418394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:43.418394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:43.418394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:43.429254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:43.436304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:43.978612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:43.992790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:44.004326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:44.009985 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-87a6fa4b-b1d0-465f-82a3-317107194af5 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1359 microversion: 2.21 time: 0.628271 Oct 04 11:23:44.014060 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3681/4915] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:43 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1359 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:44.025262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:44.031696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:44.046983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:44.047940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:44.049745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:44.051072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:44.054007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:44.055382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:44.131288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d759742-4080-402c-bc3b-cb3a5175ad57 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115488 Oct 04 11:23:44.132140 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3682/4916] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:23:44 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:44.143566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:44.148191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:44.163389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:44.166908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:44.170066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:44.171168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:44.171829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:44.174269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:44.363717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:44.572358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:44.585210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8aa16ff-2a3d-4788-8371-32877fcec447 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1654 microversion: 2.1 time: 0.447424 Oct 04 11:23:44.587300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3683/4917] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:44 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1654 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:44.598500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:44.601246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:44.620749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:44.624763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:44.625915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:44.627068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:44.627911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:44.628618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:44.898515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:44.909121 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d2891010-9c75-476b-84eb-47511145fa12 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.319085 Oct 04 11:23:44.920268 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3684/4918] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:44 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:44.928468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-951909ba-f8d5-495f-942f-dce366ae8d1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:44.947115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-951909ba-f8d5-495f-942f-dce366ae8d1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:44.947875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-951909ba-f8d5-495f-942f-dce366ae8d1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:44.948497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-951909ba-f8d5-495f-942f-dce366ae8d1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:44.979021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-951909ba-f8d5-495f-942f-dce366ae8d1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Going to try to start instance {{(pid=122409) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 11:23:45.055642 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-951909ba-f8d5-495f-942f-dce366ae8d1d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/action" status: 202 len: 0 microversion: 2.1 time: 0.133399 Oct 04 11:23:45.056815 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3685/4919] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:23:44 2022] POST /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:23:45.066683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2094480583", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f13c22c-2a0f-40fe-b7ea-9f76b204e323"}], "security_groups": [{"name": "tempest-securitygroup--467904443"}], "key_name": "tempest-keypair-692489698", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:45.356735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] validate_networks() for [('7f13c22c-2a0f-40fe-b7ea-9f76b204e323', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:23:46.258751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:23:46.259332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:23:46.259658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:23:46.260063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:23:46.260485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:23:46.280333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:46.281043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:46.281692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:46.282690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:46.283330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:46.283953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:46.315955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:23:46.323342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for user e91bdb8e1e364219bc1fa98517eb19d9 and project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:23:46.344660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:23:46.347481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:23:46.418930 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b9ba03c0-9193-4dac-8444-de48302d3680 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.359209 Oct 04 11:23:46.421116 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3686/4920] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:23:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:23:46.446845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:46.447768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:46.461406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:46.462239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:46.462926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:46.463901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:46.464616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:46.465486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:46.676228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:46.686981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:46.688462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:46.689841 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6cec675d-41a3-4cbe-bdc5-cef1e85a3105 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1359 microversion: 2.21 time: 0.266854 Oct 04 11:23:46.690421 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3687/4921] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:46 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:46.705788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:46.706419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:46.714362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:46.714913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:46.715542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:46.716427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:46.716887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:46.717314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:46.903351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:46.916858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aef95165-9c2a-4420-b690-10bde509093e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1663 microversion: 2.1 time: 0.225089 Oct 04 11:23:46.917852 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3688/4922] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:46 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1663 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:46.931557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:46.936849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:46.953610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:46.957617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:46.965280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:46.966229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:46.966730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:46.967178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.044856 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eefa6785-62f4-48a6-b6fe-63911603daea tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125214 Oct 04 11:23:47.045863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3689/4923] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:23:46 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:23:47.054151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a32be722-2f27-4ccd-b64d-1ead6d649cda req-a8f53c1f-9db8-4ac8-a10d-41c105052ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34", "name": "network-vif-plugged", "status": "completed", "tag": "42eff900-fecb-4890-8d51-247c26bb30ef"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:47.069815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a32be722-2f27-4ccd-b64d-1ead6d649cda req-a8f53c1f-9db8-4ac8-a10d-41c105052ba9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.070563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a32be722-2f27-4ccd-b64d-1ead6d649cda req-a8f53c1f-9db8-4ac8-a10d-41c105052ba9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.071189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a32be722-2f27-4ccd-b64d-1ead6d649cda req-a8f53c1f-9db8-4ac8-a10d-41c105052ba9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.095932 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a32be722-2f27-4ccd-b64d-1ead6d649cda req-a8f53c1f-9db8-4ac8-a10d-41c105052ba9 service nova] Creating event network-vif-plugged:42eff900-fecb-4890-8d51-247c26bb30ef for instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 on n-h2-791135-8 Oct 04 11:23:47.109305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a32be722-2f27-4ccd-b64d-1ead6d649cda req-a8f53c1f-9db8-4ac8-a10d-41c105052ba9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061686 Oct 04 11:23:47.113719 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3690/4924] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:47.128503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:47.129554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:47.146969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.147467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.150797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.154093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.154581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.155385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.420665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:47.432027 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bebc40ce-6eac-44c4-afbc-48280ee85d75 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.314927 Oct 04 11:23:47.433343 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3691/4925] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:47 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:47.455425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:47.456641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:47.464625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.465272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.482251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.483327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.483987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.484600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.596140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:47.611574 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-103c93d9-acc0-47c2-a4ce-09fda28bc546 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1237 microversion: 2.1 time: 0.176554 Oct 04 11:23:47.612186 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3692/4926] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:47 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1237 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:47.627356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:47.635105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:47.657452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.657957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.672304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.674806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.675318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.678294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.735591 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Cannot 'reboot' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154/action HTTP/1.1 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 28 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: {"reboot": {"type": "HARD"}} Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'reboot' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a46eb658-0913-4726-acb8-874f01b5c154', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a46eb658-0913-4726-acb8-874f01b5c154 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:23:47.737698 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued Oct 04 11:23:47.743211 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:47.748264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 409 to user: Cannot 'reboot' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:47.756957 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b007ddc-e9ba-49dc-901d-eae781d1c0e0 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154/action" status: 409 len: 145 microversion: 2.1 time: 0.140122 Oct 04 11:23:47.757824 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3693/4927] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:23:47 2022] POST /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154/action => generated 145 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:23:47.767363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:47.770118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:47.781162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.781930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.784576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:47.785590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:47.786788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:47.787587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:48.063888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:48.079970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:48.090487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:48.091973 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c6625fb-8b01-4395-ab8f-071dabca4b47 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1359 microversion: 2.21 time: 0.332887 Oct 04 11:23:48.100257 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3694/4928] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:47 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:48.110242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:48.113086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:48.142188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:48.142690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:48.143132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:48.143853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:48.144310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:48.144739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:48.193386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Cannot 'rebuild' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154/action HTTP/1.1 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 65 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: exception: Cannot 'rebuild' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a46eb658-0913-4726-acb8-874f01b5c154', 'body': {'rebuild': {'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244'}}} Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a46eb658-0913-4726-acb8-874f01b5c154 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:23:48.199491 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued Oct 04 11:23:48.204061 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:48.206600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 409 to user: Cannot 'rebuild' instance a46eb658-0913-4726-acb8-874f01b5c154 while it is in vm_state rescued {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:48.211168 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8784d9e-f158-408f-a637-298488b23129 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "POST /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154/action" status: 409 len: 146 microversion: 2.1 time: 0.107848 Oct 04 11:23:48.211945 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3695/4929] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:23:48 2022] POST /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154/action => generated 146 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 11:23:48.226609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:48.227459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:48.244314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:48.244621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:48.245200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:48.246031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:48.249263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:48.249912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:48.259889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:48.588774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:48.606540 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d126f1e1-e86b-4d68-b54e-3ea2f19bf0bc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1663 microversion: 2.1 time: 0.387218 Oct 04 11:23:48.607220 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3696/4930] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:48 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1663 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:48.640924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:48.644433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:48.660991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:48.661743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:48.662188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:48.663038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:48.663534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:48.663964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:48.722294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:23:48.914815 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c0cda43c-a30a-4bfc-9abf-b81cad1066cb tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "DELETE /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 204 len: 0 microversion: 2.1 time: 0.295777 Oct 04 11:23:48.916131 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3697/4931] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:23:48 2022] DELETE /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:23:48.923098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:48.924179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:48.933135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:48.933848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:48.934396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:48.936268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:48.936909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:48.947456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:49.433196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:49.444997 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0d00996c-2c5f-4709-948c-c94555d25559 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.526188 Oct 04 11:23:49.446640 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3698/4932] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:48 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:49.456692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:49.459115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:49.484379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:49.485815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:49.488375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:49.489417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:49.490695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:49.493486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:49.660697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:49.695799 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e7f1f25-bb56-482c-ba9c-2fde56d69766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1311 microversion: 2.1 time: 0.246468 Oct 04 11:23:49.698566 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3699/4933] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:49 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1311 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:49.704810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:49.706161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:49.715116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:49.716153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:49.716795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:49.720580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:49.721239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:49.721869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:49.940270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:49.959968 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75efe3fd-e264-41fb-a0e2-44ab89e49790 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1689 microversion: 2.1 time: 0.259908 Oct 04 11:23:49.962059 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3700/4934] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:49 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1689 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:49.979897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:49.980727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:49.998920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:49.999827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:50.000276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:50.001048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:50.002197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:50.005183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:50.277850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:50.293082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:50.295170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:50.296538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9edf866a-5a20-4f86-be35-f700721aa64f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1359 microversion: 2.21 time: 0.329411 Oct 04 11:23:50.311821 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3701/4935] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:49 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:50.336482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bca04686-26da-4ddc-a927-a30edc8123bb req-18b04a8f-667f-47eb-8cdd-402b55498fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dd1287-3998-4904-ad1b-d6d3c5260cfc", "name": "network-vif-plugged", "status": "completed", "tag": "6eea92a0-2deb-41d4-8a5b-b3b33d0e6510"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:50.376764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bca04686-26da-4ddc-a927-a30edc8123bb req-18b04a8f-667f-47eb-8cdd-402b55498fa3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:50.377496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bca04686-26da-4ddc-a927-a30edc8123bb req-18b04a8f-667f-47eb-8cdd-402b55498fa3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:50.381561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bca04686-26da-4ddc-a927-a30edc8123bb req-18b04a8f-667f-47eb-8cdd-402b55498fa3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:50.399009 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bca04686-26da-4ddc-a927-a30edc8123bb req-18b04a8f-667f-47eb-8cdd-402b55498fa3 service nova] Creating event network-vif-plugged:6eea92a0-2deb-41d4-8a5b-b3b33d0e6510 for instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc on n-h1-791135-8 Oct 04 11:23:50.405545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bca04686-26da-4ddc-a927-a30edc8123bb req-18b04a8f-667f-47eb-8cdd-402b55498fa3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092123 Oct 04 11:23:50.416477 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3702/4936] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:50.423644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:50.425333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:50.434490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:50.435411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:50.436018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:50.438243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:50.438944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:50.439833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:50.706276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:50.714740 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2182aba6-636f-4370-b668-64c9b42e83da tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1667 microversion: 2.1 time: 0.296582 Oct 04 11:23:50.715324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3703/4937] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:50 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1667 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:50.741976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:50.746703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:50.761006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:50.761555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:50.762199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:50.763287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:50.763906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:50.764493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:51.165385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:51.173837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b33f7ab-d1d7-48f5-98ae-75fb34c8b25c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1314 microversion: 2.1 time: 0.435639 Oct 04 11:23:51.176867 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3704/4938] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:50 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:51.181940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:51.183014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:51.190016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:51.190584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:51.191101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:51.191893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:51.192700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:51.193344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:51.324404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:51.339075 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-305c0fd4-eca3-4f0c-87d4-9f1b998f1ad2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1311 microversion: 2.1 time: 0.160453 Oct 04 11:23:51.340309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3705/4939] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:51 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:51.345574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:51.346216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:51.353121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:51.353631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:51.355107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:51.355832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:51.356297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:51.356954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:51.548513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:51.577887 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d0f18bf-d767-46e2-8b99-e9616f380689 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1689 microversion: 2.1 time: 0.235796 Oct 04 11:23:51.585608 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3706/4940] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:51 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:51.600650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:51.601533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:51.608785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:51.615380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:51.616221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:51.616673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:51.617578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:51.618086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:51.618635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:51.963619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:51.985049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:51.988609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:51.991810 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d89b925-6403-4839-a9e7-8ac98be1cbed tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1359 microversion: 2.21 time: 0.403560 Oct 04 11:23:52.011242 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3707/4941] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:51 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:52.199118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:52.206036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:52.211079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:52.211699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:52.212341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:52.213179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:52.213782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:52.214383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:52.509019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:52.519463 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09791cc8-bdb3-4ccd-bce0-2ab8f13cff7d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1501 microversion: 2.1 time: 0.324180 Oct 04 11:23:52.520045 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3708/4942] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:52 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:52.525300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:52.526135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:52.547352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:52.548304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:52.549834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:52.550817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:52.551536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:52.552363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:52.644132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:52.658561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0169538-21fd-4274-975b-3409dbd2cfd8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1299 microversion: 2.1 time: 0.136639 Oct 04 11:23:52.659324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3709/4943] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:52 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:52.668071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:52.678354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:52.690581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:52.691117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:52.691560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:52.693290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:52.693957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:52.695595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:52.731243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lazy-loading 'flavor' on Instance uuid 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:23:52.783356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:52.869336 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c0c8b25-2fd8-46f7-a689-012c46fce612 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "POST /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34/action" status: 200 len: 32 microversion: 2.1 time: 0.207489 Oct 04 11:23:52.871674 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3710/4944] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:23:52 2022] POST /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:23:52.887035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:52.888222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:52.906476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:52.906844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:52.907303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:52.908041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:52.908491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:52.908977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:53.249941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:53.262878 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a2a3ddc-50a8-409a-a189-5d852f5e74f8 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1689 microversion: 2.1 time: 0.387863 Oct 04 11:23:53.263317 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3711/4945] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:52 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1689 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:53.281514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:53.282842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:53.301153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:53.301762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:53.302206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:53.302928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:53.303386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:53.303805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:54.370953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:54.381601 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31045d1a-d25d-47b6-9837-66f626a90266 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 1.116946 Oct 04 11:23:54.386815 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3712/4946] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:53 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:54.391642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:54.392780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:54.410587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:54.412203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:54.415843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:54.416874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:54.418551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:54.420129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:54.817494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:54.830052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:54.833982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:54.835905 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e95f0687-a63a-4786-93d3-592d274b5bef tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1552 microversion: 2.21 time: 0.447954 Oct 04 11:23:54.836724 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3713/4947] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:54 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1552 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:54.841527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:54.842432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:54.851567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:54.852428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:54.853273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:54.854321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:54.855020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:54.855708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:55.067442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:55.078500 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecae2dd6-945d-4067-85db-e9cb79b14df1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.239856 Oct 04 11:23:55.092818 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3714/4948] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:54 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:55.100762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:55.101700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:55.110324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:55.111203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:55.111933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:55.113301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:55.114596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:55.115818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:55.204613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:55.216681 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0ef44c66-8ec2-4307-9ee7-c5e322c8bfec tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 200 len: 1622 microversion: 2.1 time: 0.123381 Oct 04 11:23:55.218979 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3715/4949] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:55 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 1622 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:55.238233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:55.239046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:55.246522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:55.247242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:55.247855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:55.249259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:55.250179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:55.250781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:55.312792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:23:55.437848 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e90e8900-21ae-46a2-97d4-e88061a9264f tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 204 len: 0 microversion: 2.21 time: 0.216584 Oct 04 11:23:55.439384 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3716/4950] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:23:55 2022] DELETE /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:23:55.453642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1de98034-242f-4838-a0b2-2058210e8e0c req-216f7421-e81a-45a1-af1f-145206ea9467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0", "name": "network-vif-deleted", "tag": "e19a409c-8a87-4928-9624-7ab08668b7f0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:55.468989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1de98034-242f-4838-a0b2-2058210e8e0c req-216f7421-e81a-45a1-af1f-145206ea9467 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:55.469949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1de98034-242f-4838-a0b2-2058210e8e0c req-216f7421-e81a-45a1-af1f-145206ea9467 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:55.471360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1de98034-242f-4838-a0b2-2058210e8e0c req-216f7421-e81a-45a1-af1f-145206ea9467 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:55.492833 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1de98034-242f-4838-a0b2-2058210e8e0c req-216f7421-e81a-45a1-af1f-145206ea9467 service nova] Creating event network-vif-deleted:e19a409c-8a87-4928-9624-7ab08668b7f0 for instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 on n-h2-791135-8 Oct 04 11:23:55.514859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1de98034-242f-4838-a0b2-2058210e8e0c req-216f7421-e81a-45a1-af1f-145206ea9467 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068416 Oct 04 11:23:55.517517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3717/4951] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:55.538325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:55.544509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:55.577742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:55.587840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:55.588345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:55.589125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:55.591870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:55.591870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:55.968179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:55.979033 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b1947b2c-ba40-427a-8f2c-92024774bece tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.458385 Oct 04 11:23:55.980461 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3718/4952] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:55 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:56.001961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:56.002521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:56.011425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:56.012132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:56.012751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:56.013514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:56.014135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:56.014719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:56.194810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:56.204926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:56.206607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:56.208571 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f16574a9-2426-45e9-b926-d47d4dd25a79 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1558 microversion: 2.21 time: 0.217225 Oct 04 11:23:56.209322 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3719/4953] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:55 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:56.233762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:56.234681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:56.242827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:56.243673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:56.244315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:56.245241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:56.246033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:56.246635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:56.294434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:56.338862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:56.552242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:56.597210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbff49fc-b0ef-4d04-a85c-cd8f81a9e9c0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.371441 Oct 04 11:23:56.599696 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3720/4954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:56 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:56.618850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:56.620890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:56.628740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:56.630926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:56.631688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:56.632763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:56.634356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:56.635143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:56.655326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 could not be found. Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 HTTP/1.1 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 could not be found. Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0'} Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 could not be found. Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 could not be found. Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:56.657779 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:23:56.662069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:56.662069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:23:56.662069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:23:56.662069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:23:56.662069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:23:56.662069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:23:56.662069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 could not be found. Oct 04 11:23:56.662069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:23:56.664597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 404 to user: Instance 62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:23:56.667641 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01ba57cb-6289-4a06-94ca-6ef1d50c7722 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0" status: 404 len: 111 microversion: 2.1 time: 0.065555 Oct 04 11:23:56.669236 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3721/4955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:56 2022] GET /compute/v2.1/servers/62bb6070-f4ac-4ef8-84cb-0f0d7d8bd0b0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:23:56.679182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ffcfd227-30e4-48b4-b5d8-52e63e3ab615 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '.version_select at 0x7f71d86fe4c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:56.725838 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ffcfd227-30e4-48b4-b5d8-52e63e3ab615 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-995352199" status: 202 len: 0 microversion: 2.1 time: 0.051732 Oct 04 11:23:56.731126 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3722/4956] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:23:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-995352199 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:23:57.006716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:57.007621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:57.025386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:57.030048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:57.030527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:57.031324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:57.032017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:57.032619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:57.447636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:57.462202 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-50af9794-f418-4df3-a430-48bfc36bc84d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.460756 Oct 04 11:23:57.465034 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3723/4957] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:56 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:23:57.478683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:57.479312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:57.494896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:57.495608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:57.495863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:57.496600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:57.497066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:57.497538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:57.837506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:57.846406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:57.850804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:57.853480 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9cb9beea-c452-4e53-8f9c-d98d3d1bb647 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1558 microversion: 2.21 time: 0.387155 Oct 04 11:23:57.855036 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3724/4958] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:57 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1558 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:57.863905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:57.868410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:57.896813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:57.899988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:57.900697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:57.901784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:57.905698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:57.906328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:58.291040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:58.299897 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc1ecf79-203a-448c-8410-45a2b2794c34 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.443503 Oct 04 11:23:58.305680 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3725/4959] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:57 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:58.310554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-81724c7d-f29e-4af8-9b32-5c55174ef17b req-a6a30edd-0fb6-4904-8140-89b477a2dd7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0218e8b-e3de-480e-8747-71c06ac4752c", "tag": "270bb04e-3ff4-4ecf-bf64-bdc8665ca993"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:23:58.321955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-81724c7d-f29e-4af8-9b32-5c55174ef17b req-a6a30edd-0fb6-4904-8140-89b477a2dd7e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:58.322723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-81724c7d-f29e-4af8-9b32-5c55174ef17b req-a6a30edd-0fb6-4904-8140-89b477a2dd7e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:58.323306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-81724c7d-f29e-4af8-9b32-5c55174ef17b req-a6a30edd-0fb6-4904-8140-89b477a2dd7e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:58.337972 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-81724c7d-f29e-4af8-9b32-5c55174ef17b req-a6a30edd-0fb6-4904-8140-89b477a2dd7e service nova] Creating event network-changed:270bb04e-3ff4-4ecf-bf64-bdc8665ca993 for instance b0218e8b-e3de-480e-8747-71c06ac4752c on n-h2-791135-8 Oct 04 11:23:58.343906 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-81724c7d-f29e-4af8-9b32-5c55174ef17b req-a6a30edd-0fb6-4904-8140-89b477a2dd7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036761 Oct 04 11:23:58.344884 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3726/4960] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:23:58.490764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:58.491475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:58.511276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:58.511276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:58.511877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:58.512825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:58.513230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:58.513656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:59.065196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:59.070923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:23:59.081514 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68313902-ae2c-44da-9ca6-518909a8f2ee tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.595815 Oct 04 11:23:59.082830 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3727/4961] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:58 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:23:59.103268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:59.103904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:59.129192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:59.132291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:59.133886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:59.135352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:59.137530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:59.141064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:59.237682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:59.238506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:59.239860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:59.242477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lazy-loading 'fault' on Instance uuid a5dd1287-3998-4904-ad1b-d6d3c5260cfc {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:23:59.377841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:59.395270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:59.402348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d11a58d99ce4fcd974700c8600bac97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaec20a5ce964a899a1bfef2e6d1fc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:59.404177 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-155fcd14-729a-47bf-b510-b5469af1aa9b tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 200 len: 1349 microversion: 2.21 time: 0.319354 Oct 04 11:23:59.405366 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3728/4962] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:23:59 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 1349 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:23:59.411007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:23:59.411926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:23:59.429892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:59.430397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:59.431024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:59.431741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:23:59.432221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:23:59.432637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:23:59.798148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:23:59.835427 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be1caf1a-8f37-43ac-ab35-54c4af495aca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.426400 Oct 04 11:23:59.836464 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3729/4963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:23:59 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:00.108917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:00.110314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:00.123405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.125916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.128318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.129490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.132269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.133131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.507236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:00.516982 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98b8fe6f-f22d-45b6-b2cf-2610d9ad5d61 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.412691 Oct 04 11:24:00.517634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3730/4964] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:00 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:00.523106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6abaa1f5-d4f0-47db-857c-aed7d872c8dc req-6dc81f83-e296-4517-88e2-a78c445f8734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dd1287-3998-4904-ad1b-d6d3c5260cfc", "name": "network-vif-deleted", "tag": "6eea92a0-2deb-41d4-8a5b-b3b33d0e6510"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:00.536522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6abaa1f5-d4f0-47db-857c-aed7d872c8dc req-6dc81f83-e296-4517-88e2-a78c445f8734 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.537219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6abaa1f5-d4f0-47db-857c-aed7d872c8dc req-6dc81f83-e296-4517-88e2-a78c445f8734 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.537680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6abaa1f5-d4f0-47db-857c-aed7d872c8dc req-6dc81f83-e296-4517-88e2-a78c445f8734 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.576122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6abaa1f5-d4f0-47db-857c-aed7d872c8dc req-6dc81f83-e296-4517-88e2-a78c445f8734 service nova] Creating event network-vif-deleted:6eea92a0-2deb-41d4-8a5b-b3b33d0e6510 for instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc on n-h1-791135-8 Oct 04 11:24:00.594428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6abaa1f5-d4f0-47db-857c-aed7d872c8dc req-6dc81f83-e296-4517-88e2-a78c445f8734 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072155 Oct 04 11:24:00.594428 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3731/4965] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:00.612041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:00.612899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:00.620161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.620811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.621284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.622046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.622506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.623197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.644031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] HTTP exception thrown: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Request method failure captured: Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc HTTP/1.1 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBewQ3q6X7KwlrpMQ5ibhQAg_o9gGoV_DYOvf42cj6CAlpFFVODjbfJIHa0vei0jf5dPyX9rdKxIkmrlmlZV8huSMo60zxeNDN8I_CfXPJelr1WWmTRwpr7aFihSHBGhPKU7e4hKY2qMcVwjXGpkBSGC3UlL6LGx2gSfpCL_DP_gQFs Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: eaec20a5ce964a899a1bfef2e6d1fc3b Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}] Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: eaec20a5ce964a899a1bfef2e6d1fc3b Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceActionsV221TestJSON-1008989611-project Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8d11a58d99ce4fcd974700c8600bac97 Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceActionsV221TestJSON-1008989611-project Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a5dd1287-3998-4904-ad1b-d6d3c5260cfc'} Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.646477 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Returning 404 to user: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b40caee8-21e0-457e-831f-f13f1480bf35 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 404 len: 111 microversion: 2.21 time: 0.054159 Oct 04 11:24:00.651053 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3732/4966] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:00 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:00.662423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '.version_select at 0x7f71d86fe5e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:00.663020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:00.670455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.671153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.671912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.672905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.673786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.674389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.811941 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e199279-ff2e-4037-80c8-bb1eb01fb414 tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.154524 Oct 04 11:24:00.821947 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3733/4967] 10.222.0.23 () {60 vars in 1337 bytes} [Tue Oct 4 11:24:00 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc/os-instance-actions => generated 611 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:24:00.827656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:00.828445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:00.835890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.836663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.837283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.838380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.838846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.839280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.855948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] HTTP exception thrown: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Request method failure captured: Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc HTTP/1.1 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBewQ3q6X7KwlrpMQ5ibhQAg_o9gGoV_DYOvf42cj6CAlpFFVODjbfJIHa0vei0jf5dPyX9rdKxIkmrlmlZV8huSMo60zxeNDN8I_CfXPJelr1WWmTRwpr7aFihSHBGhPKU7e4hKY2qMcVwjXGpkBSGC3UlL6LGx2gSfpCL_DP_gQFs Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: eaec20a5ce964a899a1bfef2e6d1fc3b Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}] Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: eaec20a5ce964a899a1bfef2e6d1fc3b Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceActionsV221TestJSON-1008989611-project Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8d11a58d99ce4fcd974700c8600bac97 Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceActionsV221TestJSON-1008989611-project Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a5dd1287-3998-4904-ad1b-d6d3c5260cfc'} Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:24:00.858103 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:00.862550 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:00.865791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Returning 404 to user: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:00.866938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e65a585e-f3a9-4d40-8c63-08ee8baf6a9a tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 404 len: 111 microversion: 2.21 time: 0.043530 Oct 04 11:24:00.867734 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3734/4968] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:24:00 2022] DELETE /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:00.873679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:00.875218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:00.882785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.885543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.886456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:00.887422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:00.888091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:00.888866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:01.136985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:01.146944 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-204cb806-d910-4c8e-8c0f-7057a7089047 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.276746 Oct 04 11:24:01.147998 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3735/4969] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:00 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:01.154163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:01.156506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] [instance: a5dd1287-3998-4904-ad1b-d6d3c5260cfc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:01.181009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:01.181935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:01.182607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:01.183583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:01.184266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:01.184934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:01.205057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] HTTP exception thrown: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Request method failure captured: Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc HTTP/1.1 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBewQ3q6X7KwlrpMQ5ibhQAg_o9gGoV_DYOvf42cj6CAlpFFVODjbfJIHa0vei0jf5dPyX9rdKxIkmrlmlZV8huSMo60zxeNDN8I_CfXPJelr1WWmTRwpr7aFihSHBGhPKU7e4hKY2qMcVwjXGpkBSGC3UlL6LGx2gSfpCL_DP_gQFs Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: eaec20a5ce964a899a1bfef2e6d1fc3b Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eaec20a5ce964a899a1bfef2e6d1fc3b"}]}] Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: eaec20a5ce964a899a1bfef2e6d1fc3b Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1008989611 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-InstanceActionsV221TestJSON-1008989611-project Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 8d11a58d99ce4fcd974700c8600bac97 Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-InstanceActionsV221TestJSON-1008989611-project Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a5dd1287-3998-4904-ad1b-d6d3c5260cfc'} Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:01.215305 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:01.219673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:01.219673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:01.219673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:01.219673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:01.219673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:01.219673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:01.219673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. Oct 04 11:24:01.219673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:01.221600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] Returning 404 to user: Instance a5dd1287-3998-4904-ad1b-d6d3c5260cfc could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:01.222695 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-90819be9-7c6a-4bc0-80bc-b218cb8d4dbd tempest-InstanceActionsV221TestJSON-1008989611 tempest-InstanceActionsV221TestJSON-1008989611-project] 10.222.0.23 "GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc" status: 404 len: 111 microversion: 2.21 time: 0.073539 Oct 04 11:24:01.236964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3736/4970] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:01 2022] GET /compute/v2.1/servers/a5dd1287-3998-4904-ad1b-d6d3c5260cfc => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:01.540519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:01.541323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:01.573718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:01.574639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:01.575185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:01.576029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:01.576617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:01.577152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:01.956849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:01.967822 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9834233-8f7e-410a-b125-e351058133b7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.431620 Oct 04 11:24:01.968425 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3737/4971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:01 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:02.171461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:02.172838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:02.183832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:02.186522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:02.187649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:02.190206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:02.195059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:02.195515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:02.935285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:02.947586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61d72d24-842c-4bf5-ac49-304146699da6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.779727 Oct 04 11:24:02.949940 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3738/4972] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:02 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:02.994208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:02.995172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:03.003878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:03.004835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:03.005679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:03.006724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:03.007645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:03.008310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:03.330937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:03.390110 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c2b357cd-e44b-4226-a0a7-f6ec88369af7 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.395988 Oct 04 11:24:03.419683 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3739/4973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:02 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:03.973606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:03.974776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:03.993077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:03.994573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:03.995832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:03.998348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:04.000966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:04.001692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:04.845543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:04.855832 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc71d0aa-8a1f-4981-bc4f-88e743f3beae tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.887650 Oct 04 11:24:04.862366 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3740/4974] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:03 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:04.874383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:04.890182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:04.919760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:04.920361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:04.920883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:04.921720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:04.927551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:04.929664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:05.540929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:05.571018 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94e582f3-b0df-4c74-9e4f-ca4f6c9fc186 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.707027 Oct 04 11:24:05.594101 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3741/4975] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:04 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:05.782717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7868962e-ed97-4f06-a48d-5880e5cea72a req-d9d6ea1c-a818-466f-94a9-3f2896723fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0218e8b-e3de-480e-8747-71c06ac4752c", "name": "network-vif-plugged", "status": "completed", "tag": "270bb04e-3ff4-4ecf-bf64-bdc8665ca993"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:05.803441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7868962e-ed97-4f06-a48d-5880e5cea72a req-d9d6ea1c-a818-466f-94a9-3f2896723fff service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:05.804354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7868962e-ed97-4f06-a48d-5880e5cea72a req-d9d6ea1c-a818-466f-94a9-3f2896723fff service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:05.805724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7868962e-ed97-4f06-a48d-5880e5cea72a req-d9d6ea1c-a818-466f-94a9-3f2896723fff service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:05.848958 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7868962e-ed97-4f06-a48d-5880e5cea72a req-d9d6ea1c-a818-466f-94a9-3f2896723fff service nova] Creating event network-vif-plugged:270bb04e-3ff4-4ecf-bf64-bdc8665ca993 for instance b0218e8b-e3de-480e-8747-71c06ac4752c on n-h2-791135-8 Oct 04 11:24:05.872170 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7868962e-ed97-4f06-a48d-5880e5cea72a req-d9d6ea1c-a818-466f-94a9-3f2896723fff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092928 Oct 04 11:24:05.874729 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3742/4976] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:24:05.890114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:05.902324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:05.923846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:05.924570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:05.925970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:05.927340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:05.928937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:05.934191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:06.690682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:06.705510 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4eddf934-088d-41da-91a5-0ad9dc1597b2 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.819350 Oct 04 11:24:06.708472 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3743/4977] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:05 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:06.724370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:06.724901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:06.754964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:06.756834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:06.759026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:06.759977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:06.761671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:06.762285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:07.177567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:07.190967 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a104dfe8-61c4-4e9f-86d3-277ec447d5df tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.480698 Oct 04 11:24:07.191943 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3744/4978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:06 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:07.732054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:07.732656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:07.741988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:07.749571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:07.750118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:07.750868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:07.751340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:07.751765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:08.293199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:08.324904 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-105b4984-da90-445b-83c6-1d11bf8a897a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1366 microversion: 2.1 time: 0.592594 Oct 04 11:24:08.330202 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3745/4979] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:07 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:08.341695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:08.342573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:08.355934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:08.356444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:08.356895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:08.357624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:08.358088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:08.358522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:08.794589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:08.811162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-373db6e7-45d0-4b7e-b148-1c799e86cb95 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.479202 Oct 04 11:24:08.812111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3746/4980] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:08 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:08.816786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:08.817288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:08.836540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:08.837042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:08.837500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:08.838217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:08.838679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:08.839109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:08.875662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:08.894217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:24:09.106862 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa6cb4e0-9d89-4da5-9c83-17f036e4a89d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 204 len: 0 microversion: 2.1 time: 0.291205 Oct 04 11:24:09.114220 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3747/4981] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:24:08 2022] DELETE /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:24:09.131227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:09.134712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:09.148722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:09.151587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:09.154236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:09.155242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:09.155900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:09.157069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:09.584576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:09.595179 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4e5307e-5a73-4a6c-873c-9d4817dc849b tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1507 microversion: 2.1 time: 0.474234 Oct 04 11:24:09.598873 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3748/4982] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:09 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:09.609571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:09.616604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:09.630553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:09.637261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:09.637811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:09.638396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:09.639135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:09.639603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:09.640037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:09.950878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:09.959805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6350ef3c-092a-4cf1-aaf6-606dc70efd00 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1556 microversion: 2.1 time: 0.359585 Oct 04 11:24:09.963974 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3749/4983] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:09 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1556 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:09.971800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:09.976301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:09.992855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:09.993790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:09.995120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:09.996175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:09.996812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:09.997446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:10.267314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:10.282579 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a36f766-9012-48ae-89f7-9b595c7a7f2c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.316180 Oct 04 11:24:10.283683 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3750/4984] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:09 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:10.312295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:10.315142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:10.350789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:10.352689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:10.354964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:10.356269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:10.360093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:10.360999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:10.457297 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:24:10.458375 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:24:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:24:10.482350 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d4d3049-0e85-414a-9e93-bf537469bdbb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194521 Oct 04 11:24:10.482955 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3751/4985] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:24:10 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:10.623594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:10.625180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:10.634250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:10.635563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:10.636217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:10.637259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:10.637909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:10.638513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:10.919490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:10.933670 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3693104d-b89c-4ba8-b408-131d7672e943 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1507 microversion: 2.1 time: 0.314124 Oct 04 11:24:10.936015 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3752/4986] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:10 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:11.307294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:11.308126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:11.319483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:11.319968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:11.324765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:11.325803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:11.326446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:11.327677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:11.777054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:11.794012 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-897135f9-f213-4951-b0d7-e75ece781bbe tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.491170 Oct 04 11:24:11.795148 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3753/4987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:11 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:11.800011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c4c30736-34df-4053-abb1-9d6c62d1611c req-48708478-9ff7-4669-a0ca-4df3a860788b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46eb658-0913-4726-acb8-874f01b5c154", "name": "network-vif-deleted", "tag": "8ca489d8-9727-487d-837c-0eeabde037c6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:11.825186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c4c30736-34df-4053-abb1-9d6c62d1611c req-48708478-9ff7-4669-a0ca-4df3a860788b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:11.829860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c4c30736-34df-4053-abb1-9d6c62d1611c req-48708478-9ff7-4669-a0ca-4df3a860788b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:11.830321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c4c30736-34df-4053-abb1-9d6c62d1611c req-48708478-9ff7-4669-a0ca-4df3a860788b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:11.851741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c4c30736-34df-4053-abb1-9d6c62d1611c req-48708478-9ff7-4669-a0ca-4df3a860788b service nova] Creating event network-vif-deleted:8ca489d8-9727-487d-837c-0eeabde037c6 for instance a46eb658-0913-4726-acb8-874f01b5c154 on n-h1-791135-8 Oct 04 11:24:11.871208 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c4c30736-34df-4053-abb1-9d6c62d1611c req-48708478-9ff7-4669-a0ca-4df3a860788b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074572 Oct 04 11:24:11.872432 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3754/4988] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:11.965710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:11.966830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:11.988584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:11.989420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:11.991334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:11.992319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:11.994221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:11.996676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:12.079536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:12.080296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:12.084474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:12.085077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lazy-loading 'fault' on Instance uuid a46eb658-0913-4726-acb8-874f01b5c154 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:24:12.294575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:12.306057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92433dfd-0951-4cb0-8674-13c9513cf678 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 200 len: 1311 microversion: 2.1 time: 0.346559 Oct 04 11:24:12.322573 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3755/4989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:11 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 1311 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:12.824128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:12.827831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:12.837734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:12.841536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:12.841536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:12.842832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:12.846658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:12.847286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:13.739360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:13.750847 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9018395b-d4da-4edc-b90e-9c5fca2b85cc tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.936639 Oct 04 11:24:13.756134 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3756/4990] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:12 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:13.782810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-46f3e41a-b1ee-44a9-a30e-d00ccbf4518f req-2cb0939a-1253-48e2-9cf0-d649735bc0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0218e8b-e3de-480e-8747-71c06ac4752c", "tag": "270bb04e-3ff4-4ecf-bf64-bdc8665ca993"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:13.804290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-46f3e41a-b1ee-44a9-a30e-d00ccbf4518f req-2cb0939a-1253-48e2-9cf0-d649735bc0d2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:13.805011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-46f3e41a-b1ee-44a9-a30e-d00ccbf4518f req-2cb0939a-1253-48e2-9cf0-d649735bc0d2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:13.806104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-46f3e41a-b1ee-44a9-a30e-d00ccbf4518f req-2cb0939a-1253-48e2-9cf0-d649735bc0d2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:13.834443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-46f3e41a-b1ee-44a9-a30e-d00ccbf4518f req-2cb0939a-1253-48e2-9cf0-d649735bc0d2 service nova] Creating event network-changed:270bb04e-3ff4-4ecf-bf64-bdc8665ca993 for instance b0218e8b-e3de-480e-8747-71c06ac4752c on n-h2-791135-8 Oct 04 11:24:13.849968 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-46f3e41a-b1ee-44a9-a30e-d00ccbf4518f req-2cb0939a-1253-48e2-9cf0-d649735bc0d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074739 Oct 04 11:24:13.851914 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3757/4991] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:13.862026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:13.864112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: a46eb658-0913-4726-acb8-874f01b5c154] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:13.876055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:13.876853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:13.877534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:13.878456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:13.879838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:13.880468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:13.902107 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Instance a46eb658-0913-4726-acb8-874f01b5c154 could not be found. Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 HTTP/1.1 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a46eb658-0913-4726-acb8-874f01b5c154 could not be found. Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a46eb658-0913-4726-acb8-874f01b5c154'} Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46eb658-0913-4726-acb8-874f01b5c154 could not be found. Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46eb658-0913-4726-acb8-874f01b5c154 could not be found. Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:13.905109 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:13.910923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:13.910923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:13.910923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:13.910923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:13.910923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:13.910923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:13.910923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46eb658-0913-4726-acb8-874f01b5c154 could not be found. Oct 04 11:24:13.910923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:13.912950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 404 to user: Instance a46eb658-0913-4726-acb8-874f01b5c154 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:13.914334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa52d901-79a9-4e77-b4a9-61ec961f1662 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154" status: 404 len: 111 microversion: 2.1 time: 0.061320 Oct 04 11:24:13.915235 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3758/4992] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:13 2022] GET /compute/v2.1/servers/a46eb658-0913-4726-acb8-874f01b5c154 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:24:13.929699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:13.930402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:13.937952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:13.938709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:13.939419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:13.940485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:13.941092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:13.942477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:13.976734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:24:14.147976 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5acfe801-c9f1-4be6-9e7a-5b828fc56713 tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 204 len: 0 microversion: 2.1 time: 0.227345 Oct 04 11:24:14.150040 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3759/4993] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:24:13 2022] DELETE /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:24:14.164235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:14.166867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:14.187626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:14.188211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:14.191742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:14.195633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:14.196630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:14.197098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:14.933343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:14.949535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4f9d4d6-753f-4629-8d0a-e283049c99af tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1521 microversion: 2.1 time: 0.793120 Oct 04 11:24:14.961750 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3760/4994] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:14 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1521 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:14.993923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:14.994692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:15.001876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:15.002507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:15.003259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:15.005331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:15.006485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:15.007163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:15.441148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:15.458065 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-500bd6ad-8bc8-4c98-bb30-ba666bcb848b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.465149 Oct 04 11:24:15.462949 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3761/4995] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:14 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:15.726855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f74bd9f2-4c15-42f7-97c9-ac902772b6d0 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-898458903", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:15.743184 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-f74bd9f2-4c15-42f7-97c9-ac902772b6d0 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] HTTP exception thrown: min_count must be <= max_count Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f74bd9f2-4c15-42f7-97c9-ac902772b6d0 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Request method failure captured: Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 183 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBfedQfCXxDB2NO15vXOHcV08cS2LDBZxeZF4GThM6dB6Dj3nrn9nokvVvVXqz1yzcsQRLkUE_ujdPuWv9U2JFn4FJSk7v9j_x5-2W4LJVEphZiJRN_9lMy2yTiz-3wDzDnnjrS4qWEnJzPZZEeYKkmXvxXmZnK5dmlmujfndF0E3Vs Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c206b3ca18cc4dcd94977395f0615039"}]}] Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6926c0309d524924bae5c7531c7735df Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-898458903", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: exception: min_count must be <= max_count Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-898458903', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 11:24:15.748940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.755637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f74bd9f2-4c15-42f7-97c9-ac902772b6d0 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Returning 400 to user: min_count must be <= max_count {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:15.756703 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f74bd9f2-4c15-42f7-97c9-ac902772b6d0 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.289908 Oct 04 11:24:15.760171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3762/4996] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:15 2022] POST /compute/v2.1/servers => generated 74 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:24:15.970294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e968f8ba-2b20-4024-8293-294658e2fb98 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1319661516", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "max_count": 0}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e968f8ba-2b20-4024-8293-294658e2fb98 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Request method failure captured: Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 168 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBfedQfCXxDB2NO15vXOHcV08cS2LDBZxeZF4GThM6dB6Dj3nrn9nokvVvVXqz1yzcsQRLkUE_ujdPuWv9U2JFn4FJSk7v9j_x5-2W4LJVEphZiJRN_9lMy2yTiz-3wDzDnnjrS4qWEnJzPZZEeYKkmXvxXmZnK5dmlmujfndF0E3Vs Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c206b3ca18cc4dcd94977395f0615039"}]}] Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6926c0309d524924bae5c7531c7735df Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1319661516", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "max_count": 0}} Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1319661516', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'max_count': 0}}} Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 0 Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:15.979749 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e968f8ba-2b20-4024-8293-294658e2fb98 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:15.984642 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e968f8ba-2b20-4024-8293-294658e2fb98 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.017425 Oct 04 11:24:16.001455 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3763/4997] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:15 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:16.011635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:16.013000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:16.033283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:16.033873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:16.034319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:16.037637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:16.040837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:16.041307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:16.251252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5c346b48e674ad48fa6fd6aa2634361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0313e8ab904049c58fd4c9d9a7adf40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:16.256686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:16.283078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6e690e0-18d1-4a89-bf40-5d178e11babf tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 200 len: 1479 microversion: 2.1 time: 0.288543 Oct 04 11:24:16.299245 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3764/4998] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:15 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 1479 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:16.312782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-def9e0d5-28ed-4365-82bf-9a87d394251a req-7ee557c2-20a5-4348-bdda-c67844645483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77681c9a-5e04-4b84-a338-33360377e251", "name": "network-vif-deleted", "tag": "c49d45af-ed02-47a4-b127-7ff640b59053"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:16.355069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-def9e0d5-28ed-4365-82bf-9a87d394251a req-7ee557c2-20a5-4348-bdda-c67844645483 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:16.355553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-def9e0d5-28ed-4365-82bf-9a87d394251a req-7ee557c2-20a5-4348-bdda-c67844645483 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:16.355983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-def9e0d5-28ed-4365-82bf-9a87d394251a req-7ee557c2-20a5-4348-bdda-c67844645483 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:16.402715 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-def9e0d5-28ed-4365-82bf-9a87d394251a req-7ee557c2-20a5-4348-bdda-c67844645483 service nova] Creating event network-vif-deleted:c49d45af-ed02-47a4-b127-7ff640b59053 for instance 77681c9a-5e04-4b84-a338-33360377e251 on n-h2-791135-8 Oct 04 11:24:16.420080 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-def9e0d5-28ed-4365-82bf-9a87d394251a req-7ee557c2-20a5-4348-bdda-c67844645483 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119151 Oct 04 11:24:16.420884 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3765/4999] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:16.444043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1526d774-de80-4528-8d34-92146f3c719a tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-563591110", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "max_count": 2.5}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1526d774-de80-4528-8d34-92146f3c719a tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Request method failure captured: Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 169 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBfedQfCXxDB2NO15vXOHcV08cS2LDBZxeZF4GThM6dB6Dj3nrn9nokvVvVXqz1yzcsQRLkUE_ujdPuWv9U2JFn4FJSk7v9j_x5-2W4LJVEphZiJRN_9lMy2yTiz-3wDzDnnjrS4qWEnJzPZZEeYKkmXvxXmZnK5dmlmujfndF0E3Vs Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c206b3ca18cc4dcd94977395f0615039"}]}] Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6926c0309d524924bae5c7531c7735df Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-563591110", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "max_count": 2.5}} Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-563591110', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:16.450879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1526d774-de80-4528-8d34-92146f3c719a tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:16.456387 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1526d774-de80-4528-8d34-92146f3c719a tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030295 Oct 04 11:24:16.461527 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3766/5000] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:16 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:16.489313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:16.490085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:16.518527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:16.519504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:16.520744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:16.522398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:16.525633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:16.526420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:16.862884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:16.903873 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2cfc5e4c-712e-4c32-8dda-eb84c4393da3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.419152 Oct 04 11:24:16.920008 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3767/5001] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:16 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:16.925409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-428dee3e-c4a5-4abe-b571-d847c38f1c36 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2105595356", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 0}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-428dee3e-c4a5-4abe-b571-d847c38f1c36 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Request method failure captured: Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 168 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBfedQfCXxDB2NO15vXOHcV08cS2LDBZxeZF4GThM6dB6Dj3nrn9nokvVvVXqz1yzcsQRLkUE_ujdPuWv9U2JFn4FJSk7v9j_x5-2W4LJVEphZiJRN_9lMy2yTiz-3wDzDnnjrS4qWEnJzPZZEeYKkmXvxXmZnK5dmlmujfndF0E3Vs Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c206b3ca18cc4dcd94977395f0615039"}]}] Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6926c0309d524924bae5c7531c7735df Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2105595356", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 0}} Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2105595356', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'min_count': 0}}} Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 0 Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:16.934320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 11:24:16.939916 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:16.950327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-428dee3e-c4a5-4abe-b571-d847c38f1c36 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:16.951483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-428dee3e-c4a5-4abe-b571-d847c38f1c36 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030189 Oct 04 11:24:16.952590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3768/5002] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:16 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:17.066037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ccdf72d-d7af-4b9b-8b67-680003d481d5 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1521444818", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 2.5}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ccdf72d-d7af-4b9b-8b67-680003d481d5 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Request method failure captured: Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 170 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBfedQfCXxDB2NO15vXOHcV08cS2LDBZxeZF4GThM6dB6Dj3nrn9nokvVvVXqz1yzcsQRLkUE_ujdPuWv9U2JFn4FJSk7v9j_x5-2W4LJVEphZiJRN_9lMy2yTiz-3wDzDnnjrS4qWEnJzPZZEeYKkmXvxXmZnK5dmlmujfndF0E3Vs Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c206b3ca18cc4dcd94977395f0615039"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c206b3ca18cc4dcd94977395f0615039"}]}] Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: c206b3ca18cc4dcd94977395f0615039 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1132487969 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 6926c0309d524924bae5c7531c7735df Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1132487969-project Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1521444818", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "min_count": 2.5}} Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1521444818', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:17.072923 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 11:24:17.078633 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.089264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ccdf72d-d7af-4b9b-8b67-680003d481d5 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:17.090414 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ccdf72d-d7af-4b9b-8b67-680003d481d5 tempest-MultipleCreateNegativeTestJSON-1132487969 tempest-MultipleCreateNegativeTestJSON-1132487969-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029161 Oct 04 11:24:17.093226 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3769/5003] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 11:24:17.314449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:17.315629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] [instance: 77681c9a-5e04-4b84-a338-33360377e251] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:17.334601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:17.337729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:17.341108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:17.342430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:17.344575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:17.345800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:17.380552 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] HTTP exception thrown: Instance 77681c9a-5e04-4b84-a338-33360377e251 could not be found. Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Request method failure captured: Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 HTTP/1.1 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBZILfPI9M8LpW7qeKCY6JKh-TLZns77Uf47GbaR8Gf0YSubHjfxkBmyVaZF7yITqTzR9xNhRk0tMlBstxpM8InY_nMwhuHs-uRsqVF5iZwJuQgNzz2CQabx6EhnGOffUHCA6nAnPOUEAx6i3bSGL2FhjXbQqgC7RvEof5GFG9fkbo4 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0313e8ab904049c58fd4c9d9a7adf40a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0313e8ab904049c58fd4c9d9a7adf40a"}]}] Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 0313e8ab904049c58fd4c9d9a7adf40a Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2125619053 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d5c346b48e674ad48fa6fd6aa2634361 Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2125619053-project Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 77681c9a-5e04-4b84-a338-33360377e251 could not be found. Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '77681c9a-5e04-4b84-a338-33360377e251'} Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77681c9a-5e04-4b84-a338-33360377e251 could not be found. Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77681c9a-5e04-4b84-a338-33360377e251 could not be found. Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.382628 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:17.387870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.387870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:17.387870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:17.387870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:17.387870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:17.387870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:17.387870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77681c9a-5e04-4b84-a338-33360377e251 could not be found. Oct 04 11:24:17.387870 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:17.391047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] Returning 404 to user: Instance 77681c9a-5e04-4b84-a338-33360377e251 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:17.392874 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dcacf944-0a5d-4eb3-8cce-268cca84f75d tempest-ServerRescueNegativeTestJSON-2125619053 tempest-ServerRescueNegativeTestJSON-2125619053-project] 10.222.0.23 "GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251" status: 404 len: 111 microversion: 2.1 time: 0.086166 Oct 04 11:24:17.402094 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3770/5004] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:17 2022] GET /compute/v2.1/servers/77681c9a-5e04-4b84-a338-33360377e251 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:24:17.926705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:17.927915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:17.934139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:17.934637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:17.935079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:17.935794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:17.961436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:17.961436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:18.530183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:18.563334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-164ebcfc-4316-4c04-a745-2e04abfe2bed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.639449 Oct 04 11:24:18.565040 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3771/5005] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:17 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:19.257224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:19.266510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:19.279515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:19.284566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:19.285290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:19.286251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:19.287349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:19.287961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:19.328433 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c0817fea-b877-43f3-8238-6fc286df8de7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075573 Oct 04 11:24:19.340263 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3772/5006] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:24:19 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:24:19.442544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:19.443051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:19.452176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:19.452676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:19.456620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:19.458159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:19.461109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:19.461782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:19.526854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:24:19.807968 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf73c9da-9607-4253-9858-cf6e1462fd4f tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 204 len: 0 microversion: 2.1 time: 0.369656 Oct 04 11:24:19.812460 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3773/5007] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:24:19 2022] DELETE /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:24:19.820264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:19.821071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:19.833298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:19.834877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:19.835515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:19.836432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:19.837074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:19.837705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:20.414738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:20.430717 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9640fad5-1cbc-40c1-bb5c-416835d398dd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.618196 Oct 04 11:24:20.431822 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3774/5008] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:19 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:20.451637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:20.452574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:20.460845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:20.462005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:20.462655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:20.464460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:20.466054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:20.467004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:20.859709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:20.875812 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3dbea170-8c16-4665-943a-ca098b10c0c3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1673 microversion: 2.1 time: 0.438457 Oct 04 11:24:20.882437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3775/5009] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:20 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1673 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:21.461709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:21.465029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:21.493010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:21.497114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:21.497757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:21.499143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:21.501292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:21.502377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:22.068406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:22.082095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f55f68e4-678e-44e6-8304-82ca6adde14b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.627358 Oct 04 11:24:22.082971 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3776/5010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:21 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:22.099887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:22.100520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:22.110629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:22.111060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:22.114338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:22.118983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:22.119669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:22.120314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:23.159579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:23.177658 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64d56f1d-d4c9-4822-9b9b-7efabfa9992c tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 200 len: 1673 microversion: 2.1 time: 1.092788 Oct 04 11:24:23.187747 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3777/5011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:22 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 1673 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:23.192530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:23.193147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:23.244109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:23.244625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:23.245068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:23.245822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:23.246289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:23.246720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:23.917069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:23.929422 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1395ccb7-9b0a-4141-9e11-4d0b9f13f88e tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1507 microversion: 2.1 time: 0.736829 Oct 04 11:24:23.946118 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3778/5012] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:23 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1507 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:23.982101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-aa377fdb-8786-4b03-90b4-150b5f417eaa req-6113e434-1e90-4445-9520-443ed9c4ffe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2", "name": "network-vif-deleted", "tag": "9e055cbd-e1db-4998-bc21-f523ddd8968c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:24.017240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aa377fdb-8786-4b03-90b4-150b5f417eaa req-6113e434-1e90-4445-9520-443ed9c4ffe1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:24.017705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aa377fdb-8786-4b03-90b4-150b5f417eaa req-6113e434-1e90-4445-9520-443ed9c4ffe1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:24.018360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aa377fdb-8786-4b03-90b4-150b5f417eaa req-6113e434-1e90-4445-9520-443ed9c4ffe1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:24.049152 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-aa377fdb-8786-4b03-90b4-150b5f417eaa req-6113e434-1e90-4445-9520-443ed9c4ffe1 service nova] Creating event network-vif-deleted:9e055cbd-e1db-4998-bc21-f523ddd8968c for instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 on n-h1-791135-8 Oct 04 11:24:24.059944 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-aa377fdb-8786-4b03-90b4-150b5f417eaa req-6113e434-1e90-4445-9520-443ed9c4ffe1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112840 Oct 04 11:24:24.061178 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3779/5013] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:24.213562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:24.214962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:24.233185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:24.235758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:24.236397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:24.244740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:24.248469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:24.249105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:24.289195 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] HTTP exception thrown: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Request method failure captured: Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 HTTP/1.1 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcRm5fMmd_EVS40xoP_6ujvxJhJGcWUnyb0ezXFh6XbOVVE9KOLWSPuCxF3P3szZtLTaMBGvPk3SF6c5KW01hB-5G6D9jILmYuTsHzXuWqea0KRtXelLhZ4Cz7ORAMItKzh14zR7PjKbruLWNVet7I-bFM4PXMPpFj1kUPKsZVqzbI Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bca571652d66413ab8000101c4e51262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bca571652d66413ab8000101c4e51262"}]}] Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 12f16f7befa14be687888f0b00588c6b Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2'} Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:24.292246 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:24.296818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:24.296818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:24.296818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:24.296818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:24.296818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:24.296818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:24:24.296818 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:24.314189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Returning 404 to user: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:24.315334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53bf6acd-969e-437e-b56f-ac2aa3bc65fc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 404 len: 111 microversion: 2.1 time: 0.106492 Oct 04 11:24:24.318071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3780/5014] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:24 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:24:24.327370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-55f0b190-644d-40d8-a3fa-5aad7a0b0f17 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '.version_select at 0x7f71cf070430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:24.357567 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-55f0b190-644d-40d8-a3fa-5aad7a0b0f17 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-732027173" status: 202 len: 0 microversion: 2.1 time: 0.034505 Oct 04 11:24:24.361856 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3781/5015] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-732027173 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:24:24.961939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:24.963305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:24.970074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:24.970848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:24.972241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:24.980511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:24.981535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:24.982246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:25.393998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:25.416524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-50b60a32-5b32-435f-b8b3-4e4921ffed46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1487 microversion: 2.1 time: 0.466493 Oct 04 11:24:25.422264 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3782/5016] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:24 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1487 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:25.650391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1880424571", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:25.738589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] validate_networks() for [('6a0ec4e4-e688-466d-9fdf-74d258bd1cc8', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:24:27.291159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:24:27.292517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:24:27.294270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:24:27.298425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:24:27.299203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:24:27.319913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:27.320412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:27.321043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:27.322684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:27.323325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:27.323956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:27.345449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Getting quotas for project f829c02cff75406896dbc4c16ad43a46. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:24:27.362752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Getting quotas for user d9c82357fe154bec8bab1152fc57e0e9 and project f829c02cff75406896dbc4c16ad43a46. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:24:27.415531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:24:27.418534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:24:27.502874 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95e1acae-c3ff-4d30-81ba-095c1d9ea12f tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.856936 Oct 04 11:24:27.506865 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3783/5017] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:24:27.513681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e36202c0-defa-4659-bfa1-1c712cc57034 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'create', calling method: .version_select at 0x7f71cf070550>, body: {"keypair": {"name": "tempest-keypair-2096390986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/Acmq7gxT0n4Ah6m4STFW7FlBcwnvZ2uWomN31QUIMJNHRyX88z69f3eHsVfrSxXKpDw5zYDiYRRXT91m52yBijPFGck9j/t2St5gUIL8S/FnbYchg//inUZCSvpnTGg=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:27.583828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e36202c0-defa-4659-bfa1-1c712cc57034 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Getting quotas for project bca571652d66413ab8000101c4e51262. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:24:27.601918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e36202c0-defa-4659-bfa1-1c712cc57034 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Getting quotas for user 12f16f7befa14be687888f0b00588c6b and project bca571652d66413ab8000101c4e51262. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:24:27.650085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:27.663185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e36202c0-defa-4659-bfa1-1c712cc57034 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154325 Oct 04 11:24:27.667026 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3784/5018] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:24:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:27.678770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18324837-5637-487b-87f3-39619e6d8018 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:27.679870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18324837-5637-487b-87f3-39619e6d8018 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:27.790610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-18324837-5637-487b-87f3-39619e6d8018 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:27.894873 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18324837-5637-487b-87f3-39619e6d8018 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1214 microversion: 2.1 time: 0.226454 Oct 04 11:24:27.914968 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3785/5019] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:27 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:28.921871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:28.922500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:28.937301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:28.938273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:28.939497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:28.943872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:28.946522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:28.947305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:29.247055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:29.255897 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a600c83d-04f4-4508-9406-05dd651e0707 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1218 microversion: 2.1 time: 0.337812 Oct 04 11:24:29.275903 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3786/5020] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:28 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1218 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:30.282110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:30.283524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:30.296973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:30.301789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:30.302915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:30.311910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:30.312515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:30.313973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:31.225229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:31.235378 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e93efeef-da74-4b45-8b91-e741f836d94a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1272 microversion: 2.1 time: 0.957406 Oct 04 11:24:31.250408 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3787/5021] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:30 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1272 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:32.309820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1929188218", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": "none"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:32.420944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:24:32.421808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:24:32.422907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:24:32.423463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:24:32.424079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:24:32.443095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:32.443836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:32.446817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:32.448380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:32.449269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:32.450040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:32.492779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Getting quotas for project a56ff553f9b8470180fe0b98892ce75d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:24:32.513827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Getting quotas for user 32f0fc8e8bde4c8e9ff5e2e1007f5ae5 and project a56ff553f9b8470180fe0b98892ce75d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:24:32.553029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:24:32.558277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:24:32.693865 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a25bca18-2ca2-4374-a099-87153e91065e tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.725936 Oct 04 11:24:32.695391 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3788/5022] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 11:24:32.705406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:32.706280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:32.718249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:32.725554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:32.726261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:32.727224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:32.727862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:32.728964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:33.435592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:33.439451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:33.450797 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a6a7ac1d-ea50-4d1b-b6b9-d566cef276f0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1314 microversion: 2.1 time: 0.749049 Oct 04 11:24:33.462056 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3789/5023] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:32 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:33.462056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-599d83eb-f875-4ff3-aace-b00eb02d1d0c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:33.462056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-599d83eb-f875-4ff3-aace-b00eb02d1d0c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:33.731472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-599d83eb-f875-4ff3-aace-b00eb02d1d0c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:33.760189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-599d83eb-f875-4ff3-aace-b00eb02d1d0c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:33.780972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-599d83eb-f875-4ff3-aace-b00eb02d1d0c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:33.783880 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-599d83eb-f875-4ff3-aace-b00eb02d1d0c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131" status: 200 len: 1278 microversion: 2.47 time: 0.330824 Oct 04 11:24:33.801435 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3790/5024] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:33 2022] GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131 => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:33.899255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-990112460", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": "none"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:34.008560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:24:34.009042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:24:34.009846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:24:34.010602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:24:34.011199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:24:34.054948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:34.055628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:34.055876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:34.062372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:34.064393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:34.065028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:34.110868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Getting quotas for project a56ff553f9b8470180fe0b98892ce75d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:24:34.122727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Getting quotas for user 32f0fc8e8bde4c8e9ff5e2e1007f5ae5 and project a56ff553f9b8470180fe0b98892ce75d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:24:34.152973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:24:34.155467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:24:34.252043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51677507-be05-4985-80eb-a37723233a13 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.357432 Oct 04 11:24:34.253917 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3791/5025] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Oct 4 11:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 11:24:34.537863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Calling method '.version_select at 0x7f71cefe9700>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:34.539731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:34.540908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:34.541552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:34.588495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:34.589332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:34.591144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:34.617819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:34.624350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:34.625076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:34.639402 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f08ca9f-355e-4492-86ee-96590f3e55a3 tempest-PortsAdminExtendedAttrsTestJSON-273227976 tempest-PortsAdminExtendedAttrsTestJSON-273227976-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.383937 Oct 04 11:24:34.641961 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3792/5026] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:24:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:34.663394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6404e81d-e97e-4226-9a3d-abea75efbc15 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:34.671758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6404e81d-e97e-4226-9a3d-abea75efbc15 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:34.783585 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6404e81d-e97e-4226-9a3d-abea75efbc15 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "PUT /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 991 microversion: 2.47 time: 0.140105 Oct 04 11:24:34.789657 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3793/5027] 10.222.0.23 () {62 vars in 1297 bytes} [Tue Oct 4 11:24:34 2022] PUT /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 991 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:24:34.798291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:34.802849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:34.839909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:34.843846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:34.851014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:34.852452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:34.853918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:34.856270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:35.529404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:35.547973 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d8ffd58-2cf5-4bbc-a970-ac137a6cebf1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1314 microversion: 2.1 time: 0.753210 Oct 04 11:24:35.568314 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3794/5028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:34 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:35.575049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:35.575964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:35.584216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:35.584999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:35.585773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:35.586687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:35.587362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:35.587988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:35.906610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:35.955436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:35.977819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:35.983422 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-093c7147-69da-4f4e-8788-44426fee747d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1281 microversion: 2.47 time: 0.412596 Oct 04 11:24:35.997010 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3795/5029] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:35 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1281 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:35.997010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-afb1f857-8706-4264-aa99-8bf90e659b80 req-5e41d5de-0f38-4c18-82d3-adeea87f0825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78641eab-c3a1-458e-805a-5d437c19aa85", "tag": "f156c303-6d35-429a-9199-d399c4e4abcc"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:36.030031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-afb1f857-8706-4264-aa99-8bf90e659b80 req-5e41d5de-0f38-4c18-82d3-adeea87f0825 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:36.030527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-afb1f857-8706-4264-aa99-8bf90e659b80 req-5e41d5de-0f38-4c18-82d3-adeea87f0825 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:36.030970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-afb1f857-8706-4264-aa99-8bf90e659b80 req-5e41d5de-0f38-4c18-82d3-adeea87f0825 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:36.068665 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-afb1f857-8706-4264-aa99-8bf90e659b80 req-5e41d5de-0f38-4c18-82d3-adeea87f0825 service nova] Creating event network-changed:f156c303-6d35-429a-9199-d399c4e4abcc for instance 78641eab-c3a1-458e-805a-5d437c19aa85 on n-h1-791135-8 Oct 04 11:24:36.085808 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-afb1f857-8706-4264-aa99-8bf90e659b80 req-5e41d5de-0f38-4c18-82d3-adeea87f0825 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087222 Oct 04 11:24:36.087048 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3796/5030] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:36.591631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:36.592345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:36.602817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:36.604378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:36.605575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:36.608205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:36.609140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:36.613015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:36.954333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:36.977206 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94080079-0dd3-469a-85de-bd965842b8ed tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1314 microversion: 2.1 time: 0.389104 Oct 04 11:24:36.989657 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3797/5031] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:36 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:37.032777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-242310716", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a1c1cda-67d7-4d42-a700-0c9a2c75d1a2"}], "security_groups": [{"name": "tempest-securitygroup--2090283496"}], "key_name": "tempest-keypair-2096390986", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:37.346983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] validate_networks() for [('1a1c1cda-67d7-4d42-a700-0c9a2c75d1a2', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:24:38.361419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:24:38.362093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:24:38.362280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:24:38.362941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:24:38.363532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:24:38.378412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:38.383319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:38.384020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:38.385033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:38.385705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:38.386332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:38.429686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Getting quotas for project bca571652d66413ab8000101c4e51262. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:24:38.449420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Getting quotas for user 12f16f7befa14be687888f0b00588c6b and project bca571652d66413ab8000101c4e51262. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:24:38.474937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:24:38.477315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:24:38.575214 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9ba63942-024f-4054-a529-5339dc660c36 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.556940 Oct 04 11:24:38.576405 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3798/5032] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:24:38.581192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:38.589426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:38.604325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:38.606489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:38.608883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:38.609808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:38.610352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:38.612427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:38.734278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:38.744618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:38.748452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:38.751810 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6afab5df-3f0c-43ab-9fce-8745bad7fff5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1335 microversion: 2.47 time: 0.174387 Oct 04 11:24:38.758435 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3799/5033] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:38 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1335 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:38.884988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1972458936", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:39.008976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] validate_networks() for [('17e2b8b8-2f44-4f26-8d3b-a70e0969ad66', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:24:39.673655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:24:39.674331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:24:39.674612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:24:39.675793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:24:39.676392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:24:39.697956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:39.698451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:39.698894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:39.700029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:39.700695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:39.701415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:39.753810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Getting quotas for project 591474389cc748708f8d1f16a6f665af. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:24:39.768459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Getting quotas for user 3e89c8e904134a6ab0eb5a619780deb0 and project 591474389cc748708f8d1f16a6f665af. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:24:39.795187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:24:39.797622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:24:39.856885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:39.939249 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-577acd15-be9e-45e1-af21-4d0dd2a226f5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173597 Oct 04 11:24:39.940494 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3800/5034] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:24:39.962339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:39.968024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:40.003915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:40.004650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:40.006669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:40.008149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:40.011755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:40.012816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:40.805048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:40.817008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e9bac3f-4efe-4510-aa60-53fd7a9edb98 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1314 microversion: 2.1 time: 0.875038 Oct 04 11:24:40.826896 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3801/5035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:39 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:40.855059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:40.855695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:40.877225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:40.878971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:40.879476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:40.882380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:40.884075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:40.884566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:41.062391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:41.091319 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ed49bfe-7bd2-4e20-a109-85837c36f4d9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1297 microversion: 2.1 time: 0.261678 Oct 04 11:24:41.092247 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3802/5036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:40 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1297 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:41.106496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:41.107564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:41.120399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:41.121746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:41.122676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:41.124485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:41.125297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:41.126005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:41.375344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:41.403684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:41.412616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:41.414185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d3f4032-0b88-4d16-b27c-b7dbf432dee2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1356 microversion: 2.47 time: 0.319913 Oct 04 11:24:41.416572 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3803/5037] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:41 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1356 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:41.452308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:41.458257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:41.476843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:41.484009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:41.485582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:41.486508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:41.486817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:41.487280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:41.648583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:41.669552 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a33c6a88-3cfa-42f2-b5d8-8975740f0ab5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1220 microversion: 2.1 time: 0.238585 Oct 04 11:24:41.671441 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3804/5038] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:41 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1220 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:41.679320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:41.683026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:41.706237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:41.708986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:41.710638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:41.712708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:41.713218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:41.713801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:41.883809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:24:41.884490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:24:41.885270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:24:41.885743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:24:41.886164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:24:42.061187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:42.069845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:42.071077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:42.071734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:42.072835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:42.073611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:42.074411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:42.132049 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ce23c1f9-05eb-42c7-9aa1-b9e2ee487922 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "POST /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb/action" status: 202 len: 1078 microversion: 2.47 time: 0.457371 Oct 04 11:24:42.133557 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3805/5039] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Oct 4 11:24:41 2022] POST /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb/action => generated 1078 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 11:24:42.138808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:42.139519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:42.151110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:42.153224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:42.154375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:42.156455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:42.157297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:42.158346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:42.880278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:42.888377 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c219f723-6e42-4292-8c9f-2d8a422f2630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1314 microversion: 2.1 time: 0.753644 Oct 04 11:24:42.891090 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3806/5040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:42 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:42.899388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:42.901943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:42.921144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:42.922259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:42.926168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:42.927579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:42.928074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:42.928573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:43.110260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:43.131943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2357cbb6-4d7b-4843-970b-f1ae66ab4f1e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1295 microversion: 2.1 time: 0.235487 Oct 04 11:24:43.148163 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3807/5041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:42 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1295 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:43.172283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:43.184833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:43.221961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:43.225620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:43.226130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:43.228528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:43.229013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:43.229505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:43.519549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:43.529492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:43.530933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:43.532122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d120db86-a5b3-4347-8e6e-7ab65f4d1829 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.379511 Oct 04 11:24:43.546598 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3808/5042] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:43 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:43.567462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:43.571634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:43.589022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:43.589521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:43.589913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:43.590618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:43.591074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:43.591497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:43.596230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:43.751949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:43.768652 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b54f151a-4f67-4a9a-84f6-fac1702c0a8d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1282 microversion: 2.1 time: 0.220757 Oct 04 11:24:43.769469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3809/5043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:43 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:43.914882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:43.915536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:43.924552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:43.930668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:43.930668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:43.931280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:43.932724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:43.933422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:44.117957 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:24:44.118731 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:24:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:24:44.388629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:44.418919 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3846568c-43f9-41db-9401-f5ff76ce2744 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1314 microversion: 2.1 time: 0.507743 Oct 04 11:24:44.426300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3810/5044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:43 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:44.438725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:44.445309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:44.457815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:44.470732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:44.472909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:44.473850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:44.474347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:44.474796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:44.848947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:44.875208 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80fb0fbe-bb11-41a4-b0b9-068098fe9fa5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.433718 Oct 04 11:24:44.882402 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3811/5045] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:44 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:44.920303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:44.920984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:44.972754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:44.979669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:44.981714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:44.984115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:44.986455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:44.987174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:45.172165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:45.187544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:45.193412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:45.196913 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cac0ce6d-2f34-4c31-b0fd-c9dfcacba62d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.309664 Oct 04 11:24:45.197720 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3812/5046] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:44 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:45.210666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:45.213338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:45.226063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:45.226557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:45.226988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:45.233716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:45.234348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:45.234638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:45.647029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:45.660943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a870eda4-4b5e-4012-96b0-05e5b741c4c7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.459968 Oct 04 11:24:45.661877 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3813/5047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:45 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:45.667620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:45.670994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:45.785058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:45.785693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:45.792731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:45.794062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:45.798748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:45.815507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:46.090002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:46.101484 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c2bfdec-5f13-4ddf-899e-c1214f3ceacb tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1314 microversion: 2.1 time: 0.436471 Oct 04 11:24:46.115389 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3814/5048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:45 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:46.127216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2c9b911b-a3f6-47e4-9e55-cab09d9addda req-a4fa8f74-e977-47ee-be9b-9fb757010892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78641eab-c3a1-458e-805a-5d437c19aa85", "name": "network-vif-plugged", "status": "completed", "tag": "f156c303-6d35-429a-9199-d399c4e4abcc"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:46.146520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c9b911b-a3f6-47e4-9e55-cab09d9addda req-a4fa8f74-e977-47ee-be9b-9fb757010892 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:46.147217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c9b911b-a3f6-47e4-9e55-cab09d9addda req-a4fa8f74-e977-47ee-be9b-9fb757010892 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:46.150349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c9b911b-a3f6-47e4-9e55-cab09d9addda req-a4fa8f74-e977-47ee-be9b-9fb757010892 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:46.165011 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2c9b911b-a3f6-47e4-9e55-cab09d9addda req-a4fa8f74-e977-47ee-be9b-9fb757010892 service nova] Creating event network-vif-plugged:f156c303-6d35-429a-9199-d399c4e4abcc for instance 78641eab-c3a1-458e-805a-5d437c19aa85 on n-h1-791135-8 Oct 04 11:24:46.173549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2c9b911b-a3f6-47e4-9e55-cab09d9addda req-a4fa8f74-e977-47ee-be9b-9fb757010892 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050781 Oct 04 11:24:46.174954 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3815/5049] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:46.196786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:46.199877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:46.208019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:46.208871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:46.209472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:46.210379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:46.212426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:46.213320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:46.445041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:46.454924 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00a311d5-acda-44fd-94f1-57a6890e65c6 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.277013 Oct 04 11:24:46.469951 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3816/5050] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:46 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:46.475671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:46.476490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:46.493583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:46.494340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:46.495203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:46.496233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:46.496882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:46.497521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:46.622962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:46.638978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:46.645845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:46.647112 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0dd9fe2a-c19b-4805-9f60-5005ece6901b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.175871 Oct 04 11:24:46.647689 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3817/5051] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:46 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:46.690225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:46.691483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:46.699687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:46.700055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:46.700568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:46.701825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:46.702323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:46.703008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:46.962969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:46.974570 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49f85a21-d299-4216-ab43-1130b3ae86f3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.292826 Oct 04 11:24:46.975718 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3818/5052] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:46 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:47.008730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3239a298-f0be-4247-8ab2-b69ba71e30ed req-2998b8aa-c610-4303-8437-cac88ceb19ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b34ef62-b652-4a7c-8b0b-4b97565fd964", "tag": "2abbbaa4-7541-4912-85b3-79f2689d7b41"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:47.035857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3239a298-f0be-4247-8ab2-b69ba71e30ed req-2998b8aa-c610-4303-8437-cac88ceb19ac service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:47.036483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3239a298-f0be-4247-8ab2-b69ba71e30ed req-2998b8aa-c610-4303-8437-cac88ceb19ac service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:47.037183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3239a298-f0be-4247-8ab2-b69ba71e30ed req-2998b8aa-c610-4303-8437-cac88ceb19ac service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:47.057013 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3239a298-f0be-4247-8ab2-b69ba71e30ed req-2998b8aa-c610-4303-8437-cac88ceb19ac service nova] Creating event network-changed:2abbbaa4-7541-4912-85b3-79f2689d7b41 for instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 on n-h2-791135-8 Oct 04 11:24:47.086814 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3239a298-f0be-4247-8ab2-b69ba71e30ed req-2998b8aa-c610-4303-8437-cac88ceb19ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100404 Oct 04 11:24:47.088670 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3819/5053] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:47.126895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:47.128415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:47.139457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:47.140146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:47.140814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:47.141747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:47.142374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:47.142964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:47.455422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:47.484851 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e768088-b426-439f-8c22-7acb236348b1 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1314 microversion: 2.1 time: 0.365040 Oct 04 11:24:47.486504 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3820/5054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:47 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:47.493101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:47.494138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:47.501745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:47.502945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:47.503646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:47.504948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:47.505454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:47.505890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:47.856541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:47.868482 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-629c08a2-0a5d-4953-b9de-d5583f751718 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.380071 Oct 04 11:24:47.869079 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3821/5055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:47 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:47.877012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:47.878725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:47.888729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:47.889786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:47.890658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:47.892052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:47.892941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:47.895017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:47.980474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:47.990003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:47.991461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:47.992822 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-deda689e-d9e6-47f1-bd41-a9ce9479089a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.122575 Oct 04 11:24:47.993417 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3822/5056] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:47 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:48.012280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-303d86de-4cca-4339-b3d2-51e6684aabab req-6e851908-f4bb-40be-a83d-b9f2e28543cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e91bd8b-19e4-4456-8084-50307aaeb6c1", "tag": "583c2445-bb51-4d85-b471-40271b81635a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:48.024013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-303d86de-4cca-4339-b3d2-51e6684aabab req-6e851908-f4bb-40be-a83d-b9f2e28543cd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:48.024591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-303d86de-4cca-4339-b3d2-51e6684aabab req-6e851908-f4bb-40be-a83d-b9f2e28543cd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:48.025288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-303d86de-4cca-4339-b3d2-51e6684aabab req-6e851908-f4bb-40be-a83d-b9f2e28543cd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:48.046118 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-303d86de-4cca-4339-b3d2-51e6684aabab req-6e851908-f4bb-40be-a83d-b9f2e28543cd service nova] Creating event network-changed:583c2445-bb51-4d85-b471-40271b81635a for instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 on n-h2-791135-8 Oct 04 11:24:48.081601 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-303d86de-4cca-4339-b3d2-51e6684aabab req-6e851908-f4bb-40be-a83d-b9f2e28543cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083952 Oct 04 11:24:48.083786 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3823/5057] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:48.094983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:48.098126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:48.114328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:48.115112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:48.115550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:48.116916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:48.117580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:48.118184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:48.447448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:48.468007 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbbdf74b-17de-4f68-8f5a-de4f1e791802 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.382698 Oct 04 11:24:48.482753 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3824/5058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:48 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:48.515509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:48.516349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:48.523248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:48.524033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:48.524659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:48.525607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:48.526265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:48.526869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.020986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:49.031257 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bdc81002-7477-49a6-a1b2-9013d6328af8 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1500 microversion: 2.1 time: 0.526302 Oct 04 11:24:49.032863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3825/5059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:48 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1500 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:49.055008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:49.055638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:49.062864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:49.063688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:49.064141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.065015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:49.065556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:49.066117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.326243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:49.339303 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3a62190-7d84-4a5a-a3cf-d4b60b87146d tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.304042 Oct 04 11:24:49.339919 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3826/5060] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:49 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:49.366169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:49.366790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:49.398489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:49.398489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:49.398489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.398489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:49.398489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:49.398489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.508382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:49.515410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:49.521340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:49.522866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:49.524087 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b08d26d-6a4c-4b40-ba75-5c150d022135 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.165062 Oct 04 11:24:49.541387 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3827/5061] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:49 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:49.541387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:49.541387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:49.574288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:49.574796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:49.581065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.581963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:49.582449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:49.582900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.653601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lazy-loading 'flavor' on Instance uuid 78641eab-c3a1-458e-805a-5d437c19aa85 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:24:49.743513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:49.778405 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d9665b9-c534-45bb-b7fe-9827c16813ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "POST /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85/action" status: 200 len: 32 microversion: 2.1 time: 0.243109 Oct 04 11:24:49.785805 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3828/5062] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:24:49 2022] POST /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:24:49.792484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:49.794745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:49.799333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=38 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:49.810587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:49.811880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:49.812330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.813094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:49.813864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:49.814598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:49.996740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:50.023840 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92d383bc-61b7-4d58-9f9d-93675c1694f1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.236186 Oct 04 11:24:50.025925 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3829/5063] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:49 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:50.052424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:50.054414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:50.061874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:50.062371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:50.062813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:50.063830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:50.064225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:50.064648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:50.269308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:50.280296 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e6ae07b-9f2e-431d-aa6c-87f964c3e7a2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.235096 Oct 04 11:24:50.281344 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3830/5064] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:50 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:50.367388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:50.368060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:50.387546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:50.388044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:50.388483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:50.389191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:50.389685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:50.390110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:50.658635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:50.673475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1ce7c0a-fd20-4c42-825c-1393874b36a1 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.315054 Oct 04 11:24:50.691586 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3831/5065] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:50 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:50.701160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:50.704452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:50.721485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:50.722000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:50.722437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:50.723147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:50.723603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:50.724028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:50.915218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:50.933784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:50.935893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:50.938445 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f46afd92-5b6d-417a-ab29-209370a8f15a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.245565 Oct 04 11:24:50.942073 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3832/5066] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:50 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:51.056448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:51.057073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:51.067259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:51.067757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:51.068196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:51.068912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:51.074833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:51.075412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:51.498889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:51.515905 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51323760-d0b7-4700-95de-4ee0bc92b3c3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.464431 Oct 04 11:24:51.516498 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3833/5067] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:51 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:51.521223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:51.521862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:51.533177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:51.537696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:51.538160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:51.538883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:51.539492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:51.539769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:51.870907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:51.884482 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b37faa63-1050-47b8-94a7-1f1ce39fe10c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.366930 Oct 04 11:24:51.885382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3834/5068] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:51 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:51.905685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:51.906488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:51.913386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:51.914292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:51.914907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:51.915792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:51.916407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:51.916993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:52.161018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:52.169848 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5d398a3-0e87-4744-86ba-07e0c415a5d7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.271024 Oct 04 11:24:52.170519 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3835/5069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:51 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:52.183746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:52.184693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:52.192188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:52.192923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:52.196623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:52.197438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:52.197927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:52.198371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:52.298563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:52.312105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:52.315732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:52.317663 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-347b8291-a151-436d-82a2-125818fc12b2 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.144884 Oct 04 11:24:52.319474 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3836/5070] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:52 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:52.550986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:52.551621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:52.576816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:52.577321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:52.577794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:52.578510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:52.578975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:52.579407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:52.800518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:52.808921 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cf18dfc-b33e-4b42-9b05-49c743382fe8 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.270342 Oct 04 11:24:52.810446 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3837/5071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:52 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:52.915295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:52.916139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:52.930629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:52.931436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:52.932270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:52.935514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:52.936407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:52.937083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:52.962643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG neutronclient.v2_0.client [None req-64dc1213-a6fd-4ae7-8c90-84ac4e43b63d tempest-TenantUsagesTestJSON-534289306 tempest-TenantUsagesTestJSON-534289306-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=122408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 11:24:52.963658 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-64dc1213-a6fd-4ae7-8c90-84ac4e43b63d tempest-TenantUsagesTestJSON-534289306 tempest-TenantUsagesTestJSON-534289306-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 901.780225 Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack [None req-64dc1213-a6fd-4ae7-8c90-84ac4e43b63d tempest-TenantUsagesTestJSON-534289306 tempest-TenantUsagesTestJSON-534289306-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack Traceback (most recent call last): Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack raise client_exc(message=error_message, Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-f18c8448-2df1-499d-9078-9e136ef5f368'] Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack Traceback (most recent call last): Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return req.get_response(self.application) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack self._log_req(req, res, start) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack self.force_reraise() Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack raise self.value Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack res = req.get_response(self.application) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return request.get_response(self.application) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack response = req.get_response(self._app) Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 11:24:53.014924 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack response = self.app(environ, start_response) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return method(req=request, **action_args) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return f(*args, **kwargs) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack [Previous line repeated 10 more times] Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self._create_instance( Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2626, in validate_networks Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack ports_needed_per_instance = self._ports_needed_per_instance( Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2469, in _ports_needed_per_instance Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack nets = self._get_available_networks(context, context.project_id, Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 469, in _get_available_networks Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack nets += neutron.list_networks(**search_opts).get('networks', []) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 860, in list_networks Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self.list('networks', self.networks_path, retrieve_all, Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack res = self.get(path, params=params) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:24:53.019767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack raise exception.Unauthorized() Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack [None req-64dc1213-a6fd-4ae7-8c90-84ac4e43b63d tempest-TenantUsagesTestJSON-534289306 tempest-TenantUsagesTestJSON-534289306-project] http://10.222.0.23/compute/v2.1/servers returned with HTTP 401 Oct 04 11:24:53.024775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-64dc1213-a6fd-4ae7-8c90-84ac4e43b63d tempest-TenantUsagesTestJSON-534289306 tempest-TenantUsagesTestJSON-534289306-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:53.025818 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:24:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:24:53.025818 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:24:53 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.23) Oct 04 11:24:53.029394 n-d-791135-8 devstack@n-api.service[122408]: CRITICAL nova [None req-64dc1213-a6fd-4ae7-8c90-84ac4e43b63d tempest-TenantUsagesTestJSON-534289306 tempest-TenantUsagesTestJSON-534289306-project] Unhandled error: OSError: write error Oct 04 11:24:53.029394 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova OSError: write error Oct 04 11:24:53.029394 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova Oct 04 11:24:53.029394 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1235/5072] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:09:51 2022] POST /compute/v2.1/servers => generated 0 bytes in 901844 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Oct 04 11:24:53.195056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:53.195566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:53.195755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:53.211031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a63109e3-96e4-44f4-b36f-32e0c328f21d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.302837 Oct 04 11:24:53.240403 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3838/5073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:52 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:53.253010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:53.254403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:53.255367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:53.256685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:53.257634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:53.258733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:53.344943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:53.346054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:53.358118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:53.360141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:53.362320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:53.363158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:53.363739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:53.365129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:53.488913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:53.501233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:53.504245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:53.519535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29b69d5e-1a73-4b03-9357-a36eec908c5a tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.179120 Oct 04 11:24:53.530911 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3839/5074] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:53 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:53.571392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:53.582002 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a935e485-1237-400c-88de-23f22a500086 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.390457 Oct 04 11:24:53.582807 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1236/5075] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:53 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:53.837648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:53.838863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:53.849252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:53.850223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:53.850876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:53.852228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:53.852935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:53.853636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:54.129196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:54.152140 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92d2231b-8788-4337-8fbd-0563ed19f30a tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.308648 Oct 04 11:24:54.154102 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3840/5076] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:53 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:54.240876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:54.241521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:54.255464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:54.255639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:54.256078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:54.257190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:54.257830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:54.258433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:54.570262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:54.571227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:54.583393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:54.585921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:54.586893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:54.587889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:54.588515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:54.589107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:54.675563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:54.687030 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9df8964-38cc-4a59-a154-751ce286acec tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.450031 Oct 04 11:24:54.701504 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1237/5077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:54 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:54.701504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:54.701504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:54.717294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:54.717901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:54.718968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:54.720956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:54.731313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:54.731894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:54.791320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:54.804249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:54.807114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:54.808337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0ed4938b-8285-46bb-b30c-489984f5919d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.264311 Oct 04 11:24:54.813036 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3841/5078] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:54 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:24:55.194884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:55.197713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:55.253026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:55.258184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:55.262772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:55.265190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:55.265985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:55.266680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:55.277140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:55.291657 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66f833dc-78e6-4db4-867a-dbec058e83b9 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.601130 Oct 04 11:24:55.297483 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1238/5079] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:54 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:55.310168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:55.520774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:55.537096 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b2d7e7d9-a188-469b-ac13-2e548747da7b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.358299 Oct 04 11:24:55.550576 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3842/5080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:55 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:55.716199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:55.717094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:55.728694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:55.730878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:55.732600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:55.734255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:55.736039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:55.738114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:55.819070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-85a01b0f-4418-4e54-ba16-ac1b113745df req-cd160197-28ef-4f46-afe5-9d0d7ca2fa31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b34ef62-b652-4a7c-8b0b-4b97565fd964", "name": "network-vif-plugged", "status": "completed", "tag": "2abbbaa4-7541-4912-85b3-79f2689d7b41"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:55.840590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-85a01b0f-4418-4e54-ba16-ac1b113745df req-cd160197-28ef-4f46-afe5-9d0d7ca2fa31 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:55.841450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-85a01b0f-4418-4e54-ba16-ac1b113745df req-cd160197-28ef-4f46-afe5-9d0d7ca2fa31 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:55.842467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-85a01b0f-4418-4e54-ba16-ac1b113745df req-cd160197-28ef-4f46-afe5-9d0d7ca2fa31 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:55.856449 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-85a01b0f-4418-4e54-ba16-ac1b113745df req-cd160197-28ef-4f46-afe5-9d0d7ca2fa31 service nova] Creating event network-vif-plugged:2abbbaa4-7541-4912-85b3-79f2689d7b41 for instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 on n-h2-791135-8 Oct 04 11:24:55.891097 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-85a01b0f-4418-4e54-ba16-ac1b113745df req-cd160197-28ef-4f46-afe5-9d0d7ca2fa31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337182 Oct 04 11:24:55.899229 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1239/5081] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:24:55.906528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:55.907236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:55.935447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:55.936538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:55.938418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:55.940603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:55.944141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:55.944810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:56.055346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:56.066169 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c6dbaea1-b5b1-4c95-819d-1ba2f717296b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.353884 Oct 04 11:24:56.084677 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3843/5082] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:55 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:56.175596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:56.188109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:56.192682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:56.198047 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f8c58bb6-dd8e-47c7-9230-0a8b6a5e4131 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.296360 Oct 04 11:24:56.208821 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1240/5083] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:55 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:56.324326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:56.324979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:56.332325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:56.332820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:56.333781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:56.334501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:56.334963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:56.335559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:56.508332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:56.519948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b444997-f4c1-4c2b-98ec-c5ad3667bd18 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.199874 Oct 04 11:24:56.529750 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3844/5084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:56 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:56.561959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:56.562567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:56.571914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:56.572677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:56.573178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:56.573973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:56.574473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:56.575151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:56.743580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:56.755960 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-27223601-a217-4a1f-986b-eee605f659be tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1324 microversion: 2.1 time: 0.197614 Oct 04 11:24:56.771941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1241/5085] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:56 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:57.094638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:57.095566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:57.110248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:57.111036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:57.112961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:57.117298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:57.118032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:57.118694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:57.227956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:57.228580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:57.236722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:57.237255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:57.241128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:57.241990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:57.242483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:57.242924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:57.376132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:57.387089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:57.387313 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3a3b615-ad31-481d-9ea0-bae7218fe288 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.298786 Oct 04 11:24:57.388278 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3845/5086] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:57 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:57.419417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:57.422313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:57.426929 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68f75c08-59a2-4227-8268-2bbf1f86561f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.201524 Oct 04 11:24:57.427835 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1242/5087] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:57 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:24:57.542993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:57.543996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:57.552610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:57.554482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:57.557223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:57.558526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:57.559886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:57.560542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:57.781329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:57.784360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:57.794958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:57.796320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:57.796975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:57.798108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:57.798771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:57.799977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:58.013825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:58.025978 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b92245f-1122-408d-ac13-cfe47e776f77 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.486865 Oct 04 11:24:58.026665 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3846/5088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:57 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:58.107474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:58.116200 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5449e32-6b5e-4c51-be8e-bc81beab4935 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1520 microversion: 2.1 time: 0.341043 Oct 04 11:24:58.122083 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1243/5089] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:57 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:58.350817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3edf948-17c4-4f53-a577-2ca61bbcdbd1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1172948887", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3edf948-17c4-4f53-a577-2ca61bbcdbd1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Request method failure captured: Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 243 Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBf1F226kKyH-tGfhuKXIZxQ0ddbeHknTovhanpptn_OZVbGwPtM5jpDLzTYWvj3wDEyNYA7lfYxSVK3iMMwIbndFtbQmKKGFgki56MW2d5r-Db78em1AUPD_DqvzbzDI7Kpglz_qP7N9tV9O9ZwtwneHnFe_dkCXDkFDFSggwhuW6Q Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_591474389cc748708f8d1f16a6f665af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/591474389cc748708f8d1f16a6f665af"}]}] Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3e89c8e904134a6ab0eb5a619780deb0 Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1172948887", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1172948887', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '17e2b8b8-2f44-4f26-8d3b-a70e0969ad66'}]}}} Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:58.357620 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.365423 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.369792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3edf948-17c4-4f53-a577-2ca61bbcdbd1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:58.371306 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3edf948-17c4-4f53-a577-2ca61bbcdbd1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.025928 Oct 04 11:24:58.372876 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3847/5090] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:58 2022] POST /compute/v2.1/servers => generated 175 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:58.383249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f45fd5ac-0fab-466e-9193-ff2af4bda2e5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:58.383755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f45fd5ac-0fab-466e-9193-ff2af4bda2e5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 61468956-901e-4712-8b7d-145d4ec319c7] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:58.392374 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f45fd5ac-0fab-466e-9193-ff2af4bda2e5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] HTTP exception thrown: Instance 61468956-901e-4712-8b7d-145d4ec319c7 could not be found. Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f45fd5ac-0fab-466e-9193-ff2af4bda2e5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Request method failure captured: Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/61468956-901e-4712-8b7d-145d4ec319c7/metadata HTTP/1.1 Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBf1F226kKyH-tGfhuKXIZxQ0ddbeHknTovhanpptn_OZVbGwPtM5jpDLzTYWvj3wDEyNYA7lfYxSVK3iMMwIbndFtbQmKKGFgki56MW2d5r-Db78em1AUPD_DqvzbzDI7Kpglz_qP7N9tV9O9ZwtwneHnFe_dkCXDkFDFSggwhuW6Q Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_591474389cc748708f8d1f16a6f665af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/591474389cc748708f8d1f16a6f665af"}]}] Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 3e89c8e904134a6ab0eb5a619780deb0 Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 61468956-901e-4712-8b7d-145d4ec319c7 could not be found. Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'server_id': '61468956-901e-4712-8b7d-145d4ec319c7'} Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61468956-901e-4712-8b7d-145d4ec319c7 could not be found. Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61468956-901e-4712-8b7d-145d4ec319c7 could not be found. Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.406133 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.411904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:58.411904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:58.411904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61468956-901e-4712-8b7d-145d4ec319c7 could not be found. Oct 04 11:24:58.411904 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.411904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f45fd5ac-0fab-466e-9193-ff2af4bda2e5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Returning 404 to user: Instance 61468956-901e-4712-8b7d-145d4ec319c7 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:58.411904 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f45fd5ac-0fab-466e-9193-ff2af4bda2e5 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/61468956-901e-4712-8b7d-145d4ec319c7/metadata" status: 404 len: 111 microversion: 2.1 time: 0.028831 Oct 04 11:24:58.411904 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1244/5091] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 4 11:24:58 2022] GET /compute/v2.1/servers/61468956-901e-4712-8b7d-145d4ec319c7/metadata => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:24:58.421757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:58.422906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:58.441272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:24:58.442850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:58.443347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:58.443786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:58.444516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:58.444975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:58.445432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:58.459050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:58.462316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:58.474819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:58.475639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:58.476331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:58.477988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:58.478975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:58.480013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:58.583444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:58.592601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:58.594545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:58.595816 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a5a7483-82ed-4a0d-aaea-418cc9f2487c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.142745 Oct 04 11:24:58.596830 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1245/5092] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:58 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:24:58.620869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0acfd3e9-68c4-42f3-8317-a834f3a1a5d3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1501785317", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0acfd3e9-68c4-42f3-8317-a834f3a1a5d3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Request method failure captured: Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 499 Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBf1F226kKyH-tGfhuKXIZxQ0ddbeHknTovhanpptn_OZVbGwPtM5jpDLzTYWvj3wDEyNYA7lfYxSVK3iMMwIbndFtbQmKKGFgki56MW2d5r-Db78em1AUPD_DqvzbzDI7Kpglz_qP7N9tV9O9ZwtwneHnFe_dkCXDkFDFSggwhuW6Q Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_591474389cc748708f8d1f16a6f665af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/591474389cc748708f8d1f16a6f665af"}]}] Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 3e89c8e904134a6ab0eb5a619780deb0 Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1501785317", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1501785317', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '17e2b8b8-2f44-4f26-8d3b-a70e0969ad66'}]}}} Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 11:24:58.632305 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.636287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.644459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0acfd3e9-68c4-42f3-8317-a834f3a1a5d3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:58.651443 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0acfd3e9-68c4-42f3-8317-a834f3a1a5d3 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.052840 Oct 04 11:24:58.652926 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1246/5093] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:58 2022] POST /compute/v2.1/servers => generated 687 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:58.709398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:58.719104 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-edfa2555-2cf2-492c-821c-46d8ea99ae32 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.311699 Oct 04 11:24:58.720343 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3848/5094] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:58 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:24:58.721387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4522ba29-6410-4b75-aaa8-1fbc7af07091 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1204709500", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4522ba29-6410-4b75-aaa8-1fbc7af07091 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Request method failure captured: Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 500 Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBf1F226kKyH-tGfhuKXIZxQ0ddbeHknTovhanpptn_OZVbGwPtM5jpDLzTYWvj3wDEyNYA7lfYxSVK3iMMwIbndFtbQmKKGFgki56MW2d5r-Db78em1AUPD_DqvzbzDI7Kpglz_qP7N9tV9O9ZwtwneHnFe_dkCXDkFDFSggwhuW6Q Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_591474389cc748708f8d1f16a6f665af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/591474389cc748708f8d1f16a6f665af"}]}] Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 3e89c8e904134a6ab0eb5a619780deb0 Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1204709500", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1204709500', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '17e2b8b8-2f44-4f26-8d3b-a70e0969ad66'}]}}} Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 11:24:58.725950 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.729325 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.733877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4522ba29-6410-4b75-aaa8-1fbc7af07091 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:58.735488 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4522ba29-6410-4b75-aaa8-1fbc7af07091 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017409 Oct 04 11:24:58.736572 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1247/5095] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:24:58.791219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36d7805d-975e-4751-921a-d3e164fb44a1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2005739181", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36d7805d-975e-4751-921a-d3e164fb44a1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Request method failure captured: Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 754 Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBf1F226kKyH-tGfhuKXIZxQ0ddbeHknTovhanpptn_OZVbGwPtM5jpDLzTYWvj3wDEyNYA7lfYxSVK3iMMwIbndFtbQmKKGFgki56MW2d5r-Db78em1AUPD_DqvzbzDI7Kpglz_qP7N9tV9O9ZwtwneHnFe_dkCXDkFDFSggwhuW6Q Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_591474389cc748708f8d1f16a6f665af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/591474389cc748708f8d1f16a6f665af"}]}] Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3e89c8e904134a6ab0eb5a619780deb0 Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2005739181", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2005739181', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '17e2b8b8-2f44-4f26-8d3b-a70e0969ad66'}]}}} Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:58.795781 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:58.798731 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:58.802201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.802201 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.804291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36d7805d-975e-4751-921a-d3e164fb44a1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:58.805484 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36d7805d-975e-4751-921a-d3e164fb44a1 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.018295 Oct 04 11:24:58.806300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3849/5096] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:24:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 04 11:24:58.861779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbb68ddf-52ca-40f9-a8e5-67d99e53b290 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1263990890", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbb68ddf-52ca-40f9-a8e5-67d99e53b290 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Request method failure captured: Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 1266 Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBf1F226kKyH-tGfhuKXIZxQ0ddbeHknTovhanpptn_OZVbGwPtM5jpDLzTYWvj3wDEyNYA7lfYxSVK3iMMwIbndFtbQmKKGFgki56MW2d5r-Db78em1AUPD_DqvzbzDI7Kpglz_qP7N9tV9O9ZwtwneHnFe_dkCXDkFDFSggwhuW6Q Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_591474389cc748708f8d1f16a6f665af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/591474389cc748708f8d1f16a6f665af"}]}] Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 3e89c8e904134a6ab0eb5a619780deb0 Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1263990890", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "17e2b8b8-2f44-4f26-8d3b-a70e0969ad66"}]}} Oct 04 11:24:58.869488 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1263990890', 'imageRef': 'c5abc5b2-fab0-47a3-992d-153996b39244', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '17e2b8b8-2f44-4f26-8d3b-a70e0969ad66'}]}}} Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.871895 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 11:24:58.876565 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 11:24:58.881758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 11:24:58.881758 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.885185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbb68ddf-52ca-40f9-a8e5-67d99e53b290 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:58.885185 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cbb68ddf-52ca-40f9-a8e5-67d99e53b290 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.027816 Oct 04 11:24:58.885185 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1248/5097] 10.222.0.23 () {60 vars in 1148 bytes} [Tue Oct 4 11:24:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 11:24:58.895465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49404541-2839-4c50-a054-103d2eb5613b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:58.895976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49404541-2839-4c50-a054-103d2eb5613b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 694b03b4-cf01-420c-83fd-41c2d665163b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:58.903527 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-49404541-2839-4c50-a054-103d2eb5613b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] HTTP exception thrown: Instance 694b03b4-cf01-420c-83fd-41c2d665163b could not be found. Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49404541-2839-4c50-a054-103d2eb5613b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Request method failure captured: Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/694b03b4-cf01-420c-83fd-41c2d665163b/metadata/test2 HTTP/1.1 Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBf1F226kKyH-tGfhuKXIZxQ0ddbeHknTovhanpptn_OZVbGwPtM5jpDLzTYWvj3wDEyNYA7lfYxSVK3iMMwIbndFtbQmKKGFgki56MW2d5r-Db78em1AUPD_DqvzbzDI7Kpglz_qP7N9tV9O9ZwtwneHnFe_dkCXDkFDFSggwhuW6Q Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_591474389cc748708f8d1f16a6f665af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/591474389cc748708f8d1f16a6f665af"}]}] Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3e89c8e904134a6ab0eb5a619780deb0 Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 694b03b4-cf01-420c-83fd-41c2d665163b could not be found. Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '694b03b4-cf01-420c-83fd-41c2d665163b', 'id': 'test2'} Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694b03b4-cf01-420c-83fd-41c2d665163b could not be found. Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694b03b4-cf01-420c-83fd-41c2d665163b could not be found. Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:24:58.905280 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:24:58.920571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:24:58.920571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:24:58.920571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694b03b4-cf01-420c-83fd-41c2d665163b could not be found. Oct 04 11:24:58.920571 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:24:58.920571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49404541-2839-4c50-a054-103d2eb5613b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Returning 404 to user: Instance 694b03b4-cf01-420c-83fd-41c2d665163b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:24:58.920571 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49404541-2839-4c50-a054-103d2eb5613b tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/694b03b4-cf01-420c-83fd-41c2d665163b/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015280 Oct 04 11:24:58.928973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:58.929521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:58.932738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3850/5098] 10.222.0.23 () {58 vars in 1281 bytes} [Tue Oct 4 11:24:58 2022] GET /compute/v2.1/servers/694b03b4-cf01-420c-83fd-41c2d665163b/metadata/test2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:24:58.942493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:58.943007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:58.943482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:58.944154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:58.944616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:58.945035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:58.990495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:24:59.050742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:59.052041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:59.060035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.060879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.061956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:59.062982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.063653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.064343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:59.114109 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8805f93-75e0-440a-8d98-38aef13b812d tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 204 len: 0 microversion: 2.1 time: 0.194546 Oct 04 11:24:59.145150 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1249/5099] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:24:58 2022] DELETE /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:24:59.148750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:59.149508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:59.172994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.173794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.174331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:59.177486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.178008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.178442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:59.296506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:59.306930 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6180395e-ad1b-472d-b637-6afc1ab751af tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.260292 Oct 04 11:24:59.315054 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3851/5100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:59 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:24:59.544353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-715e3e78-2809-4885-b2e4-5c87b26610e9 req-a682ce90-2809-44cd-8f2e-bf610a97a3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e91bd8b-19e4-4456-8084-50307aaeb6c1", "name": "network-vif-plugged", "status": "completed", "tag": "583c2445-bb51-4d85-b471-40271b81635a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:24:59.598270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-715e3e78-2809-4885-b2e4-5c87b26610e9 req-a682ce90-2809-44cd-8f2e-bf610a97a3e6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.601935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-715e3e78-2809-4885-b2e4-5c87b26610e9 req-a682ce90-2809-44cd-8f2e-bf610a97a3e6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.603755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-715e3e78-2809-4885-b2e4-5c87b26610e9 req-a682ce90-2809-44cd-8f2e-bf610a97a3e6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:59.647153 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-715e3e78-2809-4885-b2e4-5c87b26610e9 req-a682ce90-2809-44cd-8f2e-bf610a97a3e6 service nova] Creating event network-vif-plugged:583c2445-bb51-4d85-b471-40271b81635a for instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 on n-h2-791135-8 Oct 04 11:24:59.662254 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-715e3e78-2809-4885-b2e4-5c87b26610e9 req-a682ce90-2809-44cd-8f2e-bf610a97a3e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124056 Oct 04 11:24:59.666467 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3852/5101] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:24:59.674693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:59.676194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:59.685458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.686983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.686983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:59.688386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.690394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.691134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:59.776123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:59.786819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:59.789196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:24:59.791270 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfc9bb51-be87-4820-896d-3e4056c1ed86 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.122698 Oct 04 11:24:59.793540 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3853/5102] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:24:59 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:24:59.799529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:24:59.801179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:24:59.808269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.809259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.809905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:24:59.812460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:24:59.813128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:24:59.813945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:00.000471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:00.010022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:00.016740 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e5942513-94b4-434c-a3cb-4f00feab1359 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1526 microversion: 2.1 time: 0.886374 Oct 04 11:25:00.029783 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1250/5103] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:59 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1526 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:00.042278 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b4a4df2-3147-4874-9b99-4824889bc668 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.247402 Oct 04 11:25:00.050512 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3854/5104] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:24:59 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:00.333319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:00.333993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:00.347040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:00.347929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:00.350025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:00.353764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:00.354473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:00.355722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:00.751472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:00.759154 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9abbcbcf-d45b-4b8b-813c-aee027c00af3 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.430592 Oct 04 11:25:00.769979 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1251/5105] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:00 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:00.834169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:00.834835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:00.843527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:00.843527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:00.843863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:00.848139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:00.851341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:00.852577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:01.029598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:01.043764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:01.044944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:01.049032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:01.050811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:01.052502 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91410ba9-12b7-4ce4-89a0-9d3f0b0ec0a6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.230558 Oct 04 11:25:01.065801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:01.066559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:01.067166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:01.069298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:01.069779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:01.070205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:01.074587 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3855/5106] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:00 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:01.079788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:01.082619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:01.100757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:01.101380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:01.101909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:01.102908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:01.103462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:01.104788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:01.537980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:01.562986 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-461bde25-7bdc-45da-af28-54dca35891c2 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.485539 Oct 04 11:25:01.567396 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3856/5107] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:01 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:01.686737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-91fc2cf0-2ff4-4a2a-b80d-23c23775b325 req-614ab12b-31f3-4bde-8813-c67aeaed350d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b34ef62-b652-4a7c-8b0b-4b97565fd964", "name": "network-vif-deleted", "tag": "2abbbaa4-7541-4912-85b3-79f2689d7b41"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:25:01.717220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91fc2cf0-2ff4-4a2a-b80d-23c23775b325 req-614ab12b-31f3-4bde-8813-c67aeaed350d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:01.736389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91fc2cf0-2ff4-4a2a-b80d-23c23775b325 req-614ab12b-31f3-4bde-8813-c67aeaed350d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:01.742164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-91fc2cf0-2ff4-4a2a-b80d-23c23775b325 req-614ab12b-31f3-4bde-8813-c67aeaed350d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:01.777234 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-91fc2cf0-2ff4-4a2a-b80d-23c23775b325 req-614ab12b-31f3-4bde-8813-c67aeaed350d service nova] Creating event network-vif-deleted:2abbbaa4-7541-4912-85b3-79f2689d7b41 for instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 on n-h2-791135-8 Oct 04 11:25:01.782828 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-91fc2cf0-2ff4-4a2a-b80d-23c23775b325 req-614ab12b-31f3-4bde-8813-c67aeaed350d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100235 Oct 04 11:25:01.784448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3857/5108] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:25:01.796862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:01.801187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:01.818052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:01.820495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:01.827853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:01.831260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:01.833493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:01.833944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:01.843555 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3c0ed34-d2b3-4dd9-b40e-b0798b36c7d7 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1526 microversion: 2.1 time: 0.804414 Oct 04 11:25:01.845144 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1252/5109] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:01 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1526 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:25:01.845765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:02.070947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:02.081677 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e9f2d90-967e-455d-90d4-e7095402fa49 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1363 microversion: 2.1 time: 0.291835 Oct 04 11:25:02.085411 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3858/5110] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:01 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:02.086385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:02.087444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:02.108412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:02.108906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:02.120960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:02.125443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:02.125710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:02.126147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:02.236494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:02.244804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:02.252726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:02.254409 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da3bd026-186f-489a-aafb-f8eada75a9f5 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.175991 Oct 04 11:25:02.258027 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1253/5111] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:02 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:02.593187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:02.594873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:02.603633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:02.604522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:02.605204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:02.606349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:02.607040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:02.607720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:02.859172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:02.871594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:02.871754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:02.872237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0073b627-be35-4b88-84cd-55f0a6fbf9e9 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.284944 Oct 04 11:25:02.874097 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3859/5112] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:02 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:02.878633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:02.879116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:02.879543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:02.880229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:02.880691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:02.881112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:02.947561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:02.948440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:02.949167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:02.949974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lazy-loading 'fault' on Instance uuid 8b34ef62-b652-4a7c-8b0b-4b97565fd964 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:25:03.040200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e89c8e904134a6ab0eb5a619780deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591474389cc748708f8d1f16a6f665af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:03.058871 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d2fec6e-4ec9-41d3-b16c-523b62eecb24 tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 200 len: 1314 microversion: 2.1 time: 0.188637 Oct 04 11:25:03.059888 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1254/5113] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:02 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:25:03.120106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:03.122362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:03.135314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:03.136178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:03.140877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:03.142813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:03.143680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:03.144342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:03.288304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:03.289664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:03.306890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:03.307464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:03.311256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:03.312072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:03.313272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:03.314038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:03.332326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:03.345668 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1be8ca7-9256-4635-ba80-3483a8e52617 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1550 microversion: 2.1 time: 0.235558 Oct 04 11:25:03.347609 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3860/5114] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:03 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1550 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:03.356872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:03.370650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:03.372367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:03.380489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:03.381187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:03.381928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:03.382921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:03.383639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:03.384331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:03.450101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:03.489289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:03.490853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:03.492165 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53f5aaed-33d7-47f0-ae3a-b36ce0430623 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.209755 Oct 04 11:25:03.505395 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1255/5115] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:03 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:25:03.525836 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32fd2309-6f19-40e6-adb2-f7b1b6c042a0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159374 Oct 04 11:25:03.527494 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3861/5116] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:25:03 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:25:03.896893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:03.897283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:03.916441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:03.916940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:03.917396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:03.921954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:03.922447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:03.922886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:04.085911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:04.086677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] [instance: 8b34ef62-b652-4a7c-8b0b-4b97565fd964] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:04.100863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:04.101472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:04.104616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:04.105430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:04.110243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:04.110805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:04.137724 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] HTTP exception thrown: Instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 could not be found. Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Request method failure captured: Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 HTTP/1.1 Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBf1F226kKyH-tGfhuKXIZxQ0ddbeHknTovhanpptn_OZVbGwPtM5jpDLzTYWvj3wDEyNYA7lfYxSVK3iMMwIbndFtbQmKKGFgki56MW2d5r-Db78em1AUPD_DqvzbzDI7Kpglz_qP7N9tV9O9ZwtwneHnFe_dkCXDkFDFSggwhuW6Q Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_591474389cc748708f8d1f16a6f665af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/591474389cc748708f8d1f16a6f665af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/591474389cc748708f8d1f16a6f665af"}]}] Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 591474389cc748708f8d1f16a6f665af Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-626674786 Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 3e89c8e904134a6ab0eb5a619780deb0 Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-626674786-project Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 could not be found. Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8b34ef62-b652-4a7c-8b0b-4b97565fd964'} Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 could not be found. Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 could not be found. Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:04.140229 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:04.148756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:04.148756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:04.148756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:04.148756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:04.148756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:25:04.148756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:25:04.148756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 could not be found. Oct 04 11:25:04.148756 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:04.151549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] Returning 404 to user: Instance 8b34ef62-b652-4a7c-8b0b-4b97565fd964 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:25:04.152727 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a65e80e-b0af-458e-b26b-88269c9c2ffc tempest-ServerMetadataNegativeTestJSON-626674786 tempest-ServerMetadataNegativeTestJSON-626674786-project] 10.222.0.23 "GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964" status: 404 len: 111 microversion: 2.1 time: 0.073134 Oct 04 11:25:04.153713 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3862/5117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:04 2022] GET /compute/v2.1/servers/8b34ef62-b652-4a7c-8b0b-4b97565fd964 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:25:04.525272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:04.526500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:04.543639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:04.545775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:04.547712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:04.552093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:04.552840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:04.555571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:04.729328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:04.743189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:04.745193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:04.750859 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76558df7-5301-42ae-b42c-ff7f1236ed4f tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.231648 Oct 04 11:25:04.753829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3863/5118] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:04 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:05.058606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:05.074757 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b18ad940-9638-4606-849b-1bdd198aa854 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 1.181864 Oct 04 11:25:05.081551 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1256/5119] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:03 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:05.782398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:05.783667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:05.795612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:05.796110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:05.798826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:05.799586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:05.800056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:05.810329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:05.874700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:06.108782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:06.110671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:06.135273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:06.136136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:06.136811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:06.137898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:06.139239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:06.139928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:06.395512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:06.409139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:06.410781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:06.415422 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6397602c-ddd2-42d3-992e-2f821d1a83d3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.635569 Oct 04 11:25:06.418875 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3864/5120] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:05 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:06.744955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:06.765816 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a8c7d3e-9313-491a-91da-1342a5c0435a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.661388 Oct 04 11:25:06.771598 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1257/5121] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:06 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:25:06.886530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6b8c29a4-57b4-45b5-b688-3be49592a451 req-bd363434-b311-4bf8-9ff2-a0103d84391f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e91bd8b-19e4-4456-8084-50307aaeb6c1", "tag": "583c2445-bb51-4d85-b471-40271b81635a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:25:06.929435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6b8c29a4-57b4-45b5-b688-3be49592a451 req-bd363434-b311-4bf8-9ff2-a0103d84391f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:06.930128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6b8c29a4-57b4-45b5-b688-3be49592a451 req-bd363434-b311-4bf8-9ff2-a0103d84391f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:06.936293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6b8c29a4-57b4-45b5-b688-3be49592a451 req-bd363434-b311-4bf8-9ff2-a0103d84391f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:07.008686 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6b8c29a4-57b4-45b5-b688-3be49592a451 req-bd363434-b311-4bf8-9ff2-a0103d84391f service nova] Creating event network-changed:583c2445-bb51-4d85-b471-40271b81635a for instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 on n-h2-791135-8 Oct 04 11:25:07.024140 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6b8c29a4-57b4-45b5-b688-3be49592a451 req-bd363434-b311-4bf8-9ff2-a0103d84391f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.603098 Oct 04 11:25:07.026370 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3865/5122] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:25:07.451974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:07.452585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:07.469788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:07.470280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:07.470716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:07.471999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:07.472454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:07.472884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:07.643768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:07.660641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:07.667017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:07.670530 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b42f3af0-a48c-4349-813d-78f0243dc530 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.221460 Oct 04 11:25:07.673009 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1258/5123] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:07 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:07.793444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:07.796039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:07.809570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:07.810061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:07.810497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:07.811206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:07.823722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:07.826889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:08.455573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:08.472627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e77b13f-2243-47c9-9d82-233796e4409b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.685426 Oct 04 11:25:08.474312 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3866/5124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:07 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:08.709285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:08.709925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:08.720078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:08.723205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:08.723708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:08.726381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:08.727071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:08.727768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:08.909991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:08.945969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:08.954102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:08.961050 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d02bedf4-2933-4050-b82f-3ec08e700156 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.254728 Oct 04 11:25:08.963826 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1259/5125] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:08 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:09.497970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:09.498864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:09.539693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:09.540354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:09.540821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:09.541617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:09.542088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:09.542526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:09.993779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:09.994673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:10.019794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:10.020972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:10.021673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:10.022923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:10.023638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:10.025449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:10.055166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:10.079089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db62e6f8-bef0-4a0c-8ecc-7bec8219f657 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.586173 Oct 04 11:25:10.101698 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3867/5126] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:09 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:10.153061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:10.184237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:10.185792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:10.194215 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f052e9a-a4f8-4394-8f39-01ca26d95002 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.203017 Oct 04 11:25:10.197513 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1260/5127] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:09 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:11.107556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:11.109019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:11.131552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:11.132157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:11.132903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:11.133725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:11.135476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:11.136918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:11.225499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:11.226231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:11.242466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:11.242983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:11.243484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:11.244274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:11.244793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:11.245331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:11.434136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:11.447892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:11.452657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:11.456107 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-01f86658-9a29-4b2d-94e8-edf5c5b6d4ef tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.235097 Oct 04 11:25:11.463637 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1261/5128] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:11 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:25:11.497729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:11.509389 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-197eb38f-90da-4454-b10f-7077a8e60d46 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.405834 Oct 04 11:25:11.510024 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3868/5129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:11 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:12.490543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:12.491145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:12.502452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:12.504310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:12.508058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:12.509197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:12.510817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:12.511608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:12.536854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:12.538688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:12.557375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:12.559018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:12.562174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:12.564043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:12.566741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:12.567133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:12.819801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:12.839496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:12.842814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:12.845362 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ea00ea2-f613-40c5-8edc-7bc97ecc5546 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.360193 Oct 04 11:25:12.860797 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1262/5130] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:12 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:12.873803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:12.916497 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31f7445c-75c8-4bc7-9d23-a62526a7502a tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.377614 Oct 04 11:25:12.918485 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3869/5131] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:12 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:13.882010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:13.882636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:13.893926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:13.894393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:13.894840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:13.895561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:13.899212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:13.899662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:13.944502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:13.945296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:13.958651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:13.959175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:13.959649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:13.960419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:13.960885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:13.961326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:14.063913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:14.092234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:14.096911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:14.099940 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79e7030f-007a-4751-bb2b-ab4e015c817c tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1365 microversion: 2.47 time: 0.221926 Oct 04 11:25:14.102323 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1263/5132] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:13 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:14.303679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:14.333640 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b96d90af-a430-4575-89f2-5e21d1e8bfc3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.392563 Oct 04 11:25:14.334841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3870/5133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:13 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:15.133587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:15.136039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:15.160102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:15.162391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:15.162906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:15.165053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:15.166801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:15.170347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:15.349654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:15.363182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:15.363799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:15.364114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:15.366584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:15.368499 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d14d267-2b2c-465f-a71a-919ba70e19e4 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1383 microversion: 2.47 time: 0.241169 Oct 04 11:25:15.369979 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1264/5134] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:15 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1383 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:15.374765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:15.375713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:15.377554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:15.378284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:15.378750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:15.379256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:15.687125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:15.699245 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f416ca5e-47da-4660-8e65-3e06c86193ba tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.340381 Oct 04 11:25:15.702627 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3871/5135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:15 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:16.411075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:16.412390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:16.437877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:16.438497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:16.438940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:16.439706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:16.440475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:16.446110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:16.616261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:16.630467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:16.631926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:16.633116 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65406fca-aa2b-43de-ab16-481fafbdad8d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1371 microversion: 2.47 time: 0.231876 Oct 04 11:25:16.637819 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1265/5136] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:16 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:16.725535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:16.726289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:16.738433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:16.740086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:16.740527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:16.742427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:16.744255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:16.744875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:17.139027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:17.151280 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11ea0741-adbe-4622-b45e-97a87d15d96b tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.426149 Oct 04 11:25:17.156575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3872/5137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:16 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:17.667835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:17.669271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:17.678169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:17.679180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:17.679883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:17.681084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:17.681817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:17.682458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:17.771756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:17.779981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:17.781668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:17.783735 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-17432574-c885-427f-a55e-c3cdc0f5c6b1 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1371 microversion: 2.47 time: 0.120439 Oct 04 11:25:17.800970 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1266/5138] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:17 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:18.185933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:18.186612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:18.202119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:18.205695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:18.205695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:18.207316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:18.208983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:18.209494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:18.698846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:18.719678 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-20ea310b-d4d3-46bb-893f-54ccd756058d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.533306 Oct 04 11:25:18.727741 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3873/5139] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:18 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:18.811312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:18.811923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:18.828653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:18.829155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:18.829594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:18.834447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:18.841711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:18.843331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:19.198440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:19.218841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:19.221623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:19.224299 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ca0d99e-8de7-4f02-b073-638b34a08290 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1356 microversion: 2.47 time: 0.416559 Oct 04 11:25:19.239084 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1267/5140] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:18 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1356 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:19.253224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:19.258674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:19.264089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Searching by: {'deleted': False, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 11:25:19.278050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:19.280703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:19.281415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:19.286447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:19.287157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:19.287985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:19.594205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 11:25:19.748369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:19.748985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:19.758923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:19.759427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:19.759868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:19.769859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:19.770432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:19.770873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:19.803849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:19.827292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:19.827697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:19.828138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:19.864481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:19.866351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:20.163606 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29f7f39b-4bf5-4f42-90eb-1abc94660622 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.914080 Oct 04 11:25:20.164779 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3874/5141] 10.222.0.23 () {60 vars in 1187 bytes} [Tue Oct 4 11:25:19 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:20.203291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:20.204177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:20.213389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:20.214237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:20.214900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:20.216060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:20.216729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:20.217384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:20.262869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:25:20.414688 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2ca5b52-4ff6-435d-bd1e-ba53007f355d tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 204 len: 0 microversion: 2.47 time: 0.221551 Oct 04 11:25:20.416640 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3875/5142] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:25:20 2022] DELETE /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 11:25:20.426572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:20.427539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:20.435700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:20.436811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:20.437676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:20.438695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:20.440090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:20.441610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:20.638920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:20.650098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:20.651880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:20.654729 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e8614bd-f9a3-4756-b502-ee9f83c78bd0 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1362 microversion: 2.47 time: 0.232445 Oct 04 11:25:20.655602 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3876/5143] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:20 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:25:20.996065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:21.011821 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e67da23-62f1-45ce-a62e-9e9e496abb40 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1486 microversion: 2.1 time: 1.266760 Oct 04 11:25:21.013168 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1268/5144] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:19 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1486 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:21.040209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:25:21.040754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:21.054566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:21.055062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:21.055686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:21.056409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:21.061902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:21.062734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:21.203106 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cfe8e7ed-fa89-445a-aa7f-74f4666a5c96 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "POST /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85/action" status: 202 len: 0 microversion: 2.1 time: 0.167318 Oct 04 11:25:21.203924 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3877/5145] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:25:21 2022] POST /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:25:21.213978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:21.214895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:21.233143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:21.236035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:21.236500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:21.237271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:21.239769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:21.240277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:21.684486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:21.685940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:21.711494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:21.712390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:21.713244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:21.714242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:21.715551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:21.716226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:21.744819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:21.780420 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c328fc1-a9e6-4461-978b-0c1cb8dc46ef tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1494 microversion: 2.1 time: 0.571198 Oct 04 11:25:21.787915 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1269/5146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:21 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1494 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:21.810029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:21.979769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:21.997931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:21.999683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:22.004089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe600a43-5ee4-40fd-a884-4e31aaba3997 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1362 microversion: 2.47 time: 0.321203 Oct 04 11:25:22.004721 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3878/5147] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:21 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:22.806648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:22.807264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:22.810312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:22.827619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:22.828120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:22.828554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:22.830023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:22.831625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:22.832070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:23.034512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:23.035128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:23.042527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:23.043021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:23.043459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:23.044169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:23.044623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:23.045050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:23.143209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:23.144091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:23.144900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:23.145597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lazy-loading 'fault' on Instance uuid f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:25:23.305678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:23.313643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:23.317926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:23.323807 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-591c9c4c-c290-4893-9b68-d0b714628b26 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 200 len: 1367 microversion: 2.47 time: 0.292651 Oct 04 11:25:23.336294 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3879/5148] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:23 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:25:23.731395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:23.742842 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f31c8960-1cf2-46c2-8198-964967971220 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1494 microversion: 2.1 time: 0.940073 Oct 04 11:25:23.751420 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1270/5149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:22 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1494 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:24.353964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:24.355396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:24.365294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:24.368573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:24.369276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:24.372005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:24.372691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:24.374126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:24.420529 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] HTTP exception thrown: Instance f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb could not be found. Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Request method failure captured: Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb HTTP/1.1 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBfvlIgG66zluRkl_IkqjputSGF8a0XBHj3RqsEiIjgCvs_jBQcWRJGKOm2w8rfzlRrtpiZsQzAYBqmZ0abkIWDBSdpcFp8Rhg5HxQrfLVWMRhePiUnb-_dI4v2dprORcMN9zyPpYyLyclb7tqnh8Ehg4wm8nMl2qSiHIsDAD4xP5oc Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a56ff553f9b8470180fe0b98892ce75d Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerShowV247Test-826951558 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a56ff553f9b8470180fe0b98892ce75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a56ff553f9b8470180fe0b98892ce75d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a56ff553f9b8470180fe0b98892ce75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a56ff553f9b8470180fe0b98892ce75d"}]}] Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerShowV247Test-826951558 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a56ff553f9b8470180fe0b98892ce75d Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerShowV247Test-826951558 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerShowV247Test-826951558-project Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 32f0fc8e8bde4c8e9ff5e2e1007f5ae5 Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerShowV247Test-826951558-project Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb could not be found. Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb'} Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb could not be found. Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb could not be found. Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:24.423286 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:24.430071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:24.430071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:24.430071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:24.430071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:25:24.430071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:25:24.430071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb could not be found. Oct 04 11:25:24.430071 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:24.434861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Returning 404 to user: Instance f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:25:24.453083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bacdfe70-84c8-4b3e-87f3-f24f990e7bd6 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb" status: 404 len: 111 microversion: 2.47 time: 0.085832 Oct 04 11:25:24.455102 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3880/5150] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:24 2022] GET /compute/v2.1/servers/f9f81dd9-9838-48d8-85ec-7e96f5fdc7cb => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:25:24.463389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:24.463964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:24.487220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:24.487646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:24.488086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:24.488831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:24.489283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:24.489747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:24.556556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:25:24.564761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:24.735774 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-991409a7-9b5a-454c-bf12-6ac787f8d118 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "DELETE /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131" status: 204 len: 0 microversion: 2.47 time: 0.276509 Oct 04 11:25:24.739238 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1271/5151] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Oct 4 11:25:24 2022] DELETE /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 11:25:24.746595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:24.747313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:24.758481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:24.759358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:24.760022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:24.770613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:24.774003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:24.775036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:24.784903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:24.787294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:24.825152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:24.830270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:24.831133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:24.832110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:24.832801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:24.833499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:25.235313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:25.250214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:25.253735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:25.255406 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b22a581b-22c9-46d8-ad1a-6af46b2f5648 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131" status: 200 len: 1363 microversion: 2.47 time: 0.514382 Oct 04 11:25:25.270770 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3881/5152] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:24 2022] GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131 => generated 1363 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:25.315747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:25.326493 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5262166-1e18-4e82-92f3-de307c033cb5 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1494 microversion: 2.1 time: 0.561155 Oct 04 11:25:25.329140 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1272/5153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:24 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1494 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:26.287623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:26.288317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:26.297553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:26.297553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:26.297850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:26.298619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:26.299150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:26.299654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:26.363022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:26.364654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:26.375619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:26.376600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:26.384480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:26.385400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:26.386113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:26.386620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:26.459598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:26.471277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:26.474002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:26.476210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8ca94a8-a3fc-475c-b678-2b03f5fb0c2b tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131" status: 200 len: 1363 microversion: 2.47 time: 0.193341 Oct 04 11:25:26.477266 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3882/5154] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:26 2022] GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:26.587412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:26.601389 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bfd0b6a8-0864-4d51-a43a-494d81f822cf tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1494 microversion: 2.1 time: 0.250057 Oct 04 11:25:26.602520 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1273/5155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:26 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1494 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:25:27.398821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:27.399381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:27.415607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:27.416396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:27.417100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:27.418018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:27.418705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:27.419351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:27.488559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0988fb95-d832-4532-b86e-e1c9de0266e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/ips" status: 200 len: 150 microversion: 2.1 time: 0.093339 Oct 04 11:25:27.489811 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3883/5156] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:25:27 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:25:27.505103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:27.505857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:27.525882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:27.526415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:27.526863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:27.527666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:27.528132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:27.528557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:27.629203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:27.630013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:27.642379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:27.647122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:27.647803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:27.649231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:27.649981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:27.651501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:27.666414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:27.684655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:27.688856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:27.698123 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5aa6198-c800-4d71-b0bd-bf721525b8f3 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131" status: 200 len: 1363 microversion: 2.47 time: 0.193235 Oct 04 11:25:27.700396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1274/5157] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:27 2022] GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:25:28.730839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:28.731559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:28.744586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:28.745089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:28.745734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:28.746247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:28.746697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:28.747120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:28.859624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:28.860119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:28.860553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:28.861604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lazy-loading 'fault' on Instance uuid 928cb58a-4137-44bc-9332-6bb7e9c0c131 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:25:28.969310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:28.981437 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98b83088-7065-47ae-beb6-74fb88366fb3 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1500 microversion: 2.1 time: 1.357228 Oct 04 11:25:28.982033 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3884/5158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:27 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1500 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:28.994380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:29.009757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:29.014746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:29.015471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:29.016875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32f0fc8e8bde4c8e9ff5e2e1007f5ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a56ff553f9b8470180fe0b98892ce75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:29.018524 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf9c391b-4823-49f4-8d76-bcabcf366878 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131" status: 200 len: 1368 microversion: 2.47 time: 0.291614 Oct 04 11:25:29.031808 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1275/5159] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:28 2022] GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:25:29.032061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:29.032061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:29.032061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:29.032061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:29.032061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:29.032061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:29.032061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:29.084478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:25:29.305125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dbe50185-d6cd-43fd-8691-c4eda1b5ccdd tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 204 len: 0 microversion: 2.1 time: 0.296243 Oct 04 11:25:29.310336 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3885/5160] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:25:29 2022] DELETE /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:25:29.315797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:29.316758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:29.325403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:29.326232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:29.328984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:29.332254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:29.335866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:29.340207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:29.805164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:29.818970 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83685531-8585-4b25-9772-0a985e418cd0 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.506883 Oct 04 11:25:29.821159 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1276/5161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:29 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:30.061317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:30.063859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] [instance: 928cb58a-4137-44bc-9332-6bb7e9c0c131] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:30.073415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:30.075971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:30.078892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:30.081026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:30.082893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:30.084106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:30.085491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:30.086257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:30.114004 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] HTTP exception thrown: Instance 928cb58a-4137-44bc-9332-6bb7e9c0c131 could not be found. Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Request method failure captured: Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131 HTTP/1.1 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBfvlIgG66zluRkl_IkqjputSGF8a0XBHj3RqsEiIjgCvs_jBQcWRJGKOm2w8rfzlRrtpiZsQzAYBqmZ0abkIWDBSdpcFp8Rhg5HxQrfLVWMRhePiUnb-_dI4v2dprORcMN9zyPpYyLyclb7tqnh8Ehg4wm8nMl2qSiHIsDAD4xP5oc Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: a56ff553f9b8470180fe0b98892ce75d Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerShowV247Test-826951558 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a56ff553f9b8470180fe0b98892ce75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a56ff553f9b8470180fe0b98892ce75d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a56ff553f9b8470180fe0b98892ce75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a56ff553f9b8470180fe0b98892ce75d"}]}] Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerShowV247Test-826951558 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: a56ff553f9b8470180fe0b98892ce75d Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerShowV247Test-826951558 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerShowV247Test-826951558-project Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 32f0fc8e8bde4c8e9ff5e2e1007f5ae5 Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerShowV247Test-826951558-project Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 928cb58a-4137-44bc-9332-6bb7e9c0c131 could not be found. Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '928cb58a-4137-44bc-9332-6bb7e9c0c131'} Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928cb58a-4137-44bc-9332-6bb7e9c0c131 could not be found. Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928cb58a-4137-44bc-9332-6bb7e9c0c131 could not be found. Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:30.116643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:30.122661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:30.122661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:30.122661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:30.122661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:25:30.122661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:25:30.122661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928cb58a-4137-44bc-9332-6bb7e9c0c131 could not be found. Oct 04 11:25:30.122661 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:30.125778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] Returning 404 to user: Instance 928cb58a-4137-44bc-9332-6bb7e9c0c131 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:25:30.139995 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25d4594e-6dfd-4e88-8b1a-fcf235d267b9 tempest-ServerShowV247Test-826951558 tempest-ServerShowV247Test-826951558-project] 10.222.0.23 "GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131" status: 404 len: 111 microversion: 2.47 time: 0.073179 Oct 04 11:25:30.146837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3886/5162] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Oct 4 11:25:30 2022] GET /compute/v2.1/servers/928cb58a-4137-44bc-9332-6bb7e9c0c131 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:25:30.517040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32b3a0f3-8df1-4061-b57a-2a6140cb5870"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:25:30.521064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:30.540448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:30.540943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:30.541398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:30.542121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:30.542575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:30.542997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:30.844193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:30.844889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:30.857237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:30.866993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:30.868063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:30.870515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:30.871077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:30.875091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:31.010264 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b43036c-c868-4b9c-b07d-d85d707d77fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496296 Oct 04 11:25:31.014692 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1277/5163] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:25:30 2022] POST /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:25:31.211074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:31.223448 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98e09f37-035f-44b1-b046-56059fc30f3d tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.383035 Oct 04 11:25:31.226125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3887/5164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:30 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:32.251007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:32.251909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:32.279678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:32.286478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:32.297573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:32.301761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:32.302963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:32.305230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:32.994051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:33.016412 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35613eaa-529e-49b6-87d1-88023dfcfa4c tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1506 microversion: 2.1 time: 0.766529 Oct 04 11:25:33.018226 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1278/5165] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:32 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:33.931649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4c8fe6ed-2c97-4171-9826-304598a32175 req-5d3229f6-d6df-4dde-a6b0-8bb22e078da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78641eab-c3a1-458e-805a-5d437c19aa85", "name": "network-vif-deleted", "tag": "f156c303-6d35-429a-9199-d399c4e4abcc"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:25:33.959885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4c8fe6ed-2c97-4171-9826-304598a32175 req-5d3229f6-d6df-4dde-a6b0-8bb22e078da7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:33.960383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4c8fe6ed-2c97-4171-9826-304598a32175 req-5d3229f6-d6df-4dde-a6b0-8bb22e078da7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:33.963610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4c8fe6ed-2c97-4171-9826-304598a32175 req-5d3229f6-d6df-4dde-a6b0-8bb22e078da7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:33.999305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4c8fe6ed-2c97-4171-9826-304598a32175 req-5d3229f6-d6df-4dde-a6b0-8bb22e078da7 service nova] Creating event network-vif-deleted:f156c303-6d35-429a-9199-d399c4e4abcc for instance 78641eab-c3a1-458e-805a-5d437c19aa85 on n-h1-791135-8 Oct 04 11:25:34.026765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4c8fe6ed-2c97-4171-9826-304598a32175 req-5d3229f6-d6df-4dde-a6b0-8bb22e078da7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.513110 Oct 04 11:25:34.029793 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3888/5166] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:25:34.043023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:34.043639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:34.054638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:34.061695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:34.062420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:34.063176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:34.063863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:34.064531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:34.182838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:34.182951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:34.183463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:34.183916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lazy-loading 'fault' on Instance uuid 78641eab-c3a1-458e-805a-5d437c19aa85 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:25:34.472125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:34.481508 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-054448c6-546b-4173-b898-2aa675536a64 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 200 len: 1304 microversion: 2.1 time: 0.443746 Oct 04 11:25:34.482294 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1279/5167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:34 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 1304 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:35.509133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:35.510039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 78641eab-c3a1-458e-805a-5d437c19aa85] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:35.548859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:35.562475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:35.562475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:35.562475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:35.562475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:35.562475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:35.608538 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] HTTP exception thrown: Instance 78641eab-c3a1-458e-805a-5d437c19aa85 could not be found. Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Request method failure captured: Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 HTTP/1.1 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBejJ1_NeJJNeBFXAWOzzDqnvU3RHKIcd2uYWv0r_qFUwSjl3GyqVsoWhFjp4csFiQZjlFJxsjwY6_9SRVLmoGpWRGosEmNIv70OE4RkrvE3z9zR0wBjs-hOzY145-iQ6uYQAbDjmw5VfxRlSneNlxMZv3hNp7tP_trhe5e9APDPcp4 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: f829c02cff75406896dbc4c16ad43a46 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerRescueTestJSON-153316569 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f829c02cff75406896dbc4c16ad43a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f829c02cff75406896dbc4c16ad43a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f829c02cff75406896dbc4c16ad43a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f829c02cff75406896dbc4c16ad43a46"}]}] Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerRescueTestJSON-153316569 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: f829c02cff75406896dbc4c16ad43a46 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerRescueTestJSON-153316569 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerRescueTestJSON-153316569-project Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: d9c82357fe154bec8bab1152fc57e0e9 Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerRescueTestJSON-153316569-project Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 78641eab-c3a1-458e-805a-5d437c19aa85 could not be found. Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '78641eab-c3a1-458e-805a-5d437c19aa85'} Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78641eab-c3a1-458e-805a-5d437c19aa85 could not be found. Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78641eab-c3a1-458e-805a-5d437c19aa85 could not be found. Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:35.618547 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78641eab-c3a1-458e-805a-5d437c19aa85 could not be found. Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Returning 404 to user: Instance 78641eab-c3a1-458e-805a-5d437c19aa85 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a6e54c53-7f0a-4e8a-a7b1-fc45b58f5630 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85" status: 404 len: 111 microversion: 2.1 time: 0.116145 Oct 04 11:25:35.628500 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3889/5168] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:35 2022] GET /compute/v2.1/servers/78641eab-c3a1-458e-805a-5d437c19aa85 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:25:35.632966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:35.633521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:35.656352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:35.656862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:35.657337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:35.658092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:35.663006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:35.665653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:35.721200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:25:35.963167 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1eec6be2-8985-408b-a4a4-dabd51ed7748 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 204 len: 0 microversion: 2.1 time: 0.336618 Oct 04 11:25:35.964290 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1280/5169] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:25:35 2022] DELETE /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:25:35.973311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:35.974291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:35.988841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:35.989344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:35.991098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:35.994057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:35.996788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:35.997474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:37.233704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:37.250069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e8e8de6-ebcb-422d-b3b1-a4c0f118a505 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1493 microversion: 2.1 time: 1.279645 Oct 04 11:25:37.262437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3890/5170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:35 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1493 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:38.276180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:38.277664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:38.297680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:38.302919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:38.307220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:38.308890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:38.310553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:38.316277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:38.839691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:38.852196 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc66adaa-2018-44cd-ae19-d8c4898dc078 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1493 microversion: 2.1 time: 0.581141 Oct 04 11:25:38.857824 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1281/5171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:38 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1493 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:39.878225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:39.879007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:39.896555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:39.901781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:39.902364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:39.907382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:39.909187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:39.909775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:40.597315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:40.615808 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-40fe8919-45db-473e-a3ad-199eeb8b96b6 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1451 microversion: 2.1 time: 0.741562 Oct 04 11:25:40.621667 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3891/5172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:39 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1451 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:25:40.874697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-7c850ec1-a239-4a34-acc3-dc3ecc413244 req-d31e989c-9adc-437c-956d-70844c226248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34", "name": "network-vif-deleted", "tag": "42eff900-fecb-4890-8d51-247c26bb30ef"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:25:40.894214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c850ec1-a239-4a34-acc3-dc3ecc413244 req-d31e989c-9adc-437c-956d-70844c226248 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:40.895075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c850ec1-a239-4a34-acc3-dc3ecc413244 req-d31e989c-9adc-437c-956d-70844c226248 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:40.895722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-7c850ec1-a239-4a34-acc3-dc3ecc413244 req-d31e989c-9adc-437c-956d-70844c226248 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:40.913032 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-7c850ec1-a239-4a34-acc3-dc3ecc413244 req-d31e989c-9adc-437c-956d-70844c226248 service nova] Creating event network-vif-deleted:42eff900-fecb-4890-8d51-247c26bb30ef for instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 on n-h2-791135-8 Oct 04 11:25:40.920196 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-7c850ec1-a239-4a34-acc3-dc3ecc413244 req-d31e989c-9adc-437c-956d-70844c226248 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054722 Oct 04 11:25:40.922330 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1282/5173] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:25:41.651187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:41.653406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:41.678462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:41.680434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:41.682682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:41.684392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:41.687271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:41.689485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:41.820387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:41.835143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:41.838749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:41.839892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lazy-loading 'fault' on Instance uuid 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:25:42.526450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c82357fe154bec8bab1152fc57e0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f829c02cff75406896dbc4c16ad43a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:42.537639 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d53f1239-4b05-461d-ab60-424f59efe360 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 200 len: 1304 microversion: 2.1 time: 0.890208 Oct 04 11:25:42.549410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3892/5174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:41 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 1304 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:43.566639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:43.568256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] [instance: 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:43.596199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:43.597037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:43.598512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:43.599418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:43.602269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:43.604084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:43.653138 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] HTTP exception thrown: Instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 could not be found. Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Request method failure captured: Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 HTTP/1.1 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBejJ1_NeJJNeBFXAWOzzDqnvU3RHKIcd2uYWv0r_qFUwSjl3GyqVsoWhFjp4csFiQZjlFJxsjwY6_9SRVLmoGpWRGosEmNIv70OE4RkrvE3z9zR0wBjs-hOzY145-iQ6uYQAbDjmw5VfxRlSneNlxMZv3hNp7tP_trhe5e9APDPcp4 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: f829c02cff75406896dbc4c16ad43a46 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerRescueTestJSON-153316569 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f829c02cff75406896dbc4c16ad43a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f829c02cff75406896dbc4c16ad43a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f829c02cff75406896dbc4c16ad43a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f829c02cff75406896dbc4c16ad43a46"}]}] Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerRescueTestJSON-153316569 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: f829c02cff75406896dbc4c16ad43a46 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerRescueTestJSON-153316569 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerRescueTestJSON-153316569-project Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: d9c82357fe154bec8bab1152fc57e0e9 Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerRescueTestJSON-153316569-project Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 could not be found. Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34'} Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 could not be found. Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 could not be found. Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:25:43.659696 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:25:43.664946 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:25:43.664946 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:25:43.664946 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:25:43.664946 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:25:43.664946 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:25:43.664946 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 could not be found. Oct 04 11:25:43.664946 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:25:43.668043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] Returning 404 to user: Instance 0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:25:43.668924 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99861075-51ff-4487-8dec-3c40a11bdc41 tempest-ServerRescueTestJSON-153316569 tempest-ServerRescueTestJSON-153316569-project] 10.222.0.23 "GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34" status: 404 len: 111 microversion: 2.1 time: 0.108395 Oct 04 11:25:43.673665 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1283/5175] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:43 2022] GET /compute/v2.1/servers/0e59a97f-5d3a-44e0-8d8a-6b2ea5358b34 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:25:50.909492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aaf7fc1e-9fb4-4503-b9cb-ab2b0fbf8909 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: .version_select at 0x7f71cefe9160>, body: {"keypair": {"name": "tempest-keypair-1539396948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtqH6w2bvNgU41KydxI8Myhg6i8035wkDmF3COlFKJ25NA22gWeW3JkF5e03/c7yxw1/vkVzFe1/zCR9E6o6sr131sXNC0JK9kS/HKN6Qugig0+lhtJb4m+zWYoZ9wMMg=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:25:50.947289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-aaf7fc1e-9fb4-4503-b9cb-ab2b0fbf8909 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:25:50.955725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-aaf7fc1e-9fb4-4503-b9cb-ab2b0fbf8909 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for user e91bdb8e1e364219bc1fa98517eb19d9 and project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:25:51.015966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aaf7fc1e-9fb4-4503-b9cb-ab2b0fbf8909 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108352 Oct 04 11:25:51.020866 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3893/5176] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:25:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:25:54.343331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1198352689", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f13c22c-2a0f-40fe-b7ea-9f76b204e323"}], "security_groups": [{"name": "tempest-securitygroup--257880908"}], "key_name": "tempest-keypair-1539396948", "user_data": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:25:54.366339 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:25:54.366597 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:25:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:25:54.367658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:54.368437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:54.503187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] validate_networks() for [('7f13c22c-2a0f-40fe-b7ea-9f76b204e323', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:25:56.108977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:25:56.111015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:25:56.111925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:25:56.112512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:25:56.113229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:25:56.138063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:56.143643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:56.144756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:56.149594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:56.150410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:56.151039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:56.183695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:25:56.190894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for user e91bdb8e1e364219bc1fa98517eb19d9 and project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:25:56.211395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:25:56.214962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:25:56.282860 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-016aebb3-00bd-43e8-ae94-bdce649639fa tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.943775 Oct 04 11:25:56.286981 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1284/5177] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:25:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:25:56.299183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ad7a679-514f-4a0f-b711-57e75d539135 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:56.299923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ad7a679-514f-4a0f-b711-57e75d539135 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:56.303170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:56.535453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ad7a679-514f-4a0f-b711-57e75d539135 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:56.545047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ad7a679-514f-4a0f-b711-57e75d539135 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1242 microversion: 2.1 time: 0.251023 Oct 04 11:25:56.584355 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3894/5178] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:56 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1242 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:57.595052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-857a7735-635e-45d3-b4c6-dad20e4313d0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:57.596195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-857a7735-635e-45d3-b4c6-dad20e4313d0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:58.150902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-857a7735-635e-45d3-b4c6-dad20e4313d0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:58.165406 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-857a7735-635e-45d3-b4c6-dad20e4313d0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1242 microversion: 2.1 time: 0.572218 Oct 04 11:25:58.168992 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1285/5179] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:57 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1242 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:25:59.195332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:25:59.196617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:25:59.202735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:25:59.222393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:59.223084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:59.223880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:59.226215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:25:59.226872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:25:59.228301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:25:59.543105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:25:59.555391 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2803d5ee-2519-4c28-a0de-01c730fafa1c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1312 microversion: 2.1 time: 0.365046 Oct 04 11:25:59.556184 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3895/5180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:25:59 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:00.583146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:00.583747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:00.603078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:00.605893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:00.606420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:00.612846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:00.613441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:00.615063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:00.951926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:00.979652 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb89595a-1306-47e0-b0d7-bdb2f2e8ecf4 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1300 microversion: 2.1 time: 0.401348 Oct 04 11:26:00.981485 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1286/5181] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:00 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1300 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:02.004753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:02.006902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:02.019711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:02.023686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:02.024372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:02.025634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:02.026259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:02.030796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:03.792832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:03.796854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c38752e3-a7d8-43f1-a70d-90e7629b4317 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1367 microversion: 2.1 time: 1.796495 Oct 04 11:26:03.797512 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3896/5182] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:01 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1367 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:04.824563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:04.825762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:04.841778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:04.847263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:04.848565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:04.849832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:04.851787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:04.852846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:05.745996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:05.757570 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90169439-49a6-4af0-98fa-e2bd7576650d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1367 microversion: 2.1 time: 0.933999 Oct 04 11:26:05.757570 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1287/5183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:04 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1367 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:06.339426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f808239f-cb45-4a5b-b22d-aa30471ad434 req-6fd6388b-ea7c-48cd-ac67-7aef0279ca64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45bbf133-3fff-46bb-97bd-d20eebd081a4", "tag": "fba66681-1e7b-4bab-92b1-c463f45b3629"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:06.354916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f808239f-cb45-4a5b-b22d-aa30471ad434 req-6fd6388b-ea7c-48cd-ac67-7aef0279ca64 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:06.355833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f808239f-cb45-4a5b-b22d-aa30471ad434 req-6fd6388b-ea7c-48cd-ac67-7aef0279ca64 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:06.356413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f808239f-cb45-4a5b-b22d-aa30471ad434 req-6fd6388b-ea7c-48cd-ac67-7aef0279ca64 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:06.369867 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f808239f-cb45-4a5b-b22d-aa30471ad434 req-6fd6388b-ea7c-48cd-ac67-7aef0279ca64 service nova] Creating event network-changed:fba66681-1e7b-4bab-92b1-c463f45b3629 for instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 on n-h1-791135-8 Oct 04 11:26:06.376934 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f808239f-cb45-4a5b-b22d-aa30471ad434 req-6fd6388b-ea7c-48cd-ac67-7aef0279ca64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043863 Oct 04 11:26:06.378263 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3897/5184] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:06.779642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:06.780269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:06.786336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:06.796774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:06.810705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:06.815068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:06.820576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:06.824576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:06.825277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:07.627825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:07.663195 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1367 microversion: 2.1 time: 0.876282 Oct 04 11:26:07.664243 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1288/5185] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:06 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1367 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:26:08.688105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:08.688830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:08.690956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:08.732734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:08.733255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:08.744712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:08.751915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:08.752419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:08.752879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:09.166555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:09.179043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc034a19-5642-48b0-be20-8eeab93a3671 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1367 microversion: 2.1 time: 0.495597 Oct 04 11:26:09.180907 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3898/5186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:08 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:09.778896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:09.780466 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a56cc482-fc62-4bdb-b2fa-054fa8c3e766 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001943 Oct 04 11:26:09.781854 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1289/5187] 10.222.0.23 () {56 vars in 886 bytes} [Tue Oct 4 11:26:09 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 11:26:10.206861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:10.207480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:10.234244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:10.235616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:10.237628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:10.241980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:10.242674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:10.243271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:11.126355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:11.135153 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-276ae791-6c6e-412b-a066-3593f10a2f43 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1367 microversion: 2.1 time: 0.932466 Oct 04 11:26:11.138911 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3899/5188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:10 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1367 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:11.809039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-286efd10-bd71-43bd-a77d-63be862d2520 req-5b6b444c-a7a5-43c7-8608-03496bbeead4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bbf133-3fff-46bb-97bd-d20eebd081a4", "name": "network-vif-plugged", "status": "completed", "tag": "fba66681-1e7b-4bab-92b1-c463f45b3629"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:11.862710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:11.871730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-286efd10-bd71-43bd-a77d-63be862d2520 req-5b6b444c-a7a5-43c7-8608-03496bbeead4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:11.881259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-286efd10-bd71-43bd-a77d-63be862d2520 req-5b6b444c-a7a5-43c7-8608-03496bbeead4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:11.881739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-286efd10-bd71-43bd-a77d-63be862d2520 req-5b6b444c-a7a5-43c7-8608-03496bbeead4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:11.963557 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-286efd10-bd71-43bd-a77d-63be862d2520 req-5b6b444c-a7a5-43c7-8608-03496bbeead4 service nova] Creating event network-vif-plugged:fba66681-1e7b-4bab-92b1-c463f45b3629 for instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 on n-h1-791135-8 Oct 04 11:26:11.988588 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-286efd10-bd71-43bd-a77d-63be862d2520 req-5b6b444c-a7a5-43c7-8608-03496bbeead4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198418 Oct 04 11:26:11.995217 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1290/5189] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:26:12.170873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:12.173151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:12.183892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:12.184787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:12.185554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:12.187145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:12.187883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:12.190130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:12.632438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:12.634332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:12.643690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:12.644192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:12.644624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:12.645580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:12.646180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:12.646883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:12.677275 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9cea2ed8-e727-46ce-82aa-77bf75188e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/ips" status: 200 len: 147 microversion: 2.1 time: 0.780809 Oct 04 11:26:12.678796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3900/5190] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:26:11 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/ips => generated 147 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:12.810277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:12.822007 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-407f1f8d-5a64-4bce-98e2-5404446db95b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1367 microversion: 2.1 time: 0.659311 Oct 04 11:26:12.827938 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1291/5191] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:12 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1367 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:26:13.855422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:13.856653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:13.867270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:13.868044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:13.868789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:13.870855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:13.871461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:13.873395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:14.876370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:14.895793 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a58b5b4b-717e-4760-8227-375963fb6c88 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1556 microversion: 2.1 time: 1.045083 Oct 04 11:26:14.901893 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3901/5192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:13 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1556 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:14.928269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:14.928761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:14.943411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:14.958029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:14.958580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:14.959347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:14.959901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:14.960900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:15.395233 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40db6f93-9f91-4414-841f-acdab29e00e5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.470721 Oct 04 11:26:15.397444 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1292/5193] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:26:14 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4/os-interface => generated 284 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:16.813690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "633ce8c3-4951-410f-9fc5-ffb3a0f3e161"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:16.816922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:16.837267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:16.838069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:16.838664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:16.839536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:16.840165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:16.840603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:17.400590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25201cc0-a1e8-43d6-8b82-674ca60c3b46 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.589662 Oct 04 11:26:17.414413 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3902/5194] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:26:16 2022] POST /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:21.993959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4344c66b-6f72-4154-9549-de97f56cc229 req-8f9d52fe-67b7-4852-908f-18429fc1bf0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45bbf133-3fff-46bb-97bd-d20eebd081a4", "tag": "fba66681-1e7b-4bab-92b1-c463f45b3629"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:22.060598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4344c66b-6f72-4154-9549-de97f56cc229 req-8f9d52fe-67b7-4852-908f-18429fc1bf0e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:22.065570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4344c66b-6f72-4154-9549-de97f56cc229 req-8f9d52fe-67b7-4852-908f-18429fc1bf0e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:22.067392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4344c66b-6f72-4154-9549-de97f56cc229 req-8f9d52fe-67b7-4852-908f-18429fc1bf0e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:22.102611 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4344c66b-6f72-4154-9549-de97f56cc229 req-8f9d52fe-67b7-4852-908f-18429fc1bf0e service nova] Creating event network-changed:fba66681-1e7b-4bab-92b1-c463f45b3629 for instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 on n-h1-791135-8 Oct 04 11:26:22.140078 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4344c66b-6f72-4154-9549-de97f56cc229 req-8f9d52fe-67b7-4852-908f-18429fc1bf0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140381 Oct 04 11:26:22.144943 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1293/5195] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:26.837388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=15 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:26.971429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f927f715-7ad4-42d5-ac86-9ac4847bce99 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Action: 'create', calling method: .version_select at 0x7f71cf0e5a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-477153614"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:27.370466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:27.779830 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f927f715-7ad4-42d5-ac86-9ac4847bce99 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.045812 Oct 04 11:26:27.780826 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3903/5196] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Oct 4 11:26:26 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1048 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 11:26:27.798182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b9c72a6-61e8-4c36-8d67-2f5833907f30 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71d88b5790>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:27.940376 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b9c72a6-61e8-4c36-8d67-2f5833907f30 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 200 len: 344 microversion: 2.1 time: 0.148970 Oct 04 11:26:27.941003 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1294/5197] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:27 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:26:28.955583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e5661b8-f252-4894-97ea-c49277186023 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf0e51f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:29.089807 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e5661b8-f252-4894-97ea-c49277186023 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 200 len: 344 microversion: 2.1 time: 0.139704 Oct 04 11:26:29.096745 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3904/5198] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:28 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:30.106787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21b0d680-3995-4e27-8ab1-3962431c6422 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71d874c3a0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:30.237439 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21b0d680-3995-4e27-8ab1-3962431c6422 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 200 len: 345 microversion: 2.1 time: 0.136775 Oct 04 11:26:30.239993 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1295/5199] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:30 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:30.253967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3336886c-1913-4284-9e0d-435aaf62d11a tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Action: 'create', calling method: .version_select at 0x7f71cf07ca60>, body: {"snapshot": {"volume_id": "f27b0ade-bb0c-4800-b8de-c4feee60ba55", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1785768327"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:30.609937 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3336886c-1913-4284-9e0d-435aaf62d11a tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.360612 Oct 04 11:26:30.610814 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3905/5200] 10.222.0.23 () {60 vars in 1162 bytes} [Tue Oct 4 11:26:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:30.624883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-484c011e-ca95-4f77-871f-067f58fa2030 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71d874c310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:30.693564 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-484c011e-ca95-4f77-871f-067f58fa2030 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 200 len: 287 microversion: 2.1 time: 0.075209 Oct 04 11:26:30.694155 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1296/5201] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:26:30 2022] GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:30.709410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c604d19-67be-4d13-955f-5ac510a89849 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cedd2ca0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:30.769302 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c604d19-67be-4d13-955f-5ac510a89849 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.066984 Oct 04 11:26:30.770527 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3906/5202] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Oct 4 11:26:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:26:30.782084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b799f32f-1336-479d-acb4-8f8ed86554b6 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71d88b5040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:30.851503 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b799f32f-1336-479d-acb4-8f8ed86554b6 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 200 len: 287 microversion: 2.1 time: 0.073370 Oct 04 11:26:30.852628 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1297/5203] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:26:30 2022] GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:31.871757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e668d05d-e3bb-4450-bdf1-691f4c1b05ee tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf0e2550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:31.959164 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e668d05d-e3bb-4450-bdf1-691f4c1b05ee tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 200 len: 287 microversion: 2.1 time: 0.095916 Oct 04 11:26:31.964863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3907/5204] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:26:31 2022] GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:32.980944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:32.984721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=34 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:32.994075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82f26d09-d016-40b1-8086-2ff0d24ad831 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71d4509700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:33.099464 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82f26d09-d016-40b1-8086-2ff0d24ad831 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 200 len: 287 microversion: 2.1 time: 0.125113 Oct 04 11:26:33.109749 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1298/5205] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:26:32 2022] GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:34.122329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e85a70c-9e1d-41c6-8b34-5c0fe803050f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cee3d040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:34.167299 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e85a70c-9e1d-41c6-8b34-5c0fe803050f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 200 len: 288 microversion: 2.1 time: 0.049598 Oct 04 11:26:34.168245 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3908/5206] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:26:34 2022] GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 288 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:34.180899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86e5d0b2-f39f-4cdd-875e-2a3986f6d449 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71d42885e0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:34.283665 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86e5d0b2-f39f-4cdd-875e-2a3986f6d449 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 202 len: 0 microversion: 2.1 time: 0.107037 Oct 04 11:26:34.297674 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1299/5207] 10.222.0.23 () {58 vars in 1254 bytes} [Tue Oct 4 11:26:34 2022] DELETE /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:26:34.299257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6fd19a7-a72e-4045-bb98-623f9986d242 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf07c0d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:34.355980 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6fd19a7-a72e-4045-bb98-623f9986d242 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 200 len: 287 microversion: 2.1 time: 0.066900 Oct 04 11:26:34.363023 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3909/5208] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:26:34 2022] GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:35.369961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbcf618f-40f8-470d-8483-3d670e12681d tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf8fc700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:35.425239 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbcf618f-40f8-470d-8483-3d670e12681d tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 200 len: 287 microversion: 2.1 time: 0.059426 Oct 04 11:26:35.426089 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1300/5209] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:26:35 2022] GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:36.175563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:36.182537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:36.192089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:36.192818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:36.193491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:36.195013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:36.196939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:36.197616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:36.235021 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cf8bf53-522c-4d3e-99ac-1197e1a9f014 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067123 Oct 04 11:26:36.247977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:36.248958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:36.252226 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3910/5210] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:26:36 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:36.263296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:36.265638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:36.266175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:36.268512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:36.270576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:36.271294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:36.340900 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-351c9188-50f7-44ab-86e0-e795cb38a682 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/633ce8c3-4951-410f-9fc5-ffb3a0f3e161" status: 200 len: 194 microversion: 2.1 time: 0.098168 Oct 04 11:26:36.344856 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1301/5211] 10.222.0.23 () {58 vars in 1413 bytes} [Tue Oct 4 11:26:36 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/633ce8c3-4951-410f-9fc5-ffb3a0f3e161 => generated 194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:36.440968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c08340de-39b5-4fb1-9794-7886156f6e9f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf0971f0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:36.481645 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c08340de-39b5-4fb1-9794-7886156f6e9f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] HTTP exception thrown: Snapshot e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 could not be found. Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c08340de-39b5-4fb1-9794-7886156f6e9f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Request method failure captured: Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 HTTP/1.1 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBhip9s_LSdmBQcdcBYlxx7lccEWKC2_yZg976j3g9gEixpNF7EuLaPPW2DV3LD5NveJ8ikr1tI_iAyx9ZbbX-nTq7UAJP_NWpcMwCO4iOM0vyK0_z7IKwbS949PWE6cNOXifIZLWcK0qZ5L3d2a1Pnxe6RmronLt5ynZF1t93SvLtM Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bae32dcb39434b32ab93301944d758e0 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bae32dcb39434b32ab93301944d758e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bae32dcb39434b32ab93301944d758e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bae32dcb39434b32ab93301944d758e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bae32dcb39434b32ab93301944d758e0"}]}] Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bae32dcb39434b32ab93301944d758e0 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesSnapshotsTestJSON-618882113-project Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 39baa78aec3d4f169464c94019d35f7a Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-618882113-project Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: exception: Snapshot e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 could not be found. Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'e8bd7eb2-e228-405d-b2bf-0ce8f25ca286'} Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 could not be found. (HTTP 404) (Request-ID: req-4aef4e7b-e2a8-46a3-88a0-cfa0d8a08097) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:26:36.487160 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 could not be found. Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 could not be found. Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 could not be found. Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c08340de-39b5-4fb1-9794-7886156f6e9f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Returning 404 to user: Snapshot e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:26:36.491687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c08340de-39b5-4fb1-9794-7886156f6e9f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286" status: 404 len: 111 microversion: 2.1 time: 0.054946 Oct 04 11:26:36.498801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c4f5931-b193-4ef1-bde5-797f39df35e9 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf88f4c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:36.501859 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3911/5212] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:26:36 2022] GET /compute/v2.1/os-snapshots/e8bd7eb2-e228-405d-b2bf-0ce8f25ca286 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:26:36.629196 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c4f5931-b193-4ef1-bde5-797f39df35e9 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 202 len: 0 microversion: 2.1 time: 0.134709 Oct 04 11:26:36.630391 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1302/5213] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:26:36 2022] DELETE /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:26:36.639026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-407d8e1e-c0d2-4962-95a9-2b80a39c988d tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf07cee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:36.710517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-407d8e1e-c0d2-4962-95a9-2b80a39c988d tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 200 len: 344 microversion: 2.1 time: 0.075439 Oct 04 11:26:36.718864 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3912/5214] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:36 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:37.726939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-967cbf90-7dc0-43db-b830-3b5964bdd235 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf890f70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:37.919884 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-967cbf90-7dc0-43db-b830-3b5964bdd235 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 200 len: 344 microversion: 2.1 time: 0.198144 Oct 04 11:26:37.921115 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1303/5215] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:37 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:38.934486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0a3d849-6bb8-41d8-8ba5-13642db2587f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf07c160>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:39.045462 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0a3d849-6bb8-41d8-8ba5-13642db2587f tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 200 len: 344 microversion: 2.1 time: 0.114930 Oct 04 11:26:39.046172 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3913/5216] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:38 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:39.089009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68269f82-d698-4ca7-9c31-2c3ba56c3a7c"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:39.093631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:39.105245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:39.105756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:39.106190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:39.106890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:39.107334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:39.107748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:39.615217 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f33b7c59-d999-416f-90d9-992fca1c8b73 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "POST /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533062 Oct 04 11:26:39.626051 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1304/5217] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:26:39 2022] POST /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:40.064532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32db400f-4a78-4d2f-9193-744ed7d6c249 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71ced15c10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:40.243565 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32db400f-4a78-4d2f-9193-744ed7d6c249 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 200 len: 344 microversion: 2.1 time: 0.187205 Oct 04 11:26:40.244239 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3914/5218] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:40 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:41.263929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd6d1830-f8ee-4d5c-b0a4-966303fce4b7 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf88f700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:41.887864 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-dd6d1830-f8ee-4d5c-b0a4-966303fce4b7 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] HTTP exception thrown: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd6d1830-f8ee-4d5c-b0a4-966303fce4b7 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Request method failure captured: Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 HTTP/1.1 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBhip9s_LSdmBQcdcBYlxx7lccEWKC2_yZg976j3g9gEixpNF7EuLaPPW2DV3LD5NveJ8ikr1tI_iAyx9ZbbX-nTq7UAJP_NWpcMwCO4iOM0vyK0_z7IKwbS949PWE6cNOXifIZLWcK0qZ5L3d2a1Pnxe6RmronLt5ynZF1t93SvLtM Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: bae32dcb39434b32ab93301944d758e0 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bae32dcb39434b32ab93301944d758e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bae32dcb39434b32ab93301944d758e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bae32dcb39434b32ab93301944d758e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bae32dcb39434b32ab93301944d758e0"}]}] Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: bae32dcb39434b32ab93301944d758e0 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-VolumesSnapshotsTestJSON-618882113-project Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 39baa78aec3d4f169464c94019d35f7a Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesSnapshotsTestJSON-618882113-project Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: exception: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'f27b0ade-bb0c-4800-b8de-c4feee60ba55'} Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. (HTTP 404) (Request-ID: req-85bbac57-059c-4619-a559-de8f7059aa34) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:26:41.892092 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:41.896209 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:41.906212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd6d1830-f8ee-4d5c-b0a4-966303fce4b7 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Returning 404 to user: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:26:41.907245 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd6d1830-f8ee-4d5c-b0a4-966303fce4b7 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 404 len: 109 microversion: 2.1 time: 0.652347 Oct 04 11:26:41.908563 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1305/5219] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:41 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 109 bytes in 654 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:26:41.920121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34bebacd-597c-4d0e-a8ec-8891b7665882 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf07c4c0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:42.027970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-34bebacd-597c-4d0e-a8ec-8891b7665882 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] HTTP exception thrown: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34bebacd-597c-4d0e-a8ec-8891b7665882 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Request method failure captured: Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 HTTP/1.1 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBhip9s_LSdmBQcdcBYlxx7lccEWKC2_yZg976j3g9gEixpNF7EuLaPPW2DV3LD5NveJ8ikr1tI_iAyx9ZbbX-nTq7UAJP_NWpcMwCO4iOM0vyK0_z7IKwbS949PWE6cNOXifIZLWcK0qZ5L3d2a1Pnxe6RmronLt5ynZF1t93SvLtM Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bae32dcb39434b32ab93301944d758e0 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bae32dcb39434b32ab93301944d758e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bae32dcb39434b32ab93301944d758e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bae32dcb39434b32ab93301944d758e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bae32dcb39434b32ab93301944d758e0"}]}] Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bae32dcb39434b32ab93301944d758e0 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesSnapshotsTestJSON-618882113-project Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 39baa78aec3d4f169464c94019d35f7a Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-618882113-project Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: exception: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f27b0ade-bb0c-4800-b8de-c4feee60ba55'} Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. (HTTP 404) (Request-ID: req-0982a7d9-4442-4f97-87cc-4e7b1a38cc6f) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:26:42.031684 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.035664 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.039434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-34bebacd-597c-4d0e-a8ec-8891b7665882 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Returning 404 to user: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:26:42.040590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-34bebacd-597c-4d0e-a8ec-8891b7665882 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 404 len: 109 microversion: 2.1 time: 0.126220 Oct 04 11:26:42.042284 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3915/5220] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:26:41 2022] DELETE /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:26:42.054468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46baccbd-a94e-4947-9d48-aed42e270808 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Calling method '.version_select at 0x7f71cf88ec10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:42.090556 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-46baccbd-a94e-4947-9d48-aed42e270808 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] HTTP exception thrown: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46baccbd-a94e-4947-9d48-aed42e270808 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Request method failure captured: Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 HTTP/1.1 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBhip9s_LSdmBQcdcBYlxx7lccEWKC2_yZg976j3g9gEixpNF7EuLaPPW2DV3LD5NveJ8ikr1tI_iAyx9ZbbX-nTq7UAJP_NWpcMwCO4iOM0vyK0_z7IKwbS949PWE6cNOXifIZLWcK0qZ5L3d2a1Pnxe6RmronLt5ynZF1t93SvLtM Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: bae32dcb39434b32ab93301944d758e0 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bae32dcb39434b32ab93301944d758e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bae32dcb39434b32ab93301944d758e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bae32dcb39434b32ab93301944d758e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bae32dcb39434b32ab93301944d758e0"}]}] Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: bae32dcb39434b32ab93301944d758e0 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-618882113 Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-VolumesSnapshotsTestJSON-618882113-project Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 39baa78aec3d4f169464c94019d35f7a Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesSnapshotsTestJSON-618882113-project Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: method: Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: exception: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'f27b0ade-bb0c-4800-b8de-c4feee60ba55'} Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. (HTTP 404) (Request-ID: req-b295612e-1181-4218-a607-f7aa1241d159) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:26:42.094328 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. Oct 04 11:26:42.098079 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:42.102594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46baccbd-a94e-4947-9d48-aed42e270808 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] Returning 404 to user: Volume f27b0ade-bb0c-4800-b8de-c4feee60ba55 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:26:42.103768 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46baccbd-a94e-4947-9d48-aed42e270808 tempest-VolumesSnapshotsTestJSON-618882113 tempest-VolumesSnapshotsTestJSON-618882113-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55" status: 404 len: 109 microversion: 2.1 time: 0.056604 Oct 04 11:26:42.104986 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1306/5221] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:26:42 2022] GET /compute/v2.1/os-volumes/f27b0ade-bb0c-4800-b8de-c4feee60ba55 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:26:48.018040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:48.018722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:26:48.028605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:48.030955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:48.043532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:48.046112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:48.055396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:48.056341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:48.056830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:48.057270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:48.139051 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c211a5c5-2f68-4626-aee8-d65d02fba3c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4/ips" status: 200 len: 149 microversion: 2.1 time: 0.123184 Oct 04 11:26:48.164772 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3916/5222] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:26:48 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4/ips => generated 149 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:48.177202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32b3a0f3-8df1-4061-b57a-2a6140cb5870"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:48.180101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:48.208965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:48.214557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:48.215166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:48.216088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:48.216699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:48.228096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:48.475913 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Invalid volume: volume 32b3a0f3-8df1-4061-b57a-2a6140cb5870 is already attached to instances: b0218e8b-e3de-480e-8747-71c06ac4752c Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4/os-volume_attachments HTTP/1.1 Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 74 Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: {"volumeAttachment": {"volumeId": "32b3a0f3-8df1-4061-b57a-2a6140cb5870"}} Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid volume: volume 32b3a0f3-8df1-4061-b57a-2a6140cb5870 is already attached to instances: b0218e8b-e3de-480e-8747-71c06ac4752c Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'server_id': '45bbf133-3fff-46bb-97bd-d20eebd081a4', 'body': {'volumeAttachment': {'volumeId': '32b3a0f3-8df1-4061-b57a-2a6140cb5870'}}} Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 32b3a0f3-8df1-4061-b57a-2a6140cb5870 is already attached to instances: b0218e8b-e3de-480e-8747-71c06ac4752c Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:26:48.477811 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 32b3a0f3-8df1-4061-b57a-2a6140cb5870 is already attached to instances: b0218e8b-e3de-480e-8747-71c06ac4752c Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 32b3a0f3-8df1-4061-b57a-2a6140cb5870 is already attached to instances: b0218e8b-e3de-480e-8747-71c06ac4752c Oct 04 11:26:48.481693 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:26:48.493801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 400 to user: Invalid volume: volume 32b3a0f3-8df1-4061-b57a-2a6140cb5870 is already attached to instances: b0218e8b-e3de-480e-8747-71c06ac4752c {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:26:48.496279 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfd5b936-8bce-4a70-a407-8e9bf45e8971 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.323728 Oct 04 11:26:48.501728 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1307/5223] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:26:48 2022] POST /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4/os-volume_attachments => generated 174 bytes in 330 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:26:48.509741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:48.510341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:48.517694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:48.520683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:48.524502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:48.526601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:48.530382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:48.532351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:48.613345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:26:48.893632 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-acccd0b6-8e0b-46a7-aa7d-4a820448e310 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 204 len: 0 microversion: 2.1 time: 0.387824 Oct 04 11:26:48.894232 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3917/5224] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:26:48 2022] DELETE /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:26:48.905144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:48.909516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:48.931759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:48.932258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:48.932716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:48.937828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:48.941048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:48.941593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:49.644954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:49.655550 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21f4ebb8-fabd-44f0-844d-2976f0a20643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1681 microversion: 2.1 time: 0.756227 Oct 04 11:26:49.664132 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1308/5225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:48 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1681 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:50.690516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:50.692357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:50.715437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:50.716182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:50.719091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:50.720213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:50.721023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:50.721670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:53.648611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:53.659592 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2d62ce2-233c-42a7-afc1-88344b7c946e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1681 microversion: 2.1 time: 2.973956 Oct 04 11:26:53.660196 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3918/5226] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:50 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1681 bytes in 2975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:54.689344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:54.691496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:54.708290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:54.710418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:54.712194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:54.714569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:54.715667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:54.716285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:55.051977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:55.069685 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3bd16df0-2f22-4942-9828-877f1eae8961 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1614 microversion: 2.1 time: 0.376749 Oct 04 11:26:55.071116 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1309/5227] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:54 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1614 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:55.927018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-fce8e23f-832e-43c6-9405-33fddf2427d8 req-561e824c-a06c-46eb-a37f-593f74b13db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bbf133-3fff-46bb-97bd-d20eebd081a4", "name": "network-vif-deleted", "tag": "fba66681-1e7b-4bab-92b1-c463f45b3629"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:26:55.942900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fce8e23f-832e-43c6-9405-33fddf2427d8 req-561e824c-a06c-46eb-a37f-593f74b13db0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:55.943812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fce8e23f-832e-43c6-9405-33fddf2427d8 req-561e824c-a06c-46eb-a37f-593f74b13db0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:55.944428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fce8e23f-832e-43c6-9405-33fddf2427d8 req-561e824c-a06c-46eb-a37f-593f74b13db0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:55.994665 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-fce8e23f-832e-43c6-9405-33fddf2427d8 req-561e824c-a06c-46eb-a37f-593f74b13db0 service nova] Creating event network-vif-deleted:fba66681-1e7b-4bab-92b1-c463f45b3629 for instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 on n-h1-791135-8 Oct 04 11:26:56.010080 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-fce8e23f-832e-43c6-9405-33fddf2427d8 req-561e824c-a06c-46eb-a37f-593f74b13db0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089592 Oct 04 11:26:56.011543 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3919/5228] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:26:56.104372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:56.104986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:56.130520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:56.131928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:56.133875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:56.135067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:56.136532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:56.137161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:56.308548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:56.309042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:56.309520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:56.309959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lazy-loading 'fault' on Instance uuid 45bbf133-3fff-46bb-97bd-d20eebd081a4 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:26:56.441270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:26:56.463392 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b035dbd-455a-42e2-a289-5559e6620f4c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 200 len: 1332 microversion: 2.1 time: 0.364758 Oct 04 11:26:56.465381 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1310/5229] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:56 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 1332 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:26:57.495538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:57.496500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:26:57.515498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:57.519950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:57.521979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:57.526190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:26:57.526691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:26:57.530827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:26:57.643408 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 HTTP/1.1 Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '45bbf133-3fff-46bb-97bd-d20eebd081a4'} Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:26:57.647432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:57.650938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:26:57.650938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:26:57.650938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:26:57.650938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:26:57.650938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:26:57.650938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:26:57.650938 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:26:57.650938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:26:57.657512 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-868536da-e656-4957-a179-160c68d815e1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 404 len: 111 microversion: 2.1 time: 0.161963 Oct 04 11:26:57.658307 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3920/5230] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:26:57 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:26:57.667063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af9a3adf-abd8-423b-9b51-82d96cccde62 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '.version_select at 0x7f71cf88ef70>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:26:57.711237 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af9a3adf-abd8-423b-9b51-82d96cccde62 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539396948" status: 202 len: 0 microversion: 2.1 time: 0.048202 Oct 04 11:26:57.712622 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1311/5231] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539396948 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:27:01.008385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:01.010460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:01.023948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:01.024406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:01.024850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:01.033340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:01.033978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:01.034423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:01.101429 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f479dc7-fa11-4617-9233-f8898d60e53e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.097221 Oct 04 11:27:01.102354 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3921/5232] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:01 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments => generated 371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:01.255225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:01.256046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:01.269930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:01.270430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:01.271063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:01.271778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:01.272326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:01.272973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:01.366904 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8adf603d-932f-4094-8c99-4a8cac2d2c5e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/633ce8c3-4951-410f-9fc5-ffb3a0f3e161" status: 200 len: 194 microversion: 2.1 time: 0.116089 Oct 04 11:27:01.378927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:01.379435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:01.387706 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1312/5233] 10.222.0.23 () {58 vars in 1413 bytes} [Tue Oct 4 11:27:01 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/633ce8c3-4951-410f-9fc5-ffb3a0f3e161 => generated 194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:01.390435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:01.392425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:01.393049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:01.395932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:01.396579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:01.397171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:01.562672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lazy-loading 'services' on Instance uuid 7e91bd8b-19e4-4456-8084-50307aaeb6c1 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:27:01.724029 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99315b43-1979-4ff2-91d7-a2887dd607bd tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/633ce8c3-4951-410f-9fc5-ffb3a0f3e161" status: 202 len: 0 microversion: 2.1 time: 0.348994 Oct 04 11:27:01.725427 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3922/5234] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:27:01 2022] DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/633ce8c3-4951-410f-9fc5-ffb3a0f3e161 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:27:01.889644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:01.890490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:01.901196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:01.902494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:01.903283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:01.904981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:01.905674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:01.906608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:02.051948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lazy-loading 'services' on Instance uuid b0218e8b-e3de-480e-8747-71c06ac4752c {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:27:02.192641 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e134a8e6-b219-4c1e-8a00-2c3506514eb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments/32b3a0f3-8df1-4061-b57a-2a6140cb5870" status: 202 len: 0 microversion: 2.1 time: 0.308602 Oct 04 11:27:02.197866 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1313/5235] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:27:01 2022] DELETE /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments/32b3a0f3-8df1-4061-b57a-2a6140cb5870 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:27:02.205337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:02.209864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:02.231751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:02.232492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:02.235204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:02.236067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:02.240362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:02.240870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:02.319588 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af8c49ab-bfc5-4cd7-976a-99a4baa1cb0f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120622 Oct 04 11:27:02.320668 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3923/5236] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:02 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:27:03.334371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:03.337021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:03.349182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:03.391266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:03.392287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:03.398120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:03.402696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:03.403944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:03.407875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:03.426760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:03.639094 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06e718b7-eb90-4761-b953-f48773fd0e20 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.308564 Oct 04 11:27:03.646003 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1314/5237] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:03 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:04.657177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:04.661683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:04.677950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:04.681290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:04.682877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:04.686941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:04.688779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:04.689431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:04.760383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e93de9d0-24ef-4d70-a6dd-fff8ad6e0852 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108751 Oct 04 11:27:04.769211 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3924/5238] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:04 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:05.779596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:05.782700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:05.811420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:05.812223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:05.814331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:05.816553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:05.819089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:05.819967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:05.969040 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e82f3637-f6b3-4345-b5df-27c5d80dfe75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192978 Oct 04 11:27:05.973807 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1315/5239] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:05 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:06.982541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:06.984792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:07.002542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:07.004928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:07.005447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:07.006451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:07.008377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:07.009163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:07.081311 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-82a1ae96-ce8c-4a7d-99e3-c18a7d5463cb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102158 Oct 04 11:27:07.087824 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3925/5240] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:06 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:08.095327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:08.098690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:08.107541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:08.108447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:08.109205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:08.110875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:08.111506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:08.112076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:08.157838 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0d748fe-fefe-4677-865f-6d2db7c7f3c7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067650 Oct 04 11:27:08.158428 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1316/5241] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:08 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:27:09.171837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:09.174200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:09.191316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:09.193557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:09.194203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:09.195156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:09.199901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:09.200623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:09.282206 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2596df1d-9b29-4ae6-b821-93b47a2b797b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115478 Oct 04 11:27:09.288156 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3926/5242] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:09 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:10.043645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:10.045792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:10.059459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:10.061573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:10.062186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:10.064520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:10.066865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:10.067504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:10.158741 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-677b54ac-e2b4-48bf-8f05-19d15ee5d4ac tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/68269f82-d698-4ca7-9c31-2c3ba56c3a7c" status: 200 len: 194 microversion: 2.1 time: 0.120504 Oct 04 11:27:10.172775 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1317/5243] 10.222.0.23 () {58 vars in 1413 bytes} [Tue Oct 4 11:27:10 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/68269f82-d698-4ca7-9c31-2c3ba56c3a7c => generated 194 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:10.173479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:10.175951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:10.189080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:10.189972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:10.190592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:10.194284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:10.194904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:10.196245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:10.301286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:10.303899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:10.316734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:10.317243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:10.317710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:10.319430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:10.319895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:10.320324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:10.390814 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f58a6c55-1f41-438b-9959-c64052bb23de tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094591 Oct 04 11:27:10.391955 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1318/5244] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:10 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:10.666983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lazy-loading 'services' on Instance uuid 7e91bd8b-19e4-4456-8084-50307aaeb6c1 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:27:10.900781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13758e89-7183-4071-98df-0e4cc1d16411 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/68269f82-d698-4ca7-9c31-2c3ba56c3a7c" status: 202 len: 0 microversion: 2.1 time: 0.731833 Oct 04 11:27:10.905296 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3927/5245] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:27:10 2022] DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments/68269f82-d698-4ca7-9c31-2c3ba56c3a7c => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:27:11.402958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:11.406881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:11.422914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:11.428439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:11.429063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:11.430003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:11.430629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:11.431214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:11.502064 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7757ccf3-c9db-47b4-86bb-6a230aa95e3c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103167 Oct 04 11:27:11.507580 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1319/5246] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:11 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:27:12.519615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:12.521958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:12.539697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:12.540195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:12.540632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:12.541586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:12.542025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:12.542445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:12.630572 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0868b6ee-04b7-483d-a326-65cf63ee6dfc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115211 Oct 04 11:27:12.634547 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3928/5247] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:12 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:13.648669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:13.658291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:13.679184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:13.679941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:13.682277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:13.683204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:13.684461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:13.687785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:13.734274 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afffdc01-2b17-44b2-b2b9-699df6e2ca1f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091168 Oct 04 11:27:13.739828 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1320/5248] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:13 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:14.748116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:14.750776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:14.781911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:14.782431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:14.784793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:14.785601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:14.790259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:14.790840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:14.882212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3562bc74-e810-472d-822d-e8919bc1796a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138835 Oct 04 11:27:14.883222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3929/5249] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:14 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:15.895913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:15.898154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:15.911793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:15.912285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:15.916492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:15.921589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:15.922668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:15.923269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:16.050725 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e81efc4-f360-499a-b7d1-08cf6f00846c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159302 Oct 04 11:27:16.056654 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1321/5250] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:15 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:17.063651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:17.066355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:17.079377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:17.079938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:17.080564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:17.081948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:17.082472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:17.082963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:17.119171 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-710019f3-7a37-41d9-980a-42a45c299a5d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059311 Oct 04 11:27:17.120165 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3930/5251] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:17 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:18.134924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:18.137606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:18.153570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:18.155999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:18.158823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:18.159986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:18.161266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:18.164033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:18.239698 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43f515b3-5900-4795-b22d-8a5ac907a855 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111724 Oct 04 11:27:18.243028 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1322/5252] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:18 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:27:18.352595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:18.357381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:18.394209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:18.423933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:18.427158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:18.427682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:18.440072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:18.440859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:18.442830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:18.535494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:18.548425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:27:18.764829 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5711176d-347c-4eb4-b0d5-ba377fe5aeff tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 204 len: 0 microversion: 2.1 time: 0.426533 Oct 04 11:27:18.765762 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3931/5253] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:27:18 2022] DELETE /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:27:18.774093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:18.775032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:18.784602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:18.785306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:18.785913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:18.786774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:18.788011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:18.788594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:19.642926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:19.653093 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ec7b511-e7d8-485c-9986-6a5850274d89 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1681 microversion: 2.1 time: 0.882723 Oct 04 11:27:19.659683 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1323/5254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:18 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1681 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:20.684012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:20.684760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:20.702071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:20.702945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:20.703400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:20.708377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:20.708879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:20.712835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:21.320207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:21.333169 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ea64f4b-59d8-44d9-bf78-8fc6c7ebbb75 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1681 microversion: 2.1 time: 0.653539 Oct 04 11:27:21.349976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3932/5255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:20 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1681 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:22.362765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:22.363567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:22.381063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:22.381641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:22.382188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:22.383033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:22.383595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:22.384125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:22.834414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:22.874554 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a4388bbf-f095-425c-a232-62f545143cf5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 200 len: 1614 microversion: 2.1 time: 0.497171 Oct 04 11:27:22.885434 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1324/5256] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:22 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 1614 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:22.966164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-dd1c9ce9-bbba-4504-82ba-fde40811a95c req-02369c15-5f04-4475-bfa2-4677ee940fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0218e8b-e3de-480e-8747-71c06ac4752c", "name": "network-vif-deleted", "tag": "270bb04e-3ff4-4ecf-bf64-bdc8665ca993"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:23.028255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dd1c9ce9-bbba-4504-82ba-fde40811a95c req-02369c15-5f04-4475-bfa2-4677ee940fbf service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:23.028913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dd1c9ce9-bbba-4504-82ba-fde40811a95c req-02369c15-5f04-4475-bfa2-4677ee940fbf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:23.029627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-dd1c9ce9-bbba-4504-82ba-fde40811a95c req-02369c15-5f04-4475-bfa2-4677ee940fbf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:23.060528 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-dd1c9ce9-bbba-4504-82ba-fde40811a95c req-02369c15-5f04-4475-bfa2-4677ee940fbf service nova] Creating event network-vif-deleted:270bb04e-3ff4-4ecf-bf64-bdc8665ca993 for instance b0218e8b-e3de-480e-8747-71c06ac4752c on n-h2-791135-8 Oct 04 11:27:23.073809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-dd1c9ce9-bbba-4504-82ba-fde40811a95c req-02369c15-5f04-4475-bfa2-4677ee940fbf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107413 Oct 04 11:27:23.075927 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3933/5257] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:23.899976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:23.900597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:23.917828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:23.918336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:23.918782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:23.920287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:23.920882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:23.921172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:23.964316 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c HTTP/1.1 Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'b0218e8b-e3de-480e-8747-71c06ac4752c'} Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:23.970310 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:23.975083 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:23.975083 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:23.975083 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:23.975083 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:27:23.975083 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:27:23.975083 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:27:23.975083 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:23.976526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:27:23.977809 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c040aa92-c7d1-44b8-8302-e037d99a9360 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 404 len: 111 microversion: 2.1 time: 0.081473 Oct 04 11:27:23.985113 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1325/5258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:23 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:27:23.992338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc0bf4e2-4ab0-446c-adf2-9cc8f56b3545 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '.version_select at 0x7f71cf0e5a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:24.058789 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc0bf4e2-4ab0-446c-adf2-9cc8f56b3545 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-692489698" status: 202 len: 0 microversion: 2.1 time: 0.071398 Oct 04 11:27:24.062731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3934/5259] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-692489698 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:27:25.319101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:25.321928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:25.350177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:25.352865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:25.353661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:25.354557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:25.356293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:25.357540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:25.414991 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0da8678b-d860-43d2-871f-50ca5aab7fdc tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101156 Oct 04 11:27:25.416015 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1326/5260] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:25 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:27:25.656690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:25.667185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:25.687032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:25.689127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:25.693518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:25.697380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:25.698140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:25.698857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:25.768286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c26c35fb-16b1-45cd-ab9e-296c6081ee3f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: .version_select at 0x7f71cf8940d0>, body: {"keypair": {"name": "tempest-keypair-1407032701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL86h05wC1wS6EKe1n0tZvDqNQn9hiLv/avqnOI31poQMTKBjDxpHT9PIGFu/GHB1v6gg/VfVgkL1a+V2nrXlF4nWfCoIzVE4fkQC3MjtytwgYyb+bUjROYiNcU+L7/WA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:25.789442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c26c35fb-16b1-45cd-ab9e-296c6081ee3f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:27:25.795422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c26c35fb-16b1-45cd-ab9e-296c6081ee3f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for user e91bdb8e1e364219bc1fa98517eb19d9 and project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:27:25.798097 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8869b1b8-be16-4e18-a47f-018baeacb13e tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157338 Oct 04 11:27:25.799588 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3935/5261] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:27:25 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:27:25.832052 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c26c35fb-16b1-45cd-ab9e-296c6081ee3f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068910 Oct 04 11:27:25.832889 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1327/5262] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:27:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:27:25.920801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:25.921422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:25.932153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:25.935629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:25.936148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:25.938116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:25.938657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:25.940989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:25.991773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:27:26.111754 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1f7fc1b7-a2a8-4148-82c2-04eeaaf3e9c7 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 204 len: 0 microversion: 2.1 time: 0.195220 Oct 04 11:27:26.116193 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3936/5263] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:27:25 2022] DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:27:26.123876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:26.124510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:26.139961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:26.141637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:26.142120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:26.146341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:26.146855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:26.147303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:26.619071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:26.629637 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a497858e-dfcc-47d6-bd6e-f12ad0ddfbe0 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1675 microversion: 2.1 time: 0.511717 Oct 04 11:27:26.630755 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1328/5264] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:26 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1675 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:27.658166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:27.659179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:27.676053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:27.676880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:27.678069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:27.679092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:27.679763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:27.680398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:28.712423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:28.725937 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-541c66c2-b70a-45fe-b021-f7193f6b3938 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1675 microversion: 2.1 time: 1.073467 Oct 04 11:27:28.727478 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3937/5265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:27 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1675 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:29.554051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Calling method '.version_select at 0x7f71cf8944c0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:29.555944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:29.556546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:29.557053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:29.596942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:29.597836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:29.598558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:29.626199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:29.626914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:29.627975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:29.650789 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e07e8f1-2867-41f4-8806-742bf40bfa55 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1791885619-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.731399 Oct 04 11:27:29.654251 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1329/5266] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:27:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:29.754337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:29.755496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:29.768472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:29.768965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:29.771946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:29.772918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:29.775851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:29.777407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:30.662995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f16f7befa14be687888f0b00588c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca571652d66413ab8000101c4e51262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:30.676932 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd0e7e24-558e-4b36-96b8-6f7e84887613 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 200 len: 1675 microversion: 2.1 time: 0.927177 Oct 04 11:27:30.681745 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3938/5267] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:29 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 1675 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:30.895849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-234154130", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:31.027127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:27:31.276666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1749428747", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f13c22c-2a0f-40fe-b7ea-9f76b204e323"}], "security_groups": [{"name": "tempest-securitygroup--375449232"}], "key_name": "tempest-keypair-1407032701", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:31.464517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] validate_networks() for [('7f13c22c-2a0f-40fe-b7ea-9f76b204e323', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:27:32.136143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:27:32.136682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:27:32.137253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:27:32.138524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:27:32.139052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:27:32.156536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:32.164334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:32.165084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:32.167684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:32.168436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:32.170548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:32.236616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Getting quotas for project e3e70c09a5854575a46fa9e94da394e4. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:27:32.251113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Getting quotas for user f8e91011b75740dcb72369ca714c8e3d and project e3e70c09a5854575a46fa9e94da394e4. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:27:32.295988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:27:32.298640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:27:32.381008 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-172032a7-3fa4-4f8d-8243-7c2f6728ba69 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.487447 Oct 04 11:27:32.394696 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1330/5268] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:27:32.413188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3d1ecd5b-993a-4cff-994f-c68702a39ba0 req-ca76d1c2-b54d-43e7-915f-d5ec03cb6083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e91bd8b-19e4-4456-8084-50307aaeb6c1", "name": "network-vif-deleted", "tag": "583c2445-bb51-4d85-b471-40271b81635a"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:32.449866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d1ecd5b-993a-4cff-994f-c68702a39ba0 req-ca76d1c2-b54d-43e7-915f-d5ec03cb6083 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:32.450389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d1ecd5b-993a-4cff-994f-c68702a39ba0 req-ca76d1c2-b54d-43e7-915f-d5ec03cb6083 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:32.452946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d1ecd5b-993a-4cff-994f-c68702a39ba0 req-ca76d1c2-b54d-43e7-915f-d5ec03cb6083 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:32.517846 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3d1ecd5b-993a-4cff-994f-c68702a39ba0 req-ca76d1c2-b54d-43e7-915f-d5ec03cb6083 service nova] Creating event network-vif-deleted:583c2445-bb51-4d85-b471-40271b81635a for instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 on n-h2-791135-8 Oct 04 11:27:32.531588 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3d1ecd5b-993a-4cff-994f-c68702a39ba0 req-ca76d1c2-b54d-43e7-915f-d5ec03cb6083 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133475 Oct 04 11:27:32.532729 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1331/5269] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:32.541088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:32.542142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:32.569080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:32.569599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:32.570032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:32.570733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:32.571183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:32.571615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:32.589269 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] HTTP exception thrown: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Request method failure captured: Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 HTTP/1.1 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBcRm5fMmd_EVS40xoP_6ujvxJhJGcWUnyb0ezXFh6XbOVVE9KOLWSPuCxF3P3szZtLTaMBGvPk3SF6c5KW01hB-5G6D9jILmYuTsHzXuWqea0KRtXelLhZ4Cz7ORAMItKzh14zR7PjKbruLWNVet7I-bFM4PXMPpFj1kUPKsZVqzbI Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bca571652d66413ab8000101c4e51262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bca571652d66413ab8000101c4e51262"}]}] Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 12f16f7befa14be687888f0b00588c6b Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '7e91bd8b-19e4-4456-8084-50307aaeb6c1'} Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:32.591789 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:32.596154 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:32.596154 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:32.596154 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:32.596154 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:27:32.596154 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:27:32.596154 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:32.596154 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:32.598092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Returning 404 to user: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:27:32.599140 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7f529db-7590-4354-a49f-6f3a5e511655 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 404 len: 111 microversion: 2.1 time: 0.065144 Oct 04 11:27:32.600186 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1332/5270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:32 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:27:32.607952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9c25c55-a945-43f7-9a5a-8b7d6e21f745 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:32.609035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9c25c55-a945-43f7-9a5a-8b7d6e21f745 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:33.147378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9c25c55-a945-43f7-9a5a-8b7d6e21f745 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:33.148406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:27:33.150268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:27:33.150892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:27:33.151239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:27:33.153441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:27:33.168224 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9c25c55-a945-43f7-9a5a-8b7d6e21f745 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1214 microversion: 2.1 time: 0.566718 Oct 04 11:27:33.168874 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1333/5271] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:32 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1214 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:33.181510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:33.181510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:33.181510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:33.181510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:33.181510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:33.181510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:33.183074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-daec1d31-7c8e-48f4-8604-177b7c0e0a63 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '.version_select at 0x7f71d8764a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:33.218950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:27:33.229397 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-daec1d31-7c8e-48f4-8604-177b7c0e0a63 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096390986" status: 202 len: 0 microversion: 2.1 time: 0.058968 Oct 04 11:27:33.230601 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1334/5272] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:27:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096390986 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:27:33.231382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for user e91bdb8e1e364219bc1fa98517eb19d9 and project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:27:33.245867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:27:33.249164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:27:33.300933 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [cc9aa9f9-cff9-4930-b3ec-a6327100d9ff] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 11:27:34.197875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cbf4c6e7-564e-4b61-a4a1-ee4ca852f8ed tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:34.199508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cbf4c6e7-564e-4b61-a4a1-ee4ca852f8ed tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:34.205274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:34.308620 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [cc9aa9f9-cff9-4930-b3ec-a6327100d9ff] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34440. Oct 04 11:27:34.324466 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c614a0f5-902a-4aaf-accd-1a7ae1321eb8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.047178 Oct 04 11:27:34.325510 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3939/5273] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:27:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 3054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:27:34.332703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cbf4c6e7-564e-4b61-a4a1-ee4ca852f8ed tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:34.346516 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cbf4c6e7-564e-4b61-a4a1-ee4ca852f8ed tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1214 microversion: 2.1 time: 0.157008 Oct 04 11:27:34.347997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9423b138-fa9c-43a8-8c9b-54284ffa5c64 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:34.349791 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1335/5274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:34 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:27:34.354443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9423b138-fa9c-43a8-8c9b-54284ffa5c64 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:34.632656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9423b138-fa9c-43a8-8c9b-54284ffa5c64 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:34.640259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9423b138-fa9c-43a8-8c9b-54284ffa5c64 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1242 microversion: 2.1 time: 0.306632 Oct 04 11:27:34.649965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3940/5275] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:34 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1242 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:35.377848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:35.379156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:35.403076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:35.404182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:35.412570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:35.413691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:35.415732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:35.416980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:35.440877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=92 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:35.675428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:35.676837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:35.682552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:35.696880 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44899040-39b1-4fa6-8a28-fe5760d3cbf2 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1218 microversion: 2.1 time: 0.325269 Oct 04 11:27:35.701093 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1336/5276] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:35 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1218 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:35.719735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:35.720564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:35.722136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:35.728426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:35.733170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:35.736940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:36.123498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:36.136987 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-05be0e9b-6d7d-4f1f-8bba-676845ec1f74 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1238 microversion: 2.1 time: 0.472703 Oct 04 11:27:36.138743 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3941/5277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:35 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1238 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:36.724746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:36.725377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:36.738585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:36.739079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:36.739544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:36.740206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:36.744258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:36.744735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:36.882054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:36.900960 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b881321-acf8-40e4-9dd6-9c240f3044a8 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1284 microversion: 2.1 time: 0.178745 Oct 04 11:27:36.902108 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1337/5278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:36 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:37.161090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:37.161864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:37.183735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:37.184960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:37.185426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:37.191396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:37.191975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:37.192424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:37.463602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:37.478668 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5fe67f9-864c-4b31-a9bc-9dd6e1b13954 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1302 microversion: 2.1 time: 0.320678 Oct 04 11:27:37.480552 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3942/5279] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:37 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1302 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:37.935421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:37.936551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:37.950951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:37.952897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:37.953879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:37.957772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:37.959109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:37.960514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:38.217475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:38.225697 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a44b0a94-4f70-47b6-bcbc-09e206e43d3c tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1272 microversion: 2.1 time: 0.296948 Oct 04 11:27:38.226312 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1338/5280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:37 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:38.507363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:38.509289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:38.527187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:38.528746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:38.533322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:38.535663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:38.538679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:38.543368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:38.944495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:38.966324 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-421302f2-df99-41ca-8b1a-fc9cb5926d7e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1300 microversion: 2.1 time: 0.463877 Oct 04 11:27:38.984822 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3943/5281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:38 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1300 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:39.252776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:39.253991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:39.280573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:39.281417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:39.287003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:39.290046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:39.290722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:39.291428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:39.713054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:39.737488 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e411cfa-7298-4a87-94a4-4dabb83e11dc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1272 microversion: 2.1 time: 0.475088 Oct 04 11:27:39.738442 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1339/5282] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:39 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1272 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:39.996510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:39.998180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:40.016300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:40.018010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:40.018923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:40.020684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:40.021309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:40.022371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:40.562377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:40.571158 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-23e2806b-ad19-4bfd-a529-59658ba8ff84 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1367 microversion: 2.1 time: 0.579380 Oct 04 11:27:40.572320 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3944/5283] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:39 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1367 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:40.766273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:40.767597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:40.785155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:40.788166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:40.788785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:40.789747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:40.790350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:40.790965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:41.428477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:41.436948 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bcc62834-44b2-42fc-86fb-6c9d04aad8ff tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1314 microversion: 2.1 time: 0.676549 Oct 04 11:27:41.449271 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1340/5284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:40 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:41.596220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:41.596855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:41.610294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:41.619086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:41.619629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:41.622778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:41.623734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:41.626299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:42.015375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:42.024368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bec5b220-ad80-49c7-a426-13dcc260d187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1367 microversion: 2.1 time: 0.432312 Oct 04 11:27:42.031890 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3945/5285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:41 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:42.273343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3584daac-1d5d-40c1-8904-2f6980b62222 req-959b6052-364b-45bf-a3d4-8fb847f59695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fee352b-0863-45a2-8361-595490b5b2f3", "tag": "b736abb9-9c40-47a6-affd-8df9d3423e59"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:42.299447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:42.306765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3584daac-1d5d-40c1-8904-2f6980b62222 req-959b6052-364b-45bf-a3d4-8fb847f59695 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:42.307296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3584daac-1d5d-40c1-8904-2f6980b62222 req-959b6052-364b-45bf-a3d4-8fb847f59695 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:42.307739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3584daac-1d5d-40c1-8904-2f6980b62222 req-959b6052-364b-45bf-a3d4-8fb847f59695 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:42.351978 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3584daac-1d5d-40c1-8904-2f6980b62222 req-959b6052-364b-45bf-a3d4-8fb847f59695 service nova] Creating event network-changed:b736abb9-9c40-47a6-affd-8df9d3423e59 for instance 5fee352b-0863-45a2-8361-595490b5b2f3 on n-h1-791135-8 Oct 04 11:27:42.368563 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3584daac-1d5d-40c1-8904-2f6980b62222 req-959b6052-364b-45bf-a3d4-8fb847f59695 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101342 Oct 04 11:27:42.398138 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1341/5286] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:27:42.473589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:42.484711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:42.494478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:42.495200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:42.496132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:42.497674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:42.499075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:42.499689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:43.063943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:43.064660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:43.079292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:43.082647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:43.084164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:43.087688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:43.090050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:43.112221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:43.206595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:43.457739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:43.472905 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-41cae741-98db-47b8-a4cd-95a52a74d112 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1314 microversion: 2.1 time: 1.004073 Oct 04 11:27:43.476207 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3946/5287] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:42 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1314 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:43.653241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-63b4698a-23ca-4562-9caa-79965ef1a8d6 req-244402fc-b98b-40a6-9caa-2caa7a5f4947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d47fb7-17be-4de1-a5ff-c88b9cd107a6", "tag": "136c3b32-6b00-442a-9279-5c3a724d51e7"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:43.675020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-63b4698a-23ca-4562-9caa-79965ef1a8d6 req-244402fc-b98b-40a6-9caa-2caa7a5f4947 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:43.677713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-63b4698a-23ca-4562-9caa-79965ef1a8d6 req-244402fc-b98b-40a6-9caa-2caa7a5f4947 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:43.678520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-63b4698a-23ca-4562-9caa-79965ef1a8d6 req-244402fc-b98b-40a6-9caa-2caa7a5f4947 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:43.707679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-63b4698a-23ca-4562-9caa-79965ef1a8d6 req-244402fc-b98b-40a6-9caa-2caa7a5f4947 service nova] Creating event network-changed:136c3b32-6b00-442a-9279-5c3a724d51e7 for instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 on n-h1-791135-8 Oct 04 11:27:43.718906 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-63b4698a-23ca-4562-9caa-79965ef1a8d6 req-244402fc-b98b-40a6-9caa-2caa7a5f4947 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076345 Oct 04 11:27:43.720028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3947/5288] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:43.760286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:43.773610 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ebaea56-9f7d-475b-a3a6-2cfef3c2d186 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1367 microversion: 2.1 time: 0.715663 Oct 04 11:27:43.775539 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1342/5289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:43 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1367 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:44.504694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:44.505620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:44.514303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:44.519333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:44.519968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:44.522048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:44.524516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:44.525041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:44.583519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:44.640534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:44.800828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:44.810516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:44.811306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:44.836110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:44.836527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:44.836957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:44.837689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:44.838301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:44.838906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:45.186077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:45.194423 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-faad7bc5-24dd-44ad-be90-26e162645bfb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1367 microversion: 2.1 time: 0.397786 Oct 04 11:27:45.197788 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1343/5290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:44 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:45.199003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:45.220070 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-62fc6729-068a-4651-8b6c-1297c0056adf tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1314 microversion: 2.1 time: 0.719656 Oct 04 11:27:45.220832 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3948/5291] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:44 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:46.220231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:46.220847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:46.233697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:46.236597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:46.240347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:46.241533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:46.243834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:46.251127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:46.252319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:46.256789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:46.272005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:46.273289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:46.276635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:46.277672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:46.285836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:46.286764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:46.656296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:46.672551 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6070daa3-499a-4a64-bb47-e626167d0efa tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1314 microversion: 2.1 time: 0.422139 Oct 04 11:27:46.674752 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3949/5292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:46 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:27:46.760029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:46.771862 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7239c857-90eb-475e-bd96-47d8c2d66011 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1367 microversion: 2.1 time: 0.552549 Oct 04 11:27:46.773590 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1344/5293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:46 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:47.700329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:47.701722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:47.720437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:47.724042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:47.724745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:47.730366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:47.731650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:47.734092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:47.797583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:47.798263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:47.814111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:47.817268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:47.823253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:47.827001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:47.827604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:47.828141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:48.149279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:48.164622 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae0d2bd5-8d60-42fd-a937-408c163ae8cc tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1314 microversion: 2.1 time: 0.472168 Oct 04 11:27:48.165233 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3950/5294] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:47 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:27:48.192328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:48.193668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:48.223566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:48.224488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:48.228235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:48.235593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:48.238026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:48.240402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:48.272567 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] HTTP exception thrown: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Request method failure captured: Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 HTTP/1.1 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcRm5fMmd_EVS40xoP_6ujvxJhJGcWUnyb0ezXFh6XbOVVE9KOLWSPuCxF3P3szZtLTaMBGvPk3SF6c5KW01hB-5G6D9jILmYuTsHzXuWqea0KRtXelLhZ4Cz7ORAMItKzh14zR7PjKbruLWNVet7I-bFM4PXMPpFj1kUPKsZVqzbI Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bca571652d66413ab8000101c4e51262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bca571652d66413ab8000101c4e51262"}]}] Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 12f16f7befa14be687888f0b00588c6b Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '7e91bd8b-19e4-4456-8084-50307aaeb6c1'} Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:27:48.282811 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.287013 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.289115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Returning 404 to user: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:27:48.290337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-39870a84-f23a-4711-9d5f-fd899b349ea5 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 404 len: 111 microversion: 2.1 time: 0.124127 Oct 04 11:27:48.294361 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3951/5295] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:27:48 2022] DELETE /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:27:48.302107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:48.303459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 7e91bd8b-19e4-4456-8084-50307aaeb6c1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:48.319865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:48.322116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:48.322818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:48.330020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:48.330736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:48.331722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:48.361078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] HTTP exception thrown: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Request method failure captured: Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 HTTP/1.1 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcRm5fMmd_EVS40xoP_6ujvxJhJGcWUnyb0ezXFh6XbOVVE9KOLWSPuCxF3P3szZtLTaMBGvPk3SF6c5KW01hB-5G6D9jILmYuTsHzXuWqea0KRtXelLhZ4Cz7ORAMItKzh14zR7PjKbruLWNVet7I-bFM4PXMPpFj1kUPKsZVqzbI Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bca571652d66413ab8000101c4e51262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bca571652d66413ab8000101c4e51262"}]}] Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 12f16f7befa14be687888f0b00588c6b Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '7e91bd8b-19e4-4456-8084-50307aaeb6c1'} Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:48.365179 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.368695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:48.368695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:48.368695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:48.368695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:27:48.368695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:27:48.368695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. Oct 04 11:27:48.368695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:48.371234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Returning 404 to user: Instance 7e91bd8b-19e4-4456-8084-50307aaeb6c1 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:27:48.376638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff0e3d1d-f29e-414a-b8f0-323095297199 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1" status: 404 len: 111 microversion: 2.1 time: 0.080877 Oct 04 11:27:48.377517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3952/5296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:48 2022] GET /compute/v2.1/servers/7e91bd8b-19e4-4456-8084-50307aaeb6c1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:27:48.598891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3af2b88e-3a9d-487b-a6f6-f5ed1976692c req-cb10e25c-a376-4685-8563-5c3e39ed28dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fee352b-0863-45a2-8361-595490b5b2f3", "name": "network-vif-plugged", "status": "completed", "tag": "b736abb9-9c40-47a6-affd-8df9d3423e59"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:48.635644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:27:48.637555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3af2b88e-3a9d-487b-a6f6-f5ed1976692c req-cb10e25c-a376-4685-8563-5c3e39ed28dc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:48.642924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3af2b88e-3a9d-487b-a6f6-f5ed1976692c req-cb10e25c-a376-4685-8563-5c3e39ed28dc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:48.643477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3af2b88e-3a9d-487b-a6f6-f5ed1976692c req-cb10e25c-a376-4685-8563-5c3e39ed28dc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:48.693912 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3af2b88e-3a9d-487b-a6f6-f5ed1976692c req-cb10e25c-a376-4685-8563-5c3e39ed28dc service nova] Creating event network-vif-plugged:b736abb9-9c40-47a6-affd-8df9d3423e59 for instance 5fee352b-0863-45a2-8361-595490b5b2f3 on n-h1-791135-8 Oct 04 11:27:48.708583 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3af2b88e-3a9d-487b-a6f6-f5ed1976692c req-cb10e25c-a376-4685-8563-5c3e39ed28dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114275 Oct 04 11:27:48.713406 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3953/5297] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:49.196681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:49.197732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:49.221961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:49.222716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:49.225837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:49.226805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:49.227912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:49.229888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:49.643161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:49.661118 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a60a55ff-1ddc-44d8-81cf-23d0c5583f95 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1367 microversion: 2.1 time: 1.865906 Oct 04 11:27:49.661778 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1345/5298] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:47 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1367 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:49.797873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:49.812043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-448484f7-510e-4bab-bf00-895fbed5c545 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1314 microversion: 2.1 time: 0.621913 Oct 04 11:27:49.825529 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3954/5299] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:49 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:50.686402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:50.687043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:50.701340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:50.702280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:50.702992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:50.705243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:50.707388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:50.707999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:50.728370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4ed3cbb0-44e5-40aa-ab92-a1002ee55734 req-d37bca8a-948a-4719-a811-52334e8e35e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d47fb7-17be-4de1-a5ff-c88b9cd107a6", "name": "network-vif-plugged", "status": "completed", "tag": "136c3b32-6b00-442a-9279-5c3a724d51e7"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:50.747463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4ed3cbb0-44e5-40aa-ab92-a1002ee55734 req-d37bca8a-948a-4719-a811-52334e8e35e8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:50.748080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4ed3cbb0-44e5-40aa-ab92-a1002ee55734 req-d37bca8a-948a-4719-a811-52334e8e35e8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:50.748795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4ed3cbb0-44e5-40aa-ab92-a1002ee55734 req-d37bca8a-948a-4719-a811-52334e8e35e8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:50.790705 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4ed3cbb0-44e5-40aa-ab92-a1002ee55734 req-d37bca8a-948a-4719-a811-52334e8e35e8 service nova] Creating event network-vif-plugged:136c3b32-6b00-442a-9279-5c3a724d51e7 for instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 on n-h1-791135-8 Oct 04 11:27:50.808116 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4ed3cbb0-44e5-40aa-ab92-a1002ee55734 req-d37bca8a-948a-4719-a811-52334e8e35e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082763 Oct 04 11:27:50.817096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3955/5300] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:50.846836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:50.847485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:50.862957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:50.863477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:50.865635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:50.871393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:50.871914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:50.872372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:51.432676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:51.447299 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c267df8c-030e-4b81-a5ba-88d8eb460a98 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1314 microversion: 2.1 time: 0.606370 Oct 04 11:27:51.449392 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3956/5301] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:50 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:27:51.578947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:51.601470 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ecf673c-fe30-4d20-a106-b345b20e299a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1557 microversion: 2.1 time: 0.916499 Oct 04 11:27:51.603740 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1346/5302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:50 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1557 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:51.627224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:51.627973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:51.644196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:51.644933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:51.645855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:51.647249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:51.647866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:51.648482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:51.814862 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b00a2a40-a703-4aad-b22d-f415f319e48b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.191602 Oct 04 11:27:51.816040 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3957/5303] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:27:51 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:52.476934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:52.477666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:52.499289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:52.501110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:52.501631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:52.502391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:52.507290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:52.509823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:53.350864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:53.364142 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4515d72c-2fce-47ce-916f-bb9961641f37 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1314 microversion: 2.1 time: 0.892304 Oct 04 11:27:53.385467 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1347/5304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:52 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:54.190530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:54.191634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:54.203837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:54.204409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:54.208387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:54.209731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:54.210268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:54.210762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:54.238120 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] HTTP exception thrown: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Request method failure captured: Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 HTTP/1.1 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBcRm5fMmd_EVS40xoP_6ujvxJhJGcWUnyb0ezXFh6XbOVVE9KOLWSPuCxF3P3szZtLTaMBGvPk3SF6c5KW01hB-5G6D9jILmYuTsHzXuWqea0KRtXelLhZ4Cz7ORAMItKzh14zR7PjKbruLWNVet7I-bFM4PXMPpFj1kUPKsZVqzbI Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bca571652d66413ab8000101c4e51262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bca571652d66413ab8000101c4e51262"}]}] Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 12f16f7befa14be687888f0b00588c6b Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2'} Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:27:54.244119 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.248964 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.254361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Returning 404 to user: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:27:54.255700 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68ce6bc5-9837-4d28-bcc6-530acfb84b39 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 404 len: 111 microversion: 2.1 time: 0.071927 Oct 04 11:27:54.260837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3958/5305] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:27:54 2022] DELETE /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:27:54.266140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:54.266767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] [instance: 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:54.280142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:54.280625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:54.281076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:54.288497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:54.288996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:54.289462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:54.333658 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] HTTP exception thrown: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Request method failure captured: Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 HTTP/1.1 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBcRm5fMmd_EVS40xoP_6ujvxJhJGcWUnyb0ezXFh6XbOVVE9KOLWSPuCxF3P3szZtLTaMBGvPk3SF6c5KW01hB-5G6D9jILmYuTsHzXuWqea0KRtXelLhZ4Cz7ORAMItKzh14zR7PjKbruLWNVet7I-bFM4PXMPpFj1kUPKsZVqzbI Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bca571652d66413ab8000101c4e51262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca571652d66413ab8000101c4e51262"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bca571652d66413ab8000101c4e51262"}]}] Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: bca571652d66413ab8000101c4e51262 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273394202 Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 12f16f7befa14be687888f0b00588c6b Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeTestJSON-273394202-project Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2'} Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:27:54.344326 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] Returning 404 to user: Instance 5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-035588bc-93f8-4cb2-8fb8-38c4d33f1e68 tempest-AttachVolumeTestJSON-273394202 tempest-AttachVolumeTestJSON-273394202-project] 10.222.0.23 "GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2" status: 404 len: 111 microversion: 2.1 time: 0.084484 Oct 04 11:27:54.352701 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1348/5306] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:54 2022] GET /compute/v2.1/servers/5db09aef-8c4e-42a9-8a0b-0f9a96b5eba2 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:27:54.390882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:54.392184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:54.407440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:54.408418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:54.409269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:54.410622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:54.411937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:54.414698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:54.953726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:54.969440 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d4205d8b-47e5-48da-b89d-ec6decb6ea1a tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1464 microversion: 2.1 time: 0.582965 Oct 04 11:27:54.970046 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3959/5307] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:54 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1464 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:55.059442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:55.059972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:55.080508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:55.081005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:55.084340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:55.084340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:55.084340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:55.084340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:55.178031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f6e260e7-dea6-479b-9633-5a299099f949 req-0165090a-5585-4e21-82c3-9b037fc341e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fee352b-0863-45a2-8361-595490b5b2f3", "tag": "b736abb9-9c40-47a6-affd-8df9d3423e59"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:55.201994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:27:55.212033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6e260e7-dea6-479b-9633-5a299099f949 req-0165090a-5585-4e21-82c3-9b037fc341e7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:55.212545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6e260e7-dea6-479b-9633-5a299099f949 req-0165090a-5585-4e21-82c3-9b037fc341e7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:55.212989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f6e260e7-dea6-479b-9633-5a299099f949 req-0165090a-5585-4e21-82c3-9b037fc341e7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:55.261018 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f6e260e7-dea6-479b-9633-5a299099f949 req-0165090a-5585-4e21-82c3-9b037fc341e7 service nova] Creating event network-changed:b736abb9-9c40-47a6-affd-8df9d3423e59 for instance 5fee352b-0863-45a2-8361-595490b5b2f3 on n-h1-791135-8 Oct 04 11:27:55.291077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f6e260e7-dea6-479b-9633-5a299099f949 req-0165090a-5585-4e21-82c3-9b037fc341e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108078 Oct 04 11:27:55.291288 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3960/5308] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:27:55.484007 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5fc33a2b-49b0-47fc-a82e-7682c88598a3 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "DELETE /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 204 len: 0 microversion: 2.1 time: 0.428720 Oct 04 11:27:55.495496 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1349/5309] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:27:55 2022] DELETE /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:27:55.495651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:55.496473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:55.506945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:55.513191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:55.514242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:55.515186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:55.515823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:55.517002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:56.139086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:56.152127 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b063e52-050f-475c-844c-a45116ee0d42 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1470 microversion: 2.1 time: 0.658380 Oct 04 11:27:56.165396 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3961/5310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:55 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1470 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:57.186162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:57.187542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:57.204017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:57.207525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:57.207525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:57.210475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:57.211312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:57.212342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:58.213147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:58.222964 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75819ad1-2f8d-4365-ba7b-3482d1469b1b tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1470 microversion: 2.1 time: 1.044892 Oct 04 11:27:58.238291 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1350/5311] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:57 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1470 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:27:59.045469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f43f9831-b04b-4dec-bbe4-2fc2f6be6206 req-45d2278b-9fa7-4117-ba3c-5ae483fcd2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d47fb7-17be-4de1-a5ff-c88b9cd107a6", "name": "network-vif-deleted", "tag": "136c3b32-6b00-442a-9279-5c3a724d51e7"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:27:59.065645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f43f9831-b04b-4dec-bbe4-2fc2f6be6206 req-45d2278b-9fa7-4117-ba3c-5ae483fcd2bf service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:59.067386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f43f9831-b04b-4dec-bbe4-2fc2f6be6206 req-45d2278b-9fa7-4117-ba3c-5ae483fcd2bf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:59.068134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f43f9831-b04b-4dec-bbe4-2fc2f6be6206 req-45d2278b-9fa7-4117-ba3c-5ae483fcd2bf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:59.083980 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f43f9831-b04b-4dec-bbe4-2fc2f6be6206 req-45d2278b-9fa7-4117-ba3c-5ae483fcd2bf service nova] Creating event network-vif-deleted:136c3b32-6b00-442a-9279-5c3a724d51e7 for instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 on n-h1-791135-8 Oct 04 11:27:59.101387 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f43f9831-b04b-4dec-bbe4-2fc2f6be6206 req-45d2278b-9fa7-4117-ba3c-5ae483fcd2bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062675 Oct 04 11:27:59.102881 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3962/5312] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:27:59.249656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:27:59.250222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:27:59.260721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:59.261211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:59.262273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:59.262983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:59.263436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:59.263858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:59.378371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:27:59.378902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:27:59.379354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:27:59.379920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lazy-loading 'fault' on Instance uuid 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:27:59.467727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8e91011b75740dcb72369ca714c8e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e70c09a5854575a46fa9e94da394e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:27:59.479148 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a34d0ad-882b-4c19-bc2e-5b22022e63fd tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 200 len: 1304 microversion: 2.1 time: 0.234971 Oct 04 11:27:59.485694 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1351/5313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:27:59 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 1304 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:28:00.505935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:00.506953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] [instance: 31d47fb7-17be-4de1-a5ff-c88b9cd107a6] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:00.525165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:00.525809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:00.526413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:00.527853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:00.528525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:00.529950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:00.563738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] HTTP exception thrown: Instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 could not be found. Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Request method failure captured: Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 HTTP/1.1 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBifrKRXYW4vTv3b2vFql_npe0CsSmaqIKhAh0aFTIWZR0JtW9ol2VHueqPbQoPNa0UD2EUOpg4ltWxPbEXSOyXifBoOl8OiCVp2NjYaBuEjTl10ohF2Xz8f7MFQDnTEJKJQOM2la6S8jiE1trtJS6ovsPOUvjePNDOThz9u7-AiA94 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: e3e70c09a5854575a46fa9e94da394e4 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesNegativeTest-307474208 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e3e70c09a5854575a46fa9e94da394e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3e70c09a5854575a46fa9e94da394e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e3e70c09a5854575a46fa9e94da394e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e3e70c09a5854575a46fa9e94da394e4"}]}] Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesNegativeTest-307474208 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: e3e70c09a5854575a46fa9e94da394e4 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesNegativeTest-307474208 Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesNegativeTest-307474208-project Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: f8e91011b75740dcb72369ca714c8e3d Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesNegativeTest-307474208-project Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 could not be found. Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '31d47fb7-17be-4de1-a5ff-c88b9cd107a6'} Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 could not be found. Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 could not be found. Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:28:00.569522 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:28:00.572992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:28:00.572992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:28:00.572992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:28:00.572992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:28:00.572992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:28:00.572992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 could not be found. Oct 04 11:28:00.572992 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:28:00.575478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] Returning 404 to user: Instance 31d47fb7-17be-4de1-a5ff-c88b9cd107a6 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:28:00.576590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ffda7c4-4cef-4c66-acd7-4b61093ac342 tempest-VolumesNegativeTest-307474208 tempest-VolumesNegativeTest-307474208-project] 10.222.0.23 "GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6" status: 404 len: 111 microversion: 2.1 time: 0.075756 Oct 04 11:28:00.579564 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3963/5314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:28:00 2022] GET /compute/v2.1/servers/31d47fb7-17be-4de1-a5ff-c88b9cd107a6 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:28:27.847737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:27.848877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:27.880801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:28:27.881706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:28:27.883654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:27.884263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:27.885756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:27.888598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:27.894320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:27.897970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:28.001649 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c75dd4a3-db7a-4315-9b62-6a5a3c71956f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/ips" status: 200 len: 149 microversion: 2.1 time: 0.157705 Oct 04 11:28:28.003248 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1352/5315] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:28:27 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/ips => generated 149 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:28:30.924397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "724a7e10-88c0-4c3a-86ea-c0edaedcf9e1"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:28:30.927190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:30.947884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=21 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:28:30.948812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=59 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:28:30.953956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:30.955036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:30.955501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:30.958528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:30.959017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:30.960368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:31.515528 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-498e54df-36a7-4f33-8074-1b92cc8b8b08 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.597154 Oct 04 11:28:31.516069 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3964/5316] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:28:30 2022] POST /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 194 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:28:48.230404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "724a7e10-88c0-4c3a-86ea-c0edaedcf9e1"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:28:48.241998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:48.265608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:28:48.267547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:28:48.298304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:48.299198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:48.299958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:48.300850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:48.302799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:48.306213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:48.481306 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Invalid volume: volume 724a7e10-88c0-4c3a-86ea-c0edaedcf9e1 is already attached to instances: 5fee352b-0863-45a2-8361-595490b5b2f3 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments HTTP/1.1 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 74 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: {"volumeAttachment": {"volumeId": "724a7e10-88c0-4c3a-86ea-c0edaedcf9e1"}} Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid volume: volume 724a7e10-88c0-4c3a-86ea-c0edaedcf9e1 is already attached to instances: 5fee352b-0863-45a2-8361-595490b5b2f3 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'server_id': '5fee352b-0863-45a2-8361-595490b5b2f3', 'body': {'volumeAttachment': {'volumeId': '724a7e10-88c0-4c3a-86ea-c0edaedcf9e1'}}} Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 724a7e10-88c0-4c3a-86ea-c0edaedcf9e1 is already attached to instances: 5fee352b-0863-45a2-8361-595490b5b2f3 Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:28:48.483285 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 724a7e10-88c0-4c3a-86ea-c0edaedcf9e1 is already attached to instances: 5fee352b-0863-45a2-8361-595490b5b2f3 Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 724a7e10-88c0-4c3a-86ea-c0edaedcf9e1 is already attached to instances: 5fee352b-0863-45a2-8361-595490b5b2f3 Oct 04 11:28:48.487750 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:28:48.492469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 400 to user: Invalid volume: volume 724a7e10-88c0-4c3a-86ea-c0edaedcf9e1 is already attached to instances: 5fee352b-0863-45a2-8361-595490b5b2f3 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:28:48.497488 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a799f33b-9a04-4826-9727-7c135026517b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.278645 Oct 04 11:28:48.499287 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1353/5317] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:28:48 2022] POST /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 174 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 11:28:48.641072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:28:48.643786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:28:48.666062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:48.668191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:48.694481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:48.695492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:48.696766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:48.700514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:48.701587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:48.702639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:48.881604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lazy-loading 'services' on Instance uuid 5fee352b-0863-45a2-8361-595490b5b2f3 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:28:49.026550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5fe7dd19-05fa-4f3e-9366-5a26ea089da3 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments/724a7e10-88c0-4c3a-86ea-c0edaedcf9e1" status: 202 len: 0 microversion: 2.1 time: 0.393896 Oct 04 11:28:49.027721 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3965/5318] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:28:48 2022] DELETE /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments/724a7e10-88c0-4c3a-86ea-c0edaedcf9e1 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:28:49.036339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:49.039672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:49.051134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:49.058921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:49.059288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:49.062393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:49.078245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:49.078999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:49.130915 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f412bf43-3325-495f-bc40-d7e09e376e98 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098780 Oct 04 11:28:49.132018 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1354/5319] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:28:49 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:28:50.145742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:50.148180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:50.164465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:50.166060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:50.166929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:50.167861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:50.168519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:50.169163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:50.257750 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72a0281d-d4f1-4dd7-bcea-b0665c71c55a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116810 Oct 04 11:28:50.258434 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3966/5320] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:28:50 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:28:51.271073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:51.273534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:51.287354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:51.287834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:51.288265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:51.301627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:51.302138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:51.302570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:51.399379 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35630327-f52d-4a53-b440-62a4490e0a2f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132083 Oct 04 11:28:51.400227 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1355/5321] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:28:51 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:28:52.412530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:52.415540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:52.433288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:52.434076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:52.434724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:52.435625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:52.436338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:52.440239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:52.506030 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18af5bac-5e48-4a42-a98c-72aae5b13ceb tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097649 Oct 04 11:28:52.507324 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3967/5322] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:28:52 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:28:53.519481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:53.522027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:53.535494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:53.565555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:53.566005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:53.566759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:53.567299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:53.567727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:53.644747 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2512161-4faf-4f70-9d09-a2840cf7cdf7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129367 Oct 04 11:28:53.645361 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1356/5323] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:28:53 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:28:54.658828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:54.661946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:54.689959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:54.695787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:54.712618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:54.717066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:54.729672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:54.730619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:54.816132 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d414fd96-5914-40a0-a387-fcc1b4f1f655 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162012 Oct 04 11:28:54.818123 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3968/5324] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:28:54 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:28:55.829605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:55.831870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:55.863396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:55.863899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:55.864636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:55.865306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:55.869551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:55.872782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:55.968394 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc2f6d0b-275f-4110-a9ff-71fee71619f0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142732 Oct 04 11:28:55.975818 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1357/5325] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:28:55 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:28:56.985239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:56.988679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:57.005986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:57.006674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:57.010253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:57.011316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:57.011952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:57.013083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:57.114608 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-38ce5959-6514-452e-a30f-2354004efb81 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134196 Oct 04 11:28:57.115990 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3969/5326] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:28:56 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:28:57.221406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:57.222522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:57.230721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:57.231507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:57.232099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:57.233329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:57.234060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:57.234828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:57.289027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:28:57.471197 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-995b7f82-78bc-40f0-ade3-7129e2144f50 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 204 len: 0 microversion: 2.1 time: 0.254448 Oct 04 11:28:57.484221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:57.484838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:57.487176 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1358/5327] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:28:57 2022] DELETE /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:28:57.492152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:57.493246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:57.494169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:57.495043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:57.495662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:57.496248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:57.897388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:28:57.909895 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-332de959-fb00-4077-a78c-7fee08d32525 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1681 microversion: 2.1 time: 0.430703 Oct 04 11:28:57.910771 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3970/5328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:28:57 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1681 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:28:58.953512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:28:58.955968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:28:58.983764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:58.986586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:58.988127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:58.989154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:28:58.991516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:28:58.993534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:28:59.538735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:28:59.568500 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9d8ede9-acd5-4373-9326-bd4da85e6576 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1681 microversion: 2.1 time: 0.638071 Oct 04 11:28:59.569651 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1359/5329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:28:58 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1681 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:00.594796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:00.596799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:00.607154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:00.608282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:00.608982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:00.609961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:00.610621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:00.611242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:01.000889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:01.011671 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31e67025-e597-4819-a87f-c53af6e11550 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1681 microversion: 2.1 time: 0.420958 Oct 04 11:29:01.014645 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3971/5330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:00 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1681 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:02.038498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:02.039232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:02.063010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:02.063688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:02.064790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:02.065771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:02.066456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:02.067027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:02.443226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:02.458107 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0964f2d-b333-49dd-b131-4f6088acab71 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 200 len: 1614 microversion: 2.1 time: 0.424061 Oct 04 11:29:02.481425 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1360/5331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:02 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 1614 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:02.537925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6d188f44-7703-40e3-adab-5195692991d2 req-7e77b4ea-b4e1-4340-b283-5cb8c13c8511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fee352b-0863-45a2-8361-595490b5b2f3", "name": "network-vif-deleted", "tag": "b736abb9-9c40-47a6-affd-8df9d3423e59"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:29:02.593034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d188f44-7703-40e3-adab-5195692991d2 req-7e77b4ea-b4e1-4340-b283-5cb8c13c8511 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:02.597016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d188f44-7703-40e3-adab-5195692991d2 req-7e77b4ea-b4e1-4340-b283-5cb8c13c8511 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:02.598898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d188f44-7703-40e3-adab-5195692991d2 req-7e77b4ea-b4e1-4340-b283-5cb8c13c8511 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:02.633399 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6d188f44-7703-40e3-adab-5195692991d2 req-7e77b4ea-b4e1-4340-b283-5cb8c13c8511 service nova] Creating event network-vif-deleted:b736abb9-9c40-47a6-affd-8df9d3423e59 for instance 5fee352b-0863-45a2-8361-595490b5b2f3 on n-h1-791135-8 Oct 04 11:29:02.645515 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6d188f44-7703-40e3-adab-5195692991d2 req-7e77b4ea-b4e1-4340-b283-5cb8c13c8511 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112609 Oct 04 11:29:02.648649 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3972/5332] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:29:03.490239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:03.490846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:03.508818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:03.510694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:03.557593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:03.578279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:03.578821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:03.579297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:03.664429 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 HTTP/1.1 Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '5fee352b-0863-45a2-8361-595490b5b2f3'} Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:29:03.672190 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:29:03.678731 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:29:03.678731 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:29:03.678731 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:29:03.678731 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:29:03.678731 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:29:03.678731 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:29:03.678731 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:29:03.678731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:29:03.679567 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d033489d-bed0-478e-aa0b-498854312131 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 404 len: 111 microversion: 2.1 time: 0.193558 Oct 04 11:29:03.688119 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1361/5333] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:03 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:29:03.691887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-211bfc38-4669-4206-9abe-fd918ae428c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '.version_select at 0x7f71cf2de8b0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:03.735853 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-211bfc38-4669-4206-9abe-fd918ae428c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407032701" status: 202 len: 0 microversion: 2.1 time: 0.049376 Oct 04 11:29:03.737165 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3973/5334] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407032701 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:29:07.745421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cd7483d3-f263-4907-b6c2-ee04a331b8e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: .version_select at 0x7f71cf84f8b0>, body: {"keypair": {"name": "tempest-keypair-526608304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9BM3XJNeF+KU+3lavqeJJVEiLk+VS9bHJq6XD6stqe8rKm+QE7E9nGJ3NHj4pMVjNYUszyV9IiyCGx4Z+5LBIAvziiGfQJZRQX96RyWF/U1wgZdqvpgDoTdoDpef4bVg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:29:07.790028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-cd7483d3-f263-4907-b6c2-ee04a331b8e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:29:07.806371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-cd7483d3-f263-4907-b6c2-ee04a331b8e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for user e91bdb8e1e364219bc1fa98517eb19d9 and project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:29:07.867815 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cd7483d3-f263-4907-b6c2-ee04a331b8e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126242 Oct 04 11:29:07.876026 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1362/5335] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:29:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:29:12.538438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1245763542", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f13c22c-2a0f-40fe-b7ea-9f76b204e323"}], "security_groups": [{"name": "tempest-securitygroup--654548780"}], "key_name": "tempest-keypair-526608304", "user_data": "}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:29:12.612781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:29:13.415048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] validate_networks() for [('7f13c22c-2a0f-40fe-b7ea-9f76b204e323', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:29:15.505902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:29:15.506874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:29:15.506992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:29:15.508117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:29:15.509773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:29:15.525545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:15.526421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:15.527042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:15.527976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:15.528665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:15.529289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:15.591620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:29:15.597778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Getting quotas for user e91bdb8e1e364219bc1fa98517eb19d9 and project 17a9efb9b22945df8f49cc263bb14bab. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:29:15.635110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:29:15.638073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:29:15.715044 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e6b5594-1344-456d-ab3b-9d65ce633cc1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.180619 Oct 04 11:29:15.729041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4bd86689-d2fd-43d2-bb7f-6a15456306c6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:15.730354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4bd86689-d2fd-43d2-bb7f-6a15456306c6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:15.735880 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3974/5336] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:29:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 3202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:29:15.738210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:29:15.860643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4bd86689-d2fd-43d2-bb7f-6a15456306c6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:15.872435 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4bd86689-d2fd-43d2-bb7f-6a15456306c6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1241 microversion: 2.1 time: 0.145587 Oct 04 11:29:15.881418 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1363/5337] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:15 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:16.896752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:16.897538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:16.912284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:16.918015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:16.918857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:16.919477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:16.920023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:16.930005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:17.113753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:17.127860 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-668fa144-4b2d-460b-b7af-bff685709080 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1293 microversion: 2.1 time: 0.235153 Oct 04 11:29:17.128990 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3975/5338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:16 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1293 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:18.156176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:18.156772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:18.172837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:18.173329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:18.173793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:18.174518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:18.174973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:18.175450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:18.356855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:18.366917 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a009bab-8c93-4bb3-b028-c6d88bd293fe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1299 microversion: 2.1 time: 0.214427 Oct 04 11:29:18.367460 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1364/5339] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:18 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:29:19.396442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:19.397129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:19.401057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:29:19.419128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:19.419653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:19.426051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:19.428409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:19.428930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:19.431308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:20.143211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:20.154198 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e701785-4480-4d4f-918f-14fef4314643 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1366 microversion: 2.1 time: 0.762261 Oct 04 11:29:20.157659 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3976/5340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:19 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1366 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:21.187298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:21.187927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:21.190726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:29:21.207923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:21.208432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:21.208878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:21.209738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:21.210080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:21.210512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:22.295654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:22.324482 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbaab388-203c-4a01-a735-2ffaed71093b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1366 microversion: 2.1 time: 1.141017 Oct 04 11:29:22.326798 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1365/5341] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:21 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1366 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:22.737289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bf3d55ad-d4ad-4ea2-9843-034fbefddf3a req-57b471ce-84d9-44f6-882a-b15b02a46440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2a1411-d5fa-4f87-ad65-601a44890324", "tag": "44fae003-834d-4743-bb2c-244e9490adb8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:29:22.767360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bf3d55ad-d4ad-4ea2-9843-034fbefddf3a req-57b471ce-84d9-44f6-882a-b15b02a46440 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:22.767858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bf3d55ad-d4ad-4ea2-9843-034fbefddf3a req-57b471ce-84d9-44f6-882a-b15b02a46440 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:22.768306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bf3d55ad-d4ad-4ea2-9843-034fbefddf3a req-57b471ce-84d9-44f6-882a-b15b02a46440 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:22.781292 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bf3d55ad-d4ad-4ea2-9843-034fbefddf3a req-57b471ce-84d9-44f6-882a-b15b02a46440 service nova] Creating event network-changed:44fae003-834d-4743-bb2c-244e9490adb8 for instance de2a1411-d5fa-4f87-ad65-601a44890324 on n-h2-791135-8 Oct 04 11:29:22.798734 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bf3d55ad-d4ad-4ea2-9843-034fbefddf3a req-57b471ce-84d9-44f6-882a-b15b02a46440 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067010 Oct 04 11:29:22.799915 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3977/5342] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:29:23.360134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:23.360898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:23.372660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:23.374675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:23.376583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:23.380394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:23.381142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:23.381877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:23.878327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:23.889797 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13c0065f-0915-4deb-9298-28278cd3d96a tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1366 microversion: 2.1 time: 0.533458 Oct 04 11:29:23.890418 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1366/5343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:23 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1366 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:24.920430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:24.921141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:24.944439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:24.949733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:24.950448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:24.951365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:24.953987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:24.956906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:25.352778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:25.366393 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a800ae04-20b2-4efb-a539-919353aed945 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1366 microversion: 2.1 time: 0.451441 Oct 04 11:29:25.368705 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3978/5344] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:24 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:26.395939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:26.397687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:26.405812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:29:26.407697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:26.408407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:26.409003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:26.410091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:26.410734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:26.411644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:26.890505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:26.907689 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-deadd256-cc4b-48a2-bd99-1d0b9a4abfe7 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1366 microversion: 2.1 time: 0.516629 Oct 04 11:29:26.914297 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1367/5345] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:26 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:27.934499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:27.935700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:27.960262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:29:27.961002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:29:27.964088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:27.974813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:27.975309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:27.976076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:27.976556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:27.976995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:28.905698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:28.924907 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69d05df5-1567-482e-8e7c-98ebf49d6acc tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1366 microversion: 2.1 time: 0.990380 Oct 04 11:29:28.926699 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3979/5346] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:27 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1366 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:29.953301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:29.954875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:29.968359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:29.969043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:29.970609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:29.973466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:29.974217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:29.978473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:30.320230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:30.339786 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-93458b6b-aa6d-4df4-b448-546d726743c9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1366 microversion: 2.1 time: 0.391378 Oct 04 11:29:30.340244 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1368/5347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:29 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:30.842170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-84107925-a4a7-4eaa-bafe-8f0a9204a77c req-a2fb9802-82d8-4f4f-97c8-fd1878b53488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2a1411-d5fa-4f87-ad65-601a44890324", "name": "network-vif-plugged", "status": "completed", "tag": "44fae003-834d-4743-bb2c-244e9490adb8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:29:30.853275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-84107925-a4a7-4eaa-bafe-8f0a9204a77c req-a2fb9802-82d8-4f4f-97c8-fd1878b53488 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:30.854107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-84107925-a4a7-4eaa-bafe-8f0a9204a77c req-a2fb9802-82d8-4f4f-97c8-fd1878b53488 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:30.854764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-84107925-a4a7-4eaa-bafe-8f0a9204a77c req-a2fb9802-82d8-4f4f-97c8-fd1878b53488 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:30.867481 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-84107925-a4a7-4eaa-bafe-8f0a9204a77c req-a2fb9802-82d8-4f4f-97c8-fd1878b53488 service nova] Creating event network-vif-plugged:44fae003-834d-4743-bb2c-244e9490adb8 for instance de2a1411-d5fa-4f87-ad65-601a44890324 on n-h2-791135-8 Oct 04 11:29:30.873778 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-84107925-a4a7-4eaa-bafe-8f0a9204a77c req-a2fb9802-82d8-4f4f-97c8-fd1878b53488 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035038 Oct 04 11:29:30.874742 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3980/5348] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:29:31.364520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:31.365743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:31.380662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:31.381027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:31.381491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:31.382202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:31.387357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:31.388707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:32.076704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:32.096060 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e0e1f84-7b3b-46c1-96e7-8a3970b0935b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1366 microversion: 2.1 time: 0.735520 Oct 04 11:29:32.096672 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1369/5349] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:31 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1366 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:33.125052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:33.125806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:33.141528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:33.142334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:33.143487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:33.145912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:33.147342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:33.150057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:34.301486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:29:34.319755 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71513ca5-5d42-4c8a-9c0a-e625d04e6b6b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1555 microversion: 2.1 time: 1.200483 Oct 04 11:29:34.321772 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3981/5350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:29:33 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1555 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:29:34.346031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:29:34.346528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:29:34.357440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:34.357930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:34.358371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:34.364928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:34.367289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:34.371109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:34.666441 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fda9cd37-83ee-48cb-a642-efe49569811b tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.325247 Oct 04 11:29:34.667323 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1370/5351] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:29:34 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-interface => generated 284 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:29:39.694731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f043dbee-9af5-42f1-9f19-3c1f4bf7fa2c req-cf49a827-7ef2-464e-9e65-b73e971f7d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2a1411-d5fa-4f87-ad65-601a44890324", "tag": "44fae003-834d-4743-bb2c-244e9490adb8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:29:39.727697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f043dbee-9af5-42f1-9f19-3c1f4bf7fa2c req-cf49a827-7ef2-464e-9e65-b73e971f7d5c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:29:39.728452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f043dbee-9af5-42f1-9f19-3c1f4bf7fa2c req-cf49a827-7ef2-464e-9e65-b73e971f7d5c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:29:39.729234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f043dbee-9af5-42f1-9f19-3c1f4bf7fa2c req-cf49a827-7ef2-464e-9e65-b73e971f7d5c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:29:39.751661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f043dbee-9af5-42f1-9f19-3c1f4bf7fa2c req-cf49a827-7ef2-464e-9e65-b73e971f7d5c service nova] Creating event network-changed:44fae003-834d-4743-bb2c-244e9490adb8 for instance de2a1411-d5fa-4f87-ad65-601a44890324 on n-h2-791135-8 Oct 04 11:29:39.768660 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f043dbee-9af5-42f1-9f19-3c1f4bf7fa2c req-cf49a827-7ef2-464e-9e65-b73e971f7d5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077746 Oct 04 11:29:39.769987 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3982/5352] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:30:40.130906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=11 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:30:40.132935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=40 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:30:40.157125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:30:40.165731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:30:40.206959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:30:40.207460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:30:40.207899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:30:40.208606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:30:40.209116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:30:40.210079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:30:40.329527 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef96c1bb-71d7-4fce-a3c6-9fb7fa550ca5 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/ips" status: 200 len: 149 microversion: 2.1 time: 0.203665 Oct 04 11:30:40.330040 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1371/5353] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:30:40 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/ips => generated 149 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:30:43.794556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=13 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:30:43.804903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=38 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:30:43.816708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d2a3278-409e-4964-9c06-ef2996cfc530"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:30:43.819759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:30:43.829095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:30:43.829781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:30:43.830474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:30:43.831309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:30:43.831872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:30:43.832413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:30:44.448125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3681b4b2-9c7c-4613-9fc2-58e64a1fad9f tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "POST /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.657272 Oct 04 11:30:44.454842 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3983/5354] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:30:43 2022] POST /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:01.945985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:01.947514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:01.950808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:01.954456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:01.981949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:01.982764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:01.983575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:01.984474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:01.985102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:01.985875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:02.690711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lazy-loading 'services' on Instance uuid de2a1411-d5fa-4f87-ad65-601a44890324 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:31:02.947556 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15c0715b-482d-4cbb-9349-48ef48bbdeb6 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments/6d2a3278-409e-4964-9c06-ef2996cfc530" status: 202 len: 0 microversion: 2.1 time: 1.006236 Oct 04 11:31:02.968780 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1372/5355] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:31:01 2022] DELETE /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments/6d2a3278-409e-4964-9c06-ef2996cfc530 => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:31:02.974694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:02.975751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:02.982116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:02.992190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:03.011664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:03.016356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:03.020657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:03.023061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:03.025652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:03.030635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:03.158123 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f783b52-8a3a-428f-adb1-c40d10ef9302 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183146 Oct 04 11:31:03.166555 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3984/5356] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:02 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:04.173025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:04.175598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:04.198027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:04.198516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:04.211663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:04.212672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:04.219050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:04.220217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:04.352240 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80d1686d-2a33-4bb6-a658-54080182f256 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179791 Oct 04 11:31:04.353975 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1373/5357] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:04 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:05.366777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:05.369692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:05.393260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:05.432523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:05.433265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:05.441222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:05.442858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:05.464310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:05.599456 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d69e1f96-eba8-4ad4-8919-91ba6f296187 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238162 Oct 04 11:31:05.604322 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3985/5358] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:05 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:06.615618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:06.619359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:06.638030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:06.640817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:06.644371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:06.647456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:06.648103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:06.650315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:06.732492 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0cebbb8-4cbe-413b-97aa-536515d66327 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124176 Oct 04 11:31:06.745791 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1374/5359] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:06 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:07.748511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:07.751457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:07.778792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:07.779341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:07.782528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:07.795523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:07.797798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:07.798696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:07.895121 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b48f437-534e-464e-925a-8bc003ded77d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152485 Oct 04 11:31:07.904897 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3986/5360] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:07 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:08.908103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:08.910472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:08.946703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:08.947749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:08.948498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:08.949485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:08.950164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:08.950809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:09.032399 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b4bc4c1e-7e7b-4be9-a141-6ba6f6fce250 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128073 Oct 04 11:31:09.033737 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1375/5361] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:08 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:10.047210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:10.051654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:10.096843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:10.097391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:10.097837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:10.098563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:10.107752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:10.108260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:10.208784 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a413c79a-9501-4132-9a10-cb125f6b28c1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166378 Oct 04 11:31:10.209420 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3987/5362] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:10 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:11.228003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:11.230428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:11.253768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:11.254613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:11.255314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:11.256225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:11.256862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:11.257298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:11.327527 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f693556-2f05-4e18-967c-477576334bca tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109005 Oct 04 11:31:11.328802 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1376/5363] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:11 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:12.341266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:12.343911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:12.361398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:12.366734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:12.368906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:12.369870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:12.371831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:12.374083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:12.420567 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9a29836-ccc9-4765-b4d0-57a76b8920e8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084273 Oct 04 11:31:12.422270 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1377/5364] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:12 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:31:12.457500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b1b119a2-1ef2-4cdd-957d-7ecc14acd151 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Action: 'create', calling method: .version_select at 0x7f71cefcc1f0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-415824212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuTnhdSyNv8XtKZwRW+K4Lr0lliUMgl8wtzT1rmAKMqlIM5CFQsVdrrtV6tuzDebGzPRBoKrXvkAMznf5MDx7ZrDTP4ylD4lxH1ZyLfDozrC6+ove+0TW5Mg7t3WP06/A=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:31:12.502338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b1b119a2-1ef2-4cdd-957d-7ecc14acd151 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Getting quotas for project 13aa4682314a4017b0108b637bb85b1b. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:31:12.512277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-b1b119a2-1ef2-4cdd-957d-7ecc14acd151 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Getting quotas for user e47b8844a79f4214ac9afeece1e9b2bc and project 13aa4682314a4017b0108b637bb85b1b. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:31:12.542407 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b1b119a2-1ef2-4cdd-957d-7ecc14acd151 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.458442 Oct 04 11:31:12.543608 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3988/5365] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:31:12 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:13.434254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:13.436421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:13.446043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:13.446451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:13.446887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:13.447597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:13.448047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:13.448473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:13.520085 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e2ce2a6c-e198-4b5a-8bbb-9b7264fe8484 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089717 Oct 04 11:31:13.525444 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1378/5366] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:13 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:14.534926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:14.538031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:14.547472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:14.548224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:14.548991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:14.550012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:14.550704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:14.551365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:14.616343 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8e4fe1f-8497-4937-997a-d9f9ba3caf9d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087193 Oct 04 11:31:14.623666 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3989/5367] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 11:31:14 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 11:31:14.727621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:14.728205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:14.736096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:14.736793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:14.737404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:14.738962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:14.740460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:14.741061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:14.770587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:31:14.951548 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-629f62ab-fbf7-4962-93a0-3907447d1653 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 204 len: 0 microversion: 2.1 time: 0.226431 Oct 04 11:31:14.953498 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1379/5368] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:31:14 2022] DELETE /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:31:14.962826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:14.963460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:14.977701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:14.978202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:14.978642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:14.979360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:14.979819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:14.980250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:15.383465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:15.400967 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be423c48-a1c4-46d9-a428-c1fc6a677b0d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1680 microversion: 2.1 time: 0.442717 Oct 04 11:31:15.403890 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3990/5369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:14 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1680 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:16.428056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:16.429755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:16.442851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:16.448681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:16.449595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:16.450542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:16.451176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:16.451773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:16.979177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:16.994843 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3bd4184-64a5-47a4-9e74-2fd00a61322d tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1680 microversion: 2.1 time: 0.570621 Oct 04 11:31:16.995374 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1380/5370] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:16 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1680 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:18.028247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:18.028887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:18.040161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:18.040659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:18.041104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:18.041850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:18.042303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:18.047059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:19.089166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:19.113966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4ab96e7-087b-4b29-b2de-e5d558a2623e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1680 microversion: 2.1 time: 1.089850 Oct 04 11:31:19.114887 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3991/5371] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:18 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1680 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:20.140512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:20.141291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:20.155337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:20.158753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:20.159428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:20.160289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:20.161032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:20.163717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:20.925620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:20.934908 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1dc5cd75-b81c-4f7b-878b-1a0e743cfffe tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1613 microversion: 2.1 time: 0.798646 Oct 04 11:31:20.941448 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1381/5372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:20 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1613 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:21.970552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:21.971293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:21.991547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:21.992048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:21.996797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:22.002932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:22.005910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:22.007135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:22.518957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:22.522366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:22.549825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-224a5454-7cc4-4270-932e-0e193a6b600e tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1613 microversion: 2.1 time: 0.580882 Oct 04 11:31:22.573125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3992/5373] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:21 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1613 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:23.578203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:23.578851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:23.592912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:23.593438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:23.593883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:23.594597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:23.595069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:23.595476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:23.919640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2e970c80-9e78-4a96-b783-83d295cb0162 req-9545cbe0-a79d-4f91-9893-4bc8d87998b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2a1411-d5fa-4f87-ad65-601a44890324", "name": "network-vif-deleted", "tag": "44fae003-834d-4743-bb2c-244e9490adb8"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:31:23.937515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2e970c80-9e78-4a96-b783-83d295cb0162 req-9545cbe0-a79d-4f91-9893-4bc8d87998b0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:23.938026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2e970c80-9e78-4a96-b783-83d295cb0162 req-9545cbe0-a79d-4f91-9893-4bc8d87998b0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:23.938476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2e970c80-9e78-4a96-b783-83d295cb0162 req-9545cbe0-a79d-4f91-9893-4bc8d87998b0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:23.966102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2e970c80-9e78-4a96-b783-83d295cb0162 req-9545cbe0-a79d-4f91-9893-4bc8d87998b0 service nova] Creating event network-vif-deleted:44fae003-834d-4743-bb2c-244e9490adb8 for instance de2a1411-d5fa-4f87-ad65-601a44890324 on n-h2-791135-8 Oct 04 11:31:23.979252 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2e970c80-9e78-4a96-b783-83d295cb0162 req-9545cbe0-a79d-4f91-9893-4bc8d87998b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175874 Oct 04 11:31:23.985617 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3993/5374] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:24.554075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91bdb8e1e364219bc1fa98517eb19d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9efb9b22945df8f49cc263bb14bab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:24.579354 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-811b758a-34d2-4d5a-8d85-75d60401f501 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 200 len: 1613 microversion: 2.1 time: 1.006985 Oct 04 11:31:24.584223 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1382/5375] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:23 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 1613 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:25.608270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:25.609144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:25.626310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:25.627044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:25.627663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:25.628604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:25.629220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:25.630450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:25.647978 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 HTTP/1.1 Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'de2a1411-d5fa-4f87-ad65-601a44890324'} Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:25.649984 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:25.654940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:25.654940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:25.654940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:25.654940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:25.654940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:25.654940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:25.654940 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:25.656789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:25.657933 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8ad2ada-3878-42c1-b560-dcd5df40b191 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 404 len: 111 microversion: 2.1 time: 0.054255 Oct 04 11:31:25.659055 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3994/5376] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:25 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:25.674914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f5895ca-ceec-4873-8891-5998a5a3549c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '.version_select at 0x7f71d4c08af0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:25.716670 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f5895ca-ceec-4873-8891-5998a5a3549c tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526608304" status: 202 len: 0 microversion: 2.1 time: 0.051017 Oct 04 11:31:25.729527 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1383/5377] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 4 11:31:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526608304 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:31:32.761310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:32.761856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:32.775571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:32.776119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:32.776573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:32.777313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:32.779992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:32.780454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:32.817820 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 HTTP/1.1 Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'de2a1411-d5fa-4f87-ad65-601a44890324'} Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:32.819741 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6685f74-5e52-4771-b290-bc74434a3f30 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 404 len: 111 microversion: 2.1 time: 0.064673 Oct 04 11:31:32.827840 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3995/5378] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:31:32 2022] DELETE /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:32.830426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:32.831034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: de2a1411-d5fa-4f87-ad65-601a44890324] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:32.845830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:32.850299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:32.853260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:32.853903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:32.854813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:32.860447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:32.861089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:32.914528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:32.919005 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 HTTP/1.1 Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'de2a1411-d5fa-4f87-ad65-601a44890324'} Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:32.923088 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.928520 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:32.928520 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:32.928520 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:32.928520 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:32.928520 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:32.928520 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. Oct 04 11:31:32.928520 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:32.933958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance de2a1411-d5fa-4f87-ad65-601a44890324 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:32.939928 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa5a7398-7c09-48f3-952e-8b183a665bd1 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324" status: 404 len: 111 microversion: 2.1 time: 0.113286 Oct 04 11:31:32.943832 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1384/5379] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:32 2022] GET /compute/v2.1/servers/de2a1411-d5fa-4f87-ad65-601a44890324 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:37.799328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1961966359-access_point-960261164", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "1d154cd4-800e-4f4d-8d05-3b9ff23ffb31"}], "key_name": "tempest-TestSecurityGroupsBasicOps-415824212", "security_groups": [{"name": "tempest-secgroup_access--1081034962"}, {"name": "tempest-secgroup_general--785043305"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:31:37.867597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:38.471684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] validate_networks() for [('1d154cd4-800e-4f4d-8d05-3b9ff23ffb31', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:31:41.636640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:31:41.637234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:31:41.637569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:31:41.637978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:31:41.638387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:31:41.663733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:41.664201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:41.664652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:41.665429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:41.665923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:41.668908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:41.699679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=55 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:41.743294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Getting quotas for project 13aa4682314a4017b0108b637bb85b1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:31:41.764556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Getting quotas for user e47b8844a79f4214ac9afeece1e9b2bc and project 13aa4682314a4017b0108b637bb85b1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:31:41.810599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:31:41.824654 n-d-791135-8 devstack@n-api.service[122409]: WARNING nova.utils [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1961966359-access_point-960261164 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1961966359-ac Oct 04 11:31:41.825978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:31:41.955962 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ca911b4-b0f0-4f1c-81e9-33abf23c162d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 4.164951 Oct 04 11:31:41.959217 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3996/5380] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:31:37 2022] POST /compute/v2.1/servers => generated 457 bytes in 4167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:31:41.969380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-87e2ae03-36ad-4ef3-b86f-e6c6c22779ca tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:41.970011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-87e2ae03-36ad-4ef3-b86f-e6c6c22779ca tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:42.736251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-87e2ae03-36ad-4ef3-b86f-e6c6c22779ca tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:42.780667 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-87e2ae03-36ad-4ef3-b86f-e6c6c22779ca tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1293 microversion: 2.1 time: 0.815895 Oct 04 11:31:42.783151 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1385/5381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:41 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1293 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:43.398883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:43.400402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:43.419018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.422466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.423036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.425302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.426326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.429180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.466057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 HTTP/1.1 Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '5fee352b-0863-45a2-8361-595490b5b2f3'} Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:43.470028 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.474214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:43.474993 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-43d831aa-946d-448e-86a7-8d5bcd245d56 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 404 len: 111 microversion: 2.1 time: 0.079977 Oct 04 11:31:43.476545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3997/5382] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:31:43 2022] DELETE /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:43.483066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:43.483689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 5fee352b-0863-45a2-8361-595490b5b2f3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:43.493238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.494095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.494592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.495316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.495774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.496197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.512075 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 HTTP/1.1 Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '5fee352b-0863-45a2-8361-595490b5b2f3'} Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:43.514230 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.518753 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.518753 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:43.518753 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:43.518753 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:43.518753 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:43.518753 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. Oct 04 11:31:43.518753 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.520615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance 5fee352b-0863-45a2-8361-595490b5b2f3 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:43.521731 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-63b255d3-78f3-48f7-b553-2fc297732862 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3" status: 404 len: 111 microversion: 2.1 time: 0.042693 Oct 04 11:31:43.530694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:43.531745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:43.536866 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1386/5383] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:43 2022] GET /compute/v2.1/servers/5fee352b-0863-45a2-8361-595490b5b2f3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:43.538843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.539609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.540321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.541271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.541988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.542676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.574953 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 HTTP/1.1 Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '45bbf133-3fff-46bb-97bd-d20eebd081a4'} Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:43.576950 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.580928 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.602380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:43.607332 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-67ff9c76-165b-41da-9f3e-7374f2bd5cb0 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 404 len: 111 microversion: 2.1 time: 0.076829 Oct 04 11:31:43.616483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:43.617278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: 45bbf133-3fff-46bb-97bd-d20eebd081a4] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:43.620602 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3998/5384] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:31:43 2022] DELETE /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:43.626434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.627337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.628134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.630352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.631130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.631928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.658926 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 HTTP/1.1 Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '45bbf133-3fff-46bb-97bd-d20eebd081a4'} Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:43.661296 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.667052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:43.667052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:43.667052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:43.667052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:43.667052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:43.667052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. Oct 04 11:31:43.667052 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:43.669644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance 45bbf133-3fff-46bb-97bd-d20eebd081a4 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:43.670877 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-051ec6ca-783c-4260-8b5a-ab0d43a91506 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4" status: 404 len: 111 microversion: 2.1 time: 0.058882 Oct 04 11:31:43.672788 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1387/5385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:43 2022] GET /compute/v2.1/servers/45bbf133-3fff-46bb-97bd-d20eebd081a4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:43.807830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:43.808423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:43.825549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.827253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.827712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:43.828454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:43.828914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:43.829344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:44.025140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:44.037360 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91db1908-5c14-485e-b89f-3bcb9ca5add1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1289 microversion: 2.1 time: 0.232164 Oct 04 11:31:44.038001 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 3999/5386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:43 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1289 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:45.064304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:45.065534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:45.076908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:45.082188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:45.083097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:45.084019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:45.085924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:45.086555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:45.215247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:45.224439 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0019c4c2-773a-47a4-871d-f65ae7ae0f37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1351 microversion: 2.1 time: 0.165101 Oct 04 11:31:45.227656 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1388/5387] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:45 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:46.251099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:46.251720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:46.269024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:46.269948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:46.270658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:46.271538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:46.272006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:46.272449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:46.399940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:46.408359 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f992ac30-3982-4c5e-8d91-45001091cdf1 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1351 microversion: 2.1 time: 0.161342 Oct 04 11:31:46.426291 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4000/5388] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:46 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1351 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:47.443454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:47.444022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:47.455106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:47.461172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:47.462554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:47.463492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:47.464116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:47.464741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:47.785846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:47.797924 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8fc7ef6b-6e80-43ab-9dc7-da163230a067 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1351 microversion: 2.1 time: 0.359931 Oct 04 11:31:47.798738 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1389/5389] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:47 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1351 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:48.823273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:48.824457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:48.843650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:48.844463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:48.845091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:48.847915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:48.848822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:48.851877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:49.389151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:49.389776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:49.404864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:49.405378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:49.406036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:49.406934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:49.407560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:49.408158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:49.434452 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c HTTP/1.1 Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'b0218e8b-e3de-480e-8747-71c06ac4752c'} Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:49.439685 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.444929 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.447120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:49.449587 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-443b1404-3aac-4b45-a9d8-b679d02efda8 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 404 len: 111 microversion: 2.1 time: 0.064395 Oct 04 11:31:49.457381 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1390/5390] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:31:49 2022] DELETE /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:49.462682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:49.472682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] [instance: b0218e8b-e3de-480e-8747-71c06ac4752c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:49.481557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:49.482283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:49.487396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:49.488921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:49.489648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:49.490321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:49.527258 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] HTTP exception thrown: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Request method failure captured: Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c HTTP/1.1 Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBe0LvWLiFP9eE3y8fYKIRvcyiKG5HeK0fcABYTNB9KSdmXKOBP_O3mLXiUfPwGDcLwJuHh3lGqgUGHU8b8VU5fC4etVoT1JFxy8tVWs5i9wDYya1Yx_O1Jx6sEtn0sXceHQhcsklTZ5tGWdknL0Dshe0OnCyvM0KCxoktUb4jE1a2o Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9efb9b22945df8f49cc263bb14bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9efb9b22945df8f49cc263bb14bab"}]}] Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 17a9efb9b22945df8f49cc263bb14bab Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274597662 Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e91bdb8e1e364219bc1fa98517eb19d9 Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-AttachVolumeNegativeTest-1274597662-project Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'b0218e8b-e3de-480e-8747-71c06ac4752c'} Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:31:49.529212 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.533563 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:31:49.533563 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:31:49.533563 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:31:49.533563 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:31:49.533563 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:31:49.533563 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. Oct 04 11:31:49.533563 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:31:49.538251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:49.547167 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80bbecf5-8f80-431a-b4d1-7276d2f80a71 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 0.727553 Oct 04 11:31:49.548199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] Returning 404 to user: Instance b0218e8b-e3de-480e-8747-71c06ac4752c could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:31:49.549316 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e4129393-fab5-43a7-a5f1-c55cd5dfcee9 tempest-AttachVolumeNegativeTest-1274597662 tempest-AttachVolumeNegativeTest-1274597662-project] 10.222.0.23 "GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c" status: 404 len: 111 microversion: 2.1 time: 0.090393 Oct 04 11:31:49.562938 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4001/5391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:48 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:49.563341 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1391/5392] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:49 2022] GET /compute/v2.1/servers/b0218e8b-e3de-480e-8747-71c06ac4752c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:31:50.579345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:50.580564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:50.593471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:50.594189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:50.594809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:50.597766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:50.598425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:50.602504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:51.247535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:51.262048 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3700b178-fa07-4972-8d92-16a6d66b94ce tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 0.686449 Oct 04 11:31:51.262648 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4002/5393] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:50 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:51.509752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-38b89645-9267-45dc-8086-2c068b64324c req-71336534-6308-4487-a45f-4d9b5b4a9351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aece1df8-5ec3-4a71-ac9a-f3c048791ece", "tag": "3dc994ea-bae4-4161-8cac-8060ce61f32c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:31:51.533386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-38b89645-9267-45dc-8086-2c068b64324c req-71336534-6308-4487-a45f-4d9b5b4a9351 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:51.533856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-38b89645-9267-45dc-8086-2c068b64324c req-71336534-6308-4487-a45f-4d9b5b4a9351 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:51.534308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-38b89645-9267-45dc-8086-2c068b64324c req-71336534-6308-4487-a45f-4d9b5b4a9351 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:51.570118 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-38b89645-9267-45dc-8086-2c068b64324c req-71336534-6308-4487-a45f-4d9b5b4a9351 service nova] Creating event network-changed:3dc994ea-bae4-4161-8cac-8060ce61f32c for instance aece1df8-5ec3-4a71-ac9a-f3c048791ece on n-h2-791135-8 Oct 04 11:31:51.575582 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-38b89645-9267-45dc-8086-2c068b64324c req-71336534-6308-4487-a45f-4d9b5b4a9351 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070371 Oct 04 11:31:51.576724 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1392/5394] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:31:52.284739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:52.285473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:52.288428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:52.289246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:52.303437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:52.304250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:52.318200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:52.319256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:52.319984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:52.320649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:53.195606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:53.209406 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d071b7f-e307-40a2-a165-7b068adab922 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 0.929052 Oct 04 11:31:53.210440 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4003/5395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:52 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:54.230724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:31:54.235821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:54.236551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:54.249162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:54.253343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:54.254342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:54.257269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:54.257854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:54.258517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:55.107096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:55.120484 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ead6271d-a94d-4d43-96e6-dbdc5b50e5ed tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 0.889510 Oct 04 11:31:55.125370 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1393/5396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:54 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:56.151129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:56.152557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:56.162453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:56.163255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:56.165167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:56.166177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:56.166825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:56.167435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:56.533413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:56.545184 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f32d44e2-bce4-4571-9868-70bbf2e0e587 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 0.400489 Oct 04 11:31:56.562627 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4004/5397] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:56 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:57.568254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:57.569028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:57.580689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:57.581187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:57.581692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:57.582408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:57.582859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:57.583479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:58.662100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:31:58.687773 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24a39bd6-fc81-45f1-b7b0-1255436bdb37 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 1.122847 Oct 04 11:31:58.701615 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1394/5398] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:57 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:31:59.717821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:31:59.718643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:31:59.734051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:59.734596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:59.735062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:31:59.737409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:31:59.737409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:31:59.737409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:00.168747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:32:00.182623 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aeec264f-f60f-4865-b1d8-39a0e644fbb4 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 0.468028 Oct 04 11:32:00.183186 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4005/5399] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:31:59 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:32:01.213813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:01.215574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:32:01.229377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:01.231287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:01.232103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:01.256637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:01.257582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:01.258194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:02.523642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:32:02.532138 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe053dfa-5f2e-4540-b37a-24f33e0e7f38 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 1.326742 Oct 04 11:32:02.549780 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1395/5400] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:32:01 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:32:02.633979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a548bc78-fbb1-4467-9693-455a6257757f req-5737c3c3-0075-40a6-8692-ff20ff8963a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aece1df8-5ec3-4a71-ac9a-f3c048791ece", "name": "network-vif-plugged", "status": "completed", "tag": "3dc994ea-bae4-4161-8cac-8060ce61f32c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:32:02.667552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a548bc78-fbb1-4467-9693-455a6257757f req-5737c3c3-0075-40a6-8692-ff20ff8963a3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:02.671137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a548bc78-fbb1-4467-9693-455a6257757f req-5737c3c3-0075-40a6-8692-ff20ff8963a3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:02.671575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a548bc78-fbb1-4467-9693-455a6257757f req-5737c3c3-0075-40a6-8692-ff20ff8963a3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:02.706763 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a548bc78-fbb1-4467-9693-455a6257757f req-5737c3c3-0075-40a6-8692-ff20ff8963a3 service nova] Creating event network-vif-plugged:3dc994ea-bae4-4161-8cac-8060ce61f32c for instance aece1df8-5ec3-4a71-ac9a-f3c048791ece on n-h2-791135-8 Oct 04 11:32:02.725561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a548bc78-fbb1-4467-9693-455a6257757f req-5737c3c3-0075-40a6-8692-ff20ff8963a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.522024 Oct 04 11:32:02.728964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4006/5401] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:32:03.559746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:03.560584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:32:03.577538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:03.578043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:03.578484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:03.579273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:03.592480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:03.593826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:03.830215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8bbd9b12-a549-4ce3-837f-6e8a7ce7e66b tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Action: 'create', calling method: .version_select at 0x7f71cf7e4af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-537774271", "metadata": {"Type": "work"}}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:32:04.201065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:32:04.212794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-181012ae-fc4e-44e6-89eb-b710724dce79 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1470 microversion: 2.1 time: 0.659568 Oct 04 11:32:04.217005 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4007/5402] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:32:03 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1470 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:32:04.427689 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8bbd9b12-a549-4ce3-837f-6e8a7ce7e66b tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.095082 Oct 04 11:32:04.433830 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1396/5403] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Oct 4 11:32:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1103 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 11:32:04.447692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac4b5ce4-72b4-42ae-b80a-b9d8f11edd7e tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cedd2790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:04.546039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac4b5ce4-72b4-42ae-b80a-b9d8f11edd7e tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 200 len: 352 microversion: 2.1 time: 0.102672 Oct 04 11:32:04.547664 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4008/5404] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:32:04 2022] GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:32:05.240160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:05.240997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:32:05.252123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:05.252777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:05.253341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:05.254614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:05.256328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:05.256859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:05.562726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1c529fa-164c-4730-97f5-6f19d92e323a tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cf1cf310>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:05.726102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1c529fa-164c-4730-97f5-6f19d92e323a tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 200 len: 352 microversion: 2.1 time: 0.168209 Oct 04 11:32:05.727684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4009/5405] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:32:05 2022] GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:32:05.748437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:32:05.761700 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cdf391d4-dee8-48ed-b0f7-a5af1969e7bb tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1642 microversion: 2.1 time: 0.524131 Oct 04 11:32:05.762802 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1397/5406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:32:05 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1642 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:32:05.792735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:05.795493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:32:05.808659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:05.810199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:05.810991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:05.812000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:05.816795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:05.817614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:06.439529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:32:06.452077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f9693afc-2e41-416a-95eb-a87d023e47e2 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1642 microversion: 2.1 time: 0.666925 Oct 04 11:32:06.454201 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4010/5407] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:32:05 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1642 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:32:06.477884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:06.480739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:32:06.494859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:06.496197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:06.496802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:06.499486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:06.500146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:06.500767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:06.741048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e19288d-4fbc-4bc3-826a-6ca3d426f0fb tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cedd2040>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:06.867831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e19288d-4fbc-4bc3-826a-6ca3d426f0fb tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 200 len: 353 microversion: 2.1 time: 0.130895 Oct 04 11:32:06.868438 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4011/5408] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:32:06 2022] GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:32:06.886699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e3f5054-2c42-4ff4-bfb6-183a082d42cc tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cf1b5d30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:06.996946 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e3f5054-2c42-4ff4-bfb6-183a082d42cc tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 200 len: 353 microversion: 2.1 time: 0.115960 Oct 04 11:32:07.008279 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4012/5409] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:32:06 2022] GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:32:07.014627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa9619f8-3d29-4027-b98c-ec51ed311a0f tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cf1eb280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:07.151604 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa9619f8-3d29-4027-b98c-ec51ed311a0f tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 202 len: 0 microversion: 2.1 time: 0.142128 Oct 04 11:32:07.152868 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4013/5410] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Oct 4 11:32:07 2022] DELETE /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:32:07.162209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12bccd9c-f285-4cd2-b46a-83ae56f7d4d5 tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cf1cf160>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:07.249675 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12bccd9c-f285-4cd2-b46a-83ae56f7d4d5 tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 200 len: 352 microversion: 2.1 time: 0.092843 Oct 04 11:32:07.257511 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4014/5411] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:32:07 2022] GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:32:08.171480 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ffd52ad8-d14e-4861-939f-cdc604480b65 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1793 microversion: 2.1 time: 1.701355 Oct 04 11:32:08.172074 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1398/5412] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:32:06 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1793 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:32:08.272698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30cd84ab-890e-4d2a-92e7-24d32b7c88e9 tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cf1b5430>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:08.377122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-30cd84ab-890e-4d2a-92e7-24d32b7c88e9 tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 200 len: 352 microversion: 2.1 time: 0.114573 Oct 04 11:32:08.385287 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4015/5413] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:32:08 2022] GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:32:09.400973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ef2ffea-028a-4795-9a58-4f9ba6580089 tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cf7e4c10>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:09.507025 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ef2ffea-028a-4795-9a58-4f9ba6580089 tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 200 len: 352 microversion: 2.1 time: 0.117002 Oct 04 11:32:09.508739 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1399/5414] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:32:09 2022] GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:32:10.524120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-860221af-020e-4efb-906b-575bcc12911e tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Calling method '.version_select at 0x7f71cf1b5f70>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:32:10.588906 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-860221af-020e-4efb-906b-575bcc12911e tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] HTTP exception thrown: Volume 1b7d23f6-5f1b-4e7c-adae-2ba23559f76e could not be found. Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-860221af-020e-4efb-906b-575bcc12911e tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Request method failure captured: Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e HTTP/1.1 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBmzYKhgccwxMH49NpPBwLmayL-ajK10wGSK3-WWe42OLWsFQb44nZaJ7D3MgY4moatCedDdzRBkrKV2HZp9NpLZT07xYo_9-4VA3eX_Ji4D_BpR48v--g721GESgVtU-sxKc_QPovAmPWdR25pZ7al1PcBuQuDoV86VUFlBW_Nzwb0 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 7d7b8487600b46ef83683559c297a7f9 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesGetTestJSON-528367550 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7d7b8487600b46ef83683559c297a7f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d7b8487600b46ef83683559c297a7f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d7b8487600b46ef83683559c297a7f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7d7b8487600b46ef83683559c297a7f9"}]}] Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesGetTestJSON-528367550 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 7d7b8487600b46ef83683559c297a7f9 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesGetTestJSON-528367550 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesGetTestJSON-528367550-project Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: ed1fdcaafd804514b0de7b62bc637d53 Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesGetTestJSON-528367550-project Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: method: Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: exception: Volume 1b7d23f6-5f1b-4e7c-adae-2ba23559f76e could not be found. Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1b7d23f6-5f1b-4e7c-adae-2ba23559f76e'} Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b7d23f6-5f1b-4e7c-adae-2ba23559f76e could not be found. (HTTP 404) (Request-ID: req-637caa40-baee-4666-9405-ee28e6c50608) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 11:32:10.591579 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b7d23f6-5f1b-4e7c-adae-2ba23559f76e could not be found. Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b7d23f6-5f1b-4e7c-adae-2ba23559f76e could not be found. Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b7d23f6-5f1b-4e7c-adae-2ba23559f76e could not be found. Oct 04 11:32:10.596732 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:32:10.602913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-860221af-020e-4efb-906b-575bcc12911e tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] Returning 404 to user: Volume 1b7d23f6-5f1b-4e7c-adae-2ba23559f76e could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:32:10.604166 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-860221af-020e-4efb-906b-575bcc12911e tempest-VolumesGetTestJSON-528367550 tempest-VolumesGetTestJSON-528367550-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e" status: 404 len: 109 microversion: 2.1 time: 0.086809 Oct 04 11:32:10.605310 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4016/5415] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Oct 4 11:32:10 2022] GET /compute/v2.1/os-volumes/1b7d23f6-5f1b-4e7c-adae-2ba23559f76e => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:32:13.066560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-630df40c-e705-4a44-bc8f-fa694b3aa3c0 req-a34911a1-ecd3-47c9-b082-e767f8867521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aece1df8-5ec3-4a71-ac9a-f3c048791ece", "tag": "3dc994ea-bae4-4161-8cac-8060ce61f32c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:32:13.073124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=30 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:32:13.110452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-630df40c-e705-4a44-bc8f-fa694b3aa3c0 req-a34911a1-ecd3-47c9-b082-e767f8867521 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:32:13.118979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-630df40c-e705-4a44-bc8f-fa694b3aa3c0 req-a34911a1-ecd3-47c9-b082-e767f8867521 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:32:13.119673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-630df40c-e705-4a44-bc8f-fa694b3aa3c0 req-a34911a1-ecd3-47c9-b082-e767f8867521 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:32:13.141639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=54 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:32:13.161744 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-630df40c-e705-4a44-bc8f-fa694b3aa3c0 req-a34911a1-ecd3-47c9-b082-e767f8867521 service nova] Creating event network-changed:3dc994ea-bae4-4161-8cac-8060ce61f32c for instance aece1df8-5ec3-4a71-ac9a-f3c048791ece on n-h2-791135-8 Oct 04 11:32:13.180070 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-630df40c-e705-4a44-bc8f-fa694b3aa3c0 req-a34911a1-ecd3-47c9-b082-e767f8867521 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118012 Oct 04 11:32:13.185685 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1400/5416] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:32:58.361457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:32:58.369464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=61 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:32:58.389059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-034da8a6-1f15-45c8-94e8-2f5945680e59 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'create', calling method: .version_select at 0x7f71d417b1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-903413324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORax6/P9rI4LmEP3cz+ZdTRETJSETfeJyEOaYfa2HBHFdbLh6uMuB1bFomXfonbe86oe6+uXvPOHe3x3/xZy+wWBhPNAK1AuhE9e8CVfwx2dYaBtP4X2RlcrT3ZnLbFEw=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:32:58.465072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-034da8a6-1f15-45c8-94e8-2f5945680e59 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for project 6ab55c98bb424804b2b405228f663b12. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:32:58.479338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-034da8a6-1f15-45c8-94e8-2f5945680e59 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for user c2b1b00cd36e44029505dd9d14b2fec6 and project 6ab55c98bb424804b2b405228f663b12. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:32:58.539395 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-034da8a6-1f15-45c8-94e8-2f5945680e59 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.180634 Oct 04 11:32:58.540174 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4017/5417] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:32:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:33:00.951205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-281653477", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "976eb92c-0e07-46cb-bb77-37b0bf38c50a"}], "key_name": "tempest-TestNetworkBasicOps-903413324", "security_groups": [{"name": "tempest-secgroup-smoke-1141515718"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:00.978960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:00.980088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:00.981312 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:33:00.981809 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:33:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:33:01.266559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] validate_networks() for [('976eb92c-0e07-46cb-bb77-37b0bf38c50a', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:33:03.066620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:33:03.071513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:33:03.072007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:33:03.075536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:33:03.076114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:33:03.106568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:03.108028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:03.111464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:03.114297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:03.116717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:03.119608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:03.162868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for project 6ab55c98bb424804b2b405228f663b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:33:03.178370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for user c2b1b00cd36e44029505dd9d14b2fec6 and project 6ab55c98bb424804b2b405228f663b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:33:03.198797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:33:03.202971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:33:03.303899 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81d50cff-a0e1-4fd3-b7b8-3d13aa7f0bcc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.357513 Oct 04 11:33:03.314520 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1401/5418] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:33:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:33:03.319367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0dc4635f-f327-4264-b784-62f802b396e7 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:03.320035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0dc4635f-f327-4264-b784-62f802b396e7 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:03.441291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0dc4635f-f327-4264-b784-62f802b396e7 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:03.453083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0dc4635f-f327-4264-b784-62f802b396e7 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1247 microversion: 2.1 time: 0.138718 Oct 04 11:33:03.455438 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4018/5419] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:03 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1247 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:33:04.482387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:04.483190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:04.499006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:04.499975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:04.500586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:04.502315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:04.503885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:04.504630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:04.626990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:04.637324 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3fe6b35-9694-4cd7-9cfc-8d78946db4fc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1243 microversion: 2.1 time: 0.161311 Oct 04 11:33:04.641582 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1402/5420] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:04 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1243 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:05.666064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:05.666690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:05.678006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:05.678494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:05.678956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:05.680764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:05.681423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:05.681865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:05.770636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:05.785085 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a4e2d50-ed21-485a-a1de-f0e7b704a65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1305 microversion: 2.1 time: 0.122128 Oct 04 11:33:05.786056 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4019/5421] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:05 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:06.812443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:06.813158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:06.830288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:06.830872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:06.831384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:06.832179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:06.832713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:06.833343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:07.113878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:07.123744 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9a8c932-c257-4a98-94d9-fa251870dd73 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1373 microversion: 2.1 time: 0.314080 Oct 04 11:33:07.126510 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1403/5422] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:06 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1373 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:08.157416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:08.158051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:08.174295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:08.176299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:08.177052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:08.179329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:08.182074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:08.182710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:08.429047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:08.439829 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24a638e8-7c65-4615-9b94-3a6f7c8671c9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1373 microversion: 2.1 time: 0.294421 Oct 04 11:33:08.449602 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4020/5423] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:08 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1373 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:09.464876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:09.466242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:09.477968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:09.480326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:09.481010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:09.483070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:09.483792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:09.485702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:09.628560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3d822ce6-1aa2-4a2f-b461-8c718913e3a4 req-c3023e7a-9e20-487a-8c2f-add85a76cf10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8769bc5-df9a-4f3f-809f-845aab341a2f", "tag": "47c25c95-ca59-409d-88d1-f5c08b2f3fdf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:09.653960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d822ce6-1aa2-4a2f-b461-8c718913e3a4 req-c3023e7a-9e20-487a-8c2f-add85a76cf10 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:09.654462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d822ce6-1aa2-4a2f-b461-8c718913e3a4 req-c3023e7a-9e20-487a-8c2f-add85a76cf10 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:09.654906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d822ce6-1aa2-4a2f-b461-8c718913e3a4 req-c3023e7a-9e20-487a-8c2f-add85a76cf10 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:09.690497 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3d822ce6-1aa2-4a2f-b461-8c718913e3a4 req-c3023e7a-9e20-487a-8c2f-add85a76cf10 service nova] Creating event network-changed:47c25c95-ca59-409d-88d1-f5c08b2f3fdf for instance a8769bc5-df9a-4f3f-809f-845aab341a2f on n-h1-791135-8 Oct 04 11:33:09.704640 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3d822ce6-1aa2-4a2f-b461-8c718913e3a4 req-c3023e7a-9e20-487a-8c2f-add85a76cf10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.591384 Oct 04 11:33:09.705831 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1404/5424] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:33:09.911306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:09.931781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c8b2777-43aa-4c19-9be5-5b367e3a8304 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1373 microversion: 2.1 time: 0.471362 Oct 04 11:33:09.938986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4021/5425] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:09 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1373 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:10.964929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:10.966681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:10.982272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:10.984421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:10.986019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:10.986843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:10.987727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:10.989908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:11.482389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:11.496429 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0bcbc424-d3b9-4380-baee-1fd9241c5b51 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1373 microversion: 2.1 time: 0.536456 Oct 04 11:33:11.501202 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1405/5426] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:10 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1373 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:12.527044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:12.527674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:12.549310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:12.550589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:12.554166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:12.560580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:12.562905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:12.563677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:12.907526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:12.924966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29c981fc-4de5-4629-975e-3e01ed0c4196 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1373 microversion: 2.1 time: 0.400985 Oct 04 11:33:12.925825 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4022/5427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:12 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1373 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:13.951838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:13.953050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:13.977934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:13.981324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:13.988067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:13.994981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:13.997363 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:13.999537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:14.001292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:14.001859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:14.386634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:14.398425 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-28983c80-1e67-4b13-90dd-a2cb040ee703 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1373 microversion: 2.1 time: 0.448664 Oct 04 11:33:14.400098 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1406/5428] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:13 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1373 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:15.424915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:15.426467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:15.436754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:15.447771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:15.450493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:15.453698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:15.457717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:15.460545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:15.461865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:15.505204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e7de3eed-c002-4c1d-9cff-cac7cb95824a req-86a4bb39-ad25-480b-b108-147bbad272cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8769bc5-df9a-4f3f-809f-845aab341a2f", "name": "network-vif-plugged", "status": "completed", "tag": "47c25c95-ca59-409d-88d1-f5c08b2f3fdf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:15.531513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e7de3eed-c002-4c1d-9cff-cac7cb95824a req-86a4bb39-ad25-480b-b108-147bbad272cc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:15.535159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e7de3eed-c002-4c1d-9cff-cac7cb95824a req-86a4bb39-ad25-480b-b108-147bbad272cc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:15.538512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e7de3eed-c002-4c1d-9cff-cac7cb95824a req-86a4bb39-ad25-480b-b108-147bbad272cc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:15.580012 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e7de3eed-c002-4c1d-9cff-cac7cb95824a req-86a4bb39-ad25-480b-b108-147bbad272cc service nova] Creating event network-vif-plugged:47c25c95-ca59-409d-88d1-f5c08b2f3fdf for instance a8769bc5-df9a-4f3f-809f-845aab341a2f on n-h1-791135-8 Oct 04 11:33:15.589498 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e7de3eed-c002-4c1d-9cff-cac7cb95824a req-86a4bb39-ad25-480b-b108-147bbad272cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088250 Oct 04 11:33:15.590786 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1407/5429] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:33:15.867047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:15.877432 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c89b2d6-15e7-42ca-9260-48abcbf39589 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1373 microversion: 2.1 time: 0.457255 Oct 04 11:33:15.897061 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4023/5430] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:15 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1373 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:16.917128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:16.918420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:16.947090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:16.949540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:16.951062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:16.954817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:16.956883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:16.957620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:17.388554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:17.397737 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c9445eac-0a65-491f-9087-ed4fdca69282 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1373 microversion: 2.1 time: 0.496835 Oct 04 11:33:17.416679 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1408/5431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:16 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1373 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:18.425565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:18.427567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:18.437228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:18.439628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:18.441094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:18.442131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:18.443545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:18.444330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:18.724049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:18.738974 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9472575-3c41-4112-ac18-1d34dcf7f3a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1546 microversion: 2.1 time: 0.319027 Oct 04 11:33:18.740191 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4024/5432] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:18 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1546 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:18.764721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:18.766115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:18.773800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:18.774493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:18.775097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:18.775977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:18.776598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:18.777191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:19.253141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:19.279639 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45245146-0c93-44a5-aa73-3d6b0c0bb880 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1546 microversion: 2.1 time: 0.519419 Oct 04 11:33:19.280238 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1409/5433] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:18 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1546 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:23.734493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c31f2d2f-9c57-4190-893c-693508e3cfdc req-e397ce74-f6e8-4d1a-ad9f-df1a6b37201b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8769bc5-df9a-4f3f-809f-845aab341a2f", "tag": "47c25c95-ca59-409d-88d1-f5c08b2f3fdf"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:23.765480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c31f2d2f-9c57-4190-893c-693508e3cfdc req-e397ce74-f6e8-4d1a-ad9f-df1a6b37201b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:23.766011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c31f2d2f-9c57-4190-893c-693508e3cfdc req-e397ce74-f6e8-4d1a-ad9f-df1a6b37201b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:23.766450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c31f2d2f-9c57-4190-893c-693508e3cfdc req-e397ce74-f6e8-4d1a-ad9f-df1a6b37201b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:23.798658 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c31f2d2f-9c57-4190-893c-693508e3cfdc req-e397ce74-f6e8-4d1a-ad9f-df1a6b37201b service nova] Creating event network-changed:47c25c95-ca59-409d-88d1-f5c08b2f3fdf for instance a8769bc5-df9a-4f3f-809f-845aab341a2f on n-h1-791135-8 Oct 04 11:33:23.831787 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c31f2d2f-9c57-4190-893c-693508e3cfdc req-e397ce74-f6e8-4d1a-ad9f-df1a6b37201b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102388 Oct 04 11:33:23.836301 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4025/5434] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:33:30.764661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1130348681", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "444b86d9-d518-4d68-bb3e-60e73fe5dca2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-415824212", "security_groups": []}, "os:scheduler_hints": {"different_host": ["aece1df8-5ec3-4a71-ac9a-f3c048791ece"]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:30.806048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:30.809850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=42 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:30.861131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] validate_networks() for [('444b86d9-d518-4d68-bb3e-60e73fe5dca2', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:33:31.780196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:33:31.780993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:33:31.782254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:33:31.783797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:33:31.784507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:33:31.810032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:31.810974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:31.811612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:31.814182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:31.814931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:31.815578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:31.858026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Getting quotas for project 13aa4682314a4017b0108b637bb85b1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:33:31.881224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Getting quotas for user e47b8844a79f4214ac9afeece1e9b2bc and project 13aa4682314a4017b0108b637bb85b1b. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:33:31.938821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:33:31.950111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:33:32.035851 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-430f0644-f648-4fef-9aac-d775eced40bc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.275745 Oct 04 11:33:32.037154 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1410/5435] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:33:30 2022] POST /compute/v2.1/servers => generated 361 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:33:32.048753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3400513-2b29-4dc3-915f-641d164f10a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:32.049643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3400513-2b29-4dc3-915f-641d164f10a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:32.082762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:32.153825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3400513-2b29-4dc3-915f-641d164f10a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:32.166601 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3400513-2b29-4dc3-915f-641d164f10a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1241 microversion: 2.1 time: 0.122355 Oct 04 11:33:32.172697 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4026/5436] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:32 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1241 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:33.199389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:33.200196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:33.224307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:33.225305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:33.227350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:33.229660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:33.230860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:33.231974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:33.347080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:33.364366 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5d2f37c6-1caf-4e89-9a2f-9282866ce1ab tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1237 microversion: 2.1 time: 0.172323 Oct 04 11:33:33.365234 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1411/5437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:33 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1237 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:34.395394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:34.396061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:34.402341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=38 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:34.425301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:34.430554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:34.435647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:34.446697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:34.448395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:34.449716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:34.720758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:34.729330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-363b1428-bcdf-47d0-a5f5-856ae257c991 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1301 microversion: 2.1 time: 0.339650 Oct 04 11:33:34.736833 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4027/5438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:34 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1301 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:35.766375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:35.766988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:35.786689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:35.790112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:35.790807 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:35.799105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:35.802601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:35.805523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:36.359737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:36.371397 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3fd82a5f-fa54-4ef9-ba83-796b9f8d9e5e tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1299 microversion: 2.1 time: 0.614920 Oct 04 11:33:36.371817 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1412/5439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:35 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1299 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:33:37.398977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:37.400354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:37.424636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:37.425372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:37.425807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:37.427348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:37.428101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:37.428771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:37.611096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:37.622124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b036de4-a9f8-4f1f-9394-625224706e72 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1299 microversion: 2.1 time: 0.227993 Oct 04 11:33:37.626600 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4028/5440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:37 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:38.332540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a0e8086a-0a65-4c95-8add-0d38d840da73 req-03fec845-aed1-41cd-9951-eb6757e2db27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735543b7-99a9-4972-80f8-d03bd244d610", "tag": "6d89638f-daff-4f5d-8717-ac6e18309a32"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:38.351496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0e8086a-0a65-4c95-8add-0d38d840da73 req-03fec845-aed1-41cd-9951-eb6757e2db27 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:38.351976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0e8086a-0a65-4c95-8add-0d38d840da73 req-03fec845-aed1-41cd-9951-eb6757e2db27 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:38.352402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a0e8086a-0a65-4c95-8add-0d38d840da73 req-03fec845-aed1-41cd-9951-eb6757e2db27 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:38.380996 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a0e8086a-0a65-4c95-8add-0d38d840da73 req-03fec845-aed1-41cd-9951-eb6757e2db27 service nova] Creating event network-changed:6d89638f-daff-4f5d-8717-ac6e18309a32 for instance 735543b7-99a9-4972-80f8-d03bd244d610 on n-h1-791135-8 Oct 04 11:33:38.386822 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a0e8086a-0a65-4c95-8add-0d38d840da73 req-03fec845-aed1-41cd-9951-eb6757e2db27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057860 Oct 04 11:33:38.391230 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1413/5441] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:33:38.659221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:38.659874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:38.672218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:38.672713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:38.673451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:38.674926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:38.676575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:38.677258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:38.798652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:38.809419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a1249066-7630-46ad-91d1-0f2ff4038244 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1299 microversion: 2.1 time: 0.164369 Oct 04 11:33:38.811051 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4029/5442] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:38 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1299 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:39.837094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:39.837958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:39.845115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:39.845661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:39.846093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:39.846795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:39.847252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:39.847679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:40.107676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:40.123133 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ea161529-1e77-4ca1-87ad-3c99b0b9efdc tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1299 microversion: 2.1 time: 0.286081 Oct 04 11:33:40.123957 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1414/5443] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:39 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1299 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:41.147700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:41.149039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:41.165513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:41.167127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:41.169832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:41.170999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:41.173678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:41.175375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:41.449716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:41.471208 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-085555bc-c1c7-41ed-a1c5-7fbfa48ccb75 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1299 microversion: 2.1 time: 0.324086 Oct 04 11:33:41.472000 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4030/5444] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:41 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1299 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:33:42.495462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:42.496130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:42.515003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:42.516817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:42.518860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:42.519556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:42.520592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:42.521680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:42.522437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:42.523119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:42.714268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:42.724250 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac839c61-dfa1-4d69-9629-ea1bf8b7a4a9 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1299 microversion: 2.1 time: 0.232704 Oct 04 11:33:42.728078 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1415/5445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:42 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1299 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:43.107287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:43.111095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:43.136508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:43.140365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:43.140871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:43.141313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:43.142091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:43.145699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:43.146162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:43.245997 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b7d133a-e1d9-4241-905d-234d74de667d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f/action" status: 200 len: 24570 microversion: 2.1 time: 0.143544 Oct 04 11:33:43.246667 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4031/5446] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:33:43 2022] POST /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f/action => generated 24570 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:33:43.640093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9e1a6054-e1c1-46c9-aded-51eb0b84cdcf req-fdd400f6-e7bd-417f-96c7-fc9ccdead21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735543b7-99a9-4972-80f8-d03bd244d610", "name": "network-vif-plugged", "status": "completed", "tag": "6d89638f-daff-4f5d-8717-ac6e18309a32"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:43.675877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9e1a6054-e1c1-46c9-aded-51eb0b84cdcf req-fdd400f6-e7bd-417f-96c7-fc9ccdead21f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:43.676358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9e1a6054-e1c1-46c9-aded-51eb0b84cdcf req-fdd400f6-e7bd-417f-96c7-fc9ccdead21f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:43.676793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9e1a6054-e1c1-46c9-aded-51eb0b84cdcf req-fdd400f6-e7bd-417f-96c7-fc9ccdead21f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:43.738479 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9e1a6054-e1c1-46c9-aded-51eb0b84cdcf req-fdd400f6-e7bd-417f-96c7-fc9ccdead21f service nova] Creating event network-vif-plugged:6d89638f-daff-4f5d-8717-ac6e18309a32 for instance 735543b7-99a9-4972-80f8-d03bd244d610 on n-h1-791135-8 Oct 04 11:33:43.753227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:43.754048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:43.762964 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9e1a6054-e1c1-46c9-aded-51eb0b84cdcf req-fdd400f6-e7bd-417f-96c7-fc9ccdead21f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127689 Oct 04 11:33:43.765267 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1416/5447] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:33:43.773053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:43.773592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:43.774040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:43.774775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:43.775239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:43.775671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:44.028916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:44.045618 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-afbae1cb-5c7f-440b-8a26-62c7ff17f669 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1299 microversion: 2.1 time: 0.298625 Oct 04 11:33:44.062903 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4032/5448] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:43 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1299 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:45.069977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:45.070930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:45.086644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:45.091052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:45.098014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:45.103759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:45.104385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:45.107754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:45.513674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:45.530658 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62a7cee0-b6cf-4d69-92e0-3e7b25337283 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1471 microversion: 2.1 time: 0.465856 Oct 04 11:33:45.547600 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1417/5449] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:45 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1471 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:33:45.559422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:45.560672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:45.595019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:45.596536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:45.603638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:45.605998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:45.607005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:45.607446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:45.838524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:45.863275 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-692b49cc-421b-497c-85af-a5cd118a5e3b tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1471 microversion: 2.1 time: 0.308177 Oct 04 11:33:45.873377 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4033/5450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:45 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:45.889750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:45.891228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:45.900982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:45.902882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:45.904680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:45.907307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:45.908181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:45.909337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.026156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-489374344", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "3a0b1205-e4d2-4f85-b589-0287a1a6602b"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:46.143894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] validate_networks() for [('3a0b1205-e4d2-4f85-b589-0287a1a6602b', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:33:46.164659 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1dcbc42-592a-4701-9c22-33873c38124a tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1622 microversion: 2.1 time: 0.280360 Oct 04 11:33:46.182418 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1418/5451] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:45 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1622 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:46.194570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:46.195269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:46.201315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:46.202130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:46.202568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.203837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:46.204295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:46.204955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.364095 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ede3aa3-06ed-42c5-a121-9b6813e53d47 tempest-TestSecurityGroupsBasicOps-43168276 tempest-TestSecurityGroupsBasicOps-43168276-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1911 microversion: 2.1 time: 0.174034 Oct 04 11:33:46.370023 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1419/5452] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:46 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1911 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:46.436747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:46.439081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:46.446877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:46.447617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:46.448531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.449978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:46.451250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:46.452183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.486417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:33:46.611405 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0826a4f-5e3e-4ea4-9cea-2bd69a9e7030 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "DELETE /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 204 len: 0 microversion: 2.1 time: 0.177893 Oct 04 11:33:46.615516 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1420/5453] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:33:46 2022] DELETE /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:33:46.622089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:46.622945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:46.631185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:46.631425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:46.632585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.634081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:46.635164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:46.636238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.731374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:46.742605 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85f0782d-a044-4c97-900d-6b5a88943035 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1477 microversion: 2.1 time: 0.125386 Oct 04 11:33:46.743878 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1421/5454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:46 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1477 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:46.942461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:33:46.943934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:33:46.944427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:33:46.945229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:33:46.945984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:33:46.964639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:46.966452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:46.967567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.969503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:46.970003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:46.970870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:46.994969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Getting quotas for project ef0b35bbab4846b1884b7fd7a7ba9a2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:33:47.010920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Getting quotas for user 943740737ba643e8b913a05c3bbc4a64 and project ef0b35bbab4846b1884b7fd7a7ba9a2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:33:47.029196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:33:47.033390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:33:47.133507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57d6c300-1177-463f-b7e3-5f5b1c0f88e5 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114426 Oct 04 11:33:47.134942 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4034/5455] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:33:47.148185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7310a71e-4e56-4a18-9290-44f7c5a5aebc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:47.149114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7310a71e-4e56-4a18-9290-44f7c5a5aebc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:47.249754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7310a71e-4e56-4a18-9290-44f7c5a5aebc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:47.257336 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7310a71e-4e56-4a18-9290-44f7c5a5aebc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1213 microversion: 2.1 time: 0.112904 Oct 04 11:33:47.258737 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1422/5456] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:47 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:47.783355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:47.785614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:47.804364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:47.806104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:47.806792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:47.807919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:47.808613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:47.809212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:48.011313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:48.029597 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ee21ce2-8483-485e-8965-483e1c65d277 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1477 microversion: 2.1 time: 0.264042 Oct 04 11:33:48.032102 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4035/5457] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:47 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1477 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:48.281907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:48.282517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:48.302155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:48.303163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:48.304579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:48.305613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:48.308925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:48.310647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:48.515521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:48.527684 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3e714e1-6b14-4444-948c-86414f5da6dc tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1209 microversion: 2.1 time: 0.250832 Oct 04 11:33:48.531414 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1423/5458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:48 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1209 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:49.053067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:49.054075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:49.066187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:49.066187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:49.066187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:49.066480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:49.068456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:49.068995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:49.221233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:49.231289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e0bea93-f1b7-461a-89d8-2f6261826279 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 200 len: 1477 microversion: 2.1 time: 0.182092 Oct 04 11:33:49.232688 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4036/5459] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:49 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 1477 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:49.334296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e99f7596-ec73-4208-b7fb-ed35cf69e8c9 req-ee36e59a-e409-4ed2-8ca0-d306328a8238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735543b7-99a9-4972-80f8-d03bd244d610", "name": "network-vif-deleted", "tag": "6d89638f-daff-4f5d-8717-ac6e18309a32"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:49.359178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e99f7596-ec73-4208-b7fb-ed35cf69e8c9 req-ee36e59a-e409-4ed2-8ca0-d306328a8238 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:49.362440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e99f7596-ec73-4208-b7fb-ed35cf69e8c9 req-ee36e59a-e409-4ed2-8ca0-d306328a8238 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:49.362895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e99f7596-ec73-4208-b7fb-ed35cf69e8c9 req-ee36e59a-e409-4ed2-8ca0-d306328a8238 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:49.383062 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e99f7596-ec73-4208-b7fb-ed35cf69e8c9 req-ee36e59a-e409-4ed2-8ca0-d306328a8238 service nova] Creating event network-vif-deleted:6d89638f-daff-4f5d-8717-ac6e18309a32 for instance 735543b7-99a9-4972-80f8-d03bd244d610 on n-h1-791135-8 Oct 04 11:33:49.389121 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e99f7596-ec73-4208-b7fb-ed35cf69e8c9 req-ee36e59a-e409-4ed2-8ca0-d306328a8238 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059292 Oct 04 11:33:49.391110 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1424/5460] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:33:49.555040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:49.555726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:49.562997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:49.564026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:49.564703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:49.566481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:49.567285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:49.569493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:49.702446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:49.711813 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4794f856-a3ec-43d5-bf6b-9e69404ffa26 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1273 microversion: 2.1 time: 0.161383 Oct 04 11:33:49.729932 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4037/5461] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:49 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:50.260121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:50.261098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: 735543b7-99a9-4972-80f8-d03bd244d610] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:50.270151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:50.271008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:50.271723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:50.272683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:50.273440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:50.274082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:50.291360 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] HTTP exception thrown: Instance 735543b7-99a9-4972-80f8-d03bd244d610 could not be found. Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Request method failure captured: Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 HTTP/1.1 Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBl9WmvnXWh2-aGtNVByP2QZi5O2d5O6uA4Fl0_D5dUDexEvYESrqorA96XRR2CM33jO4yMfE1p9b_ogUijUPgS35SVphePedAjJbepDnz4bAVBTarfrM02gb8fsccSKyNE8M0CUJc9WDIQtLuOJ8udRW1u_O-tpmEZc3u-TM2eOwn4 Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 13aa4682314a4017b0108b637bb85b1b Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1961966359 Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_13aa4682314a4017b0108b637bb85b1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/13aa4682314a4017b0108b637bb85b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/13aa4682314a4017b0108b637bb85b1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/13aa4682314a4017b0108b637bb85b1b"}]}] Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1961966359 Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 13aa4682314a4017b0108b637bb85b1b Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1961966359 Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestSecurityGroupsBasicOps-1961966359-project Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e47b8844a79f4214ac9afeece1e9b2bc Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1961966359-project Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 735543b7-99a9-4972-80f8-d03bd244d610 could not be found. Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '735543b7-99a9-4972-80f8-d03bd244d610'} Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 735543b7-99a9-4972-80f8-d03bd244d610 could not be found. Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 735543b7-99a9-4972-80f8-d03bd244d610 could not be found. Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:33:50.293717 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:33:50.302152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:33:50.302152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:33:50.302152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:33:50.302152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:33:50.302152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:33:50.302152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:33:50.302152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 735543b7-99a9-4972-80f8-d03bd244d610 could not be found. Oct 04 11:33:50.302152 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:33:50.304789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Returning 404 to user: Instance 735543b7-99a9-4972-80f8-d03bd244d610 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:33:50.306387 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-719e04d9-a910-464c-a9b0-031eab13d902 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610" status: 404 len: 111 microversion: 2.1 time: 0.051049 Oct 04 11:33:50.307625 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1425/5462] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:50 2022] GET /compute/v2.1/servers/735543b7-99a9-4972-80f8-d03bd244d610 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:33:50.737655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:50.738267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:50.762303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:50.763622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:50.764747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:50.768401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:50.769435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:50.776941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:51.001069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:51.026335 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75ef8a8f-662b-4cec-81aa-45881a77eb96 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1271 microversion: 2.1 time: 0.293167 Oct 04 11:33:51.026961 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4038/5463] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:50 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:52.049876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:52.051519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:52.062063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:52.062903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:52.063783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:52.064734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:52.065459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:52.066120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:52.412600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:52.426016 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-641db2f2-86b9-4096-9c2a-d49284094cd4 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1313 microversion: 2.1 time: 0.377577 Oct 04 11:33:52.426965 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1426/5464] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:52 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:53.172782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d1effe9d-e875-439f-a3a4-28f2042e799f req-6051fcb6-a2f0-4739-a9d6-4868719e4dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfaed36a-fae6-4a58-aabb-1eec9141e78d", "tag": "4cc267eb-d26a-4dc4-8624-82d76fa3e0e2"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:53.193285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1effe9d-e875-439f-a3a4-28f2042e799f req-6051fcb6-a2f0-4739-a9d6-4868719e4dab service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:53.194857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1effe9d-e875-439f-a3a4-28f2042e799f req-6051fcb6-a2f0-4739-a9d6-4868719e4dab service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:53.197410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1effe9d-e875-439f-a3a4-28f2042e799f req-6051fcb6-a2f0-4739-a9d6-4868719e4dab service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:53.240921 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d1effe9d-e875-439f-a3a4-28f2042e799f req-6051fcb6-a2f0-4739-a9d6-4868719e4dab service nova] Creating event network-changed:4cc267eb-d26a-4dc4-8624-82d76fa3e0e2 for instance dfaed36a-fae6-4a58-aabb-1eec9141e78d on n-h2-791135-8 Oct 04 11:33:53.261577 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d1effe9d-e875-439f-a3a4-28f2042e799f req-6051fcb6-a2f0-4739-a9d6-4868719e4dab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094465 Oct 04 11:33:53.263708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4039/5465] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:33:53.453580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:53.454951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:53.463822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:53.464339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:53.464785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:53.465735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:53.466190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:53.466609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:53.940011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:53.953595 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b76e991-1e7b-4912-859e-b8462938d109 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1313 microversion: 2.1 time: 0.505671 Oct 04 11:33:53.954395 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1427/5466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:53 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:54.979530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:54.980478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:55.023258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:55.023851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:55.025988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:55.031407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:55.031407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:55.032499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:55.606235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:55.618288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-44c44f31-a37a-4f91-bce0-4571c4159b28 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1313 microversion: 2.1 time: 0.644827 Oct 04 11:33:55.626590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4040/5467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:54 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:56.406267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-891814351", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "70e8695f-c828-4295-98c8-93f68f41a412"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:56.556872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] validate_networks() for [('70e8695f-c828-4295-98c8-93f68f41a412', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:33:56.649795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:56.651006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:56.687539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:56.689769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:56.690576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:56.693882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:56.695413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:56.696219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:56.985883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:57.022542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:57.254683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:33:57.815149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:33:57.815809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:33:57.816242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:33:57.816712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:33:57.817461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:33:57.836774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:57.840121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:57.840794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:57.842568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:57.844022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:57.848185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:57.894115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Getting quotas for project 02453eda255e4bf7806fb6e0d10b54e2. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:33:57.901963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Getting quotas for user 4eeb61cde59d4187b2217cae9dbe1f08 and project 02453eda255e4bf7806fb6e0d10b54e2. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:33:57.925530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:33:57.928327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:33:58.024425 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf7a05df-d589-4d0d-a773-6e275b06eced tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.121072 Oct 04 11:33:58.028251 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1428/5468] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:33:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:33:58.043879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c57b7e4f-27c3-4fea-a147-b37bffb985ce tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'create', calling method: .version_select at 0x7f71cf7b0ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1717784150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLKbr29gj/ia5EU4qWRGUZbq0haZQdRAeo4QubJ1nNV6nlepaGbgFH2UdCuEs9NS+6VefcQ0nbdmFFHOmjSJTMVa9DHw3uuOtWhkdF0SzPIUyB2tjDFbITRP9K/zycZLg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:33:58.110776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c57b7e4f-27c3-4fea-a147-b37bffb985ce tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for project 6ab55c98bb424804b2b405228f663b12. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:33:58.137592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c57b7e4f-27c3-4fea-a147-b37bffb985ce tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for user c2b1b00cd36e44029505dd9d14b2fec6 and project 6ab55c98bb424804b2b405228f663b12. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:33:58.215383 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c57b7e4f-27c3-4fea-a147-b37bffb985ce tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [e895f24a-1a5c-4f4c-a9b0-814b1b9d4209] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 11:33:58.363453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:58.393719 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd98bfb2-b593-41e2-a6f4-d0af921934a1 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1313 microversion: 2.1 time: 1.747124 Oct 04 11:33:58.395171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4041/5469] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:56 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1313 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:33:58.411008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e7fb07a-549b-4c5f-b9d2-2ad1a0e37ee2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:58.412065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e7fb07a-549b-4c5f-b9d2-2ad1a0e37ee2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:58.666736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e7fb07a-549b-4c5f-b9d2-2ad1a0e37ee2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:33:58.681484 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e7fb07a-549b-4c5f-b9d2-2ad1a0e37ee2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1213 microversion: 2.1 time: 0.281830 Oct 04 11:33:58.682133 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4042/5470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:58 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1213 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:33:59.228880 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [None req-c57b7e4f-27c3-4fea-a147-b37bffb985ce tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [e895f24a-1a5c-4f4c-a9b0-814b1b9d4209] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 45910. Oct 04 11:33:59.254520 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c57b7e4f-27c3-4fea-a147-b37bffb985ce tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.224813 Oct 04 11:33:59.255913 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1429/5471] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:33:58 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:33:59.422230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:59.423164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:59.453527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:59.454046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:59.454491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:59.463766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:59.464281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:59.474503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:59.705473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:33:59.706148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:33:59.721333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:59.724105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:59.724791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:33:59.725800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:33:59.729265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:33:59.730301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:00.079634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:00.095969 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9daf0ca7-7833-419e-99bd-bbe97292d25a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1313 microversion: 2.1 time: 0.673279 Oct 04 11:34:00.098519 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4043/5472] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:59 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:00.234098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:00.238877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:00.255400 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f9aa111-8e1e-4519-9f4d-ae5e2e04ec6b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1265 microversion: 2.1 time: 0.554063 Oct 04 11:34:00.260617 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1430/5473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:33:59 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1265 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:00.538100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:00.538638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:00.555973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9935160f-76db-49e4-883f-e9bde221ae7f req-e9faed36-20c4-4efb-8a87-5585803b36ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aece1df8-5ec3-4a71-ac9a-f3c048791ece", "tag": "3dc994ea-bae4-4161-8cac-8060ce61f32c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:00.574277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:00.574774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:00.575597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:00.576475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:00.577125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:00.578282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:00.591161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9935160f-76db-49e4-883f-e9bde221ae7f req-e9faed36-20c4-4efb-8a87-5585803b36ec service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:00.591641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9935160f-76db-49e4-883f-e9bde221ae7f req-e9faed36-20c4-4efb-8a87-5585803b36ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:00.592069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9935160f-76db-49e4-883f-e9bde221ae7f req-e9faed36-20c4-4efb-8a87-5585803b36ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:00.638792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:34:00.658232 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9935160f-76db-49e4-883f-e9bde221ae7f req-e9faed36-20c4-4efb-8a87-5585803b36ec service nova] Creating event network-changed:3dc994ea-bae4-4161-8cac-8060ce61f32c for instance aece1df8-5ec3-4a71-ac9a-f3c048791ece on n-h2-791135-8 Oct 04 11:34:00.682084 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9935160f-76db-49e4-883f-e9bde221ae7f req-e9faed36-20c4-4efb-8a87-5585803b36ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130981 Oct 04 11:34:00.685317 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1431/5474] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:34:00.774709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:00.804086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5bbc847e-c45e-4d4d-8b1e-729d0f0c9457 req-349731f9-e67b-487d-9424-9b577d112921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaed36a-fae6-4a58-aabb-1eec9141e78d", "name": "network-vif-plugged", "status": "completed", "tag": "4cc267eb-d26a-4dc4-8624-82d76fa3e0e2"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:00.827987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5bbc847e-c45e-4d4d-8b1e-729d0f0c9457 req-349731f9-e67b-487d-9424-9b577d112921 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:00.833630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5bbc847e-c45e-4d4d-8b1e-729d0f0c9457 req-349731f9-e67b-487d-9424-9b577d112921 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:00.839297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5bbc847e-c45e-4d4d-8b1e-729d0f0c9457 req-349731f9-e67b-487d-9424-9b577d112921 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:00.855202 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8957d926-a01d-45b0-9e21-25ed7439a180 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 204 len: 0 microversion: 2.1 time: 0.320735 Oct 04 11:34:00.859214 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4044/5475] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:34:00 2022] DELETE /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:34:00.874653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:00.877867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:00.891709 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5bbc847e-c45e-4d4d-8b1e-729d0f0c9457 req-349731f9-e67b-487d-9424-9b577d112921 service nova] Creating event network-vif-plugged:4cc267eb-d26a-4dc4-8624-82d76fa3e0e2 for instance dfaed36a-fae6-4a58-aabb-1eec9141e78d on n-h2-791135-8 Oct 04 11:34:00.899096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:00.901082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:00.901547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:00.902282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:00.916744 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5bbc847e-c45e-4d4d-8b1e-729d0f0c9457 req-349731f9-e67b-487d-9424-9b577d112921 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117017 Oct 04 11:34:00.918592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:00.919609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:00.930109 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1432/5476] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:34:01.134996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:01.146390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:01.168152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:01.191685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:01.194875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:01.195593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:01.198245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:01.202095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:01.202565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:01.713395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:01.721573 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d8a2857-14f1-4188-ad77-23437fedb6ad tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1766 microversion: 2.1 time: 0.858168 Oct 04 11:34:01.747522 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4045/5477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:00 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1766 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:01.771479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:01.772187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:01.778710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:01.786569 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9eb31581-eb6b-4414-b119-2317987962db tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1313 microversion: 2.1 time: 0.666533 Oct 04 11:34:01.787174 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1433/5478] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:01 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:01.792658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:01.793151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:01.793619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:01.794474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:01.795679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:01.797776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:02.006188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:02.023768 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8cd6a77-7245-401a-86b7-49ccea845369 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1271 microversion: 2.1 time: 0.275023 Oct 04 11:34:02.024580 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4046/5479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:01 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:02.751278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:02.752003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:02.771492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:02.772064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:02.772719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:02.773686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:02.774565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:02.775201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:02.813178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:02.813857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:02.816721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:02.831277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:02.831800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:02.832200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:02.832913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:02.836785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:02.837479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:03.199742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:03.224342 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a4e2b181-e40d-48e1-8894-5630f279f5df tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1313 microversion: 2.1 time: 0.415951 Oct 04 11:34:03.230156 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4047/5480] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:02 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:03.249153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:03.255085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:03.270684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:03.274600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:03.275204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:03.277675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:03.278300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:03.282664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:03.506796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:03.520089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f4bf985-cecf-4bd3-b2f1-7622f3247b05 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1313 microversion: 2.1 time: 0.288635 Oct 04 11:34:03.521787 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4048/5481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:03 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:03.831815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:03.841194 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-343895c8-6300-4b3e-b3eb-6272abdba386 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1766 microversion: 2.1 time: 1.095218 Oct 04 11:34:03.841885 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1434/5482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:02 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1766 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:04.256646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:04.257457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:04.269339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:04.274708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:04.275303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:04.276059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:04.276526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:04.276959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:04.470064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6189f59c-4a41-4c80-9d1a-10aff62bbd22 req-aa0a0d03-83c2-45b1-9074-d0a5602abcdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aece1df8-5ec3-4a71-ac9a-f3c048791ece", "name": "network-vif-deleted", "tag": "3dc994ea-bae4-4161-8cac-8060ce61f32c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:04.497164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6189f59c-4a41-4c80-9d1a-10aff62bbd22 req-aa0a0d03-83c2-45b1-9074-d0a5602abcdf service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:04.498988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6189f59c-4a41-4c80-9d1a-10aff62bbd22 req-aa0a0d03-83c2-45b1-9074-d0a5602abcdf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:04.501552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6189f59c-4a41-4c80-9d1a-10aff62bbd22 req-aa0a0d03-83c2-45b1-9074-d0a5602abcdf service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:04.539696 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6189f59c-4a41-4c80-9d1a-10aff62bbd22 req-aa0a0d03-83c2-45b1-9074-d0a5602abcdf service nova] Creating event network-vif-deleted:3dc994ea-bae4-4161-8cac-8060ce61f32c for instance aece1df8-5ec3-4a71-ac9a-f3c048791ece on n-h2-791135-8 Oct 04 11:34:04.557263 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6189f59c-4a41-4c80-9d1a-10aff62bbd22 req-aa0a0d03-83c2-45b1-9074-d0a5602abcdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088014 Oct 04 11:34:04.558541 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1435/5483] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:34:04.564966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:04.566110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:04.573963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:04.574678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:04.575322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:04.576215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:04.576858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:04.578069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:04.735731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:04.750620 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4cf4856d-4f57-4a95-8b23-233a47a6a32a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1313 microversion: 2.1 time: 0.496918 Oct 04 11:34:04.751776 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4049/5484] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:04 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:04.867639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:04.870316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:04.882982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:04.885598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:04.886883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:04.902321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:04.903030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:04.903522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:05.067657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:05.068404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:05.068950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:05.071301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lazy-loading 'fault' on Instance uuid aece1df8-5ec3-4a71-ac9a-f3c048791ece {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:34:05.252984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:05.271397 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53b202ae-a5f0-4e41-ac04-975537eced0b tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1313 microversion: 2.1 time: 0.707960 Oct 04 11:34:05.272031 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1436/5485] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:04 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:05.285905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1168645766", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "dcfdebad-147a-4302-a9a6-e0e87a6747ec"}], "key_name": "tempest-TestNetworkBasicOps-1717784150", "security_groups": [{"name": "tempest-secgroup-smoke-1250966536"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:05.317693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b8844a79f4214ac9afeece1e9b2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13aa4682314a4017b0108b637bb85b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:05.336956 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a27d7a1f-a06c-4f87-8df6-5ff394ee071d tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 200 len: 1383 microversion: 2.1 time: 0.473910 Oct 04 11:34:05.342993 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4050/5486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:04 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 1383 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:05.665365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] validate_networks() for [('dcfdebad-147a-4302-a9a6-e0e87a6747ec', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:34:05.776157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:05.776767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:05.786776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:05.786776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:05.795631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:05.797669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:05.800756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:05.801650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:06.392046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:06.404839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6f8a4e9-82bc-48ed-ace0-538f5cf4484b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1497 microversion: 2.1 time: 0.632528 Oct 04 11:34:06.407494 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4051/5487] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:05 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1497 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:06.417664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:06.419392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:06.444264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:06.445285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:06.446132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:06.447062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:06.448020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:06.448644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.007924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:34:07.008390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:34:07.008948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:34:07.009636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:34:07.010058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:34:07.031455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.032617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.033151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.034428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.034889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.035330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.105706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for project 6ab55c98bb424804b2b405228f663b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:34:07.121520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for user c2b1b00cd36e44029505dd9d14b2fec6 and project 6ab55c98bb424804b2b405228f663b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:34:07.139078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:34:07.141636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:34:07.202907 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b42b469a-7234-43e3-9383-23be46d14c3a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.927696 Oct 04 11:34:07.203956 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1437/5488] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:34:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:34:07.210947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:07.211903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] [instance: aece1df8-5ec3-4a71-ac9a-f3c048791ece] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:07.221446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.222229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.223007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.224725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.225422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.226326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.250511 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] HTTP exception thrown: Instance aece1df8-5ec3-4a71-ac9a-f3c048791ece could not be found. Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Request method failure captured: Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece HTTP/1.1 Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBl9WmvnXWh2-aGtNVByP2QZi5O2d5O6uA4Fl0_D5dUDexEvYESrqorA96XRR2CM33jO4yMfE1p9b_ogUijUPgS35SVphePedAjJbepDnz4bAVBTarfrM02gb8fsccSKyNE8M0CUJc9WDIQtLuOJ8udRW1u_O-tpmEZc3u-TM2eOwn4 Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 13aa4682314a4017b0108b637bb85b1b Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1961966359 Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_13aa4682314a4017b0108b637bb85b1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/13aa4682314a4017b0108b637bb85b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/13aa4682314a4017b0108b637bb85b1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/13aa4682314a4017b0108b637bb85b1b"}]}] Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1961966359 Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 13aa4682314a4017b0108b637bb85b1b Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1961966359 Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestSecurityGroupsBasicOps-1961966359-project Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e47b8844a79f4214ac9afeece1e9b2bc Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1961966359-project Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance aece1df8-5ec3-4a71-ac9a-f3c048791ece could not be found. Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'aece1df8-5ec3-4a71-ac9a-f3c048791ece'} Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aece1df8-5ec3-4a71-ac9a-f3c048791ece could not be found. Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aece1df8-5ec3-4a71-ac9a-f3c048791ece could not be found. Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:07.253207 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:34:07.256287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:07.256287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:07.256287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:34:07.256287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:34:07.256287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:34:07.256287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:34:07.256287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aece1df8-5ec3-4a71-ac9a-f3c048791ece could not be found. Oct 04 11:34:07.256287 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:07.259051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Returning 404 to user: Instance aece1df8-5ec3-4a71-ac9a-f3c048791ece could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:34:07.260356 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8809f59a-59e9-4777-9771-8ce7ba131686 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece" status: 404 len: 111 microversion: 2.1 time: 0.054425 Oct 04 11:34:07.262085 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1438/5489] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:07 2022] GET /compute/v2.1/servers/aece1df8-5ec3-4a71-ac9a-f3c048791ece => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:34:07.272084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e0f3e332-5b29-41fc-9db2-6ad74960182b req-6591285b-6daa-4648-9132-9bde06f7b6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b08d7f0d-f324-4d21-b750-89dab3b6e767", "tag": "af079605-52e3-496e-9073-6ee3d1daf6ca"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:07.286088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e0f3e332-5b29-41fc-9db2-6ad74960182b req-6591285b-6daa-4648-9132-9bde06f7b6aa service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.287412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e0f3e332-5b29-41fc-9db2-6ad74960182b req-6591285b-6daa-4648-9132-9bde06f7b6aa service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.288116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e0f3e332-5b29-41fc-9db2-6ad74960182b req-6591285b-6daa-4648-9132-9bde06f7b6aa service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.307206 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e0f3e332-5b29-41fc-9db2-6ad74960182b req-6591285b-6daa-4648-9132-9bde06f7b6aa service nova] Creating event network-changed:af079605-52e3-496e-9073-6ee3d1daf6ca for instance b08d7f0d-f324-4d21-b750-89dab3b6e767 on n-h1-791135-8 Oct 04 11:34:07.317820 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e0f3e332-5b29-41fc-9db2-6ad74960182b req-6591285b-6daa-4648-9132-9bde06f7b6aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054048 Oct 04 11:34:07.319664 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1439/5490] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:34:07.328367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:07.331016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:07.339542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.340606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.341329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.343359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.344626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.345259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.384211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:34:07.391054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:07.403426 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0142d44f-257f-4199-8d87-bb8122b21ea0 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1313 microversion: 2.1 time: 0.994650 Oct 04 11:34:07.408351 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4052/5491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:06 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1313 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:07.424687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4fc3951-5eb2-463b-8e67-4b2d3e4ff1d5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:07.425335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4fc3951-5eb2-463b-8e67-4b2d3e4ff1d5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:07.540746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c4fc3951-5eb2-463b-8e67-4b2d3e4ff1d5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:07.554650 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4fc3951-5eb2-463b-8e67-4b2d3e4ff1d5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1249 microversion: 2.1 time: 0.143686 Oct 04 11:34:07.555858 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4053/5492] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:07 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1249 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:07.571992 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86c53283-e904-4871-974d-2e702f070582 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 204 len: 0 microversion: 2.1 time: 0.250468 Oct 04 11:34:07.573661 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1440/5493] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:34:07 2022] DELETE /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:34:07.581795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:07.582559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:07.594570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.594570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.597625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:07.598437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:07.598858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:07.599361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:08.052841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:08.065957 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7aa9ea19-4f31-422e-b41c-d586f43dc497 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1503 microversion: 2.1 time: 0.488120 Oct 04 11:34:08.066571 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4054/5494] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:07 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1503 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:08.435984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:08.437240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:08.444608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:08.445370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:08.446218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:08.447246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:08.448434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:08.449548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:08.588246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:08.589076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:08.599854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:08.600751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:08.601404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:08.602308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:08.602973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:08.603484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:08.704745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:08.716377 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-051fc4eb-1676-4279-b834-094a87cc00fa tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1253 microversion: 2.1 time: 0.135474 Oct 04 11:34:08.717002 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4055/5495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:08 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1253 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:08.926348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:08.941720 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0e9ae90-90e9-4af9-9d32-e952e3d98742 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1313 microversion: 2.1 time: 0.509914 Oct 04 11:34:08.942541 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1441/5496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:08 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:09.092030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:09.093086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:09.103321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:09.104617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:09.105306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:09.106297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:09.106982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:09.107988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:09.395329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:09.441111 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e67863f7-c4cc-4146-9040-1baec0680c29 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1503 microversion: 2.1 time: 0.345114 Oct 04 11:34:09.444511 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4056/5497] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:09 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:09.742542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:09.743771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:09.759450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:09.760172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:09.760837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:09.762289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:09.763108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:09.764783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:09.956552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:09.969725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:09.970471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:09.988576 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66768b0a-1f74-436a-95c4-5996e2264c49 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1319 microversion: 2.1 time: 0.247014 Oct 04 11:34:10.001898 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1442/5498] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:09 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:10.008565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:10.013065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:10.015013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:10.016827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:10.019478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:10.020046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:10.231203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:10.254389 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ed57664-b5b0-48d8-b013-03920ee2d45f tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1313 microversion: 2.1 time: 0.290574 Oct 04 11:34:10.273015 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4057/5499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:09 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:10.469287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:10.470653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:10.478361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:10.479520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:10.480599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:10.481619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:10.482230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:10.482899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:11.013130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:11.013968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:11.023382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:11.024021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:11.024560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:11.025381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:11.026055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:11.026661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:11.156214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:11.167709 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb5355ad-b4a6-4bde-9430-b136e8f4d775 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1307 microversion: 2.1 time: 0.158256 Oct 04 11:34:11.168633 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4058/5500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:11 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:11.287067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:11.287839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:11.297876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:11.298473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:11.299144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:11.299971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:11.300538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:11.301112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:11.357399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:11.394464 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d4e59f5e-1ea2-4e17-972c-6a25528c2200 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 200 len: 1503 microversion: 2.1 time: 0.923126 Oct 04 11:34:11.395959 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1443/5501] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:10 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 1503 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:11.415095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-41900551-4269-40a1-aa76-4a5396d00671 req-fcc0da58-3b9d-46b7-9979-7ab1395131b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfaed36a-fae6-4a58-aabb-1eec9141e78d", "name": "network-vif-deleted", "tag": "4cc267eb-d26a-4dc4-8624-82d76fa3e0e2"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:11.435917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-41900551-4269-40a1-aa76-4a5396d00671 req-fcc0da58-3b9d-46b7-9979-7ab1395131b8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:11.436962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-41900551-4269-40a1-aa76-4a5396d00671 req-fcc0da58-3b9d-46b7-9979-7ab1395131b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:11.437904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-41900551-4269-40a1-aa76-4a5396d00671 req-fcc0da58-3b9d-46b7-9979-7ab1395131b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:11.463501 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-41900551-4269-40a1-aa76-4a5396d00671 req-fcc0da58-3b9d-46b7-9979-7ab1395131b8 service nova] Creating event network-vif-deleted:4cc267eb-d26a-4dc4-8624-82d76fa3e0e2 for instance dfaed36a-fae6-4a58-aabb-1eec9141e78d on n-h2-791135-8 Oct 04 11:34:11.480480 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-41900551-4269-40a1-aa76-4a5396d00671 req-fcc0da58-3b9d-46b7-9979-7ab1395131b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082633 Oct 04 11:34:11.483786 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1444/5502] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:34:11.630772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:11.663119 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31ea4387-345d-40b9-9e33-087ffa7bb1f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1313 microversion: 2.1 time: 0.381497 Oct 04 11:34:11.668307 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4059/5503] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:11 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:11.669154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-12b28c67-6e23-41b2-bccd-26af36969318 req-16d9700d-fa1a-4043-a0d3-568d58f9c977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08d7f0d-f324-4d21-b750-89dab3b6e767", "name": "network-vif-plugged", "status": "completed", "tag": "af079605-52e3-496e-9073-6ee3d1daf6ca"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:11.686644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12b28c67-6e23-41b2-bccd-26af36969318 req-16d9700d-fa1a-4043-a0d3-568d58f9c977 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:11.687348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12b28c67-6e23-41b2-bccd-26af36969318 req-16d9700d-fa1a-4043-a0d3-568d58f9c977 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:11.687990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12b28c67-6e23-41b2-bccd-26af36969318 req-16d9700d-fa1a-4043-a0d3-568d58f9c977 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:11.714397 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-12b28c67-6e23-41b2-bccd-26af36969318 req-16d9700d-fa1a-4043-a0d3-568d58f9c977 service nova] Creating event network-vif-plugged:af079605-52e3-496e-9073-6ee3d1daf6ca for instance b08d7f0d-f324-4d21-b750-89dab3b6e767 on n-h1-791135-8 Oct 04 11:34:11.733831 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-12b28c67-6e23-41b2-bccd-26af36969318 req-16d9700d-fa1a-4043-a0d3-568d58f9c977 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069658 Oct 04 11:34:11.752750 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1445/5504] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:34:12.193631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:12.194852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:12.206152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:12.206648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:12.207089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:12.209418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:12.210855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:12.212874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:12.426357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:12.427065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: dfaed36a-fae6-4a58-aabb-1eec9141e78d] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:12.444598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:12.446625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:12.449248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:12.453869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:12.454070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:12.457557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:12.478499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:12.488305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb74a3ca-a0e5-4303-ab9e-eb2c420fdc79 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.299459 Oct 04 11:34:12.488906 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4060/5505] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:12 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:12.521488 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] HTTP exception thrown: Instance dfaed36a-fae6-4a58-aabb-1eec9141e78d could not be found. Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Request method failure captured: Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d HTTP/1.1 Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBoWmf0QQZ6G3htQVqJ0E_DRFGFj1U9XjIcKoocKgBr9rZecKaXJ2SkIICZocjFc2F1eaTU-PzZJ2SFyG2bYflOkzbQRNk5xXL-nNTWMgILIC-ug_kIyIzn28dchKZqQeRotoGG10m5KFWiAfSWpiMQHGKkeXEYMWSLfSXhAsMZHh6M Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: ef0b35bbab4846b1884b7fd7a7ba9a2f Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesActionsTest-819972924 Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef0b35bbab4846b1884b7fd7a7ba9a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef0b35bbab4846b1884b7fd7a7ba9a2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef0b35bbab4846b1884b7fd7a7ba9a2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef0b35bbab4846b1884b7fd7a7ba9a2f"}]}] Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesActionsTest-819972924 Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: ef0b35bbab4846b1884b7fd7a7ba9a2f Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesActionsTest-819972924 Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-VolumesActionsTest-819972924-project Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 943740737ba643e8b913a05c3bbc4a64 Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesActionsTest-819972924-project Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance dfaed36a-fae6-4a58-aabb-1eec9141e78d could not be found. Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'dfaed36a-fae6-4a58-aabb-1eec9141e78d'} Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfaed36a-fae6-4a58-aabb-1eec9141e78d could not be found. Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfaed36a-fae6-4a58-aabb-1eec9141e78d could not be found. Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:34:12.524070 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfaed36a-fae6-4a58-aabb-1eec9141e78d could not be found. Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Returning 404 to user: Instance dfaed36a-fae6-4a58-aabb-1eec9141e78d could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:34:12.527825 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-94010226-2804-4255-b820-9ff5a6ff5216 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d" status: 404 len: 111 microversion: 2.1 time: 0.105396 Oct 04 11:34:12.536975 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1446/5506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:12 2022] GET /compute/v2.1/servers/dfaed36a-fae6-4a58-aabb-1eec9141e78d => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:34:12.693599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:12.694833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:12.709283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:12.711054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:12.711748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:12.714556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:12.715450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:12.716638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:12.843714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1558093049", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "3a0b1205-e4d2-4f85-b589-0287a1a6602b"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:12.957676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] validate_networks() for [('3a0b1205-e4d2-4f85-b589-0287a1a6602b', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:34:13.009590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:13.013380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:13.052607 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3730a8f-d952-46c8-88ad-160ee9468167 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1313 microversion: 2.1 time: 0.363235 Oct 04 11:34:13.053205 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4061/5507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:12 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:13.512557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:13.513924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:13.538208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:13.538900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:13.539339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:13.540120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:13.540762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:13.541578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:14.035581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:34:14.036515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:34:14.037136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:34:14.037730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:34:14.038286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:34:14.055944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:14.056668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:14.057254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:14.058247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:14.061725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:14.062968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:14.107687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Getting quotas for project ef0b35bbab4846b1884b7fd7a7ba9a2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:34:14.113259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Getting quotas for user 943740737ba643e8b913a05c3bbc4a64 and project ef0b35bbab4846b1884b7fd7a7ba9a2f. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:34:14.145223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:34:14.147601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:34:14.236600 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c244ae2-aef3-47a6-9ec2-23a47cad5f78 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396763 Oct 04 11:34:14.237257 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1447/5508] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:34:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:34:14.242004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:14.254246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:14.260629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:14.261118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:14.261733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:14.262589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:14.263196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:14.263770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:14.534109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:14.544431 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a686fb2-d5b4-4c17-b073-18f469b96077 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 1.035968 Oct 04 11:34:14.549362 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4062/5509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:13 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:14.559782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c392679e-8475-4b0f-9941-67577a0e529b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:14.562332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c392679e-8475-4b0f-9941-67577a0e529b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:14.766814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c392679e-8475-4b0f-9941-67577a0e529b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:14.778661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c392679e-8475-4b0f-9941-67577a0e529b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1214 microversion: 2.1 time: 0.226913 Oct 04 11:34:14.781270 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4063/5510] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:14 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:14.894731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:14.898704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-fec6d48f-a673-4676-82d6-61f47fda92cb req-73af83a1-091c-4aac-a0d3-896fd55d8eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c06582-9d1b-42c2-bdfb-2a54665b7cbf", "tag": "34ef2024-0a9b-46a3-866e-4101b0dc8839"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:14.913277 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b1d45e4-e758-4903-9f6f-c68db1c6fb7a tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1496 microversion: 2.1 time: 0.671782 Oct 04 11:34:14.914012 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1448/5511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:14 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1496 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:14.920380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fec6d48f-a673-4676-82d6-61f47fda92cb req-73af83a1-091c-4aac-a0d3-896fd55d8eab service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:14.933031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fec6d48f-a673-4676-82d6-61f47fda92cb req-73af83a1-091c-4aac-a0d3-896fd55d8eab service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:14.933844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-fec6d48f-a673-4676-82d6-61f47fda92cb req-73af83a1-091c-4aac-a0d3-896fd55d8eab service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:14.955001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-fec6d48f-a673-4676-82d6-61f47fda92cb req-73af83a1-091c-4aac-a0d3-896fd55d8eab service nova] Creating event network-changed:34ef2024-0a9b-46a3-866e-4101b0dc8839 for instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf on n-h2-791135-8 Oct 04 11:34:14.961571 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-fec6d48f-a673-4676-82d6-61f47fda92cb req-73af83a1-091c-4aac-a0d3-896fd55d8eab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067328 Oct 04 11:34:14.964910 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4064/5512] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:34:15.572864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:15.573563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:15.587596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:15.588103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:15.588548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:15.589273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:15.598839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:15.599500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:15.812435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:15.814171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:15.822314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:15.823141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:15.824026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:15.825636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:15.826103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:15.826639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:15.919104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:15.931594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6da774f3-6d41-4c75-9a01-0357528be70b tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1266 microversion: 2.1 time: 0.126978 Oct 04 11:34:15.932262 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4065/5513] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:15 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:16.151300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:16.161060 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9734b220-371d-48a2-ab54-c70c6c0e96a5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.593174 Oct 04 11:34:16.161692 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1449/5514] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:15 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:16.956655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:16.957376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:16.969143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:16.969960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:16.970785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:16.973422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:16.974320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:16.975089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:17.095506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:17.103705 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbcb1357-f410-4524-b301-c70bf2c9d4b3 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1272 microversion: 2.1 time: 0.150911 Oct 04 11:34:17.120369 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4066/5515] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:16 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:17.186303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:17.186990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:17.197175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:17.198075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:17.198785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:17.199955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:17.200629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:17.202407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:17.573749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:17.588976 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-69156454-86f8-4d1b-9eab-dd0bfe567d74 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.407223 Oct 04 11:34:17.591159 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1450/5516] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:17 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:18.002461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eaaa43ce-21dc-4971-bc12-dfaa77d5d880 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] Calling method '.version_select at 0x7f71d41f5ee0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:18.081505 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eaaa43ce-21dc-4971-bc12-dfaa77d5d880 tempest-TestSecurityGroupsBasicOps-1961966359 tempest-TestSecurityGroupsBasicOps-1961966359-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-415824212" status: 202 len: 0 microversion: 2.1 time: 0.083712 Oct 04 11:34:18.086705 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4067/5517] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:34:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-415824212 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:34:18.128777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:18.129670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:18.141984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:18.142704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:18.145812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:18.146772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:18.147997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:18.149036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:18.421793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:18.442699 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-914c6f92-e5c9-4f81-b838-c86245ce9d54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 0.308859 Oct 04 11:34:18.445855 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1451/5518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:18 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:18.615046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:18.615833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:18.630117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:18.630742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:18.631281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:18.633213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:18.634418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:18.636653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:18.974094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:18.988202 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-799610b7-3489-4c3b-ba76-03c3c3decf26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.377099 Oct 04 11:34:19.011892 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4068/5519] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:18 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:19.471076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:19.471680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:19.485095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:19.499788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:19.503100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:19.506287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:19.507087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:19.507999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:19.564367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:19.695818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:19.696383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:19.710888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:19.714810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:19.715878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:19.718306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:19.720049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:19.720521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:19.831065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:34:20.020570 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-930dbd50-a29c-4027-9bed-2f3877479fa2 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 204 len: 0 microversion: 2.1 time: 0.330021 Oct 04 11:34:20.021706 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4069/5520] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:34:19 2022] DELETE /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:34:20.040181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:20.041657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:20.053470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:20.054381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:20.055174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:20.056096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:20.056976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:20.057865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:20.278624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:20.289921 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82982b85-e5d5-4929-bc36-45e774924f38 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 0.823141 Oct 04 11:34:20.307949 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1452/5521] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:19 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:20.326792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:20.327537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:20.346276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:20.346990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:20.347580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:20.348461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:20.348926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:20.349385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:20.462401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:20.471958 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd9421a2-880e-4bac-b312-90fe540a1440 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.448306 Oct 04 11:34:20.472996 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4070/5522] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:20 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:21.068088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:21.076083 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9773b8b2-4889-4efa-b845-f555165b90f7 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1502 microversion: 2.1 time: 0.762092 Oct 04 11:34:21.076720 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1453/5523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:20 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1502 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:21.321721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:21.322409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:21.353165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:21.361387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:21.363449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:21.365372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:21.365899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:21.366352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:21.501632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:21.502127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:21.530863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:21.534598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:21.536071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:21.539511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:21.540055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:21.540507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:22.336520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:22.350869 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ddbb5427-6aa3-4527-816b-30e8f8d9b059 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 1.031989 Oct 04 11:34:22.351513 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4071/5524] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:21 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:22.371942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:22.372762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:22.390721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:22.391503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:22.392218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:22.393116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:22.395458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:22.396655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:22.505845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:22.521800 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aef03d58-2439-4f91-b257-8845a95e1ddc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 1.019812 Oct 04 11:34:22.522795 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1454/5525] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:21 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:22.905216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:22.934679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b24a6e4-cff3-499a-b1e6-71f0f75cd2a9 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1502 microversion: 2.1 time: 0.582044 Oct 04 11:34:22.936650 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4072/5526] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:22 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1502 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:23.220484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-028a2aca-cdc4-4d1a-9ef6-297d90f9f802 req-2a643926-0d0a-4953-9137-227fa516be02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e429b5d-102c-4c99-93d7-32f1357e361f", "tag": "2788277b-f771-43b1-bf14-defbb6a02ca6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:23.242327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-028a2aca-cdc4-4d1a-9ef6-297d90f9f802 req-2a643926-0d0a-4953-9137-227fa516be02 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:23.243239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-028a2aca-cdc4-4d1a-9ef6-297d90f9f802 req-2a643926-0d0a-4953-9137-227fa516be02 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:23.246468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-028a2aca-cdc4-4d1a-9ef6-297d90f9f802 req-2a643926-0d0a-4953-9137-227fa516be02 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:23.285047 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-028a2aca-cdc4-4d1a-9ef6-297d90f9f802 req-2a643926-0d0a-4953-9137-227fa516be02 service nova] Creating event network-changed:2788277b-f771-43b1-bf14-defbb6a02ca6 for instance 1e429b5d-102c-4c99-93d7-32f1357e361f on n-h2-791135-8 Oct 04 11:34:23.297231 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-028a2aca-cdc4-4d1a-9ef6-297d90f9f802 req-2a643926-0d0a-4953-9137-227fa516be02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078589 Oct 04 11:34:23.298213 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1455/5527] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:34:23.379593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:23.380301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:23.396862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:23.403721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:23.406898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:23.412300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:23.413037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:23.413667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:23.566992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:23.567713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:23.587466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:23.587960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:23.594568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:23.595337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:23.595817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:23.601035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:23.707128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:23.717724 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-435df279-db07-419d-88cd-1d2ebfd31859 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 0.342347 Oct 04 11:34:23.718325 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4073/5528] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:23 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:23.968358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:23.968982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:23.985511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:23.986021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:23.986450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:23.987160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:23.987619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:23.988049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:24.037208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:24.037733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:24.038638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:24.039280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lazy-loading 'fault' on Instance uuid b08d7f0d-f324-4d21-b750-89dab3b6e767 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:34:24.090037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:24.093242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:24.108199 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-394d79c3-a5d2-4ab3-96d8-0b6102c15aed tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.564645 Oct 04 11:34:24.113465 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1456/5529] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:23 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:24.499245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b6a7dac2-c4ad-47d1-af00-e90d98b64946 req-586ed5e9-5e4d-4f6f-9648-7e11212de587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c06582-9d1b-42c2-bdfb-2a54665b7cbf", "name": "network-vif-plugged", "status": "completed", "tag": "34ef2024-0a9b-46a3-866e-4101b0dc8839"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:24.521916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=22 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:24.528061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b6a7dac2-c4ad-47d1-af00-e90d98b64946 req-586ed5e9-5e4d-4f6f-9648-7e11212de587 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:24.530094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b6a7dac2-c4ad-47d1-af00-e90d98b64946 req-586ed5e9-5e4d-4f6f-9648-7e11212de587 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:24.530920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b6a7dac2-c4ad-47d1-af00-e90d98b64946 req-586ed5e9-5e4d-4f6f-9648-7e11212de587 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:24.579638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eeb61cde59d4187b2217cae9dbe1f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02453eda255e4bf7806fb6e0d10b54e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:24.580247 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b6a7dac2-c4ad-47d1-af00-e90d98b64946 req-586ed5e9-5e4d-4f6f-9648-7e11212de587 service nova] Creating event network-vif-plugged:34ef2024-0a9b-46a3-866e-4101b0dc8839 for instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf on n-h2-791135-8 Oct 04 11:34:24.588768 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c49d0dd9-029e-422f-af62-b0afb58fe224 tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 200 len: 1303 microversion: 2.1 time: 0.622888 Oct 04 11:34:24.591046 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4074/5530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:23 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 1303 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:24.600403 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b6a7dac2-c4ad-47d1-af00-e90d98b64946 req-586ed5e9-5e4d-4f6f-9648-7e11212de587 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105945 Oct 04 11:34:24.604154 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1457/5531] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:34:24.745344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:24.746053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:24.756217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:24.757058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:24.760329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:24.761289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:24.761931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:24.762965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:24.801497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:25.140064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:25.141271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:25.153100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:25.155381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:25.156125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:25.156910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:25.157475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:25.157967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:25.243276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:25.255541 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbba302e-2163-4ba4-81f6-d3180cbc31e6 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 0.516124 Oct 04 11:34:25.264077 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4075/5532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:24 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:25.354178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8d5e33ed-7868-46aa-8efe-88368414c96d req-47147a1f-5037-4928-8a1f-b750aa43631c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08d7f0d-f324-4d21-b750-89dab3b6e767", "name": "network-vif-deleted", "tag": "af079605-52e3-496e-9073-6ee3d1daf6ca"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:25.378039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d5e33ed-7868-46aa-8efe-88368414c96d req-47147a1f-5037-4928-8a1f-b750aa43631c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:25.378525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d5e33ed-7868-46aa-8efe-88368414c96d req-47147a1f-5037-4928-8a1f-b750aa43631c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:25.383753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d5e33ed-7868-46aa-8efe-88368414c96d req-47147a1f-5037-4928-8a1f-b750aa43631c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:25.416015 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8d5e33ed-7868-46aa-8efe-88368414c96d req-47147a1f-5037-4928-8a1f-b750aa43631c service nova] Creating event network-vif-deleted:af079605-52e3-496e-9073-6ee3d1daf6ca for instance b08d7f0d-f324-4d21-b750-89dab3b6e767 on n-h1-791135-8 Oct 04 11:34:25.428134 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8d5e33ed-7868-46aa-8efe-88368414c96d req-47147a1f-5037-4928-8a1f-b750aa43631c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082804 Oct 04 11:34:25.429577 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4076/5533] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:34:25.502233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:25.511382 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60e1a600-4610-4348-9206-fb25a8026a6e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.378772 Oct 04 11:34:25.516345 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1458/5534] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:25 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:25.616548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:25.618158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] [instance: b08d7f0d-f324-4d21-b750-89dab3b6e767] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:25.629674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:25.630680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:25.631201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:25.632088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:25.633173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:25.633995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:25.661192 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] HTTP exception thrown: Instance b08d7f0d-f324-4d21-b750-89dab3b6e767 could not be found. Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Request method failure captured: Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 HTTP/1.1 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBoggGjyH0jF6rz7H9FS24uU9c5mURbpg6elqawAV7gLN8VkpDkv05uyWcNPGceimQ_XDDm257iLHyCy0Pef4B85P_GbpYk4OPf417nTzhZLerEXxwnKMl4Jz3JDlg8l1NTux5R0vn4UekT2UnPhnAHbPOho8Oj17DB-E05F8_S3EVI Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 02453eda255e4bf7806fb6e0d10b54e2 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesActionsTest-1716007506 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02453eda255e4bf7806fb6e0d10b54e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02453eda255e4bf7806fb6e0d10b54e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02453eda255e4bf7806fb6e0d10b54e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02453eda255e4bf7806fb6e0d10b54e2"}]}] Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesActionsTest-1716007506 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 02453eda255e4bf7806fb6e0d10b54e2 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesActionsTest-1716007506 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesActionsTest-1716007506-project Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4eeb61cde59d4187b2217cae9dbe1f08 Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesActionsTest-1716007506-project Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b08d7f0d-f324-4d21-b750-89dab3b6e767 could not be found. Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b08d7f0d-f324-4d21-b750-89dab3b6e767'} Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b08d7f0d-f324-4d21-b750-89dab3b6e767 could not be found. Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b08d7f0d-f324-4d21-b750-89dab3b6e767 could not be found. Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:34:25.664530 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:25.668386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:25.668386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:34:25.668386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:34:25.668386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:34:25.668386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:34:25.668386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b08d7f0d-f324-4d21-b750-89dab3b6e767 could not be found. Oct 04 11:34:25.668386 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:25.671250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] Returning 404 to user: Instance b08d7f0d-f324-4d21-b750-89dab3b6e767 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:34:25.672719 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-693127be-ea62-4268-91f5-02bb362c78cd tempest-VolumesActionsTest-1716007506 tempest-VolumesActionsTest-1716007506-project] 10.222.0.23 "GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767" status: 404 len: 111 microversion: 2.1 time: 0.062487 Oct 04 11:34:25.673469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4077/5535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:25 2022] GET /compute/v2.1/servers/b08d7f0d-f324-4d21-b750-89dab3b6e767 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:34:26.280076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:26.281873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:26.290686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:26.291716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:26.292334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:26.293216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:26.293970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:26.294573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:26.539614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:26.540748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:26.574045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:26.574787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:26.575521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:26.577345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:26.578008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:26.579126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:26.613785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:26.635552 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf530391-8725-4b6e-8078-7542e1687f6e tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 0.361562 Oct 04 11:34:26.636148 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1459/5536] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:26 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:27.173406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:27.193691 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77f44c2f-5ae9-4cb8-bbee-cecb7539a6a9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.656240 Oct 04 11:34:27.195245 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4078/5537] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:26 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:27.666869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:27.669435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:27.683759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:27.684708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:27.685431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:27.686493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:27.687170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:27.687662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:28.220151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:28.220885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:28.232115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:28.233886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:28.235637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:28.236756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:28.237674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:28.242132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:28.524508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:28.537044 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e188cc96-425e-4e5c-96e7-17cbe8915376 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1375 microversion: 2.1 time: 0.321345 Oct 04 11:34:28.538998 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4079/5538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:28 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1375 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:28.661961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:28.672176 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ff04aaa-4ec4-4bac-b373-548ff9e3125a tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 1.012234 Oct 04 11:34:28.687246 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1460/5539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:27 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:29.571567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:29.572257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:29.587430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:29.589283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:29.590281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:29.596111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:29.601078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:29.601575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:29.650763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:29.696378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:29.697003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:29.713652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:29.714083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:29.714533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:29.721817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:29.722758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:29.724129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:30.270378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:30.278326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c80b8793-3874-408f-8c5b-b33966da11c1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1547 microversion: 2.1 time: 0.714087 Oct 04 11:34:30.278908 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4080/5540] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:29 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1547 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:30.307965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:30.308978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:30.320585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:30.321453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:30.322128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:30.323404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:30.325171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:30.327203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:30.513265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:30.528893 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ced8722-cef1-454b-97c9-36576879fe54 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 0.836392 Oct 04 11:34:30.530695 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1461/5541] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:29 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:30.849479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:30.855781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b919d654-47a9-49d2-971e-26e848cd1ff7 req-bc40d528-e01f-4da5-9afb-b6c8ad56e97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e429b5d-102c-4c99-93d7-32f1357e361f", "name": "network-vif-plugged", "status": "completed", "tag": "2788277b-f771-43b1-bf14-defbb6a02ca6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:30.860669 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25f86c30-aa1f-43e4-8c1f-7b015b03a0f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1547 microversion: 2.1 time: 0.557165 Oct 04 11:34:30.861283 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4081/5542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:30 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1547 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:34:30.879876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b919d654-47a9-49d2-971e-26e848cd1ff7 req-bc40d528-e01f-4da5-9afb-b6c8ad56e97e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:30.895369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b919d654-47a9-49d2-971e-26e848cd1ff7 req-bc40d528-e01f-4da5-9afb-b6c8ad56e97e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:30.895841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b919d654-47a9-49d2-971e-26e848cd1ff7 req-bc40d528-e01f-4da5-9afb-b6c8ad56e97e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:30.955909 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b919d654-47a9-49d2-971e-26e848cd1ff7 req-bc40d528-e01f-4da5-9afb-b6c8ad56e97e service nova] Creating event network-vif-plugged:2788277b-f771-43b1-bf14-defbb6a02ca6 for instance 1e429b5d-102c-4c99-93d7-32f1357e361f on n-h2-791135-8 Oct 04 11:34:30.972261 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b919d654-47a9-49d2-971e-26e848cd1ff7 req-bc40d528-e01f-4da5-9afb-b6c8ad56e97e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121111 Oct 04 11:34:30.974881 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1462/5543] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:34:31.558870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:31.559524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:31.573602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:31.574114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:31.574565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:31.577525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:31.579197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:31.580743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:32.183223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:32.199310 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f78afd0-ed50-4d38-aae2-8d713654a78c tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1314 microversion: 2.1 time: 0.648108 Oct 04 11:34:32.204610 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4082/5544] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:31 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:33.255466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:33.259920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:33.283130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:33.286304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:33.288549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:33.289663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:33.290722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:33.291782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:33.293094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:33.751345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:33.762084 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-36640ff6-3769-4d24-9dcb-d1df48e02f20 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1498 microversion: 2.1 time: 0.535973 Oct 04 11:34:33.790655 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1463/5545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:33 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1498 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:35.254448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:35.254971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:35.261841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:34:35.286190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:35.286702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:35.287151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:35.287871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:35.288335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:35.288769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:35.414552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:34:35.594154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa57b824-ebad-4883-9f1b-f6059bbdf89d tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 204 len: 0 microversion: 2.1 time: 0.345049 Oct 04 11:34:35.599015 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4083/5546] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:34:35 2022] DELETE /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:34:35.605079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:35.605749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:35.617722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:35.618215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:35.634644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:35.641805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:35.642540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:35.649392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:36.409518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:36.424641 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4814b36d-8767-4c12-b613-98ffe76142be tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1504 microversion: 2.1 time: 0.824549 Oct 04 11:34:36.425262 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1464/5547] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:35 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1504 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:37.456700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:37.457514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:37.516664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:37.517239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:37.518208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:37.518496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:37.518954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:37.537639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:38.252811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:38.261370 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-996fc891-0fd9-46fb-83bb-260da7e0bc57 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1504 microversion: 2.1 time: 0.812614 Oct 04 11:34:38.280330 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4084/5548] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:37 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1504 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:39.289387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:39.289902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:39.305158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:39.305935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:39.306567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:39.307465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:39.308097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:39.308695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:39.478940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c68aa1fd-f8d0-412a-9715-ee554f9b29f4 req-d1cf79a9-bdf7-4fc4-82bf-c0273e4f530e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e429b5d-102c-4c99-93d7-32f1357e361f", "name": "network-vif-deleted", "tag": "2788277b-f771-43b1-bf14-defbb6a02ca6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:34:39.512976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c68aa1fd-f8d0-412a-9715-ee554f9b29f4 req-d1cf79a9-bdf7-4fc4-82bf-c0273e4f530e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:39.515517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c68aa1fd-f8d0-412a-9715-ee554f9b29f4 req-d1cf79a9-bdf7-4fc4-82bf-c0273e4f530e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:39.519394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c68aa1fd-f8d0-412a-9715-ee554f9b29f4 req-d1cf79a9-bdf7-4fc4-82bf-c0273e4f530e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:39.567595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c68aa1fd-f8d0-412a-9715-ee554f9b29f4 req-d1cf79a9-bdf7-4fc4-82bf-c0273e4f530e service nova] Creating event network-vif-deleted:2788277b-f771-43b1-bf14-defbb6a02ca6 for instance 1e429b5d-102c-4c99-93d7-32f1357e361f on n-h2-791135-8 Oct 04 11:34:39.580361 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c68aa1fd-f8d0-412a-9715-ee554f9b29f4 req-d1cf79a9-bdf7-4fc4-82bf-c0273e4f530e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105019 Oct 04 11:34:39.588245 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4085/5549] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:34:39.633696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943740737ba643e8b913a05c3bbc4a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef0b35bbab4846b1884b7fd7a7ba9a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:34:39.651293 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae25ef3f-0049-4715-ba86-d0d7e1064992 tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 200 len: 1462 microversion: 2.1 time: 0.366649 Oct 04 11:34:39.655524 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1465/5550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:39 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 1462 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:34:40.677987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:34:40.678690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] [instance: 1e429b5d-102c-4c99-93d7-32f1357e361f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:34:40.705967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:40.710120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:40.710788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:40.711738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:34:40.712449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:34:40.713065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:34:40.730225 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] HTTP exception thrown: Instance 1e429b5d-102c-4c99-93d7-32f1357e361f could not be found. Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Request method failure captured: Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f HTTP/1.1 Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBoWmf0QQZ6G3htQVqJ0E_DRFGFj1U9XjIcKoocKgBr9rZecKaXJ2SkIICZocjFc2F1eaTU-PzZJ2SFyG2bYflOkzbQRNk5xXL-nNTWMgILIC-ug_kIyIzn28dchKZqQeRotoGG10m5KFWiAfSWpiMQHGKkeXEYMWSLfSXhAsMZHh6M Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ef0b35bbab4846b1884b7fd7a7ba9a2f Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesActionsTest-819972924 Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef0b35bbab4846b1884b7fd7a7ba9a2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef0b35bbab4846b1884b7fd7a7ba9a2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef0b35bbab4846b1884b7fd7a7ba9a2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef0b35bbab4846b1884b7fd7a7ba9a2f"}]}] Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesActionsTest-819972924 Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ef0b35bbab4846b1884b7fd7a7ba9a2f Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesActionsTest-819972924 Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesActionsTest-819972924-project Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 943740737ba643e8b913a05c3bbc4a64 Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesActionsTest-819972924-project Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1e429b5d-102c-4c99-93d7-32f1357e361f could not be found. Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1e429b5d-102c-4c99-93d7-32f1357e361f'} Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e429b5d-102c-4c99-93d7-32f1357e361f could not be found. Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e429b5d-102c-4c99-93d7-32f1357e361f could not be found. Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:34:40.732417 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:40.736507 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:34:40.736507 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:34:40.736507 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:34:40.736507 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:34:40.736507 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:34:40.736507 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e429b5d-102c-4c99-93d7-32f1357e361f could not be found. Oct 04 11:34:40.736507 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:34:40.737091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] Returning 404 to user: Instance 1e429b5d-102c-4c99-93d7-32f1357e361f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:34:40.738139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a0c672c-b956-402c-b839-d883da893fef tempest-VolumesActionsTest-819972924 tempest-VolumesActionsTest-819972924-project] 10.222.0.23 "GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f" status: 404 len: 111 microversion: 2.1 time: 0.065311 Oct 04 11:34:40.739153 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4086/5551] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:34:40 2022] GET /compute/v2.1/servers/1e429b5d-102c-4c99-93d7-32f1357e361f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:35:14.242397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:14.243048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:14.273683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:14.278027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=68 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:14.284949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:14.285485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:14.286845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:14.287586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:14.288045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:14.288470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:14.383144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:35:14.634256 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a506fb2-9af5-4919-b950-542c52ecc112 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "DELETE /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 204 len: 0 microversion: 2.1 time: 0.398102 Oct 04 11:35:14.635104 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1466/5552] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:35:14 2022] DELETE /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:35:14.651538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:14.654552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:14.703351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:14.704656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:14.711807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:14.716004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:14.716819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:14.718300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:14.718995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:14.722837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:15.276755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:15.301380 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45fc4b62-512a-4c49-bdb9-467699b87655 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1553 microversion: 2.1 time: 0.659945 Oct 04 11:35:15.307873 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4087/5553] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:14 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1553 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:16.331955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:16.332852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:16.376627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:16.377843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:16.383618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:16.386345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:16.390977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:16.392407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:17.138992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:17.162935 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fa83840-a1a6-46fa-951a-0e74e22417bb tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1553 microversion: 2.1 time: 0.836398 Oct 04 11:35:17.165098 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1467/5554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:16 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1553 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:18.193644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:18.194565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:18.218585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:18.219900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:18.223065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:18.225322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:18.227113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:18.227562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:18.392493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f43b3d75-dbc1-4477-a9b4-532cd86b8e25 req-3659d7ca-06cf-444e-80a4-fd078ce77ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c06582-9d1b-42c2-bdfb-2a54665b7cbf", "name": "network-vif-deleted", "tag": "34ef2024-0a9b-46a3-866e-4101b0dc8839"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:35:18.444572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f43b3d75-dbc1-4477-a9b4-532cd86b8e25 req-3659d7ca-06cf-444e-80a4-fd078ce77ee3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:18.449000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f43b3d75-dbc1-4477-a9b4-532cd86b8e25 req-3659d7ca-06cf-444e-80a4-fd078ce77ee3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:18.462340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f43b3d75-dbc1-4477-a9b4-532cd86b8e25 req-3659d7ca-06cf-444e-80a4-fd078ce77ee3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:18.534906 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f43b3d75-dbc1-4477-a9b4-532cd86b8e25 req-3659d7ca-06cf-444e-80a4-fd078ce77ee3 service nova] Creating event network-vif-deleted:34ef2024-0a9b-46a3-866e-4101b0dc8839 for instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf on n-h2-791135-8 Oct 04 11:35:18.553465 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f43b3d75-dbc1-4477-a9b4-532cd86b8e25 req-3659d7ca-06cf-444e-80a4-fd078ce77ee3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162255 Oct 04 11:35:18.556554 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1468/5555] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:35:18.616888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:18.634941 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b250a30-3e26-4c49-9040-07cced1170e5 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 200 len: 1485 microversion: 2.1 time: 0.447052 Oct 04 11:35:18.651185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4088/5556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:18 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 1485 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:19.681132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:19.681981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 87c06582-9d1b-42c2-bdfb-2a54665b7cbf] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:19.697585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:19.702026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:19.704749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:19.705673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:19.709929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:19.710499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:19.755125 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] HTTP exception thrown: Instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf could not be found. Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Request method failure captured: Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf HTTP/1.1 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBnchw0t6xCb1gy4e9tTMIESiExt7vInSL9H_qmdH4N0io8BwbMJ17ARyPFa7JG51qcqVMHOzg5muhFYDnystt9aqyPhy5W9K37sl4rp7HX5jYxiDhhb7yRtx1gSAh5zaX9JRbasYdGXuPoPQRwLq8ll2ixOy_QqHkDXJMyGb5UMk-4 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 6ab55c98bb424804b2b405228f663b12 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ab55c98bb424804b2b405228f663b12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ab55c98bb424804b2b405228f663b12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ab55c98bb424804b2b405228f663b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ab55c98bb424804b2b405228f663b12"}]}] Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 6ab55c98bb424804b2b405228f663b12 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestNetworkBasicOps-1174733418-project Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: c2b1b00cd36e44029505dd9d14b2fec6 Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkBasicOps-1174733418-project Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf could not be found. Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '87c06582-9d1b-42c2-bdfb-2a54665b7cbf'} Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf could not be found. Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf could not be found. Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:35:19.762555 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:35:19.767260 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:35:19.767260 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:35:19.767260 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:35:19.767260 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:35:19.767260 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:35:19.767260 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf could not be found. Oct 04 11:35:19.767260 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:35:19.767786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Returning 404 to user: Instance 87c06582-9d1b-42c2-bdfb-2a54665b7cbf could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:35:19.769602 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95b41892-b862-4295-be1c-b6c58b1640ba tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf" status: 404 len: 111 microversion: 2.1 time: 0.093518 Oct 04 11:35:19.795292 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1469/5557] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:19 2022] GET /compute/v2.1/servers/87c06582-9d1b-42c2-bdfb-2a54665b7cbf => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:35:20.225643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65dbbe92-a47a-4984-a927-c10a4677f36b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '.version_select at 0x7f71ceff9a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:20.290903 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-65dbbe92-a47a-4984-a927-c10a4677f36b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1717784150" status: 202 len: 0 microversion: 2.1 time: 0.069351 Oct 04 11:35:20.291698 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4089/5558] 10.222.0.23 () {58 vars in 1257 bytes} [Tue Oct 4 11:35:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1717784150 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:35:30.800578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:30.801190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:30.804520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:30.818744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a693e83b-014b-4632-be8d-662d3487a7be req-4988fff9-b957-41b1-9297-45b64318db16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8769bc5-df9a-4f3f-809f-845aab341a2f", "tag": "47c25c95-ca59-409d-88d1-f5c08b2f3fdf"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:35:30.827391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:30.858659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:30.861465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:30.864861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:30.872394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:30.877515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:30.878779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:30.879093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a693e83b-014b-4632-be8d-662d3487a7be req-4988fff9-b957-41b1-9297-45b64318db16 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:30.881251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a693e83b-014b-4632-be8d-662d3487a7be req-4988fff9-b957-41b1-9297-45b64318db16 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:30.882360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a693e83b-014b-4632-be8d-662d3487a7be req-4988fff9-b957-41b1-9297-45b64318db16 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:30.882926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:30.887898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:30.953105 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a693e83b-014b-4632-be8d-662d3487a7be req-4988fff9-b957-41b1-9297-45b64318db16 service nova] Creating event network-changed:47c25c95-ca59-409d-88d1-f5c08b2f3fdf for instance a8769bc5-df9a-4f3f-809f-845aab341a2f on n-h1-791135-8 Oct 04 11:35:30.988181 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a693e83b-014b-4632-be8d-662d3487a7be req-4988fff9-b957-41b1-9297-45b64318db16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157318 Oct 04 11:35:30.989095 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4090/5559] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:35:31.008272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:35:31.205529 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02d33979-bf47-4c2e-9d68-d3208f9cbd8c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 204 len: 0 microversion: 2.1 time: 0.409109 Oct 04 11:35:31.207242 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1470/5560] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:35:30 2022] DELETE /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:35:31.219565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:31.220800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:31.232069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:31.233333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:31.234383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:31.235404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:31.236708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:31.237739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:31.719009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:31.728070 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1ff18565-2bc0-4d6a-bcaf-fd6bf6def70b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1671 microversion: 2.1 time: 0.516366 Oct 04 11:35:31.728675 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4091/5561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:31 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1671 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:32.764605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:32.765625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:32.788387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:32.792474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:32.793632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:32.804169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:32.805686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:32.807778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:33.967796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:33.987709 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e40ebb2e-0f12-48be-8014-47116d28e667 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1671 microversion: 2.1 time: 1.230557 Oct 04 11:35:33.990987 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1471/5562] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:32 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1671 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:35.016330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:35.017956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:35.050768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:35.054509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:35.056988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:35.060656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:35.062228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:35.067127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:35.647892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:35.658793 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa3bed42-69ef-4cff-a6de-7d016c2d0d65 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 200 len: 1552 microversion: 2.1 time: 0.646080 Oct 04 11:35:35.662235 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4092/5563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:35 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 1552 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:35.691565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-76e40d5b-3230-4989-b1a5-58423cb88fdc req-51199eaf-5b7b-4626-9f80-3cc99a91c383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8769bc5-df9a-4f3f-809f-845aab341a2f", "name": "network-vif-deleted", "tag": "47c25c95-ca59-409d-88d1-f5c08b2f3fdf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:35:35.716145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-76e40d5b-3230-4989-b1a5-58423cb88fdc req-51199eaf-5b7b-4626-9f80-3cc99a91c383 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:35.718646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-76e40d5b-3230-4989-b1a5-58423cb88fdc req-51199eaf-5b7b-4626-9f80-3cc99a91c383 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:35.742928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-76e40d5b-3230-4989-b1a5-58423cb88fdc req-51199eaf-5b7b-4626-9f80-3cc99a91c383 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:35.802334 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-76e40d5b-3230-4989-b1a5-58423cb88fdc req-51199eaf-5b7b-4626-9f80-3cc99a91c383 service nova] Creating event network-vif-deleted:47c25c95-ca59-409d-88d1-f5c08b2f3fdf for instance a8769bc5-df9a-4f3f-809f-845aab341a2f on n-h1-791135-8 Oct 04 11:35:35.825567 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-76e40d5b-3230-4989-b1a5-58423cb88fdc req-51199eaf-5b7b-4626-9f80-3cc99a91c383 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137195 Oct 04 11:35:35.829649 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1472/5564] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:35:36.688627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:36.690285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: a8769bc5-df9a-4f3f-809f-845aab341a2f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:36.721239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:36.724138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:36.727162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:36.728493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:36.737531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:36.739373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:36.813393 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] HTTP exception thrown: Instance a8769bc5-df9a-4f3f-809f-845aab341a2f could not be found. Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Request method failure captured: Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f HTTP/1.1 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBnchw0t6xCb1gy4e9tTMIESiExt7vInSL9H_qmdH4N0io8BwbMJ17ARyPFa7JG51qcqVMHOzg5muhFYDnystt9aqyPhy5W9K37sl4rp7HX5jYxiDhhb7yRtx1gSAh5zaX9JRbasYdGXuPoPQRwLq8ll2ixOy_QqHkDXJMyGb5UMk-4 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 6ab55c98bb424804b2b405228f663b12 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ab55c98bb424804b2b405228f663b12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ab55c98bb424804b2b405228f663b12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ab55c98bb424804b2b405228f663b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ab55c98bb424804b2b405228f663b12"}]}] Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 6ab55c98bb424804b2b405228f663b12 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestNetworkBasicOps-1174733418-project Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: c2b1b00cd36e44029505dd9d14b2fec6 Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestNetworkBasicOps-1174733418-project Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a8769bc5-df9a-4f3f-809f-845aab341a2f could not be found. Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a8769bc5-df9a-4f3f-809f-845aab341a2f'} Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8769bc5-df9a-4f3f-809f-845aab341a2f could not be found. Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8769bc5-df9a-4f3f-809f-845aab341a2f could not be found. Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:35:36.819780 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:35:36.824275 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:35:36.824275 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:35:36.824275 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:35:36.824275 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:35:36.824275 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:35:36.824275 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8769bc5-df9a-4f3f-809f-845aab341a2f could not be found. Oct 04 11:35:36.824275 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:35:36.831324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Returning 404 to user: Instance a8769bc5-df9a-4f3f-809f-845aab341a2f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:35:36.834453 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7510dbc-7c5f-4314-afd5-79d8d6be679c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f" status: 404 len: 111 microversion: 2.1 time: 0.148776 Oct 04 11:35:36.839206 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4093/5565] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:36 2022] GET /compute/v2.1/servers/a8769bc5-df9a-4f3f-809f-845aab341a2f => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:35:37.405942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6af4adc-91b2-483e-a2ee-91e743fcf21a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '.version_select at 0x7f71d437daf0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:37.467850 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6af4adc-91b2-483e-a2ee-91e743fcf21a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-903413324" status: 202 len: 0 microversion: 2.1 time: 0.067286 Oct 04 11:35:37.482745 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4094/5566] 10.222.0.23 () {58 vars in 1254 bytes} [Tue Oct 4 11:35:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-903413324 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:35:37.790483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56ec741d-70a2-4890-8de4-ab033f5877a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Action: 'create', calling method: .version_select at 0x7f71cf7e4c10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-342496380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRR/RioXSgZsn3yy1YCPSPa2O9L9epZd8G6FPxQe1bgzhdR5cmj5dtsgmrM3zUk3rrJQa44U0J+Z9X8ZJ21lPr2T9ic5MEQ/UnYWr9vbC7O6Wu2ubQvOOG17fxXSio6eg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:35:37.845002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-56ec741d-70a2-4890-8de4-ab033f5877a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Getting quotas for project b674f857e65d4684bc6d371410bff253. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:35:37.872962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-56ec741d-70a2-4890-8de4-ab033f5877a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Getting quotas for user 18ea15d991c84397b3ddca848436b83f and project b674f857e65d4684bc6d371410bff253. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:35:37.939830 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56ec741d-70a2-4890-8de4-ab033f5877a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.169455 Oct 04 11:35:37.947305 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1473/5567] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:35:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:35:43.298652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1112537020", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-342496380", "security_groups": [{"name": "tempest-secgroup-smoke-145956433"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "7c0da745-9302-4979-833b-3a98d60fae46"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:35:43.764725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] validate_networks() for [('7c0da745-9302-4979-833b-3a98d60fae46', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:35:45.282681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Getting quotas for project b674f857e65d4684bc6d371410bff253. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:35:45.317455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Getting quotas for user 18ea15d991c84397b3ddca848436b83f and project b674f857e65d4684bc6d371410bff253. Resources: dict_keys(['metadata_items']) {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:35:45.351565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:35:45.353318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:35:45.354313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:35:45.355667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:35:45.360997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:35:45.379760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:45.380879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:45.381856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:45.384020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:45.384787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:45.385863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:45.427504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Getting quotas for project b674f857e65d4684bc6d371410bff253. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:35:45.482931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Getting quotas for user 18ea15d991c84397b3ddca848436b83f and project b674f857e65d4684bc6d371410bff253. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:35:45.607037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:35:45.610482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:35:45.730776 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-60981f1d-a2a5-4c82-b002-ddfac877bd79 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.436771 Oct 04 11:35:45.737439 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4095/5568] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:35:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:35:45.752362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6129abe2-c4ce-4862-baba-65df83beeacc tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:45.753762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6129abe2-c4ce-4862-baba-65df83beeacc tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:45.811144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:46.224932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6129abe2-c4ce-4862-baba-65df83beeacc tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:46.240002 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6129abe2-c4ce-4862-baba-65df83beeacc tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1302 microversion: 2.1 time: 0.491740 Oct 04 11:35:46.244083 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1474/5569] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:45 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1302 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:47.268215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:47.270299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:47.295723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:47.297589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:47.309646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:47.311815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:47.313074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:47.315763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:47.706871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:47.738213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-07dedd74-20ce-4e2c-ba45-15897cab1369 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1298 microversion: 2.1 time: 0.476403 Oct 04 11:35:47.746120 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4096/5570] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:47 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1298 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:48.774214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:48.774933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:48.821547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:48.822329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:48.825560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:48.828541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:48.831814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:48.832378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:49.117136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:49.130029 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-917af6d0-34bc-4ecc-840c-d0aa82beb4e3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1372 microversion: 2.1 time: 0.357848 Oct 04 11:35:49.153704 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1475/5571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:48 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1372 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:50.158741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:50.159435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:50.172037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:50.172879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:50.175675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:50.176663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:50.177343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:50.178947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:50.301639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:50.318638 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4af9052-12fe-4c6e-beb6-9497b2c61103 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1360 microversion: 2.1 time: 0.163716 Oct 04 11:35:50.327064 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4097/5572] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:50 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:51.351054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:51.352285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:51.363992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:51.365798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:51.367358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:51.368245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:51.370911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:51.373657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:52.083329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:52.103853 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4fad2398-3b53-462c-9c60-4345bd28652d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 0.757118 Oct 04 11:35:52.117602 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1476/5573] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:51 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:53.132734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:53.134038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:53.148045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:53.152012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:53.153585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:53.159246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:53.159950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:53.160586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:53.989719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:54.005604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-50fdcb31-d333-4c16-b0ca-2b1fac3acb62 req-991bbe9d-7f4e-478d-b7d6-98860b5fc491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544d260c-ff66-46df-84a1-ecb94b2e13db", "tag": "9a16af60-ed67-47b3-a3cf-d970c9744aa4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:35:54.028053 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9bed4091-2593-4228-ac5e-29a3652b9949 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 0.898313 Oct 04 11:35:54.044963 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4098/5574] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:53 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:54.048642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50fdcb31-d333-4c16-b0ca-2b1fac3acb62 req-991bbe9d-7f4e-478d-b7d6-98860b5fc491 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:54.049138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50fdcb31-d333-4c16-b0ca-2b1fac3acb62 req-991bbe9d-7f4e-478d-b7d6-98860b5fc491 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:54.056811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50fdcb31-d333-4c16-b0ca-2b1fac3acb62 req-991bbe9d-7f4e-478d-b7d6-98860b5fc491 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:54.091680 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-50fdcb31-d333-4c16-b0ca-2b1fac3acb62 req-991bbe9d-7f4e-478d-b7d6-98860b5fc491 service nova] Creating event network-changed:9a16af60-ed67-47b3-a3cf-d970c9744aa4 for instance 544d260c-ff66-46df-84a1-ecb94b2e13db on n-h2-791135-8 Oct 04 11:35:54.097227 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-50fdcb31-d333-4c16-b0ca-2b1fac3acb62 req-991bbe9d-7f4e-478d-b7d6-98860b5fc491 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103595 Oct 04 11:35:54.098406 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1477/5575] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:35:55.064092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:55.064715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:55.086252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:55.087067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:55.088593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:55.098929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:55.099707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:55.100308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:55.403214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:55.578110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=10 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:55.587095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:55.621260 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f48f3ee4-bb17-4f7a-9214-c5d07b6a0755 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 0.549765 Oct 04 11:35:55.623725 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4099/5576] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:55 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:56.648722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:56.655425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:56.658689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:35:56.683585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:56.694170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:56.694987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:56.696136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:56.696818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:56.700114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:57.046962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:57.056111 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d07a6cab-3c8d-429d-97d1-f3388b844816 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 0.411617 Oct 04 11:35:57.070926 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1478/5577] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:56 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:35:58.093594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:35:58.094962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:35:58.110034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:58.110538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:58.110984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:58.127582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:35:58.130466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:35:58.131896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:35:59.135739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:35:59.157930 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c92ed2b3-1950-488f-a198-d1e375310fac tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 1.068047 Oct 04 11:35:59.177332 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4100/5578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:35:58 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:00.188839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:00.189292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:00.210114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:00.221498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:00.222019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:00.222778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:00.223248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:00.223686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:01.627346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:01.637957 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9319f858-d6aa-489a-8f36-016f036c36db tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 1.453534 Oct 04 11:36:01.638819 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1479/5579] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:00 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:02.665828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:02.668404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:02.685007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:02.689290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:02.692150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:02.693017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:02.704204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:02.705042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:02.705946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:02.726170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=49 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:03.014465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:03.025741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61675ed5-9892-417c-8f42-549e59313983 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 0.365263 Oct 04 11:36:03.028135 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4101/5580] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:02 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:04.056062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:04.059337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:04.073081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:04.075583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:04.076493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:04.077102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:04.078497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:04.079416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:04.080140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:05.365724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:05.375820 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c6860e50-0c3a-41bf-8064-39f432816773 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 1.325431 Oct 04 11:36:05.379948 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1480/5581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:04 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:06.403453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:06.404061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:06.412962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:06.434530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:06.435173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:06.436084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:06.436702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:06.437299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:06.929525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:06.936817 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e26bbd3-293f-4fad-8b99-f75d9f1685a6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 0.538011 Oct 04 11:36:06.958792 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4102/5582] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:06 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:07.963486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:07.964069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:07.984827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:07.985323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:07.985791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:07.986505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:07.986959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:07.987796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:08.101188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-033fed9b-da04-4321-b906-6c4ef12c4d0d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'create', calling method: .version_select at 0x7f71ced220d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-631041436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEpUplHoJkTsvU9MpJYk+J4sN2DU9yrfj/Et6Q6RVvUD8SU8OT48CM5fp01SWbAi5+LME3tADnB7eETuRqGIRnQzkzlFSx8abiEv+8ACEPun7bB/YDkL96yRuY/mBRbEA=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:08.136674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-033fed9b-da04-4321-b906-6c4ef12c4d0d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for project 6ab55c98bb424804b2b405228f663b12. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:36:08.151163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-033fed9b-da04-4321-b906-6c4ef12c4d0d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for user c2b1b00cd36e44029505dd9d14b2fec6 and project 6ab55c98bb424804b2b405228f663b12. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:36:08.204289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-033fed9b-da04-4321-b906-6c4ef12c4d0d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.107321 Oct 04 11:36:08.205173 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4103/5583] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:36:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:36:08.652814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:08.664418 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ac40dbb8-9836-41c8-a63f-af3216e89850 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 0.704678 Oct 04 11:36:08.667462 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1481/5584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:07 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:09.288171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b8b4a163-a60e-404a-a5ff-fbb03de7a1d3 req-c571b6e3-bcb2-4441-9390-b17d9b0444b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544d260c-ff66-46df-84a1-ecb94b2e13db", "name": "network-vif-plugged", "status": "completed", "tag": "9a16af60-ed67-47b3-a3cf-d970c9744aa4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:09.317635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8b4a163-a60e-404a-a5ff-fbb03de7a1d3 req-c571b6e3-bcb2-4441-9390-b17d9b0444b8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:09.320465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8b4a163-a60e-404a-a5ff-fbb03de7a1d3 req-c571b6e3-bcb2-4441-9390-b17d9b0444b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:09.321246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8b4a163-a60e-404a-a5ff-fbb03de7a1d3 req-c571b6e3-bcb2-4441-9390-b17d9b0444b8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:09.349196 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b8b4a163-a60e-404a-a5ff-fbb03de7a1d3 req-c571b6e3-bcb2-4441-9390-b17d9b0444b8 service nova] Creating event network-vif-plugged:9a16af60-ed67-47b3-a3cf-d970c9744aa4 for instance 544d260c-ff66-46df-84a1-ecb94b2e13db on n-h2-791135-8 Oct 04 11:36:09.379789 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b8b4a163-a60e-404a-a5ff-fbb03de7a1d3 req-c571b6e3-bcb2-4441-9390-b17d9b0444b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096631 Oct 04 11:36:09.383789 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4104/5585] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:36:09.689327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:09.690670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:09.705525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:09.714478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:09.716898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:09.718418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:09.719541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:09.721279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:10.192824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:10.200888 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9b632ee-bf17-4e02-8074-962865c0d6a2 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1427 microversion: 2.1 time: 0.515337 Oct 04 11:36:10.205669 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1482/5586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:09 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1427 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:11.226266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:11.227148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:11.258045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:11.258045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:11.264124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:11.265051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:11.275692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:11.278740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:11.738182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:11.749510 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-22ddb764-b5a0-4be7-9e2b-0e7eb234069d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1608 microversion: 2.1 time: 0.528893 Oct 04 11:36:11.764251 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4105/5587] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:11 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1608 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:11.789853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:11.790410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:11.803049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:11.810561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:11.811188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:11.811957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:11.821401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:11.822095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:12.118171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:12.133447 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ba819b3-f3c3-4537-9364-af77339b55da tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1608 microversion: 2.1 time: 0.343050 Oct 04 11:36:12.136608 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1483/5588] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:11 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1608 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:12.170471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:12.171347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:12.189214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:12.190089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:12.190506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:12.191498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:12.191761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:12.192168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:12.676847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:12.699870 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-263a231f-f925-4f78-9a98-c1a4551667cb tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1608 microversion: 2.1 time: 0.538689 Oct 04 11:36:12.708584 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4106/5589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:12 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1608 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:12.830273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1348463226", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "7d1738c0-c815-40a4-a6aa-e69008fc8f56"}], "key_name": "tempest-TestNetworkBasicOps-631041436", "security_groups": [{"name": "tempest-secgroup-smoke-604110941"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:13.255143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] validate_networks() for [('7d1738c0-c815-40a4-a6aa-e69008fc8f56', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:36:15.462289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:36:15.463875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:36:15.464495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:36:15.465219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:36:15.466015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:36:15.502873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:15.505982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:15.508411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:15.510491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:15.511207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:15.514237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:15.597719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for project 6ab55c98bb424804b2b405228f663b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:36:15.625591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Getting quotas for user c2b1b00cd36e44029505dd9d14b2fec6 and project 6ab55c98bb424804b2b405228f663b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:36:15.679280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:36:15.686326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:36:15.876561 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f78f253-0e49-466e-8795-8c4f351b616f tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.050122 Oct 04 11:36:15.885921 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1484/5590] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:36:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 3060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:36:15.889737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52f95709-35c8-4fcb-82f7-b0ca2d4ff584 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:15.891608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-52f95709-35c8-4fcb-82f7-b0ca2d4ff584 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:16.257104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-52f95709-35c8-4fcb-82f7-b0ca2d4ff584 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:16.264886 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52f95709-35c8-4fcb-82f7-b0ca2d4ff584 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1248 microversion: 2.1 time: 0.380159 Oct 04 11:36:16.266828 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4107/5591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:15 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1248 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:36:17.293430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:17.309783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:17.331465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:17.334718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:17.336746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:17.338618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:17.339132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:17.344129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:17.356225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=53 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:17.559052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:17.593116 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f20be83-aca5-4503-92f6-32a374a22ba0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1252 microversion: 2.1 time: 0.306574 Oct 04 11:36:17.607449 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1485/5592] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:17 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1252 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:18.634082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:18.636265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:18.683166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:18.685880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:18.686992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:18.688632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:18.689152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:18.689637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:18.841166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:18.875446 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f63daf93-49a1-46a7-9955-f8f1a1ee092e tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1306 microversion: 2.1 time: 0.246914 Oct 04 11:36:18.890159 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4108/5593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:18 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1306 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:18.932890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-34b8b250-20ad-4643-8968-8b8a2a29bc63 req-111eabd9-40e2-4dcf-a4c8-b15c1f91cff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544d260c-ff66-46df-84a1-ecb94b2e13db", "tag": "9a16af60-ed67-47b3-a3cf-d970c9744aa4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:19.002338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-34b8b250-20ad-4643-8968-8b8a2a29bc63 req-111eabd9-40e2-4dcf-a4c8-b15c1f91cff1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:19.002832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-34b8b250-20ad-4643-8968-8b8a2a29bc63 req-111eabd9-40e2-4dcf-a4c8-b15c1f91cff1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:19.003263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-34b8b250-20ad-4643-8968-8b8a2a29bc63 req-111eabd9-40e2-4dcf-a4c8-b15c1f91cff1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:19.050587 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-34b8b250-20ad-4643-8968-8b8a2a29bc63 req-111eabd9-40e2-4dcf-a4c8-b15c1f91cff1 service nova] Creating event network-changed:9a16af60-ed67-47b3-a3cf-d970c9744aa4 for instance 544d260c-ff66-46df-84a1-ecb94b2e13db on n-h2-791135-8 Oct 04 11:36:19.060499 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-34b8b250-20ad-4643-8968-8b8a2a29bc63 req-111eabd9-40e2-4dcf-a4c8-b15c1f91cff1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132535 Oct 04 11:36:19.063211 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1486/5594] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:36:19.905475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:19.906205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:19.920036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:19.920537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:19.920983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:19.921732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:19.922200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:19.922636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:20.101741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:20.114130 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4dfac51-fa3b-4210-9e10-b70820655c26 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1306 microversion: 2.1 time: 0.214249 Oct 04 11:36:20.120519 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4109/5595] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:19 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1306 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:21.153820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:21.155268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:21.170719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:21.174068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:21.174750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:21.179853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:21.180811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:21.181630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:21.672052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:21.681444 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1fd8a196-4e59-48c1-bcca-744c9b95003b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1306 microversion: 2.1 time: 0.537999 Oct 04 11:36:21.693861 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1487/5596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:21 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1306 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:22.721668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:22.722303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:22.738266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:22.738689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:22.741301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:22.742077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:22.746191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:22.747333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:23.137672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:23.149975 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4771075c-6304-4aba-aecb-4ce0ddda3cb0 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1373 microversion: 2.1 time: 0.432260 Oct 04 11:36:23.151923 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4110/5597] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:22 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1373 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:24.179240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:24.183120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:24.201188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:24.204526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:24.205130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:24.206724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:24.208508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:24.210444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:24.271197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-01954bb7-d21f-423b-9613-d790a49f2b36 req-76c6071e-7cc8-43e3-ab12-464361bb1bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37600387-e637-4539-804b-bff165ab493c", "tag": "627c5e4d-2b4f-4496-bf56-0513698b0041"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:24.291842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-01954bb7-d21f-423b-9613-d790a49f2b36 req-76c6071e-7cc8-43e3-ab12-464361bb1bbe service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:24.293515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-01954bb7-d21f-423b-9613-d790a49f2b36 req-76c6071e-7cc8-43e3-ab12-464361bb1bbe service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:24.294338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-01954bb7-d21f-423b-9613-d790a49f2b36 req-76c6071e-7cc8-43e3-ab12-464361bb1bbe service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:24.308938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-01954bb7-d21f-423b-9613-d790a49f2b36 req-76c6071e-7cc8-43e3-ab12-464361bb1bbe service nova] Creating event network-changed:627c5e4d-2b4f-4496-bf56-0513698b0041 for instance 37600387-e637-4539-804b-bff165ab493c on n-h1-791135-8 Oct 04 11:36:24.321408 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-01954bb7-d21f-423b-9613-d790a49f2b36 req-76c6071e-7cc8-43e3-ab12-464361bb1bbe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053155 Oct 04 11:36:24.323090 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4111/5598] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:36:24.661786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-584786371", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:24.771661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] validate_networks() for None {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:36:24.810403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:24.824718 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfe931bd-37fc-41d4-bf13-36e2ee4392f9 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1373 microversion: 2.1 time: 0.652412 Oct 04 11:36:24.825628 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1488/5599] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:24 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1373 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:25.853091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:25.855211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:25.858422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:25.870432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:25.878081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:25.883296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:25.885704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:25.886722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:25.889517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:25.890437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:26.087292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:36:26.088276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:36:26.089211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:36:26.089664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:36:26.090568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:36:26.106117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:26.109088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:26.109610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:26.111920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:26.112416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:26.112851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:26.159651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Getting quotas for project 3e9639ee5b2147baa8514ac6ae113c6c. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:36:26.166760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Getting quotas for user 270f677d4889470a83601382f744e25b and project 3e9639ee5b2147baa8514ac6ae113c6c. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:36:26.182807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:36:26.185577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:36:26.251818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:26.261895 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0c515bb4-00c5-4b23-bfd8-32a4a61cda15 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1373 microversion: 2.1 time: 0.413182 Oct 04 11:36:26.265668 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1489/5600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:25 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1373 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:26.336413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80c55dec-9b15-4666-b202-69163e738d5d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678196 Oct 04 11:36:26.338403 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4112/5601] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:36:26.349089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49bb0921-a332-4699-bb52-1955e1e166fc tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:26.349965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49bb0921-a332-4699-bb52-1955e1e166fc tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:26.583856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49bb0921-a332-4699-bb52-1955e1e166fc tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:26.593607 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49bb0921-a332-4699-bb52-1955e1e166fc tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1213 microversion: 2.1 time: 0.247105 Oct 04 11:36:26.596727 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1490/5602] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:26 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:27.294275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:27.295824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:27.307139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:27.307990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:27.308853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:27.309852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:27.310853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:27.311625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:27.618480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:27.619698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:27.667136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:27.667645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:27.668088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:27.668816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:27.669290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:27.678981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:27.743048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:27.753508 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6f0f3d3b-7bed-49b4-94fe-ada1c96f589b tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1373 microversion: 2.1 time: 0.466848 Oct 04 11:36:27.767161 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4113/5603] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:27 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1373 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:27.858872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:27.876073 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c964b2fb-e792-4b8d-b995-0426f375cbe1 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1209 microversion: 2.1 time: 0.261449 Oct 04 11:36:27.878154 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1491/5604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:27 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1209 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:28.797646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:28.798281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:28.819211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:28.819724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:28.820169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:28.820896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:28.821387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:28.825080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:28.900006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:28.902002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:28.924752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:28.925621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:28.926226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:28.927121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:28.929907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:28.930517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:29.243180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:29.254823 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6a79cbad-decb-4657-9bf4-76dca1d06d86 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1283 microversion: 2.1 time: 0.358591 Oct 04 11:36:29.256558 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1492/5605] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:28 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1283 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:36:29.476320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:29.503264 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28af5d3e-4f1b-414c-8e5f-90e89f9f8d53 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1373 microversion: 2.1 time: 0.710309 Oct 04 11:36:29.509196 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4114/5606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:28 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1373 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:30.280601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:30.281233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:30.289826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:30.290308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:30.303617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:30.308901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:30.310727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:30.312377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:30.390343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3426dcc1-8c51-49de-843a-b0d27314005c req-cec5412f-4a32-42fd-9ded-2d34d380b8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37600387-e637-4539-804b-bff165ab493c", "name": "network-vif-plugged", "status": "completed", "tag": "627c5e4d-2b4f-4496-bf56-0513698b0041"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:30.410673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3426dcc1-8c51-49de-843a-b0d27314005c req-cec5412f-4a32-42fd-9ded-2d34d380b8aa service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:30.411533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3426dcc1-8c51-49de-843a-b0d27314005c req-cec5412f-4a32-42fd-9ded-2d34d380b8aa service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:30.412186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3426dcc1-8c51-49de-843a-b0d27314005c req-cec5412f-4a32-42fd-9ded-2d34d380b8aa service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:30.429824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3426dcc1-8c51-49de-843a-b0d27314005c req-cec5412f-4a32-42fd-9ded-2d34d380b8aa service nova] Creating event network-vif-plugged:627c5e4d-2b4f-4496-bf56-0513698b0041 for instance 37600387-e637-4539-804b-bff165ab493c on n-h1-791135-8 Oct 04 11:36:30.437419 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3426dcc1-8c51-49de-843a-b0d27314005c req-cec5412f-4a32-42fd-9ded-2d34d380b8aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055674 Oct 04 11:36:30.438759 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4115/5607] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 11:36:30.477562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:30.502533 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f1d34fbe-796b-45a5-a5dc-7e9952ab46f7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1271 microversion: 2.1 time: 0.225848 Oct 04 11:36:30.520059 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1493/5608] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:30 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:30.537424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:30.539044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:30.557335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:30.561063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:30.562568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:30.564813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:30.565787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:30.567015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:30.933375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:30.949728 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52100b2b-dd9a-496d-b951-685c991d06cc tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1373 microversion: 2.1 time: 0.413047 Oct 04 11:36:30.950686 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4116/5609] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:30 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1373 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:31.566443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:31.567065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:31.599230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:31.606136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:31.606659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:31.607415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:31.607885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:31.614091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:31.972884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:31.974243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:31.990826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:31.991536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:31.992279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:31.998140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:31.998808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:31.999416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:32.350310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:32.360160 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2f28180-15ce-4b61-a62e-f1176be89f7d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.817124 Oct 04 11:36:32.363564 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1494/5610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:31 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:32.578208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:32.599066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0320a46-30ff-4ba7-b32c-fdf985e93d72 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1373 microversion: 2.1 time: 0.630618 Oct 04 11:36:32.601471 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4117/5611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:31 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1373 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:33.393690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:33.395785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:33.418305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:33.426043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:33.426872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:33.429788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:33.430703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:33.431394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:33.631182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:33.634059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:33.650890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:33.658946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:33.661308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:33.662313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:33.663762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:33.665914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:33.667466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:33.674306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=74 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:33.808680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:33.823947 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4838da02-ba85-4cbf-89d3-60768bdb084a tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.434193 Oct 04 11:36:33.825791 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1495/5612] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:33 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:33.969815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:33.979147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3cc9470e-3707-45e3-a153-f2b34b877d50 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1545 microversion: 2.1 time: 0.351057 Oct 04 11:36:33.993764 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4118/5613] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:33 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1545 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:34.012568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:34.014961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:34.032127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:34.032910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:34.033650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:34.035014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:34.035159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:34.035517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:34.388952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:34.401537 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a75ae42e-3f95-409d-bcb3-8c3685261c01 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1545 microversion: 2.1 time: 0.401284 Oct 04 11:36:34.402140 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1496/5614] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:33 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1545 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:34.811954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6d4ad967-ccf6-480d-a41a-840c905a0b31 req-cd78c640-9061-4dfa-9763-07aa42ae1fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32", "tag": "d32b124a-ea77-48cc-8208-6324195fd122"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:34.842945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d4ad967-ccf6-480d-a41a-840c905a0b31 req-cd78c640-9061-4dfa-9763-07aa42ae1fdc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:34.843571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d4ad967-ccf6-480d-a41a-840c905a0b31 req-cd78c640-9061-4dfa-9763-07aa42ae1fdc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:34.844204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6d4ad967-ccf6-480d-a41a-840c905a0b31 req-cd78c640-9061-4dfa-9763-07aa42ae1fdc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:34.848160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:34.865507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6d4ad967-ccf6-480d-a41a-840c905a0b31 req-cd78c640-9061-4dfa-9763-07aa42ae1fdc service nova] Creating event network-changed:d32b124a-ea77-48cc-8208-6324195fd122 for instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 on n-h2-791135-8 Oct 04 11:36:34.873515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:34.882738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6d4ad967-ccf6-480d-a41a-840c905a0b31 req-cd78c640-9061-4dfa-9763-07aa42ae1fdc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074327 Oct 04 11:36:34.884135 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4119/5615] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:36:34.906852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:34.935845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:34.936392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:34.936842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:34.937603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:34.938067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:34.938494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:35.562496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:35.591839 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-17d5fe1a-a7f6-4c8b-ba45-f93dd6f9af47 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.747550 Oct 04 11:36:35.630773 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1497/5616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:34 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:36:36.641918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:36.642470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:36.662139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:36.662849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:36.682885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:36.684888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:36.686907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:36.689282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:36.695228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:36.697623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:37.426176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:37.435485 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff89079b-3fc6-4c49-9016-0fd5b94baa82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.801252 Oct 04 11:36:37.442174 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4120/5617] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:36 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:36:38.466839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:38.468467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:38.476423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:38.497410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:38.498484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:38.499151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:38.500202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:38.500652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:38.503402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:38.841957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-428eca09-6f65-4839-8045-4a19cf8617cc req-bf7214d5-c7f7-4477-937a-627adec32ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37600387-e637-4539-804b-bff165ab493c", "tag": "627c5e4d-2b4f-4496-bf56-0513698b0041"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:38.859876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-428eca09-6f65-4839-8045-4a19cf8617cc req-bf7214d5-c7f7-4477-937a-627adec32ad1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:38.860382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-428eca09-6f65-4839-8045-4a19cf8617cc req-bf7214d5-c7f7-4477-937a-627adec32ad1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:38.860829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-428eca09-6f65-4839-8045-4a19cf8617cc req-bf7214d5-c7f7-4477-937a-627adec32ad1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:38.881767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-428eca09-6f65-4839-8045-4a19cf8617cc req-bf7214d5-c7f7-4477-937a-627adec32ad1 service nova] Creating event network-changed:627c5e4d-2b4f-4496-bf56-0513698b0041 for instance 37600387-e637-4539-804b-bff165ab493c on n-h1-791135-8 Oct 04 11:36:38.902891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-428eca09-6f65-4839-8045-4a19cf8617cc req-bf7214d5-c7f7-4477-937a-627adec32ad1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300736 Oct 04 11:36:38.903855 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4121/5618] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:36:39.165474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:39.175542 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3faa789b-165f-43bc-b144-1352ca0bb1e3 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.714517 Oct 04 11:36:39.182500 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1498/5619] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:38 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:40.201702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:40.202431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:40.219228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:40.220478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:40.223156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:40.226060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:40.226765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:40.231578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:40.578306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:40.589000 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-25e97f14-1c3f-4638-a4ad-c5bb35675b82 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.393288 Oct 04 11:36:40.598322 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4122/5620] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:40 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:41.625992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:41.626602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:41.640161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:41.640648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:41.641080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:41.641815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:41.642263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:41.642677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:42.201816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:42.210653 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f80fdabc-d86b-4196-b918-b405e06b1c36 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.588799 Oct 04 11:36:42.215014 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1499/5621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:41 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:43.240170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:43.240802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:43.254962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:43.255459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:43.255904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:43.256673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:43.257144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:43.257676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:43.700583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:43.708909 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-88c26e8f-6cb7-4189-9a5a-593342b8ad33 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.472576 Oct 04 11:36:43.716846 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4123/5622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:43 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:44.738025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:44.740252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:44.776188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:44.790782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:44.795222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:44.799882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:44.800572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:44.804997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:45.192760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:45.202504 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b3345790-2e00-4daf-b3ba-11887dc4b19b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.470082 Oct 04 11:36:45.213246 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1500/5623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:44 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:46.232090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:46.233430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:46.247510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:46.255574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:46.256564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:46.257576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:46.260259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:46.262038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:46.364606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-900889bd-428b-4f02-b6a8-2916b3cb8274 req-f528372e-2698-4639-80cf-0803d0beefe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32", "name": "network-vif-plugged", "status": "completed", "tag": "d32b124a-ea77-48cc-8208-6324195fd122"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:46.385380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-900889bd-428b-4f02-b6a8-2916b3cb8274 req-f528372e-2698-4639-80cf-0803d0beefe6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:46.387346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-900889bd-428b-4f02-b6a8-2916b3cb8274 req-f528372e-2698-4639-80cf-0803d0beefe6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:46.389403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-900889bd-428b-4f02-b6a8-2916b3cb8274 req-f528372e-2698-4639-80cf-0803d0beefe6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:46.438594 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-900889bd-428b-4f02-b6a8-2916b3cb8274 req-f528372e-2698-4639-80cf-0803d0beefe6 service nova] Creating event network-vif-plugged:d32b124a-ea77-48cc-8208-6324195fd122 for instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 on n-h2-791135-8 Oct 04 11:36:46.451508 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-900889bd-428b-4f02-b6a8-2916b3cb8274 req-f528372e-2698-4639-80cf-0803d0beefe6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094407 Oct 04 11:36:46.452204 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1501/5624] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:36:46.711862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:46.730965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68e413a3-e228-4949-8d1b-86d7a2bfdc1d tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.505806 Oct 04 11:36:46.737118 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4124/5625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:46 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:47.764254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:47.764975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:47.777566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:47.779420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:47.780118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:47.783837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:47.784726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:47.785327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:47.792025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=88 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:36:48.117116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:48.131114 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13995642-db42-4513-9c2e-e040c47bdf6c tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1313 microversion: 2.1 time: 0.372448 Oct 04 11:36:48.131709 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1502/5626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:47 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:49.158187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:36:49.158932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:49.171920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:49.178643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:49.179189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:49.182089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:49.182694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:49.183254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:49.854199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:36:49.865928 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db6b834f-9520-49c6-b599-c1611fbfa7d7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1462 microversion: 2.1 time: 0.711633 Oct 04 11:36:49.866529 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4125/5627] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:36:49 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1462 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:36:49.893808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58495ebe-516c-47f0-9c33-bc770ee36bd8", "device": "/dev/sdb"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:49.896225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:49.906344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:49.907152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:49.907935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:49.908838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:49.909530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:49.910147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:50.421235 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1629247-4df9-4a86-869d-09eba9c0ac59 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "POST /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531706 Oct 04 11:36:50.422811 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1503/5628] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:36:49 2022] POST /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:36:56.410091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:36:56.414105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:36:56.438355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:56.443408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:56.444011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:56.446856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:36:56.447463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:36:56.448972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:36:56.556362 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba35105f-8c8c-473c-b001-293d9378e65d tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c/action" status: 200 len: 24573 microversion: 2.1 time: 0.150161 Oct 04 11:36:56.557482 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4126/5629] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:36:56 2022] POST /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c/action => generated 24573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:37:00.371084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1925579417", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6119b475-3673-4f80-ac06-5f3567ecbf3e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abb967bf-38d8-4c74-bd84-4e529507054d"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:00.426623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=13 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:00.435428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:00.656249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] validate_networks() for [('abb967bf-38d8-4c74-bd84-4e529507054d', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:37:01.373501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:37:01.374044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:37:01.375283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:37:01.375283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:37:01.375479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:37:01.388402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:01.389071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:01.389566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:01.390314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:01.390773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:01.391219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:01.421565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:37:01.428304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:37:01.515006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:37:01.517519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6119b475-3673-4f80-ac06-5f3567ecbf3e',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:37:01.807246 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ddb81d7-443d-4f83-a3b6-1acaab8b227b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442094 Oct 04 11:37:01.808543 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1504/5630] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:37:01.820714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d314ce1-3f72-44b2-bb27-908efc0d954a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:01.822174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d314ce1-3f72-44b2-bb27-908efc0d954a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:01.994196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d314ce1-3f72-44b2-bb27-908efc0d954a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:02.007583 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d314ce1-3f72-44b2-bb27-908efc0d954a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1057 microversion: 2.1 time: 0.191039 Oct 04 11:37:02.021413 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4127/5631] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:01 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1057 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:03.035799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:03.037001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:03.049211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:03.050879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:03.051337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:03.054505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:03.055399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:03.055999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:03.171292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:03.179247 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dbcad35a-b045-4b6e-a398-7702b2fa1193 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1107 microversion: 2.1 time: 0.151031 Oct 04 11:37:03.187255 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1505/5632] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:03 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1107 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:03.916697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-160356277", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "1f46c862-4bff-409e-862c-e2da47cb1b29"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:03.940432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=22 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:04.033042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] validate_networks() for [('1f46c862-4bff-409e-862c-e2da47cb1b29', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:37:04.206419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:04.207041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:04.219483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:04.219980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:04.220416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:04.221126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:04.221611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:04.222038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:04.486507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:04.498717 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91f547ea-2f40-4e19-a1bb-9aa43e228d9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1173 microversion: 2.1 time: 0.296154 Oct 04 11:37:04.501547 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1506/5633] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:04 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1173 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:05.150392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:37:05.150933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:37:05.151377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:37:05.151794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:37:05.152208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:37:05.164312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:05.164871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:05.165648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:05.166424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:05.166884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:05.167390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:05.176046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=44 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:05.221925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Getting quotas for project 1c1bece42945476c809344885ea4b21d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:37:05.237094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Getting quotas for user 04c2d820f8984cc39dd8ac570d697ebd and project 1c1bece42945476c809344885ea4b21d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:37:05.266596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:37:05.273867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:37:05.389071 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2f768406-7d16-4d77-b8ea-2991c734a612 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476260 Oct 04 11:37:05.398793 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4128/5634] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:37:05.403482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cdf83e1a-449f-41cd-8141-12624eaca072 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:05.404125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cdf83e1a-449f-41cd-8141-12624eaca072 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:05.520430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cdf83e1a-449f-41cd-8141-12624eaca072 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:05.527376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:05.528207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:05.528797 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cdf83e1a-449f-41cd-8141-12624eaca072 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1218 microversion: 2.1 time: 0.129337 Oct 04 11:37:05.542029 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1507/5635] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:05 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:05.542139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:05.542139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:05.542139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:05.542139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:05.542139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:05.542139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:05.809877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:05.823361 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a8e5a4e-e684-424d-b576-89c9fd31826e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1215 microversion: 2.1 time: 0.300749 Oct 04 11:37:05.824617 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4129/5636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:05 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1215 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:06.556396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:06.557033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:06.567098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:06.567791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:06.568306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:06.569271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:06.569905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:06.570625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:06.688792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:06.699192 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-00ff07fb-8f25-4533-bf58-387923fb3709 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1214 microversion: 2.1 time: 0.147192 Oct 04 11:37:06.700180 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1508/5637] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:06 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:06.747291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-135b04f6-c1b3-4208-94ac-dc40891625c6 req-4d9ff7fd-e7bf-4762-a748-3b847fa3f34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c62bd1f8-5684-4109-aa4b-297f144e5937", "tag": "e804bac6-041a-438e-a69a-f57dd54e6d18"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:06.764431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-135b04f6-c1b3-4208-94ac-dc40891625c6 req-4d9ff7fd-e7bf-4762-a748-3b847fa3f34c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:06.769806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-135b04f6-c1b3-4208-94ac-dc40891625c6 req-4d9ff7fd-e7bf-4762-a748-3b847fa3f34c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:06.772137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-135b04f6-c1b3-4208-94ac-dc40891625c6 req-4d9ff7fd-e7bf-4762-a748-3b847fa3f34c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:06.803022 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-135b04f6-c1b3-4208-94ac-dc40891625c6 req-4d9ff7fd-e7bf-4762-a748-3b847fa3f34c service nova] Creating event network-changed:e804bac6-041a-438e-a69a-f57dd54e6d18 for instance c62bd1f8-5684-4109-aa4b-297f144e5937 on n-h1-791135-8 Oct 04 11:37:06.811056 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-135b04f6-c1b3-4208-94ac-dc40891625c6 req-4d9ff7fd-e7bf-4762-a748-3b847fa3f34c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067819 Oct 04 11:37:06.812293 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4130/5638] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:06.848351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:06.849284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:06.858543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:06.860246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:06.860935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:06.862563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:06.863832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:06.864464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:07.069501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:07.081499 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8dd54fc2-6259-4d85-a3c5-e83111218b90 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1215 microversion: 2.1 time: 0.237542 Oct 04 11:37:07.082247 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1509/5639] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:06 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:07.726295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:07.726503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:07.727672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:07.730153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:07.734560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:07.735354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:07.736026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:07.736967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:07.737672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:07.738314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:07.742194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:07.744791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:07.745444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:07.746342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:07.746973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:07.747556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:07.816623 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c8274dc-860e-4991-a58f-5a3b764f948a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "POST /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c/action" status: 200 len: 32648 microversion: 2.1 time: 0.094266 Oct 04 11:37:07.818543 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4131/5640] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:37:07 2022] POST /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c/action => generated 32648 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:37:07.883761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:07.913539 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76c58e8e-ba9b-488c-932d-f4133237fcfd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1276 microversion: 2.1 time: 0.189521 Oct 04 11:37:07.916754 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1510/5641] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:07 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:08.115416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:08.116331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:08.132223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:08.132973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:08.133650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:08.134667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:08.135281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:08.135861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:08.672516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:08.686380 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b05ada99-a54c-40ad-b52a-9e78c4fc0682 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1215 microversion: 2.1 time: 0.573741 Oct 04 11:37:08.690270 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4132/5642] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:08 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1215 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:08.954323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:08.955740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:09.002654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:09.003217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:09.003719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:09.004494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:09.005026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:09.005824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:09.450391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:09.464825 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60fcf101-be32-408f-a554-526aa20683a8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.525684 Oct 04 11:37:09.466247 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1511/5643] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:08 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:09.728430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:09.729769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:09.746071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:09.751252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:09.752261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:09.753800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:09.754492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:09.755166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:09.824756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:09.825394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:09.836928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:09.840577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:09.841290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:09.842338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:09.844215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:09.848735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:09.912446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:37:10.121111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:10.133033 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-743f8808-b136-40fc-8879-948e5ff5fe11 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1215 microversion: 2.1 time: 0.409112 Oct 04 11:37:10.133749 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08b1fac4-4ab5-4778-98e3-5917118715d1 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "DELETE /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 204 len: 0 microversion: 2.1 time: 0.312618 Oct 04 11:37:10.150463 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4133/5645] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:09 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1215 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:10.156532 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1512/5645] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:37:09 2022] DELETE /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:37:10.158905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4e307c75-a6ba-446b-8096-0b689eb0e74a req-4ddcc880-1977-4aaf-a80a-c133d3a85e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37600387-e637-4539-804b-bff165ab493c", "tag": "627c5e4d-2b4f-4496-bf56-0513698b0041"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:10.167123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:10.167834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:10.195885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:10.196705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:10.197326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:10.198278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:10.198892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:10.199469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:10.203874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4e307c75-a6ba-446b-8096-0b689eb0e74a req-4ddcc880-1977-4aaf-a80a-c133d3a85e80 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:10.204376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4e307c75-a6ba-446b-8096-0b689eb0e74a req-4ddcc880-1977-4aaf-a80a-c133d3a85e80 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:10.204818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4e307c75-a6ba-446b-8096-0b689eb0e74a req-4ddcc880-1977-4aaf-a80a-c133d3a85e80 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:10.247449 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4e307c75-a6ba-446b-8096-0b689eb0e74a req-4ddcc880-1977-4aaf-a80a-c133d3a85e80 service nova] Creating event network-changed:627c5e4d-2b4f-4496-bf56-0513698b0041 for instance 37600387-e637-4539-804b-bff165ab493c on n-h1-791135-8 Oct 04 11:37:10.262471 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4e307c75-a6ba-446b-8096-0b689eb0e74a req-4ddcc880-1977-4aaf-a80a-c133d3a85e80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109938 Oct 04 11:37:10.264731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4134/5646] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:10.488918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:10.489675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:10.500715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:10.501048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:10.507853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:10.508999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:10.509674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:10.510275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:10.570071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:10.578039 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe2d6dab-3dd7-4d09-a22f-1aad8565475c tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1668 microversion: 2.1 time: 0.416399 Oct 04 11:37:10.598810 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1513/5647] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:10 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1668 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:10.782827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:10.792334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a463c5a8-94f8-4598-be86-d65d55233cbd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.307858 Oct 04 11:37:10.809375 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4135/5648] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:10 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:10.951399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f08bc1ec-91e1-4ee6-a987-ffa0466c3608 req-420d9ec4-bdcc-4e87-8f75-3e59a262c19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9ba7dd-e919-4545-af85-ad122922253f", "tag": "4a4dc353-18f1-4bba-8f9e-d879577fc41f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:10.963004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f08bc1ec-91e1-4ee6-a987-ffa0466c3608 req-420d9ec4-bdcc-4e87-8f75-3e59a262c19f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:10.963967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f08bc1ec-91e1-4ee6-a987-ffa0466c3608 req-420d9ec4-bdcc-4e87-8f75-3e59a262c19f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:10.964620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f08bc1ec-91e1-4ee6-a987-ffa0466c3608 req-420d9ec4-bdcc-4e87-8f75-3e59a262c19f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:10.998693 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f08bc1ec-91e1-4ee6-a987-ffa0466c3608 req-420d9ec4-bdcc-4e87-8f75-3e59a262c19f service nova] Creating event network-changed:4a4dc353-18f1-4bba-8f9e-d879577fc41f for instance 2c9ba7dd-e919-4545-af85-ad122922253f on n-h2-791135-8 Oct 04 11:37:11.017879 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f08bc1ec-91e1-4ee6-a987-ffa0466c3608 req-420d9ec4-bdcc-4e87-8f75-3e59a262c19f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067800 Oct 04 11:37:11.024425 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1514/5649] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:11.167887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:11.175164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:11.189995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:11.190885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:11.197661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:11.199207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:11.199958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:11.200956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:11.607758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:11.608737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:11.615113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:11.670852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:11.679212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8522d9b-6b72-4013-afa1-ec778c3a50bb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1215 microversion: 2.1 time: 0.525007 Oct 04 11:37:11.680047 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4136/5650] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:11 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1215 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:11.680491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:11.680993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:11.682467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:11.683205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:11.683662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:11.684090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:11.820543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:11.821826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:11.832794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:11.837757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:11.838439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:11.839437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:11.840415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:11.842521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:12.245225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:12.254648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:12.268523 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d9f91c9-0387-4506-8a13-a026d210e530 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1668 microversion: 2.1 time: 0.666188 Oct 04 11:37:12.269340 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1515/5651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:11 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1668 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:12.280414 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68e6a281-05f5-43fa-a718-635284af2377 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.461455 Oct 04 11:37:12.281587 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4137/5652] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:11 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:12.692619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ec55d34a-f309-4f1f-a6ad-02026783de4d req-b8c881b7-aa17-4c42-b12a-d1e195ce00f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37600387-e637-4539-804b-bff165ab493c", "name": "network-vif-deleted", "tag": "627c5e4d-2b4f-4496-bf56-0513698b0041"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:12.704728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:12.705366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:12.723963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:12.724530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:12.724950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:12.731418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:12.731926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:12.732445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:12.737576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec55d34a-f309-4f1f-a6ad-02026783de4d req-b8c881b7-aa17-4c42-b12a-d1e195ce00f0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:12.738305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec55d34a-f309-4f1f-a6ad-02026783de4d req-b8c881b7-aa17-4c42-b12a-d1e195ce00f0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:12.738915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec55d34a-f309-4f1f-a6ad-02026783de4d req-b8c881b7-aa17-4c42-b12a-d1e195ce00f0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:12.782668 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ec55d34a-f309-4f1f-a6ad-02026783de4d req-b8c881b7-aa17-4c42-b12a-d1e195ce00f0 service nova] Creating event network-vif-deleted:627c5e4d-2b4f-4496-bf56-0513698b0041 for instance 37600387-e637-4539-804b-bff165ab493c on n-h1-791135-8 Oct 04 11:37:12.799381 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ec55d34a-f309-4f1f-a6ad-02026783de4d req-b8c881b7-aa17-4c42-b12a-d1e195ce00f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110980 Oct 04 11:37:12.805641 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1516/5653] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:13.035447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:13.054613 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9eb3f02-a378-4905-86b7-04f448ffc58f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.353956 Oct 04 11:37:13.061329 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4138/5654] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:12 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:13.293320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:13.294494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:13.308786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:13.309784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:13.323095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:13.323987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:13.326025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:13.326351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:13.328212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:13.328567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:13.330010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:13.333246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:13.333686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:13.334285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:13.334937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:13.335540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:13.382716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:13.384156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:13.384931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:13.385600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lazy-loading 'fault' on Instance uuid 37600387-e637-4539-804b-bff165ab493c {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:37:13.446653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b1b00cd36e44029505dd9d14b2fec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab55c98bb424804b2b405228f663b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:13.455056 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-26a24f6f-037b-4f38-a854-adf09ca26614 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 200 len: 1489 microversion: 2.1 time: 0.166384 Oct 04 11:37:13.456244 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1517/5655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:13 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 1489 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:13.571765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:13.582852 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f4a9f1e-8949-46f8-9570-b889d8e76297 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.278292 Oct 04 11:37:13.584086 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4139/5656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:13 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:14.084592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:14.085261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:14.095942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:14.096697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:14.097608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:14.098539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:14.099186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:14.099783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:14.289509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:14.298485 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-886bcc51-19c0-4883-9c76-1cc80fee2861 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.218056 Oct 04 11:37:14.299194 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1518/5657] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:14 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:14.480508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:14.482082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] [instance: 37600387-e637-4539-804b-bff165ab493c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:14.490052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:14.490758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:14.491656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:14.492544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:14.493149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:14.493756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:14.511826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] HTTP exception thrown: Instance 37600387-e637-4539-804b-bff165ab493c could not be found. Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Request method failure captured: Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c HTTP/1.1 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBnchw0t6xCb1gy4e9tTMIESiExt7vInSL9H_qmdH4N0io8BwbMJ17ARyPFa7JG51qcqVMHOzg5muhFYDnystt9aqyPhy5W9K37sl4rp7HX5jYxiDhhb7yRtx1gSAh5zaX9JRbasYdGXuPoPQRwLq8ll2ixOy_QqHkDXJMyGb5UMk-4 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 6ab55c98bb424804b2b405228f663b12 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6ab55c98bb424804b2b405228f663b12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ab55c98bb424804b2b405228f663b12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6ab55c98bb424804b2b405228f663b12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6ab55c98bb424804b2b405228f663b12"}]}] Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 6ab55c98bb424804b2b405228f663b12 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestNetworkBasicOps-1174733418 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestNetworkBasicOps-1174733418-project Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: c2b1b00cd36e44029505dd9d14b2fec6 Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestNetworkBasicOps-1174733418-project Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 37600387-e637-4539-804b-bff165ab493c could not be found. Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '37600387-e637-4539-804b-bff165ab493c'} Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37600387-e637-4539-804b-bff165ab493c could not be found. Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37600387-e637-4539-804b-bff165ab493c could not be found. Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:37:14.513931 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:14.519879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:37:14.519879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:37:14.519879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:37:14.519879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:37:14.519879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:37:14.519879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37600387-e637-4539-804b-bff165ab493c could not be found. Oct 04 11:37:14.519879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:14.521965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Returning 404 to user: Instance 37600387-e637-4539-804b-bff165ab493c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:37:14.523064 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1b6e0e92-7a12-4653-a87b-5ee6d0ec331a tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c" status: 404 len: 111 microversion: 2.1 time: 0.047853 Oct 04 11:37:14.527949 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4140/5658] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:14 2022] GET /compute/v2.1/servers/37600387-e637-4539-804b-bff165ab493c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:37:14.606507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:14.607349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:14.616241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:14.621426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:14.622333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:14.623217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:14.623819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:14.625602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:15.018340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:15.027479 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fb116ad0-b389-497d-a066-7fa3c0f270b5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.425033 Oct 04 11:37:15.028771 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1519/5659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:14 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:15.050941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a2a173f-428f-4dfa-aaff-f7415e05fcb6 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] Calling method '.version_select at 0x7f71d437ddc0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:15.077664 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a2a173f-428f-4dfa-aaff-f7415e05fcb6 tempest-TestNetworkBasicOps-1174733418 tempest-TestNetworkBasicOps-1174733418-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-631041436" status: 202 len: 0 microversion: 2.1 time: 0.030608 Oct 04 11:37:15.079717 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4141/5660] 10.222.0.23 () {58 vars in 1254 bytes} [Tue Oct 4 11:37:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-631041436 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:37:15.324168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:15.325548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:15.334056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:15.334803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:15.335553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:15.337176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:15.337692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:15.338314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:15.528689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:16.071551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:16.072086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:16.073842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:16.088823 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39ef1f6a-ae78-4d50-8c17-0d6bd88ca547 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.765254 Oct 04 11:37:16.090071 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1520/5661] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:15 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:16.099513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:16.101982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:16.135132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:16.136308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:16.136909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:16.148334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:16.149453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:16.149925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:16.411797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:16.426004 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d073e630-8f0a-4c0a-9bae-b55eadfef6c8 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.369653 Oct 04 11:37:16.441280 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4142/5662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:16 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:17.112640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:17.113991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:17.132156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:17.132923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:17.134160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:17.135034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:17.135653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:17.136237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:17.164837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:17.442295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:17.448208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:17.448829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:17.457260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:17.458946 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-261e968e-3e20-4f22-a644-c932619d3910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.344565 Oct 04 11:37:17.460364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:17.460644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:17.461438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:17.465697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:17.466175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:17.484963 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1521/5663] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:17 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:17.850292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:17.860007 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-19f78579-40f0-45ca-ae7c-60c970bbf3de tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.415756 Oct 04 11:37:17.865689 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4143/5664] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:17 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:18.484361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:18.485037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:18.503760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:18.505550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:18.508834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:18.511336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:18.511993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:18.513031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:18.791820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:18.803464 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a1f4e9a6-1cff-4312-ad86-7b36289f53b2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.323453 Oct 04 11:37:18.814100 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1522/5665] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:18 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:18.891061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:18.891763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:18.905896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:18.906320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:18.906756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:18.914826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:18.915541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:18.916142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:19.239608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:19.256471 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a28f79f6-34d0-4f88-9947-46edde4e9347 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.370322 Oct 04 11:37:19.263058 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4144/5666] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:18 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:19.839980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:19.843738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:19.925909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:19.938105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:19.938779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:19.950189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:19.957264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:19.957850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:20.307359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:20.308561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:20.340654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:20.343846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:20.346221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:20.347220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:20.351824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:20.352574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:20.476404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:20.494825 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d53c3cc8-2ae2-4136-9bc3-3a5183c698ee tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.662386 Oct 04 11:37:20.495797 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1523/5667] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:19 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:20.834694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:20.844080 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-90513dca-83b8-4f05-a15c-cd53f2b52d09 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.540550 Oct 04 11:37:20.845222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4145/5668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:20 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:21.541302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:21.543480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:21.588909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:21.592035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:21.592529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:21.593266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:21.593761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:21.594195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:21.869238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:21.871477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:21.888307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:21.888796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:21.889222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:21.897135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:21.897912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:21.903752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:21.904191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:21.913072 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81f08088-c16d-4a65-a3ab-1313d2b384f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.394757 Oct 04 11:37:21.925827 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1524/5669] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:21 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:22.322271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:22.335103 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db60dc5d-8546-4045-a852-9ee2210fd3fc tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.469486 Oct 04 11:37:22.340567 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4146/5670] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:21 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:22.801122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ceb363c3-b128-4b62-b73a-848c754437f1 req-12d669fd-1ceb-4106-8965-2ec114d5b731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9ba7dd-e919-4545-af85-ad122922253f", "name": "network-vif-plugged", "status": "completed", "tag": "4a4dc353-18f1-4bba-8f9e-d879577fc41f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:22.826510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ceb363c3-b128-4b62-b73a-848c754437f1 req-12d669fd-1ceb-4106-8965-2ec114d5b731 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:22.830682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ceb363c3-b128-4b62-b73a-848c754437f1 req-12d669fd-1ceb-4106-8965-2ec114d5b731 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:22.837343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ceb363c3-b128-4b62-b73a-848c754437f1 req-12d669fd-1ceb-4106-8965-2ec114d5b731 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:22.877746 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ceb363c3-b128-4b62-b73a-848c754437f1 req-12d669fd-1ceb-4106-8965-2ec114d5b731 service nova] Creating event network-vif-plugged:4a4dc353-18f1-4bba-8f9e-d879577fc41f for instance 2c9ba7dd-e919-4545-af85-ad122922253f on n-h2-791135-8 Oct 04 11:37:22.905883 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ceb363c3-b128-4b62-b73a-848c754437f1 req-12d669fd-1ceb-4106-8965-2ec114d5b731 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.540539 Oct 04 11:37:22.906944 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1525/5671] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:22.943235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:22.943856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:23.028632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:23.034108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:23.039387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:23.042798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:23.045151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:23.050186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:23.396910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:23.397930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:23.421198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:23.433860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:23.435515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:23.436864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:23.439073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:23.439833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:23.440783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:23.461442 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b13b011-5b03-4721-b86d-242be75fc469 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.524078 Oct 04 11:37:23.462463 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4147/5672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:22 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:23.720132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:23.731086 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f7fd1bb-faad-4d85-bb9c-f82c995b3139 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.341522 Oct 04 11:37:23.732248 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1526/5673] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:23 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:23.944700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:23.946436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:23.956792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:23.959644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:23.960350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:23.962200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:23.964109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:23.964771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:23.997535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7cef756d-0026-436c-a0a7-bf062404ca46 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.057184 Oct 04 11:37:23.998408 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4148/5674] 10.222.0.23 () {58 vars in 1293 bytes} [Tue Oct 4 11:37:23 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db/os-server-password => generated 116 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:24.490712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:24.491415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:24.502325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:24.502827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:24.503261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:24.503968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:24.504421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:24.522136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:24.764274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:24.766122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:24.786612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:24.789823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:24.791033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:24.792407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:24.793555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:24.798060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:24.798614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:24.807152 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0439c245-a9b2-4641-a59a-8e60b75a4eec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.320050 Oct 04 11:37:24.826226 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1527/5675] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:24 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:24.871966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:24.933512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8422af80-35e2-4157-aac2-80d86684d9f6 req-c844090d-d982-4a9c-8707-b3e78c1c048b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62bd1f8-5684-4109-aa4b-297f144e5937", "name": "network-vif-plugged", "status": "completed", "tag": "e804bac6-041a-438e-a69a-f57dd54e6d18"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:24.958748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8422af80-35e2-4157-aac2-80d86684d9f6 req-c844090d-d982-4a9c-8707-b3e78c1c048b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:24.959499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8422af80-35e2-4157-aac2-80d86684d9f6 req-c844090d-d982-4a9c-8707-b3e78c1c048b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:24.960393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8422af80-35e2-4157-aac2-80d86684d9f6 req-c844090d-d982-4a9c-8707-b3e78c1c048b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:24.997694 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8422af80-35e2-4157-aac2-80d86684d9f6 req-c844090d-d982-4a9c-8707-b3e78c1c048b service nova] Creating event network-vif-plugged:e804bac6-041a-438e-a69a-f57dd54e6d18 for instance c62bd1f8-5684-4109-aa4b-297f144e5937 on n-h1-791135-8 Oct 04 11:37:25.027339 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8422af80-35e2-4157-aac2-80d86684d9f6 req-c844090d-d982-4a9c-8707-b3e78c1c048b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097727 Oct 04 11:37:25.028980 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1528/5676] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:25.123610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:25.135090 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-45226bf7-dc74-4634-9e5d-dbf37cdf8b32 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1318 microversion: 2.1 time: 0.380636 Oct 04 11:37:25.145746 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4149/5677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:24 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:25.846727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:25.848473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:25.857686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:25.858685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:25.859348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:25.860266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:25.860932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:25.861627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:26.108301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:26.119758 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b7307de-8294-4ee0-a8d6-0f78f09a8e43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1203 microversion: 2.1 time: 0.278231 Oct 04 11:37:26.120358 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1529/5678] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:25 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1203 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:26.163445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:26.164646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:26.180265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:26.180778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:26.181228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:26.183953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:26.184443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:26.184891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:26.478714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:26.488613 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63249446-9385-4833-8a75-b16f07afbb91 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1507 microversion: 2.1 time: 0.330022 Oct 04 11:37:26.489770 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4150/5679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:26 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:27.151021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:27.151986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:27.183118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:27.183813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:27.186946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:27.190671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:27.192316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:27.193878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:27.534331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:27.593330 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc5b2635-1825-4bac-96ed-94a11fc1ad12 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1389 microversion: 2.1 time: 0.448531 Oct 04 11:37:27.596202 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1530/5680] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:27 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1389 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:27.628509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:27.629142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:27.639857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:27.640764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:27.641270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:27.642206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:27.642814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:27.643331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:27.857924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:27.877094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-27f7c906-a534-423e-aa6f-757287386a0e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1389 microversion: 2.1 time: 0.258266 Oct 04 11:37:27.894500 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4151/5681] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:27 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1389 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:27.912613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:27.913151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:27.921679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:27.922407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:27.923021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:27.924129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:27.924765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:27.925432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:28.307291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:28.326861 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35bbe174-4a98-42bd-b5f0-97b5fe124910 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1389 microversion: 2.1 time: 0.419858 Oct 04 11:37:28.328532 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1531/5682] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:27 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1389 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:28.356013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:28.356841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:28.364553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:28.365339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:28.366008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:28.367767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:28.368400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:28.369410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:28.401497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:37:28.580896 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9737a236-be7b-4ca7-84fb-92b56ec02725 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 204 len: 0 microversion: 2.1 time: 0.230023 Oct 04 11:37:28.588784 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4152/5683] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:37:28 2022] DELETE /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:37:28.599569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:28.600563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:28.614689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:28.615369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:28.615993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:28.616888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:28.618082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:28.618945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:28.955360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:28.968449 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d02bc420-d8c4-4095-afdb-5d03e1c41126 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1395 microversion: 2.1 time: 0.374198 Oct 04 11:37:28.969861 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1532/5684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:28 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1395 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:29.997956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:29.998700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:30.028105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:30.029876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:30.030313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:30.033467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:30.035265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:30.037489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:30.373995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:30.383343 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e45e9b7-60ad-444d-8ce4-ed9e6d970bdc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1395 microversion: 2.1 time: 0.393917 Oct 04 11:37:30.388949 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4153/5685] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:29 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1395 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:30.835408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1406770444", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "15abeb60-5f3a-45ad-87cc-00e4de684cf0"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:30.876050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:30.944185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] validate_networks() for [('15abeb60-5f3a-45ad-87cc-00e4de684cf0', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:37:31.230574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e68c3707-725d-4ea5-b340-c7e563ea2396 req-174a4230-2d90-43c4-9c01-5972c5761d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62bd1f8-5684-4109-aa4b-297f144e5937", "name": "network-vif-deleted", "tag": "e804bac6-041a-438e-a69a-f57dd54e6d18"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:31.275203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e68c3707-725d-4ea5-b340-c7e563ea2396 req-174a4230-2d90-43c4-9c01-5972c5761d29 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:31.276062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e68c3707-725d-4ea5-b340-c7e563ea2396 req-174a4230-2d90-43c4-9c01-5972c5761d29 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:31.276713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e68c3707-725d-4ea5-b340-c7e563ea2396 req-174a4230-2d90-43c4-9c01-5972c5761d29 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:31.315742 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e68c3707-725d-4ea5-b340-c7e563ea2396 req-174a4230-2d90-43c4-9c01-5972c5761d29 service nova] Creating event network-vif-deleted:e804bac6-041a-438e-a69a-f57dd54e6d18 for instance c62bd1f8-5684-4109-aa4b-297f144e5937 on n-h1-791135-8 Oct 04 11:37:31.326208 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e68c3707-725d-4ea5-b340-c7e563ea2396 req-174a4230-2d90-43c4-9c01-5972c5761d29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099236 Oct 04 11:37:31.330464 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4154/5686] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:31.417385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:31.418717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:31.435626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:31.437087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:31.438228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:31.439603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:31.441233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:31.443069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:31.666805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:31.692734 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9c0488b6-d806-4696-87d8-93ef5b85db22 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1188 microversion: 2.1 time: 0.269504 Oct 04 11:37:31.692734 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4155/5687] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:31 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1188 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:31.775459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:37:31.775996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:37:31.776470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:37:31.776917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:37:31.777922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:37:31.793998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:31.794430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:31.795314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:31.798785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:31.799272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:31.799724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:31.822781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Getting quotas for project 126020519f72477fb703e7b14ef786ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:37:31.829720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Getting quotas for user 6c7734eb82c6424ab1bd92a121438a5b and project 126020519f72477fb703e7b14ef786ec. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:37:31.845254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:37:31.848776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:37:31.900774 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-69e13538-b638-4eed-9cec-dc2b2667c914 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342584 Oct 04 11:37:31.901890 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1533/5688] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:37:31.913450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c644832-74a2-4b04-bfca-b81d20fb81ca tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:31.914412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c644832-74a2-4b04-bfca-b81d20fb81ca tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:31.992664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c644832-74a2-4b04-bfca-b81d20fb81ca tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:32.002302 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c644832-74a2-4b04-bfca-b81d20fb81ca tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1215 microversion: 2.1 time: 0.092833 Oct 04 11:37:32.003634 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4156/5689] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:31 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:32.706012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:32.707430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:32.727758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:32.730468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:32.732437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:32.734532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:32.736018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:32.736854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:32.869623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:32.879590 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9887249c-22a6-4517-853f-a89abb1074f3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1188 microversion: 2.1 time: 0.178991 Oct 04 11:37:32.889774 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1534/5690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:32 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1188 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:33.028493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:33.029040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:33.042386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:33.042882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:33.043318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:33.044357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:33.044474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:33.048402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:33.168034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:33.179623 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-55293f43-298e-4ec4-9a2d-f1a28b3c0e7e tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1211 microversion: 2.1 time: 0.155994 Oct 04 11:37:33.180392 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4157/5691] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:33 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:33.905896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:33.907006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:33.922349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:33.926658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:33.928061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:33.932068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:33.933757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:33.934659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:34.204214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:34.205270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:34.210265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:34.226454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:34.229566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:34.230165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:34.231212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:34.232889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:34.234205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:34.284025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:34.295237 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31f266f2-b6bf-40c3-95df-8bbac545989a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1188 microversion: 2.1 time: 0.393673 Oct 04 11:37:34.300169 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1535/5692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:33 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1188 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:34.401025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:34.417306 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e985250-c6b7-4048-8865-d86cfbb4ed2b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1273 microversion: 2.1 time: 0.217046 Oct 04 11:37:34.433122 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4158/5693] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:34 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:35.328586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:35.332020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:35.340850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:35.341441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:35.342042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:35.342848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:35.343396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:35.343972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:35.449579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:35.450824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:35.459649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:35.460194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:35.461157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:35.461945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:35.463083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:35.463706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:35.479997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:35.494023 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c170d9e-5a2c-43ae-bec9-30eacb68f723 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1188 microversion: 2.1 time: 0.169276 Oct 04 11:37:35.495672 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1536/5694] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:35 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1188 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:35.719791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:35.732282 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c8c0f81c-5848-4fb9-aae5-24dbc8d2229b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1315 microversion: 2.1 time: 0.290627 Oct 04 11:37:35.749197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4159/5695] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:35 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:36.314052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4e501df9-dbd7-410d-8776-7da3ece9ca5e req-a5799545-ec73-4275-b8d3-6c73acaaf5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8bb94b8-ff92-40bc-8e33-a36771b26c49", "tag": "dc1c0ff5-3ff9-46ab-b104-35cc44ffc9c5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:36.340782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4e501df9-dbd7-410d-8776-7da3ece9ca5e req-a5799545-ec73-4275-b8d3-6c73acaaf5a9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:36.345623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4e501df9-dbd7-410d-8776-7da3ece9ca5e req-a5799545-ec73-4275-b8d3-6c73acaaf5a9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:36.346287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4e501df9-dbd7-410d-8776-7da3ece9ca5e req-a5799545-ec73-4275-b8d3-6c73acaaf5a9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:36.378107 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4e501df9-dbd7-410d-8776-7da3ece9ca5e req-a5799545-ec73-4275-b8d3-6c73acaaf5a9 service nova] Creating event network-changed:dc1c0ff5-3ff9-46ab-b104-35cc44ffc9c5 for instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 on n-h1-791135-8 Oct 04 11:37:36.384296 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4e501df9-dbd7-410d-8776-7da3ece9ca5e req-a5799545-ec73-4275-b8d3-6c73acaaf5a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073923 Oct 04 11:37:36.385859 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1537/5696] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:36.526578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:36.529402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:36.548772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:36.579925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:36.581504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:36.583245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:36.583728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:36.600568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:36.758562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:36.769484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:36.784321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:36.789713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:36.790310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:36.793090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:36.795311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:36.796199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:36.796513 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fdfb6774-db96-4756-9231-efceb5a71c64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1188 microversion: 2.1 time: 0.278100 Oct 04 11:37:36.798747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:36.815799 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4160/5697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:36 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:37.108159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:37.116408 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-edba6c5d-b143-4a06-85bc-c976e346c4e8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1315 microversion: 2.1 time: 0.362456 Oct 04 11:37:37.120804 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1538/5698] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:36 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:37.824739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:37.825890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:37.833098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:37.833651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:37.834283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:37.835003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:37.835535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:37.835977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:37.964404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:37.973505 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc4e7fb8-7625-480c-a2da-20c6d26495bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1188 microversion: 2.1 time: 0.154191 Oct 04 11:37:37.974727 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4161/5699] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:37 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1188 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:38.143384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:38.144158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:38.154062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:38.160917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:38.161583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:38.162716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:38.163299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:38.163907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:38.713895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:38.729288 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d3d80b9-05f0-45be-90b1-051bef2433c8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1315 microversion: 2.1 time: 0.588784 Oct 04 11:37:38.733564 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1539/5700] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:38 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:38.997527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:38.998243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:39.012133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:39.013901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:39.014506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:39.016686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:39.021093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:39.022598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:39.135091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:39.144234 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0dff377-e1e2-40ad-83a4-50b73b3ff045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1188 microversion: 2.1 time: 0.151763 Oct 04 11:37:39.151997 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4162/5701] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:38 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1188 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:39.764466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:39.775925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:39.785667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:39.786656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:39.787512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:39.788931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:39.789581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:39.790406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:39.974087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:39.982197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:39.999369 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3930d63-e214-4fd1-9005-fd364fb53bfe tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1315 microversion: 2.1 time: 0.238523 Oct 04 11:37:39.999667 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1540/5702] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:39 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:40.181575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:40.182184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:40.189264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:40.189802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:40.190255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:40.190989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:40.191457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:40.191902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:40.265048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:40.277481 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-61f767b0-be04-4038-bc88-fd8c06f208b9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 200 len: 1188 microversion: 2.1 time: 0.099814 Oct 04 11:37:40.278666 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4163/5703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:40 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 1188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:41.028390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:41.030242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:41.061075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:41.062247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:41.062954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:41.064854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:41.071085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:41.071871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:41.301399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:41.302696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: c62bd1f8-5684-4109-aa4b-297f144e5937] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:41.332572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:41.333077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:41.333561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:41.335035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:41.335542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:41.335986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:41.377151 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance c62bd1f8-5684-4109-aa4b-297f144e5937 could not be found. Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 HTTP/1.1 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c62bd1f8-5684-4109-aa4b-297f144e5937 could not be found. Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c62bd1f8-5684-4109-aa4b-297f144e5937'} Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c62bd1f8-5684-4109-aa4b-297f144e5937 could not be found. Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c62bd1f8-5684-4109-aa4b-297f144e5937 could not be found. Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:37:41.396634 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:41.401595 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:37:41.401595 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:37:41.401595 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:37:41.401595 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:37:41.401595 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:37:41.401595 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c62bd1f8-5684-4109-aa4b-297f144e5937 could not be found. Oct 04 11:37:41.401595 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:37:41.403903 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance c62bd1f8-5684-4109-aa4b-297f144e5937 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:37:41.415557 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5fb498d1-7d3e-483d-ba69-8cf6495cc80b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937" status: 404 len: 111 microversion: 2.1 time: 0.119249 Oct 04 11:37:41.417108 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4164/5704] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:41 2022] GET /compute/v2.1/servers/c62bd1f8-5684-4109-aa4b-297f144e5937 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:37:41.438112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:41.447916 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1ed9552-45c7-4d18-bc63-8e3fbc9aff02 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1315 microversion: 2.1 time: 0.429135 Oct 04 11:37:41.469283 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1541/5705] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:41 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:42.497222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:42.498755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:42.510872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:42.513774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:42.514466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:42.515099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:42.516020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:42.516649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:42.517245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:42.884629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:42.888445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bd9336d4-645e-4526-9b7c-3b3adbe150db req-c5b3b4d4-b01a-400c-bc39-fd9ffafd61f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bb94b8-ff92-40bc-8e33-a36771b26c49", "name": "network-vif-plugged", "status": "completed", "tag": "dc1c0ff5-3ff9-46ab-b104-35cc44ffc9c5"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:42.900237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c9196c2-b9cd-4857-8bbd-c573b403b0cd tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1315 microversion: 2.1 time: 0.406804 Oct 04 11:37:42.901694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:42.904814 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4165/5706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:42 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:42.914609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:42.931762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd9336d4-645e-4526-9b7c-3b3adbe150db req-c5b3b4d4-b01a-400c-bc39-fd9ffafd61f9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:42.932450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd9336d4-645e-4526-9b7c-3b3adbe150db req-c5b3b4d4-b01a-400c-bc39-fd9ffafd61f9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:42.932896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bd9336d4-645e-4526-9b7c-3b3adbe150db req-c5b3b4d4-b01a-400c-bc39-fd9ffafd61f9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:42.955369 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bd9336d4-645e-4526-9b7c-3b3adbe150db req-c5b3b4d4-b01a-400c-bc39-fd9ffafd61f9 service nova] Creating event network-vif-plugged:dc1c0ff5-3ff9-46ab-b104-35cc44ffc9c5 for instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 on n-h1-791135-8 Oct 04 11:37:42.962498 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bd9336d4-645e-4526-9b7c-3b3adbe150db req-c5b3b4d4-b01a-400c-bc39-fd9ffafd61f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077462 Oct 04 11:37:42.963788 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1542/5707] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:37:43.931584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:43.932822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:43.950727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:43.953697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:43.955623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:43.961131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:43.962719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:43.963325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:44.017423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:44.286643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:44.303330 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-59caeffb-1cbe-47aa-be35-ddb5d01da8b4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1315 microversion: 2.1 time: 0.377476 Oct 04 11:37:44.322268 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4166/5708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:43 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:45.333708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:45.334567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:45.347149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:45.350046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:45.352406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:45.353238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:45.354887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:45.355430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:45.646683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:45.657395 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25eb7c33-d15e-4c9d-a818-3115d81295d8 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1502 microversion: 2.1 time: 0.328793 Oct 04 11:37:45.670839 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1543/5709] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:45 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:45.685413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:45.686888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:45.696576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:45.697642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:45.698316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:45.699642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:45.700369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:45.701568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:45.993085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:46.002966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f40d89b5-d3db-474c-a274-5743a8a21394 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1502 microversion: 2.1 time: 0.322667 Oct 04 11:37:46.003559 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4167/5710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:45 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1502 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:46.029600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:46.030446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:46.037291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:46.038011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:46.039276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:46.040130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:46.040736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:46.041920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:46.125679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lazy-loading 'flavor' on Instance uuid e8bb94b8-ff92-40bc-8e33-a36771b26c49 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:37:46.393409 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a7981c4-ca3c-4fe3-afea-f29ffe795b3b tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "POST /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49/action" status: 202 len: 0 microversion: 2.1 time: 0.370183 Oct 04 11:37:46.394632 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1544/5711] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:37:46 2022] POST /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:37:46.408207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:46.409838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:46.418059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:46.418557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:46.418993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:46.419707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:46.420154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:46.420755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:46.647609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:46.664282 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57800b41-bb8c-49ec-9733-9fb2d6ded7aa tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1510 microversion: 2.1 time: 0.264180 Oct 04 11:37:46.664891 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4168/5712] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:46 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:47.692445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:47.695199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:47.703906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:47.704679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:47.705185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:47.706350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:47.707117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:47.707527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:48.032784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:48.052673 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4365ec3-2683-4832-9e2d-24121acf1ce5 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1493 microversion: 2.1 time: 0.365225 Oct 04 11:37:48.056048 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1545/5713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:47 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1493 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:48.085000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:48.086059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:48.096843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:48.097343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:48.097834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:48.098544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:48.099003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:48.099432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:48.268703 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-92769083-b866-4712-94e8-35ffb81f0bed tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "POST /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49/action" status: 202 len: 0 microversion: 2.1 time: 0.186640 Oct 04 11:37:48.273441 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4169/5714] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:37:48 2022] POST /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:37:48.279087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:48.280370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:48.286229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:48.290088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:48.290817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:48.291739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:48.292365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:48.293839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:48.733686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:48.748170 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-554d5c51-dc79-4d0a-9727-055cc4f71896 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1499 microversion: 2.1 time: 0.472962 Oct 04 11:37:48.751445 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1546/5715] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:48 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1499 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:49.787549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:49.788496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:49.796810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:49.796995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:49.797647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:49.810355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:49.811265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:49.811840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:50.109077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:50.131765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4237753-3398-4311-801f-200ba35cdaa7 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1499 microversion: 2.1 time: 0.355332 Oct 04 11:37:50.146738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4170/5716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:49 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1499 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:51.159555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:51.160182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:51.167975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:51.168470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:51.168902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:51.169642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:51.170755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:51.173899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:51.360557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:51.383477 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc16d436-de34-4f77-a2af-9aa25713c9a1 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1502 microversion: 2.1 time: 0.226200 Oct 04 11:37:51.384791 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1547/5717] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:51 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:51.409302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:51.409872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:51.418323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:51.419140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:51.419797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:51.420762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:51.421470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:51.422118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:51.447887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lazy-loading 'flavor' on Instance uuid e8bb94b8-ff92-40bc-8e33-a36771b26c49 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:37:51.519407 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb241c7c-bd49-4906-bc47-4c6641e70dc4 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "POST /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49/action" status: 202 len: 0 microversion: 2.1 time: 0.113547 Oct 04 11:37:51.520059 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4171/5718] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:37:51 2022] POST /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:37:51.528827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:51.530081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:51.536839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:51.537387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:51.537975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:51.539246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:51.539959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:51.540391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:51.721334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:51.739154 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6173055-f600-4f81-b8df-ccf67e9fc41c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1510 microversion: 2.1 time: 0.214329 Oct 04 11:37:51.740252 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1548/5719] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:51 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:52.388938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1673089748", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8db682fd-9586-4435-ab6a-ef16da65cd36", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abb967bf-38d8-4c74-bd84-4e529507054d"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:52.501630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] validate_networks() for [('abb967bf-38d8-4c74-bd84-4e529507054d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:37:52.766824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:52.767440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:52.785433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:52.785968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:52.786694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:52.787425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:52.787879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:52.788342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:52.995984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:53.012471 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7888e0f5-5f9f-454d-996f-1fc12a6de024 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1493 microversion: 2.1 time: 0.249467 Oct 04 11:37:53.023416 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1549/5720] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:52 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1493 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:53.039299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:53.040189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:53.047648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:53.049281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:53.050108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:53.051079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:53.051691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:53.052278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:53.168234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:37:53.168736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:37:53.169217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:37:53.169987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:37:53.170358 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91a4b2e7-6033-4632-b250-0f11a169de19 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "POST /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49/action" status: 202 len: 0 microversion: 2.1 time: 0.134887 Oct 04 11:37:53.170493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:37:53.171396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1550/5721] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:37:53 2022] POST /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:37:53.182109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:53.183160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:53.195491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:53.196359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:53.197122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:53.197489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:53.197618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:53.198272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:53.199252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:53.199529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:53.200003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:53.200411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:53.201469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:53.202334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:53.249604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:37:53.263214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:37:53.400992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:37:53.403504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8db682fd-9586-4435-ab6a-ef16da65cd36',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:37:53.611217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:53.624481 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6547bdf-11e3-40f3-ad2e-38c0727c255c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1499 microversion: 2.1 time: 0.444179 Oct 04 11:37:53.626096 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1551/5722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:53 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1499 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:53.707360 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00ef6c0c-11d8-424d-bbbb-569a7e173d8b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322616 Oct 04 11:37:53.718622 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4172/5723] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:37:53.723249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa3d661a-b5a2-4e29-b8c4-eabf11a24cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:53.723961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa3d661a-b5a2-4e29-b8c4-eabf11a24cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:53.919121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa3d661a-b5a2-4e29-b8c4-eabf11a24cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:53.926415 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa3d661a-b5a2-4e29-b8c4-eabf11a24cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1057 microversion: 2.1 time: 0.207394 Oct 04 11:37:53.927008 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1552/5724] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:53 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1057 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:54.659250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:54.660060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:54.671126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:54.675668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:54.676287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:54.677220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:54.677867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:54.681375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:54.950252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:54.951206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:54.956265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:54.966395 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f9a362a3-7a0e-42cd-9d82-786ed51f105c tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1499 microversion: 2.1 time: 0.310892 Oct 04 11:37:54.968229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:54.971502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:54.972050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:54.972883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:54.973476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:54.975479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:54.983300 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4173/5725] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:54 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1499 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:55.064103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:55.076209 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03592b6f-ae0e-4050-a9f1-d5b5399f45a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1155 microversion: 2.1 time: 0.129612 Oct 04 11:37:55.081986 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1553/5726] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:54 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1155 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:55.993857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:55.994494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:56.032985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:56.035542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:56.039325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:56.044277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:56.046469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:56.049107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:56.107179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:56.108063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:56.137558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:56.138304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:56.147516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:56.150120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:56.150829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:56.154778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:56.453779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:56.471163 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06521068-f091-4008-aa3b-039efc57c491 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1173 microversion: 2.1 time: 0.372115 Oct 04 11:37:56.472094 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1554/5727] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:56 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1173 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:56.530325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:56.548386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4462b0d6-910d-4809-9897-dc20b00abe31 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1502 microversion: 2.1 time: 0.561204 Oct 04 11:37:56.557281 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4174/5728] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:55 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1502 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:56.573946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:56.574553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:56.581896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:56.586099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:56.587013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:56.587784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:56.588254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:56.590893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:56.652049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:37:56.726880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:37:56.843365 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f087d135-c264-4854-ad51-f7fe17979fc3 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 204 len: 0 microversion: 2.1 time: 0.274464 Oct 04 11:37:56.847901 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1555/5729] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:37:56 2022] DELETE /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:37:56.856800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:56.857988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:56.869561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:56.870372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:56.870993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:56.878333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:56.879149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:56.879882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:57.120772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:57.130728 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8472103e-c21b-48bc-ba9e-f6317f39aa58 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1508 microversion: 2.1 time: 0.277879 Oct 04 11:37:57.134161 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4175/5730] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:56 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:57.502066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:57.502848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:57.531323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:57.532223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:57.532853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:57.534624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:57.536402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:57.537186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:58.018314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:58.034561 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5156e66e-6709-4dcc-a571-dd63df503597 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.537908 Oct 04 11:37:58.035098 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1556/5731] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:57 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:58.160373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:58.161000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:58.170311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:58.170812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:58.182859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:58.187201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:58.187894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:58.188542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:58.488159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:58.499944 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff0f7213-08ad-4101-b886-e66faa6ded37 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1508 microversion: 2.1 time: 0.343439 Oct 04 11:37:58.507351 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4176/5732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:58 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:58.672684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b20fa8f2-20d6-43e5-b902-6539799a9eb8", "device": "/dev/sdb"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:58.675727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:58.693139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:58.693660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:58.694640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:58.695356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:58.695812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:58.696238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:59.059398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:59.060232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:59.073618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:59.074129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:59.076426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:59.078614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:59.079277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:59.081971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:59.182910 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4d6485c-bba7-4618-9490-f70c0ac36d92 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "POST /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515568 Oct 04 11:37:59.189392 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1557/5733] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:37:58 2022] POST /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:37:59.434325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:59.448668 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd603f60-0070-481e-a932-17bbae4dd29c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.392367 Oct 04 11:37:59.450593 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4177/5734] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:59 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:37:59.529535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:37:59.530538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:37:59.545079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:59.551246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:59.551976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:59.552927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:59.554166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:59.554983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:59.787591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-02d0f60c-0e70-4edf-9500-5c71701800e9 req-350669ae-97e8-41a2-8edc-7b8b610fc778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bb94b8-ff92-40bc-8e33-a36771b26c49", "name": "network-vif-deleted", "tag": "dc1c0ff5-3ff9-46ab-b104-35cc44ffc9c5"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:37:59.825559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02d0f60c-0e70-4edf-9500-5c71701800e9 req-350669ae-97e8-41a2-8edc-7b8b610fc778 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:37:59.826488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02d0f60c-0e70-4edf-9500-5c71701800e9 req-350669ae-97e8-41a2-8edc-7b8b610fc778 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:37:59.827094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-02d0f60c-0e70-4edf-9500-5c71701800e9 req-350669ae-97e8-41a2-8edc-7b8b610fc778 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:37:59.860508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c7734eb82c6424ab1bd92a121438a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126020519f72477fb703e7b14ef786ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:37:59.871594 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba0c8b84-004f-4c79-980c-ff40a40073e6 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 200 len: 1466 microversion: 2.1 time: 0.346536 Oct 04 11:37:59.875795 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1558/5735] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:37:59 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 1466 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:37:59.915454 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-02d0f60c-0e70-4edf-9500-5c71701800e9 req-350669ae-97e8-41a2-8edc-7b8b610fc778 service nova] Creating event network-vif-deleted:dc1c0ff5-3ff9-46ab-b104-35cc44ffc9c5 for instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 on n-h1-791135-8 Oct 04 11:37:59.922337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-02d0f60c-0e70-4edf-9500-5c71701800e9 req-350669ae-97e8-41a2-8edc-7b8b610fc778 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140081 Oct 04 11:37:59.923523 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4178/5736] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:00.212836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2350eb2a-2edb-4450-8689-671f9a03d7d5 req-09da9f2a-d375-4317-b299-b55d389ace23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d75ae74-7535-491d-8dc2-932a7de3b682", "tag": "225d52a6-ef67-4982-9eb3-33c3faba088f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:00.234232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2350eb2a-2edb-4450-8689-671f9a03d7d5 req-09da9f2a-d375-4317-b299-b55d389ace23 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:00.234720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2350eb2a-2edb-4450-8689-671f9a03d7d5 req-09da9f2a-d375-4317-b299-b55d389ace23 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:00.235146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2350eb2a-2edb-4450-8689-671f9a03d7d5 req-09da9f2a-d375-4317-b299-b55d389ace23 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:00.258775 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2350eb2a-2edb-4450-8689-671f9a03d7d5 req-09da9f2a-d375-4317-b299-b55d389ace23 service nova] Creating event network-changed:225d52a6-ef67-4982-9eb3-33c3faba088f for instance 2d75ae74-7535-491d-8dc2-932a7de3b682 on n-h1-791135-8 Oct 04 11:38:00.271699 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2350eb2a-2edb-4450-8689-671f9a03d7d5 req-09da9f2a-d375-4317-b299-b55d389ace23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064572 Oct 04 11:38:00.275577 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1559/5737] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:00.477430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:00.478818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:00.486296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:00.487122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:00.487776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:00.488749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:00.489490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:00.490142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:00.764932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:00.776016 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e00cf0c-d653-4b52-98f6-11cea817b362 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.305180 Oct 04 11:38:00.781118 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4179/5738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:00 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:00.926101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:00.926810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] [instance: e8bb94b8-ff92-40bc-8e33-a36771b26c49] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:00.932585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:00.953333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:00.956148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:00.956605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:00.957468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:00.957936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:00.958365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:00.990179 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] HTTP exception thrown: Instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 could not be found. Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Request method failure captured: Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 HTTP/1.1 Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBr3Ke1Fox0azIbPE_m0S_uXx2wufGr8ccpmmxOd4w4rPHeZvsGBh9TmZsmYSd8rcr6GlIsPGJyDKFz6nPqEbvdQfBVdr0EIWyklufjWx1fMmN5SpY2whV82zeb3ddekhYu7WjGo2f9EXxXuF57R5-a-DlFQpH4rJo3YvT0zRK2YDaE Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 126020519f72477fb703e7b14ef786ec Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestServerAdvancedOps-952131609 Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_126020519f72477fb703e7b14ef786ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/126020519f72477fb703e7b14ef786ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/126020519f72477fb703e7b14ef786ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/126020519f72477fb703e7b14ef786ec"}]}] Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestServerAdvancedOps-952131609 Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 126020519f72477fb703e7b14ef786ec Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestServerAdvancedOps-952131609 Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestServerAdvancedOps-952131609-project Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 6c7734eb82c6424ab1bd92a121438a5b Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestServerAdvancedOps-952131609-project Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 could not be found. Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'e8bb94b8-ff92-40bc-8e33-a36771b26c49'} Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 could not be found. Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 could not be found. Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:38:00.992360 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:38:00.996306 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:38:00.996306 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:38:00.996306 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:38:00.996306 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:38:00.996306 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:38:00.996306 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 could not be found. Oct 04 11:38:00.996306 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:38:00.998596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] Returning 404 to user: Instance e8bb94b8-ff92-40bc-8e33-a36771b26c49 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:38:00.999935 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efd05541-bcc4-4bb1-8027-db8ffabf03c0 tempest-TestServerAdvancedOps-952131609 tempest-TestServerAdvancedOps-952131609-project] 10.222.0.23 "GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49" status: 404 len: 111 microversion: 2.1 time: 0.081488 Oct 04 11:38:01.001431 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1560/5739] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:00 2022] GET /compute/v2.1/servers/e8bb94b8-ff92-40bc-8e33-a36771b26c49 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:38:01.807693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:01.809007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:01.821468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:01.822548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:01.828490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:01.829664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:01.830338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:01.830965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:02.113549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:02.130154 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9de87c1e-65b6-4549-916e-69b98ec582a2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.327015 Oct 04 11:38:02.130716 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4180/5740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:01 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:03.156281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:03.157078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:03.168213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:03.169910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:03.170596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:03.171955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:03.174245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:03.175728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:03.508152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:03.522555 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ade62845-034d-4be3-81b4-e642801562a9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.367651 Oct 04 11:38:03.561925 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1561/5741] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:03 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:04.549975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:04.550613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:04.554052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:04.565548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:04.567505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:04.603615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:04.604049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:04.604539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:04.605276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:04.606058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:04.606503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:04.905470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:04.910173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:04.930649 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e987c59-521e-41ff-9c87-557e95df0fbd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.389053 Oct 04 11:38:04.931244 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4181/5742] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:04 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:05.953773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:05.954748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:05.960855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:05.978857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:05.979580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:05.981307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:05.983798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:05.984563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:05.985342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:06.247431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:06.258463 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1ccdc537-a625-47bf-96ed-fedf05f5886b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.309062 Oct 04 11:38:06.273691 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1562/5743] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:05 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:07.288784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:07.289812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:07.303149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:07.303940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:07.304634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:07.305561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:07.306167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:07.306740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:07.772421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:07.791726 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b025ee3b-cb41-428b-9854-916e00a0a552 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.507623 Oct 04 11:38:07.793253 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4182/5744] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:07 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:08.816687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:08.817165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:08.835425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:08.836326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:08.837798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:08.838743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:08.841979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:08.842613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:09.169181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:09.184121 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e2484961-51aa-47e5-84a3-c6ef6e8c3d7f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1215 microversion: 2.1 time: 0.366069 Oct 04 11:38:09.184745 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1563/5745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:08 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1215 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:10.208388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:10.213238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:10.221706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:10.222676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:10.223587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:10.224517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:10.225921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:10.226551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:10.785318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:10.796308 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b13e8a4-2615-408e-a597-2529b3701ccf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.591842 Oct 04 11:38:10.809377 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4183/5746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:10 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:11.820615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:11.821542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:11.838816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:11.839505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:11.840046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:11.841178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:11.844743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:11.845611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:12.077846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:12.086835 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9e46f11-3da5-4b08-8438-a0b6985a3a7d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.270591 Oct 04 11:38:12.087431 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1564/5747] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:11 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:13.112867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:13.114090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:13.127868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:13.128380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:13.128820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:13.129576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:13.130039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:13.130473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:13.519549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:13.535915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93676177-6b7f-4306-9411-56159ce2f5c2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.428303 Oct 04 11:38:13.539624 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4184/5748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:13 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:14.564503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:14.565118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:14.577743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:14.578450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:14.579071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:14.580376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:14.581877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:14.586244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:14.858538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:14.868583 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e1dd8c1-0d26-482a-b6dd-e69db6975942 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.307855 Oct 04 11:38:14.873332 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1565/5749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:14 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:15.895009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:15.896494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:15.913337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:15.916059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:15.916711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:15.918630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:15.920489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:15.921178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:16.317625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:16.345001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8409adc0-1187-4f51-be46-6186f8257916 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.454451 Oct 04 11:38:16.347581 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4185/5750] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:15 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:17.375765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:17.377035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:17.412130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:17.412904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:17.413561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:17.414445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:17.415069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:17.415661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:17.845140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:17.865065 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-481c7845-a8cb-4f83-8650-4170ce8030b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.493293 Oct 04 11:38:17.876045 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1566/5751] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:17 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:18.907756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:18.909203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:18.923226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:18.923741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:18.924190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:18.924933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:18.934071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:18.936235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:19.283871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:19.293070 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94c55310-1272-4492-8ccc-65cea105fd9a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.394456 Oct 04 11:38:19.297238 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4186/5752] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:18 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:20.317715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:20.319408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:20.352764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:20.353279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:20.353785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:20.363205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:20.364214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:20.367449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:20.793421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:20.809427 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-34db27ac-1b8a-44ca-ab7b-b5c7856a8177 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.496845 Oct 04 11:38:20.819555 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1567/5753] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:20 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:21.834866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:21.836155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:21.865900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:21.868084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:21.868983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:21.870351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:21.871221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:21.871873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:23.479942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:23.506476 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f529621e-dfe6-440b-b4c2-7cd0a51cf194 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 1.668232 Oct 04 11:38:23.532213 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4187/5754] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:21 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:24.000893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-83403960-43cc-45c7-a5f4-9b0d00cf6887 req-f14d752e-2d78-4964-ab26-241e14959d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d75ae74-7535-491d-8dc2-932a7de3b682", "name": "network-vif-plugged", "status": "completed", "tag": "225d52a6-ef67-4982-9eb3-33c3faba088f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:24.031781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83403960-43cc-45c7-a5f4-9b0d00cf6887 req-f14d752e-2d78-4964-ab26-241e14959d6f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:24.042750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83403960-43cc-45c7-a5f4-9b0d00cf6887 req-f14d752e-2d78-4964-ab26-241e14959d6f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:24.043523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83403960-43cc-45c7-a5f4-9b0d00cf6887 req-f14d752e-2d78-4964-ab26-241e14959d6f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:24.111635 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-83403960-43cc-45c7-a5f4-9b0d00cf6887 req-f14d752e-2d78-4964-ab26-241e14959d6f service nova] Creating event network-vif-plugged:225d52a6-ef67-4982-9eb3-33c3faba088f for instance 2d75ae74-7535-491d-8dc2-932a7de3b682 on n-h1-791135-8 Oct 04 11:38:24.127820 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-83403960-43cc-45c7-a5f4-9b0d00cf6887 req-f14d752e-2d78-4964-ab26-241e14959d6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131132 Oct 04 11:38:24.131985 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1568/5755] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:24.534831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:24.536528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:24.562961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:24.600806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:24.609298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:24.610720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:24.613959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:24.614616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:25.331698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:25.358760 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-177946b3-32cf-4afe-b96e-3ebdf3073c05 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1203 microversion: 2.1 time: 0.826665 Oct 04 11:38:25.362985 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4188/5756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:24 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1203 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:26.393100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:26.393851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:26.405722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:26.406218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:26.406617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:26.407340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:26.407800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:26.408237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:26.934639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:26.960063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=80,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:26.978512 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-585d8fa0-6dde-4cb9-9914-ac6a1b061b32 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1388 microversion: 2.1 time: 0.589802 Oct 04 11:38:26.981937 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1569/5757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:26 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1388 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:27.011935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:27.015146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:27.027013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:27.029529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:27.030719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:27.033511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:27.038172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:27.038894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:27.286582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:27.288279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1898e000-8bb0-44cc-a9af-acdb6664d142 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:27.290736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1898e000-8bb0-44cc-a9af-acdb6664d142 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:27.291440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1898e000-8bb0-44cc-a9af-acdb6664d142 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:27.292075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1898e000-8bb0-44cc-a9af-acdb6664d142 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:27.293324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1898e000-8bb0-44cc-a9af-acdb6664d142 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:27.297707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1898e000-8bb0-44cc-a9af-acdb6664d142 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:27.298368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1898e000-8bb0-44cc-a9af-acdb6664d142 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:27.299463 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b350786-d610-4074-a34c-12fc4c60854d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1388 microversion: 2.1 time: 0.299406 Oct 04 11:38:27.300148 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1570/5758] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:26 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1388 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:27.347542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:27.349892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:27.390479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:27.391006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:27.391445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:27.397298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:27.397877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:27.398236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:27.432164 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1898e000-8bb0-44cc-a9af-acdb6664d142 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.467829 Oct 04 11:38:27.436071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4189/5759] 10.222.0.23 () {58 vars in 1185 bytes} [Tue Oct 4 11:38:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:27.720029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1798591598", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "availability_zone": "nova:n-h1-791135-8", "networks": [{"uuid": "66b39cdf-8cca-48d6-a29e-c29d45b8acb6"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:27.841693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] validate_networks() for [('66b39cdf-8cca-48d6-a29e-c29d45b8acb6', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:38:27.917096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:27.930740 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb0ca444-e668-48e0-a4d8-b3f97c1ee454 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1388 microversion: 2.1 time: 0.603504 Oct 04 11:38:27.932777 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1571/5760] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:27 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1388 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:27.959939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:27.960615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:28.009690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:28.017984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:28.022050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:28.023025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:28.024475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:28.029796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:28.199585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:38:28.445495 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b99adc1-475a-4a06-993c-f740f3e8ba47 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 204 len: 0 microversion: 2.1 time: 0.490340 Oct 04 11:38:28.447495 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1572/5761] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:38:27 2022] DELETE /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:38:28.462652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:28.464096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:28.476977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:28.477992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:28.478618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:28.479756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:28.480385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:28.481531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:28.746021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:28.763651 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-766526d4-6901-4e0f-a186-07ccc0bf8ab6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1394 microversion: 2.1 time: 0.307607 Oct 04 11:38:28.764737 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1573/5762] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:28 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1394 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:28.923707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:38:28.926791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:38:28.928028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:38:28.931080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:38:28.936157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:38:28.962774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:28.966229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:28.966992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:28.969581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:28.970393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:28.970939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:29.027674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Getting quotas for project ccc30e08ca9f493097687abb1c2dd2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:38:29.046517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Getting quotas for user 164c432c9c30424f852691ce6a62403a and project ccc30e08ca9f493097687abb1c2dd2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:38:29.094335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:38:29.102780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:38:29.238846 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4833c872-5d77-44a5-b0aa-3ec43df3b4e0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.525699 Oct 04 11:38:29.246482 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4190/5763] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:38:29.253766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ebc9ebe-71d3-4ca9-8862-954ce2eeffb8 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:29.256190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ebc9ebe-71d3-4ca9-8862-954ce2eeffb8 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:29.378031 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ebc9ebe-71d3-4ca9-8862-954ce2eeffb8 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1329 microversion: 2.1 time: 0.129046 Oct 04 11:38:29.384282 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1574/5764] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:29 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1329 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:29.793677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:29.794728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:29.822934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:29.836148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:29.836148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:29.849781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:29.852186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:29.852817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:30.131694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:30.142551 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd00887d-822b-40ff-ab3a-60f2268ba1a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1394 microversion: 2.1 time: 0.357523 Oct 04 11:38:30.143147 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4191/5765] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:29 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1394 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:30.406419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:30.407155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:30.427114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:30.431200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:30.433195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:30.435533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:30.438731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:30.444916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:30.720465 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-252a8b1d-9c35-40e3-ab50-6431b64e6f1b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1346 microversion: 2.1 time: 0.317706 Oct 04 11:38:30.750095 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1575/5766] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:30 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1346 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:31.169652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:31.170277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:31.183986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:31.186042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:31.186707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:31.190010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:31.192911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:31.194342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:31.434288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:31.449152 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8f8aab0-3549-4824-9ef8-b471750927d1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1352 microversion: 2.1 time: 0.284047 Oct 04 11:38:31.452663 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4192/5767] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:31 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1352 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:31.746615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:31.747615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:31.758105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:31.765680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:31.766732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:31.776641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:31.777611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:31.779760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:32.046574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d3e6476b-6f95-4238-8ea0-52aee18c3df0 req-2ae3590f-7ed4-49f6-8890-68eda7dbdd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d75ae74-7535-491d-8dc2-932a7de3b682", "name": "network-vif-deleted", "tag": "225d52a6-ef67-4982-9eb3-33c3faba088f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:32.068890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:32.073607 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-faf891e1-6657-4f14-af0e-8bca3406f5dc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1416 microversion: 2.1 time: 0.330902 Oct 04 11:38:32.084425 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4193/5768] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:31 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1416 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:38:32.103634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d3e6476b-6f95-4238-8ea0-52aee18c3df0 req-2ae3590f-7ed4-49f6-8890-68eda7dbdd7e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:32.104113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d3e6476b-6f95-4238-8ea0-52aee18c3df0 req-2ae3590f-7ed4-49f6-8890-68eda7dbdd7e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:32.104662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d3e6476b-6f95-4238-8ea0-52aee18c3df0 req-2ae3590f-7ed4-49f6-8890-68eda7dbdd7e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:32.155826 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d3e6476b-6f95-4238-8ea0-52aee18c3df0 req-2ae3590f-7ed4-49f6-8890-68eda7dbdd7e service nova] Creating event network-vif-deleted:225d52a6-ef67-4982-9eb3-33c3faba088f for instance 2d75ae74-7535-491d-8dc2-932a7de3b682 on n-h1-791135-8 Oct 04 11:38:32.183453 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d3e6476b-6f95-4238-8ea0-52aee18c3df0 req-2ae3590f-7ed4-49f6-8890-68eda7dbdd7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.641959 Oct 04 11:38:32.184662 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1576/5769] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:32.477605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:32.478209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:32.491793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:32.498636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:32.499203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:32.499978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:32.500867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:32.501386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:32.699940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:32.731031 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-56d8fa90-7424-438b-9dda-a0e23d768f60 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1188 microversion: 2.1 time: 0.257488 Oct 04 11:38:32.738622 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4194/5770] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:32 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:33.118059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:33.119410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:33.151379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:33.156763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:33.161406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:33.162778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:33.163258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:33.163686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:33.768045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:33.769161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:33.780812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:33.781319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:33.791070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:33.791070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:33.791070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:33.791300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:33.997539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:34.007669 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b4e88bf-7f47-45c6-9314-f68ff6c287a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1188 microversion: 2.1 time: 0.245738 Oct 04 11:38:34.027188 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4195/5771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:33 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1188 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:38:34.292795 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a92ec8b2-d686-48a8-9223-80d23b70a1fc tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1464 microversion: 2.1 time: 1.184941 Oct 04 11:38:34.293401 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1577/5772] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:33 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1464 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:35.031352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:35.031878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:35.057969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:35.066483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:35.066991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:35.067447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:35.068735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:35.069208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:35.069672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:35.216808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:35.228717 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b19357c-6025-423e-8a8b-cdf889d180a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1188 microversion: 2.1 time: 0.201199 Oct 04 11:38:35.229790 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4196/5773] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:35 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1188 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:35.315643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:35.316255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:35.336108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:35.336599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:35.337031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:35.337767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:35.338219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:35.338641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:35.853735 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-94e13cbf-3a8e-4eee-a454-fa1169130651 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1464 microversion: 2.1 time: 0.541492 Oct 04 11:38:35.854347 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1578/5774] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:35 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1464 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:35.937861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3b65df49-3220-4072-a03e-dc35204582ee req-02745ddb-e436-46e7-8942-023c217a04d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2dd62b8-e082-4f70-83de-b00c7afecbe8", "tag": "c12b944e-a147-429e-915e-1390c6a1af23"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:35.959110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3b65df49-3220-4072-a03e-dc35204582ee req-02745ddb-e436-46e7-8942-023c217a04d1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:35.959610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3b65df49-3220-4072-a03e-dc35204582ee req-02745ddb-e436-46e7-8942-023c217a04d1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:35.960061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3b65df49-3220-4072-a03e-dc35204582ee req-02745ddb-e436-46e7-8942-023c217a04d1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:35.990428 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3b65df49-3220-4072-a03e-dc35204582ee req-02745ddb-e436-46e7-8942-023c217a04d1 service nova] Creating event network-changed:c12b944e-a147-429e-915e-1390c6a1af23 for instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 on n-h1-791135-8 Oct 04 11:38:35.996201 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3b65df49-3220-4072-a03e-dc35204582ee req-02745ddb-e436-46e7-8942-023c217a04d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062309 Oct 04 11:38:35.996836 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4197/5775] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:36.252617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:36.253869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:36.265493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:36.266302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:36.268065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:36.273933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:36.274658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:36.275267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:36.463088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:36.475186 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8748d352-bd85-4985-979e-68d336a966ae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1188 microversion: 2.1 time: 0.226813 Oct 04 11:38:36.476345 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1579/5776] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:36 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1188 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:36.882091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:36.882806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:36.896340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:36.896848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:36.897298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:36.898160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:36.898631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:36.899067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:37.222341 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-29454566-c269-42d7-8942-30327139968a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1464 microversion: 2.1 time: 0.344908 Oct 04 11:38:37.223901 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4198/5777] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:36 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1464 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:37.499064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:37.500526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:37.511838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:37.512547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:37.513143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:37.514453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:37.515099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:37.515802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:37.638957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:37.652878 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81cc7434-35de-47b2-8f20-3ca72d916332 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1188 microversion: 2.1 time: 0.157705 Oct 04 11:38:37.657502 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1580/5778] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:37 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1188 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:38.253112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:38.254366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:38.272081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:38.277110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:38.277284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:38.277970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:38.282076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:38.282565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:38.294740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=92 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:38.677559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:38.680916 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c520a57b-9bd5-4224-b93f-9db975251fd2 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1464 microversion: 2.1 time: 0.437995 Oct 04 11:38:38.681711 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4199/5779] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:38 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1464 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:38.682542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:38.690708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:38.691439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:38.692074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:38.693082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:38.693569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:38.694153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:38.827847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:38.836773 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e1ed399-b98b-464f-b05a-8ee4a26045f1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1188 microversion: 2.1 time: 0.164515 Oct 04 11:38:38.855222 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1581/5780] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:38 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1188 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:38:39.708093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:39.710946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:39.714897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:39.716661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:39.737415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:39.738381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:39.750186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:39.751228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:39.756363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:39.756996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:39.872399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:39.873129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:39.875820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:39.888012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:39.897677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:39.898430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:39.899356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:39.899836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:39.900272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:39.967514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:39.977846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:39.978514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:39.978994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lazy-loading 'fault' on Instance uuid 2d75ae74-7535-491d-8dc2-932a7de3b682 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:38:40.032372 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c6821e63-54df-413a-be08-4c041f05de5d tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1464 microversion: 2.1 time: 0.328492 Oct 04 11:38:40.045305 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4200/5781] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:39 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:40.075588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:40.099615 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1864e7b6-2a39-47b3-bb84-cf0d0e79ec68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 200 len: 1193 microversion: 2.1 time: 0.233350 Oct 04 11:38:40.108523 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1582/5782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:39 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 1193 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:41.038667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b8be03ff-4402-412d-a7fb-c3b3bb4a5c9b req-bc2088ce-6798-464d-b704-2e38ce812a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2dd62b8-e082-4f70-83de-b00c7afecbe8", "name": "network-vif-plugged", "status": "completed", "tag": "c12b944e-a147-429e-915e-1390c6a1af23"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:41.057474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:41.058229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:41.065977 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:38:41.072320 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 (ip 10.222.0.23) !!! Oct 04 11:38:41.076846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8be03ff-4402-412d-a7fb-c3b3bb4a5c9b req-bc2088ce-6798-464d-b704-2e38ce812a98 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:41.077492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8be03ff-4402-412d-a7fb-c3b3bb4a5c9b req-bc2088ce-6798-464d-b704-2e38ce812a98 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:41.078400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b8be03ff-4402-412d-a7fb-c3b3bb4a5c9b req-bc2088ce-6798-464d-b704-2e38ce812a98 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:41.078828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:41.084079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:41.087225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:41.088891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:41.090163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:41.092564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:41.119709 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b8be03ff-4402-412d-a7fb-c3b3bb4a5c9b req-bc2088ce-6798-464d-b704-2e38ce812a98 service nova] Creating event network-vif-plugged:c12b944e-a147-429e-915e-1390c6a1af23 for instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 on n-h1-791135-8 Oct 04 11:38:41.138610 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b8be03ff-4402-412d-a7fb-c3b3bb4a5c9b req-bc2088ce-6798-464d-b704-2e38ce812a98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105137 Oct 04 11:38:41.139697 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4201/5783] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:41.147768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:41.148934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 2d75ae74-7535-491d-8dc2-932a7de3b682] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:41.164624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:41.168156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:41.168875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:41.169977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:41.176304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:41.177643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:41.216701 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 2d75ae74-7535-491d-8dc2-932a7de3b682 could not be found. Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 HTTP/1.1 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 2d75ae74-7535-491d-8dc2-932a7de3b682 could not be found. Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2d75ae74-7535-491d-8dc2-932a7de3b682'} Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d75ae74-7535-491d-8dc2-932a7de3b682 could not be found. Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d75ae74-7535-491d-8dc2-932a7de3b682 could not be found. Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:38:41.223757 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:38:41.228946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:38:41.228946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:38:41.228946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:38:41.228946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:38:41.228946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:38:41.228946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d75ae74-7535-491d-8dc2-932a7de3b682 could not be found. Oct 04 11:38:41.228946 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:38:41.231331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 2d75ae74-7535-491d-8dc2-932a7de3b682 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:38:41.232462 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0d80e910-5f5b-4705-81f1-91ba5de8dd1b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682" status: 404 len: 111 microversion: 2.1 time: 0.090847 Oct 04 11:38:41.234309 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4202/5784] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:41 2022] GET /compute/v2.1/servers/2d75ae74-7535-491d-8dc2-932a7de3b682 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:38:41.504367 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2a0fa43-0ba3-45ea-8b9b-2089f97b696f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1464 microversion: 2.1 time: 0.450573 Oct 04 11:38:41.506223 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1583/5785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:41 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1464 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:38:42.533083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:42.534604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:42.543290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:42.544704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:42.545337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:42.547551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:42.548017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:42.548819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:42.740462 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-03f69a54-f978-4ade-b31b-71012a8f3ec5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1649 microversion: 2.1 time: 0.210413 Oct 04 11:38:42.745161 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4203/5786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:42 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1649 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:42.767559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:42.768392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:42.775711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:42.776195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:42.776634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:42.777334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:42.777979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:42.778564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:42.970586 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6e0d324-defd-4d17-ae51-c1f6ce3a0ecb tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1649 microversion: 2.1 time: 0.207034 Oct 04 11:38:42.971574 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1584/5787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:42 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1649 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:42.996371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:42.997230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:43.010638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:43.011155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:43.011613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:43.015418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:43.016088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:43.016433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:43.205593 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8363e21-48e1-4da6-96ac-43d6699d6064 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1649 microversion: 2.1 time: 0.213208 Oct 04 11:38:43.216849 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4204/5788] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:42 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1649 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:43.417775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-448691538", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "availability_zone": "nova:n-h2-791135-8", "networks": [{"uuid": "66b39cdf-8cca-48d6-a29e-c29d45b8acb6"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:43.556602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] validate_networks() for [('66b39cdf-8cca-48d6-a29e-c29d45b8acb6', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:38:44.395470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:38:44.396630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:38:44.397270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:38:44.397856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:38:44.398443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:38:44.419004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:44.419522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:44.420215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:44.421003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:44.421972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:44.421972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:44.448702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Getting quotas for project ccc30e08ca9f493097687abb1c2dd2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:38:44.455171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Getting quotas for user 164c432c9c30424f852691ce6a62403a and project ccc30e08ca9f493097687abb1c2dd2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:38:44.500035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:38:44.503698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:38:44.606246 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b7bae2e-b33f-4460-b27c-38127c7fd467 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181190 Oct 04 11:38:44.618872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d41b37b-d430-4a0f-bb86-d06106a676ad tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:44.619568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9d41b37b-d430-4a0f-bb86-d06106a676ad tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:44.634234 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1585/5789] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:38:44.751142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d41b37b-d430-4a0f-bb86-d06106a676ad tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1328 microversion: 2.1 time: 0.136142 Oct 04 11:38:44.758122 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4205/5790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:44 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1328 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:44.902119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:44.902949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:44.938644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:44.939692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:44.940307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:44.941191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:44.941834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:44.944956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:45.092843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:45.096455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lazy-loading 'services' on Instance uuid 2c9ba7dd-e919-4545-af85-ad122922253f {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:38:45.244990 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3cf981ae-16bf-4565-8ec9-90cf175e7e49 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f/os-volume_attachments/b20fa8f2-20d6-43e5-b902-6539799a9eb8" status: 202 len: 0 microversion: 2.1 time: 0.347153 Oct 04 11:38:45.247431 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1586/5791] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:38:44 2022] DELETE /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f/os-volume_attachments/b20fa8f2-20d6-43e5-b902-6539799a9eb8 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:38:45.774732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:45.776284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:45.800904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:45.802864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:45.803546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:45.804622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:45.805313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:45.806395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:45.945602 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-240dab10-48ac-4f0f-8558-32a5cb70649a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1345 microversion: 2.1 time: 0.174678 Oct 04 11:38:45.946199 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4206/5792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:45 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:46.977999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:46.978785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:47.000846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:47.001390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:47.001905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:47.002629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:47.003095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:47.003528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:47.159690 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82ecfbcb-9f7f-4531-a50b-8bdf6aaeaf51 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1433 microversion: 2.1 time: 0.195084 Oct 04 11:38:47.175587 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1587/5793] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:46 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1433 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:48.191219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:48.191860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:48.208906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:48.211658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:48.212165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:48.213116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:48.217064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:48.218499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:48.512137 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3dfb5d24-93d6-497a-878d-b88722066d09 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.326416 Oct 04 11:38:48.528712 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4207/5794] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:48 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:49.535809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:49.536470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:49.586608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:49.587197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:49.588202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:49.590371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:49.591495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:49.592681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:49.653050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e7c66b25-91d2-476d-8283-c8d26c38b951 req-0419c862-9410-4bf2-97f1-de4e0dfdb90d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6628213-e1b6-43df-ba76-19972d7d946f", "tag": "74c81a56-f00b-4332-bf4f-7f9531dc054a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:49.668467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e7c66b25-91d2-476d-8283-c8d26c38b951 req-0419c862-9410-4bf2-97f1-de4e0dfdb90d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:49.669384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e7c66b25-91d2-476d-8283-c8d26c38b951 req-0419c862-9410-4bf2-97f1-de4e0dfdb90d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:49.671431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e7c66b25-91d2-476d-8283-c8d26c38b951 req-0419c862-9410-4bf2-97f1-de4e0dfdb90d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:49.689122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e7c66b25-91d2-476d-8283-c8d26c38b951 req-0419c862-9410-4bf2-97f1-de4e0dfdb90d service nova] Creating event network-changed:74c81a56-f00b-4332-bf4f-7f9531dc054a for instance f6628213-e1b6-43df-ba76-19972d7d946f on n-h2-791135-8 Oct 04 11:38:49.696377 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e7c66b25-91d2-476d-8283-c8d26c38b951 req-0419c862-9410-4bf2-97f1-de4e0dfdb90d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050484 Oct 04 11:38:49.697975 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4208/5795] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:50.185190 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-690d73bd-275e-4bce-9053-302714fc44f9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.653177 Oct 04 11:38:50.186030 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1588/5796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:49 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:51.215058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:51.215947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:51.232530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:51.233186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:51.233905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:51.235241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:51.237027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:51.238291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:51.464039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-48e75c5f-2527-40a2-bf33-315ee76a612c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.254714 Oct 04 11:38:51.465247 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4209/5797] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:51 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:38:52.488172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:52.488794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:52.496509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:52.497270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:52.497933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:52.500588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:52.501233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:52.502114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:52.780760 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e6dbace-f43c-45e5-96aa-60885178aff4 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.296771 Oct 04 11:38:52.787118 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1589/5798] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:52 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:53.808545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:53.809218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:53.819442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:53.824880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:53.826133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:53.827994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:53.830157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:53.832405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:54.058369 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8dc60fdd-b63c-4e41-8956-f43feef402d0 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.252922 Oct 04 11:38:54.070225 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4210/5799] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:53 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:54.394840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:54.395942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:54.409209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:54.414879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:54.415580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:54.416538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:54.417005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:54.417450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:54.438078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:54.494570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:54.558857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lazy-loading 'services' on Instance uuid 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:38:54.656505 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9f338f7f-8b7a-4004-a30c-eacbdb0e8bc2 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32/os-volume_attachments/58495ebe-516c-47f0-9c33-bc770ee36bd8" status: 202 len: 0 microversion: 2.1 time: 0.264311 Oct 04 11:38:54.661190 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1590/5800] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:38:54 2022] DELETE /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32/os-volume_attachments/58495ebe-516c-47f0-9c33-bc770ee36bd8 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:38:55.084349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:55.085711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:55.088157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:38:55.100278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:55.102323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:55.103346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:55.104500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:55.106951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:55.108611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:55.373241 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e327d83-d7fe-4832-847e-b3424344f475 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.293646 Oct 04 11:38:55.382194 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4211/5801] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:55 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:56.042030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:56.043233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:56.052023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:56.052790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:56.053476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:56.054388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:56.055904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:56.056559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:56.091179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:38:56.233156 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47f7aa55-662e-4019-9435-35e07bd33c03 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 204 len: 0 microversion: 2.1 time: 0.195827 Oct 04 11:38:56.233889 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1591/5802] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:38:56 2022] DELETE /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:38:56.243188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:56.243894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:56.252955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:56.253498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:56.254035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:56.254876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:56.255390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:56.255892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:56.399137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:56.400111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:56.406756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:56.407245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:56.407731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:56.408379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:56.408831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:56.409260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:56.432169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:56.441030 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a46c489-901c-4adc-af65-d20ae9f7bdd4 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1513 microversion: 2.1 time: 0.202516 Oct 04 11:38:56.469216 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4212/5803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:56 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:56.602353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-444cfdbf-bf97-4ad1-8ca2-2404f60de0fb req-cbcdee2f-ac8a-4453-82ae-8bb1b8ce3beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6628213-e1b6-43df-ba76-19972d7d946f", "name": "network-vif-plugged", "status": "completed", "tag": "74c81a56-f00b-4332-bf4f-7f9531dc054a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:56.605026 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c45683c-88d7-475a-99ca-6f4c696472a9 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.209927 Oct 04 11:38:56.606779 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1592/5804] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:56 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:38:56.623718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-444cfdbf-bf97-4ad1-8ca2-2404f60de0fb req-cbcdee2f-ac8a-4453-82ae-8bb1b8ce3beb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:56.624224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-444cfdbf-bf97-4ad1-8ca2-2404f60de0fb req-cbcdee2f-ac8a-4453-82ae-8bb1b8ce3beb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:56.624671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-444cfdbf-bf97-4ad1-8ca2-2404f60de0fb req-cbcdee2f-ac8a-4453-82ae-8bb1b8ce3beb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:56.637840 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-444cfdbf-bf97-4ad1-8ca2-2404f60de0fb req-cbcdee2f-ac8a-4453-82ae-8bb1b8ce3beb service nova] Creating event network-vif-plugged:74c81a56-f00b-4332-bf4f-7f9531dc054a for instance f6628213-e1b6-43df-ba76-19972d7d946f on n-h2-791135-8 Oct 04 11:38:56.644309 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-444cfdbf-bf97-4ad1-8ca2-2404f60de0fb req-cbcdee2f-ac8a-4453-82ae-8bb1b8ce3beb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046440 Oct 04 11:38:56.646400 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4213/5805] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:38:57.470825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:57.472251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:57.481795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:57.483291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:57.484165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:57.485520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:57.486381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:57.487322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:57.628963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:57.630170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:57.641321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:57.642133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:57.642804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:57.643851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:57.644809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:57.646040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:57.853032 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfdf308f-ecf7-41ce-ab6d-d156331f62e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.228566 Oct 04 11:38:57.856750 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4214/5806] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:57 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:38:58.312935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:58.330368 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c1a38c9-2a55-4dd3-bf36-6102be86c9aa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1513 microversion: 2.1 time: 0.864543 Oct 04 11:38:58.347100 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1593/5807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:57 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1513 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:38:58.641377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a9f98532-43ab-4ad7-8970-6a70afe8bcd6 req-3c453626-16a4-4c2b-a168-d14aab928182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9ba7dd-e919-4545-af85-ad122922253f", "name": "network-vif-deleted", "tag": "4a4dc353-18f1-4bba-8f9e-d879577fc41f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:38:58.658411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a9f98532-43ab-4ad7-8970-6a70afe8bcd6 req-3c453626-16a4-4c2b-a168-d14aab928182 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:58.659452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a9f98532-43ab-4ad7-8970-6a70afe8bcd6 req-3c453626-16a4-4c2b-a168-d14aab928182 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:58.660045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a9f98532-43ab-4ad7-8970-6a70afe8bcd6 req-3c453626-16a4-4c2b-a168-d14aab928182 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:58.682180 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a9f98532-43ab-4ad7-8970-6a70afe8bcd6 req-3c453626-16a4-4c2b-a168-d14aab928182 service nova] Creating event network-vif-deleted:4a4dc353-18f1-4bba-8f9e-d879577fc41f for instance 2c9ba7dd-e919-4545-af85-ad122922253f on n-h2-791135-8 Oct 04 11:38:58.690587 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a9f98532-43ab-4ad7-8970-6a70afe8bcd6 req-3c453626-16a4-4c2b-a168-d14aab928182 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052855 Oct 04 11:38:58.694716 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4215/5808] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:38:58.876781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:58.877968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:58.889489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:58.889983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:58.890421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:58.891121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:58.891576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:58.891999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:59.045594 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b085be6a-3f06-482c-a928-8730ad873f67 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1463 microversion: 2.1 time: 0.173160 Oct 04 11:38:59.057740 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1594/5809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:58 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1463 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:38:59.360483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:38:59.361203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:38:59.368892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:59.369423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:59.369850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:59.370557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:59.371017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:59.371441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:59.414252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:38:59.417508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:38:59.418969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:38:59.419960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lazy-loading 'fault' on Instance uuid 2c9ba7dd-e919-4545-af85-ad122922253f {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:38:59.468838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:38:59.479501 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a89fa24-37db-4b38-b3d7-3c79ef355b48 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1308 microversion: 2.1 time: 0.126998 Oct 04 11:38:59.480464 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4216/5810] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:38:59 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:00.070789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:00.073504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:00.083366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.083947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.084514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.085391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.086077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.086512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.247827 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9e06d135-7c1b-4035-a211-8a08f67789b5 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1648 microversion: 2.1 time: 0.181231 Oct 04 11:39:00.258151 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1595/5811] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:00 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1648 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:00.272522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:00.273043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:00.282515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.283262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.284236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.285316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.286017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.286792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.503947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:00.505186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:00.513424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.514521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.515220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.516190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.516869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.517557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.528228 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d3d0a770-0852-49d7-abc8-82bf3b7bc72c tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1648 microversion: 2.1 time: 0.260117 Oct 04 11:39:00.541388 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4217/5812] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:00 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1648 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:00.571743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:00.572408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:00.581194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.582231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.583267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.583776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.584634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.585318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lazy-loading 'fault' on Instance uuid 2c9ba7dd-e919-4545-af85-ad122922253f {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:39:00.590236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.591854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.593299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.593781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.683635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:00.692778 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74227090-0bf5-4b4f-8eeb-1df2abe113cf tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 200 len: 1308 microversion: 2.1 time: 0.192339 Oct 04 11:39:00.704239 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1596/5813] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:00 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:00.815868 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-16082135-3f96-463f-9e11-3d1d2fe95318 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1648 microversion: 2.1 time: 0.253899 Oct 04 11:39:00.818391 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4218/5814] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:00 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1648 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:00.842194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:00.843372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:00.851205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.852535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.853155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.854071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:00.854680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:00.855262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:00.886709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:39:00.994852 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-986ce498-4a12-49a2-af34-d346fcf7305f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 204 len: 0 microversion: 2.1 time: 0.157205 Oct 04 11:39:00.999417 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1597/5815] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:39:00 2022] DELETE /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:01.004263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:01.004918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:01.012643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:01.013177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:01.013650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:01.014359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:01.014816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:01.015464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:01.176457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:01.184916 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f587ce92-fada-430e-af4d-be95ff53fa83 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1654 microversion: 2.1 time: 0.184500 Oct 04 11:39:01.199210 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4219/5816] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:00 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1654 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:01.718015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:01.719826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 2c9ba7dd-e919-4545-af85-ad122922253f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:01.728896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:01.730406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:01.731200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:01.732307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:01.732986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:01.733695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:01.752023 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] HTTP exception thrown: Instance 2c9ba7dd-e919-4545-af85-ad122922253f could not be found. Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Request method failure captured: Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f HTTP/1.1 Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBpk2t9nvTMvkuYztXl3uAdEgE-Ah-yURC8zWyFfSmIIvbigoS746Ms4FUSATr53GE0hhGLZa7JzVBxmRIE9qzxs_9xI-cjUS8qWXKKuIhxV0tD56uH1Lpu-sJcd_v5a9Qz_ctFxVWR1XCodaPcIn8tpmtfUN1FsloEYyzfPyEPRkDk Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 1c1bece42945476c809344885ea4b21d Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1193691461 Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c1bece42945476c809344885ea4b21d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c1bece42945476c809344885ea4b21d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c1bece42945476c809344885ea4b21d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c1bece42945476c809344885ea4b21d"}]}] Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesSnapshotTestJSON-1193691461 Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 1c1bece42945476c809344885ea4b21d Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1193691461 Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-VolumesSnapshotTestJSON-1193691461-project Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 04c2d820f8984cc39dd8ac570d697ebd Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesSnapshotTestJSON-1193691461-project Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 2c9ba7dd-e919-4545-af85-ad122922253f could not be found. Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '2c9ba7dd-e919-4545-af85-ad122922253f'} Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9ba7dd-e919-4545-af85-ad122922253f could not be found. Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9ba7dd-e919-4545-af85-ad122922253f could not be found. Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:39:01.754311 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:01.759552 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:01.759552 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:39:01.759552 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:39:01.759552 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:39:01.759552 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:39:01.759552 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9ba7dd-e919-4545-af85-ad122922253f could not be found. Oct 04 11:39:01.759552 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:01.759552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Returning 404 to user: Instance 2c9ba7dd-e919-4545-af85-ad122922253f could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:39:01.769830 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f472aab0-0c9e-4e8e-a553-b6250803515f tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f" status: 404 len: 111 microversion: 2.1 time: 0.048160 Oct 04 11:39:01.769830 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1598/5817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:01 2022] GET /compute/v2.1/servers/2c9ba7dd-e919-4545-af85-ad122922253f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:39:02.219075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:02.219838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:02.238571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:02.239748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:02.240079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:02.241097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:02.241746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:02.242347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:02.462612 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0189326c-471a-47ef-821c-4ee94a04ac9b tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1654 microversion: 2.1 time: 0.247235 Oct 04 11:39:02.464564 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4220/5818] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:02 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1654 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:02.506128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:02.506902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:02.522139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:02.523417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:02.526849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:02.528062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:02.529775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:02.531051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:02.567489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:02.576787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:39:02.683527 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-764b0615-2073-4714-afd5-1e0d7dd1b88b tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "DELETE /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 204 len: 0 microversion: 2.1 time: 0.184785 Oct 04 11:39:02.685411 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1599/5819] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:39:02 2022] DELETE /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:02.695479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:02.696275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:02.703318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:02.703980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:02.704597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:02.705507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:02.706223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:02.706812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:02.923164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:02.934169 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71dcf71d-8191-4b22-a5d3-3ddc535316a0 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1468 microversion: 2.1 time: 0.243106 Oct 04 11:39:02.936158 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4221/5820] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:02 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1468 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:03.488508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:03.490402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:03.501539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:03.505885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:03.506560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:03.508295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:03.518147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:03.518863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:03.519469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:03.762752 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0296a24f-6eec-49d1-b533-2808f365fb5f tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1654 microversion: 2.1 time: 0.278269 Oct 04 11:39:03.766310 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1600/5821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:03 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1654 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:03.960705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:03.961971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:03.972131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:03.978022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:03.978674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:03.979601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:03.980548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:03.981168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:04.263190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:04.274259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a00f524d-b4bf-40bf-918d-cf168aa512b7 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1468 microversion: 2.1 time: 0.317444 Oct 04 11:39:04.278986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4222/5822] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:03 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1468 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:04.789341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:04.790670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:04.807156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:04.818948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:04.819665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:04.820423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:04.820888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:04.821322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:04.842200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5b70cac0-b453-4d2c-a84d-693784626c5b req-05bfcb9f-b708-4171-bd63-05ebaccafc0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6628213-e1b6-43df-ba76-19972d7d946f", "name": "network-vif-deleted", "tag": "74c81a56-f00b-4332-bf4f-7f9531dc054a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:04.866447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5b70cac0-b453-4d2c-a84d-693784626c5b req-05bfcb9f-b708-4171-bd63-05ebaccafc0a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:04.867162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5b70cac0-b453-4d2c-a84d-693784626c5b req-05bfcb9f-b708-4171-bd63-05ebaccafc0a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:04.868653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5b70cac0-b453-4d2c-a84d-693784626c5b req-05bfcb9f-b708-4171-bd63-05ebaccafc0a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:04.912650 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5b70cac0-b453-4d2c-a84d-693784626c5b req-05bfcb9f-b708-4171-bd63-05ebaccafc0a service nova] Creating event network-vif-deleted:74c81a56-f00b-4332-bf4f-7f9531dc054a for instance f6628213-e1b6-43df-ba76-19972d7d946f on n-h2-791135-8 Oct 04 11:39:04.920595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5b70cac0-b453-4d2c-a84d-693784626c5b req-05bfcb9f-b708-4171-bd63-05ebaccafc0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083140 Oct 04 11:39:04.923070 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4223/5823] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:39:05.115317 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4454d050-bb86-42b3-9bff-3bfa6a8d55e6 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 200 len: 1612 microversion: 2.1 time: 0.329758 Oct 04 11:39:05.121716 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1601/5824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:04 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 1612 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:05.311372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:05.312089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:05.332044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=60 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:05.339564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:05.341570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:05.344245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:05.345263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:05.347447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:05.349166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:05.693819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:05.715391 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6dfe5957-8eb5-4acc-86d0-65937d058ae9 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1468 microversion: 2.1 time: 0.409982 Oct 04 11:39:05.717653 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4224/5825] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:05 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1468 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:06.038968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f6014006-2367-4b9f-aee7-afac9d5fdf76 req-077a9ffc-a7f2-478a-ace5-a2b446f7a302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32", "name": "network-vif-deleted", "tag": "d32b124a-ea77-48cc-8208-6324195fd122"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:06.055340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6014006-2367-4b9f-aee7-afac9d5fdf76 req-077a9ffc-a7f2-478a-ace5-a2b446f7a302 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.056205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6014006-2367-4b9f-aee7-afac9d5fdf76 req-077a9ffc-a7f2-478a-ace5-a2b446f7a302 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.056856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f6014006-2367-4b9f-aee7-afac9d5fdf76 req-077a9ffc-a7f2-478a-ace5-a2b446f7a302 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.070449 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f6014006-2367-4b9f-aee7-afac9d5fdf76 req-077a9ffc-a7f2-478a-ace5-a2b446f7a302 service nova] Creating event network-vif-deleted:d32b124a-ea77-48cc-8208-6324195fd122 for instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 on n-h2-791135-8 Oct 04 11:39:06.086275 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f6014006-2367-4b9f-aee7-afac9d5fdf76 req-077a9ffc-a7f2-478a-ace5-a2b446f7a302 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049136 Oct 04 11:39:06.088146 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1602/5826] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:39:06.149377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:06.150412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: f6628213-e1b6-43df-ba76-19972d7d946f] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:06.162722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.165524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.166263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.168248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.169778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.171265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.217464 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] HTTP exception thrown: Instance f6628213-e1b6-43df-ba76-19972d7d946f could not be found. Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Request method failure captured: Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f HTTP/1.1 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBsyDyDHKSk3InFJwN7DswRBB6_yqNkpfaQUlq73M2ikpD1XG-gVn59eQUV-LDyXLFOCxWGxEG4InLu61DrOQpcD2ZU-Ep1XVs6PwLk2gU1NgjEEfO2Sg8U1xvbXtDJ0Mf1BrAxKQQ5Ew8-ZyNsofSB0670M2AQgbu5gsukvkt5tdy0 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ccc30e08ca9f493097687abb1c2dd2d5 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestServerMultinode-712667838 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccc30e08ca9f493097687abb1c2dd2d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccc30e08ca9f493097687abb1c2dd2d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccc30e08ca9f493097687abb1c2dd2d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccc30e08ca9f493097687abb1c2dd2d5"}]}] Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestServerMultinode-712667838 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ccc30e08ca9f493097687abb1c2dd2d5 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestServerMultinode-712667838 Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestServerMultinode-712667838-project-admin Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 164c432c9c30424f852691ce6a62403a Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestServerMultinode-712667838-project-admin Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f6628213-e1b6-43df-ba76-19972d7d946f could not be found. Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f6628213-e1b6-43df-ba76-19972d7d946f'} Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6628213-e1b6-43df-ba76-19972d7d946f could not be found. Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6628213-e1b6-43df-ba76-19972d7d946f could not be found. Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:39:06.220643 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6628213-e1b6-43df-ba76-19972d7d946f could not be found. Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Returning 404 to user: Instance f6628213-e1b6-43df-ba76-19972d7d946f could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-406c5f53-505a-4156-b610-9ea19d674f89 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f" status: 404 len: 111 microversion: 2.1 time: 0.078048 Oct 04 11:39:06.224913 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4225/5827] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:06 2022] GET /compute/v2.1/servers/f6628213-e1b6-43df-ba76-19972d7d946f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:39:06.229764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:06.230345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:06.247536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.248088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.248481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.249198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.249713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.250128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.318220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:39:06.527911 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c73301c5-3d7a-4efe-886a-95b58fee4690 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 204 len: 0 microversion: 2.1 time: 0.301923 Oct 04 11:39:06.539166 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1603/5828] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:39:06 2022] DELETE /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:39:06.556671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:06.557259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:06.571358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.579290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.579930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.580683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.593580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.594351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.743386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:06.744007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:06.788132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.791357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.792135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.793234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.793944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.794596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.888662 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-879b6307-8598-4784-9837-89f4d73c7740 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1655 microversion: 2.1 time: 0.349203 Oct 04 11:39:06.889257 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4226/5829] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:06 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1655 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:06.915209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:06.915711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:06.916159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:06.916623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lazy-loading 'fault' on Instance uuid 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:39:06.989430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270f677d4889470a83601382f744e25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9639ee5b2147baa8514ac6ae113c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:06.997829 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43bee095-676f-40c1-bf2d-2b0766eab257 tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 200 len: 1303 microversion: 2.1 time: 0.259526 Oct 04 11:39:07.001147 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1604/5830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:06 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:07.918096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:07.920985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:07.942688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:07.948763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:07.949890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:07.952794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:07.955397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:07.956096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:08.027749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:08.030514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] [instance: 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:08.048798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:08.050111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:08.053319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:08.054584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:08.058049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:08.059021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:08.130521 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] HTTP exception thrown: Instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 could not be found. Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Request method failure captured: Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 HTTP/1.1 Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBq1tuyHN6tbD5MpOjmgDom3zZ8fu6w8-SMO19yG95OKI0e02a9if3RzpJkjUzcJdi_CqPZPaoN6kUJFKFZxJhNkQTn2Oj-3CyEQv3FuUVPXLLHA22JP5KHNwBKqxFvIlgyU5_elbdg6wnG9tfTZyVQTuguIjvxgwDqXk9limcHKuSg Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3e9639ee5b2147baa8514ac6ae113c6c Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-VolumesBackupsTest-1027356419 Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e9639ee5b2147baa8514ac6ae113c6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e9639ee5b2147baa8514ac6ae113c6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e9639ee5b2147baa8514ac6ae113c6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e9639ee5b2147baa8514ac6ae113c6c"}]}] Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-VolumesBackupsTest-1027356419 Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3e9639ee5b2147baa8514ac6ae113c6c Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-VolumesBackupsTest-1027356419 Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-VolumesBackupsTest-1027356419-project Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 270f677d4889470a83601382f744e25b Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-VolumesBackupsTest-1027356419-project Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 could not be found. Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32'} Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 could not be found. Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 could not be found. Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:39:08.132429 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:08.136451 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:08.136451 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:39:08.136451 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:39:08.136451 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:39:08.136451 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:39:08.136451 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 could not be found. Oct 04 11:39:08.136451 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:39:08.138794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] Returning 404 to user: Instance 17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:39:08.148741 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff496e27-5071-4170-858f-af6317f527db tempest-VolumesBackupsTest-1027356419 tempest-VolumesBackupsTest-1027356419-project] 10.222.0.23 "GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32" status: 404 len: 111 microversion: 2.1 time: 0.128042 Oct 04 11:39:08.149990 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1605/5831] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:08 2022] GET /compute/v2.1/servers/17cbe5be-5a5d-4911-bfd8-b13c4b3f5b32 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:39:08.269619 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0cfd979-17c5-49ce-91a7-38de19c04ad3 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1655 microversion: 2.1 time: 0.356048 Oct 04 11:39:08.281671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4227/5832] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:07 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1655 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:08.609621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9ca534b4-2ff3-4475-b929-7a675a6be3b4 req-a6bffe5c-ceda-4a20-a2c0-d6a2ef21a47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2dd62b8-e082-4f70-83de-b00c7afecbe8", "name": "network-vif-deleted", "tag": "c12b944e-a147-429e-915e-1390c6a1af23"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:08.643367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ca534b4-2ff3-4475-b929-7a675a6be3b4 req-a6bffe5c-ceda-4a20-a2c0-d6a2ef21a47e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:08.643885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ca534b4-2ff3-4475-b929-7a675a6be3b4 req-a6bffe5c-ceda-4a20-a2c0-d6a2ef21a47e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:08.644332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ca534b4-2ff3-4475-b929-7a675a6be3b4 req-a6bffe5c-ceda-4a20-a2c0-d6a2ef21a47e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:08.691503 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9ca534b4-2ff3-4475-b929-7a675a6be3b4 req-a6bffe5c-ceda-4a20-a2c0-d6a2ef21a47e service nova] Creating event network-vif-deleted:c12b944e-a147-429e-915e-1390c6a1af23 for instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 on n-h1-791135-8 Oct 04 11:39:08.701921 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9ca534b4-2ff3-4475-b929-7a675a6be3b4 req-a6bffe5c-ceda-4a20-a2c0-d6a2ef21a47e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097936 Oct 04 11:39:08.703120 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1606/5833] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:39:09.023369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f2476464-be48-4e85-8080-dbcb5bba5ce0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Action: 'create', calling method: .version_select at 0x7f71d40938b0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1943857862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxgN+lMg3lgw2B/IbE4yEYEgp9nS3XLRmrV578MVm7337ekRXxXwg8S3E2TQuOwY5QtcxuKhQc/d5IiLHjswdHnqSSe8t7bkdl68xvp6GMgL5JBZKzbwtaWRjrw3IEuDg=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:09.043212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f2476464-be48-4e85-8080-dbcb5bba5ce0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Getting quotas for project 91b285e498224baf9c3f880a9dafd398. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:39:09.055766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-f2476464-be48-4e85-8080-dbcb5bba5ce0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Getting quotas for user 9383bcc86b444c5cbb3b1a0bec36cd2e and project 91b285e498224baf9c3f880a9dafd398. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:39:09.097259 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f2476464-be48-4e85-8080-dbcb5bba5ce0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.078357 Oct 04 11:39:09.109598 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4228/5834] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:39:09 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:39:09.298497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:09.299402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:09.321816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:09.323911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:09.324475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:09.327587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:09.329154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:09.333909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:09.458213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:09.458213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:09.458577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:09.459031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lazy-loading 'fault' on Instance uuid c2dd62b8-e082-4f70-83de-b00c7afecbe8 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:39:09.556017 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62af5ab9-0e84-4139-a364-850e195cd123 tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 200 len: 1454 microversion: 2.1 time: 0.265138 Oct 04 11:39:09.557213 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1607/5835] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:09 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 1454 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:10.588880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:10.590116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] [instance: c2dd62b8-e082-4f70-83de-b00c7afecbe8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:10.601261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:10.605870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:10.608053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:10.609668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:10.610161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:10.612976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:10.636876 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] HTTP exception thrown: Instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 could not be found. Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Request method failure captured: Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 HTTP/1.1 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBsyDyDHKSk3InFJwN7DswRBB6_yqNkpfaQUlq73M2ikpD1XG-gVn59eQUV-LDyXLFOCxWGxEG4InLu61DrOQpcD2ZU-Ep1XVs6PwLk2gU1NgjEEfO2Sg8U1xvbXtDJ0Mf1BrAxKQQ5Ew8-ZyNsofSB0670M2AQgbu5gsukvkt5tdy0 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: ccc30e08ca9f493097687abb1c2dd2d5 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestServerMultinode-712667838 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccc30e08ca9f493097687abb1c2dd2d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccc30e08ca9f493097687abb1c2dd2d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccc30e08ca9f493097687abb1c2dd2d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccc30e08ca9f493097687abb1c2dd2d5"}]}] Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestServerMultinode-712667838 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: ccc30e08ca9f493097687abb1c2dd2d5 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestServerMultinode-712667838 Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestServerMultinode-712667838-project-admin Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 164c432c9c30424f852691ce6a62403a Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestServerMultinode-712667838-project-admin Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 could not be found. Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'c2dd62b8-e082-4f70-83de-b00c7afecbe8'} Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 could not be found. Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 could not be found. Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:39:10.638967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 could not be found. Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] Returning 404 to user: Instance c2dd62b8-e082-4f70-83de-b00c7afecbe8 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:39:10.643000 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6810cb51-6101-4dfd-aec9-a424d0a3757a tempest-TestServerMultinode-712667838 tempest-TestServerMultinode-712667838-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8" status: 404 len: 111 microversion: 2.1 time: 0.061498 Oct 04 11:39:10.657124 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4229/5836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:10 2022] GET /compute/v2.1/servers/c2dd62b8-e082-4f70-83de-b00c7afecbe8 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:39:11.454375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1854236027", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "1f46c862-4bff-409e-862c-e2da47cb1b29"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:11.591661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] validate_networks() for [('1f46c862-4bff-409e-862c-e2da47cb1b29', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:39:12.214194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1258315650", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7b1267e9-849a-4c1c-b1cd-648707e26fdb", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1943857862", "security_groups": [{"name": "tempest-secgroup-smoke-2029499742"}], "networks": [{"uuid": "984d20a9-ef45-4582-a4e6-644f4e5398e8"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:12.335457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:39:12.336086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:39:12.336751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:39:12.337329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:39:12.337927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:39:12.354148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:12.354814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:12.355582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:12.356942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:12.357584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:12.358173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:12.415748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Getting quotas for project 1c1bece42945476c809344885ea4b21d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:39:12.428921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Getting quotas for user 04c2d820f8984cc39dd8ac570d697ebd and project 1c1bece42945476c809344885ea4b21d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:39:12.458025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:39:12.462524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:39:12.483962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] validate_networks() for [('984d20a9-ef45-4582-a4e6-644f4e5398e8', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:39:12.562734 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-86ee4d71-7ff8-4aeb-9b18-316dcf09c222 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112940 Oct 04 11:39:12.563800 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1608/5837] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:39:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:39:12.585109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-784062c8-d229-454c-8eee-6e4dc27d9301 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:12.586389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-784062c8-d229-454c-8eee-6e4dc27d9301 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:12.705050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-784062c8-d229-454c-8eee-6e4dc27d9301 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:12.712450 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-784062c8-d229-454c-8eee-6e4dc27d9301 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1219 microversion: 2.1 time: 0.140792 Oct 04 11:39:12.718276 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1609/5838] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:12 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:13.739786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:13.740790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:13.765168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:13.766727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:13.768498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:13.770551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:13.771272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:13.774261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:14.283738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:39:14.285002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:39:14.287715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:39:14.288399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:39:14.289033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:39:14.312473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:14.319555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:14.320482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:14.336438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:14.339678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:14.340185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:14.428653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Getting quotas for project 91b285e498224baf9c3f880a9dafd398. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:39:14.448733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Getting quotas for user 9383bcc86b444c5cbb3b1a0bec36cd2e and project 91b285e498224baf9c3f880a9dafd398. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:39:14.660316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:39:14.663966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b1267e9-849a-4c1c-b1cd-648707e26fdb',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:39:14.978730 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-de939722-d50a-458c-a2e2-62144ce4e4e0 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.768790 Oct 04 11:39:14.988057 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4230/5839] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:39:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 2782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:39:14.994358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:15.010962 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13c5018d-cdc8-4ef9-b4fc-625646b33aa5 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1271 microversion: 2.1 time: 1.275099 Oct 04 11:39:15.018164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c4f11e76-e246-48d7-bf68-daa741863e37 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:15.029448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c4f11e76-e246-48d7-bf68-daa741863e37 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:15.029608 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1610/5840] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:13 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1271 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:15.134443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c4f11e76-e246-48d7-bf68-daa741863e37 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:15.141562 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c4f11e76-e246-48d7-bf68-daa741863e37 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1099 microversion: 2.1 time: 0.142786 Oct 04 11:39:15.157755 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4231/5841] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:14 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1099 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:16.045248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:16.050752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:16.078338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:16.078861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:16.079362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:16.080227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:16.087184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:16.091851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:16.170568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:16.176783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:16.193681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:16.194630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:16.195925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:16.198548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:16.199554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:16.204109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:16.391601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:16.425569 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e78e3efd-ae11-42ec-80ef-db314f0a6afa tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1277 microversion: 2.1 time: 0.384261 Oct 04 11:39:16.430784 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1611/5842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:16 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1277 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:16.479013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:16.496917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bd720286-ef3a-4cb1-a5b9-ff23f56a7526 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1141 microversion: 2.1 time: 0.333308 Oct 04 11:39:16.500336 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4232/5843] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:16 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1141 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:17.459226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:17.459847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:17.483075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:17.483616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:17.484071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:17.487996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:17.488547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:17.489525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:17.524275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:17.525484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:17.553990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:17.554907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:17.557111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:17.558072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:17.559232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:17.560953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:17.737886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:17.757841 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-337f1e88-7448-48b9-89ba-4cb9c62f33ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1215 microversion: 2.1 time: 0.237537 Oct 04 11:39:17.758981 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4233/5844] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:17 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:18.632170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:18.641146 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1dd5981-7623-40d0-aa12-28e052714240 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1319 microversion: 2.1 time: 1.185837 Oct 04 11:39:18.646164 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1612/5845] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:17 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1319 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:18.780236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:18.782307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:18.797140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:18.801820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:18.802485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:18.803410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:18.806393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:18.807916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:19.528864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:19.549697 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ce6a818-140b-4bdd-acf2-2f1f7240445f tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1283 microversion: 2.1 time: 0.772424 Oct 04 11:39:19.562431 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4234/5846] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:18 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1283 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:19.665175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:19.666668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:19.691780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:19.696050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:19.698214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:19.702132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:19.705306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:19.709595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:19.732850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d1b492b9-102d-4d4a-9dcd-9eda34ad8f7d req-7db5b446-bd6a-4bbd-889f-ccee61863076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc64764-2d17-427e-8738-f2dca731aad8", "tag": "e6aa2591-6454-4533-a4b5-9905438723aa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:19.784779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1b492b9-102d-4d4a-9dcd-9eda34ad8f7d req-7db5b446-bd6a-4bbd-889f-ccee61863076 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:19.794937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1b492b9-102d-4d4a-9dcd-9eda34ad8f7d req-7db5b446-bd6a-4bbd-889f-ccee61863076 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:19.798016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d1b492b9-102d-4d4a-9dcd-9eda34ad8f7d req-7db5b446-bd6a-4bbd-889f-ccee61863076 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:19.856797 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d1b492b9-102d-4d4a-9dcd-9eda34ad8f7d req-7db5b446-bd6a-4bbd-889f-ccee61863076 service nova] Creating event network-changed:e6aa2591-6454-4533-a4b5-9905438723aa for instance 7cc64764-2d17-427e-8738-f2dca731aad8 on n-h1-791135-8 Oct 04 11:39:19.884794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d1b492b9-102d-4d4a-9dcd-9eda34ad8f7d req-7db5b446-bd6a-4bbd-889f-ccee61863076 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153786 Oct 04 11:39:19.889546 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4235/5847] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:39:20.427170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8d6a2667-6052-436f-9455-1e7bc7a61757 req-ab41c37a-5a82-41ee-88a5-f13564d70eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617", "tag": "e32bbce7-9144-4da4-978c-50e99d46f4dc"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:20.478025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d6a2667-6052-436f-9455-1e7bc7a61757 req-ab41c37a-5a82-41ee-88a5-f13564d70eeb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:20.486356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d6a2667-6052-436f-9455-1e7bc7a61757 req-ab41c37a-5a82-41ee-88a5-f13564d70eeb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:20.486821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d6a2667-6052-436f-9455-1e7bc7a61757 req-ab41c37a-5a82-41ee-88a5-f13564d70eeb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:20.519568 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8d6a2667-6052-436f-9455-1e7bc7a61757 req-ab41c37a-5a82-41ee-88a5-f13564d70eeb service nova] Creating event network-changed:e32bbce7-9144-4da4-978c-50e99d46f4dc for instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 on n-h2-791135-8 Oct 04 11:39:20.531819 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8d6a2667-6052-436f-9455-1e7bc7a61757 req-ab41c37a-5a82-41ee-88a5-f13564d70eeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107036 Oct 04 11:39:20.535983 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4236/5848] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:39:20.544661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:20.561161 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5f83d4fd-69b4-4128-b750-b387f65e8154 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1319 microversion: 2.1 time: 0.900602 Oct 04 11:39:20.564158 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1613/5849] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:19 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1319 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:20.575918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:20.576635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:20.591716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:20.592235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:20.592679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:20.593455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:20.606221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:20.615841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:21.089490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:21.098384 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b2777aa-6b19-4aba-b2c4-034203ef64f3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1283 microversion: 2.1 time: 0.526128 Oct 04 11:39:21.098988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4237/5850] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:20 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1283 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:21.609042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:21.610418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:21.630404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:21.632076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:21.633229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:21.636362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:21.637006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:21.638019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:22.067896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:22.094841 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e79bdba-9894-43ba-a187-3cb9a2a2a3d6 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1319 microversion: 2.1 time: 0.507885 Oct 04 11:39:22.096555 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1614/5851] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:21 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:22.130418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:22.131171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:22.157556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:22.158086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:22.158513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:22.159243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:22.159708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:22.160228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:22.514079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:22.528661 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fccfc1b9-ba5d-45b0-a064-103cef8c53b2 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1283 microversion: 2.1 time: 0.409551 Oct 04 11:39:22.533584 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4238/5852] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:22 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1283 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:23.121866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:23.124607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:23.128553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:23.135983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:23.145122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:23.146672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:23.147499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:23.149190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:23.149849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:23.150464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:23.181335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:23.194658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-155493421", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "570b1b4d-5a61-4d1d-8ec9-8c9de896a864", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "abb967bf-38d8-4c74-bd84-4e529507054d"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:23.340204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] validate_networks() for [('abb967bf-38d8-4c74-bd84-4e529507054d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:39:23.552935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:23.574830 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a808561f-9e02-4fb0-8d83-8f2e2605734d tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1319 microversion: 2.1 time: 0.459107 Oct 04 11:39:23.576448 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1615/5853] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:23 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:23.595065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:23.596074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:23.642229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:23.643247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:23.644280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:23.658813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:23.660711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:23.662247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:23.960665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:39:23.961101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:39:23.961633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:39:23.962054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:39:23.962998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:39:23.982311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:23.984051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:23.986271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:23.988947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:23.990352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:23.991693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:24.043298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:39:24.052673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:39:24.092910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:39:24.102599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='570b1b4d-5a61-4d1d-8ec9-8c9de896a864',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:39:24.126917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:24.139642 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe58abc7-3d7c-4f45-911c-76be559b89b3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1283 microversion: 2.1 time: 0.561680 Oct 04 11:39:24.140247 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1616/5854] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:23 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1283 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:24.604755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:24.606366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:24.618917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:24.620626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:24.621666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:24.623400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:24.625120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:24.626242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:24.894716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:24.911155 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c839ee1-55e7-4b16-9572-3d72e7019bd7 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1319 microversion: 2.1 time: 0.311734 Oct 04 11:39:24.912294 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1617/5855] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:24 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:25.077680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37322082-7940-42b5-bdd6-7c85fe96e926 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.888797 Oct 04 11:39:25.083841 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4239/5856] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:39:25.096834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-739ff6fb-aaff-4169-928f-86bdd257d68f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:25.098365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-739ff6fb-aaff-4169-928f-86bdd257d68f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:25.167396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:25.168897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:25.183448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:25.184397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:25.185074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:25.186044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:25.186720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:25.187367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:25.278343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-739ff6fb-aaff-4169-928f-86bdd257d68f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:25.306833 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-739ff6fb-aaff-4169-928f-86bdd257d68f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1056 microversion: 2.1 time: 0.214667 Oct 04 11:39:25.314630 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1618/5857] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:25 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1056 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:25.673234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:25.685966 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-280391ae-41b3-46ec-af37-565eb5d3428d tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1283 microversion: 2.1 time: 0.524004 Oct 04 11:39:25.687538 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4240/5858] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:25 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1283 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:25.909577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a1243aed-7598-46f5-83dd-32805b040393 req-848f0b24-5e2c-4958-926b-2ef13b8230f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc64764-2d17-427e-8738-f2dca731aad8", "name": "network-vif-plugged", "status": "completed", "tag": "e6aa2591-6454-4533-a4b5-9905438723aa"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:25.929538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a1243aed-7598-46f5-83dd-32805b040393 req-848f0b24-5e2c-4958-926b-2ef13b8230f9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:25.933178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a1243aed-7598-46f5-83dd-32805b040393 req-848f0b24-5e2c-4958-926b-2ef13b8230f9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:25.934342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a1243aed-7598-46f5-83dd-32805b040393 req-848f0b24-5e2c-4958-926b-2ef13b8230f9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:25.938402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:25.939474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:25.949072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:25.952819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:25.953531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:25.959478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:25.961092 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a1243aed-7598-46f5-83dd-32805b040393 req-848f0b24-5e2c-4958-926b-2ef13b8230f9 service nova] Creating event network-vif-plugged:e6aa2591-6454-4533-a4b5-9905438723aa for instance 7cc64764-2d17-427e-8738-f2dca731aad8 on n-h1-791135-8 Oct 04 11:39:25.961869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:25.962325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:25.971322 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a1243aed-7598-46f5-83dd-32805b040393 req-848f0b24-5e2c-4958-926b-2ef13b8230f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065696 Oct 04 11:39:25.972502 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1619/5859] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:39:26.339792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:26.341794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:26.362847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:26.363932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:26.364369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:26.365073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:26.365551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:26.366173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:26.517047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:26.524865 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8cc9c8c6-4fce-486c-8d7b-7dbf36e7cae4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1052 microversion: 2.1 time: 0.199106 Oct 04 11:39:26.525512 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1620/5860] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:26 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1052 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:26.714622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:26.715766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:26.728759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:26.738318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:26.739028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:26.741253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:26.744280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:26.751314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:26.754090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:26.757696 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c2ecee1f-1d5d-4637-ad6b-08ba8a970742 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1319 microversion: 2.1 time: 0.819819 Oct 04 11:39:26.760715 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4241/5861] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:25 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1319 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:27.035459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:27.044254 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6444bdde-3cea-4b29-be53-a962b3cfff8b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1283 microversion: 2.1 time: 0.333931 Oct 04 11:39:27.044838 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1621/5862] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:26 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1283 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:27.560827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:27.562037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:27.580762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:27.581491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:27.582047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:27.582848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:27.583376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:27.584037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:27.728915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:27.739597 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d44c0979-d828-4ee6-9486-bcb0b48d63ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1116 microversion: 2.1 time: 0.193774 Oct 04 11:39:27.743837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4242/5863] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:27 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1116 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:27.788173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:27.788862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:27.805262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:27.807690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:27.809732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:27.810622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:27.812218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:27.812864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:28.073224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:28.073854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:28.084172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:28.085091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:28.085728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:28.086626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:28.087247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:28.088581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:28.119477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:28.467483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:28.480336 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b5212f2-0d2a-4c72-bf81-e75a9addf8ef tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1508 microversion: 2.1 time: 0.694886 Oct 04 11:39:28.481306 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1622/5864] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:27 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1508 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:28.514618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a69c151-6a41-4124-85a7-5cce13d26ffa", "device": "/dev/sdb"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:28.541222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:28.585505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:28.585996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:28.586429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:28.587128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:28.587600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:28.594091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:28.668506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:28.696802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-13767448-3f33-468e-bd02-d9dc8a57708e tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.624970 Oct 04 11:39:28.699878 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4243/5865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:28 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:28.766336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:28.767249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:28.799342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:28.800426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:28.801172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:28.805237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:28.807069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:28.810563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:29.013936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:29.016535 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d29e6ff0-04a9-4b50-ba96-10a2611b8815 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "POST /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508132 Oct 04 11:39:29.018758 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1623/5866] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 11:39:28 2022] POST /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:39:29.066631 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f67a097d-0c57-4489-87ae-c2502171c1f0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1126 microversion: 2.1 time: 0.304162 Oct 04 11:39:29.071773 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4244/5867] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:28 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1126 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:29.729815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:29.734557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:29.749704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:29.751657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:29.752264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:29.753222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:29.753988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:29.755530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:30.097594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:30.098254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:30.110896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:30.115010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:30.115505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:30.125224 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-baf25f9c-109d-439a-b626-5342386bbfc3 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.401682 Oct 04 11:39:30.126868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:30.133740 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1624/5868] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:29 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:30.133943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:30.134837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:30.135464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:30.899917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:30.916432 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d18cee5-cc32-4e42-b4fc-ac6511cf5af3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.822679 Oct 04 11:39:30.930303 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4245/5869] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:30 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:31.152003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:31.152838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:31.165326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:31.166251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:31.166990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:31.178071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:31.181270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:31.182301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:31.202623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-61073f98-3895-48e3-b278-54878caa5835 req-14f3222b-e8f2-4eb9-bd84-6d02923bf23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4118493b-8dc7-4a16-a834-5f4c69fb9686", "tag": "0f848783-f396-4778-afc4-77a8cb5bcde6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:31.239163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-61073f98-3895-48e3-b278-54878caa5835 req-14f3222b-e8f2-4eb9-bd84-6d02923bf23e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:31.244789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-61073f98-3895-48e3-b278-54878caa5835 req-14f3222b-e8f2-4eb9-bd84-6d02923bf23e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:31.246107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-61073f98-3895-48e3-b278-54878caa5835 req-14f3222b-e8f2-4eb9-bd84-6d02923bf23e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:31.291714 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-61073f98-3895-48e3-b278-54878caa5835 req-14f3222b-e8f2-4eb9-bd84-6d02923bf23e service nova] Creating event network-changed:0f848783-f396-4778-afc4-77a8cb5bcde6 for instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 on n-h1-791135-8 Oct 04 11:39:31.303891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-61073f98-3895-48e3-b278-54878caa5835 req-14f3222b-e8f2-4eb9-bd84-6d02923bf23e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106283 Oct 04 11:39:31.315458 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4246/5870] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:39:31.778141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:31.790962 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8d00aef-6c83-41e2-a91c-74d5b5c6bbe8 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.642884 Oct 04 11:39:31.791916 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1625/5871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:31 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:31.944320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:31.945123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:31.964864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:31.966990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:31.967750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:31.973471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:31.974325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:31.989763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:32.289768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:32.302641 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa9f54ad-dc39-4e0b-9773-676ee2b37649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.362406 Oct 04 11:39:32.309138 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4247/5872] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:31 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:32.817460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:32.818460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:32.832710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:32.834664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:32.836612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:32.838808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:32.840243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:32.842054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:33.279847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:33.295075 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3a30956-ef0c-4951-aed8-3aef89483960 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.478280 Oct 04 11:39:33.311154 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1626/5873] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:32 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:33.339740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:33.340898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:33.349419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:33.350389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:33.351013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:33.351891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:33.352921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:33.353558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:33.634995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:33.647324 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64ae5cad-9bef-416f-9f2d-9af9c2066590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.311215 Oct 04 11:39:33.648479 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4248/5874] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:33 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:34.323418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:34.324059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:34.326072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.337677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:34.338625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:34.339044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:34.340004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:34.340682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:34.341330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:34.556711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:34.570173 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e956d7c6-90d9-4fd7-a0c4-6f88d132aa5a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.249453 Oct 04 11:39:34.570987 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1627/5875] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:34 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:39:34.669993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:34.670607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:34.673034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.673907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=18 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:34.681120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:34.681978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:34.682709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:34.683673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:34.684355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:34.685120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:35.021008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:35.034420 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a624897d-fa67-4e55-8b97-2438876bc157 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.368280 Oct 04 11:39:35.046963 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4249/5876] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:34 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:35.589050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:35.594811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:35.596010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:35.609265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:35.610113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:35.611376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:35.612329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:35.613080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:35.613781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:35.862405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:35.876384 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c08a8f6-4a04-4cae-8458-ee73e86bf3ce tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.287611 Oct 04 11:39:35.903588 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1628/5877] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:35 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:36.072072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:36.073404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:36.077474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:36.101739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:36.103024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:36.104328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:36.105674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:36.106684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:36.108001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:36.445005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:36.461415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a85b803e-4862-424b-a938-5e4f799cd2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.397642 Oct 04 11:39:36.474684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4250/5878] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:36 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:36.917251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:36.918562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:36.946500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:36.948416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:36.949396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:36.958128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:36.960842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:36.963471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:37.232555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:37.244949 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-014a1902-0589-454a-8e2c-80ad36b9be94 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.331911 Oct 04 11:39:37.246108 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1629/5879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:36 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:37.497701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:37.498913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:37.512908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:37.516229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:37.517835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:37.518606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:37.521291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:37.521846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:37.923833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:37.945132 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-939d803d-fe68-4687-8208-fb410c12f200 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.452376 Oct 04 11:39:37.970042 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4251/5880] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:37 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:38.287707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:38.288897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:38.315005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:38.315711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:38.316154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:38.317123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:38.317622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:38.318045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:38.598156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:38.610420 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8344c636-ba88-4b87-93ec-30525ca52394 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.333129 Oct 04 11:39:38.611331 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1630/5881] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:38 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:38.942429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3ee7af8a-0572-44c3-b14e-ea0c445c88c4 req-370b104b-f3d2-493a-81f8-7b141017b059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617", "name": "network-vif-plugged", "status": "completed", "tag": "e32bbce7-9144-4da4-978c-50e99d46f4dc"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:38.987267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:38.991737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:39.004658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3ee7af8a-0572-44c3-b14e-ea0c445c88c4 req-370b104b-f3d2-493a-81f8-7b141017b059 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:39.005484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3ee7af8a-0572-44c3-b14e-ea0c445c88c4 req-370b104b-f3d2-493a-81f8-7b141017b059 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:39.008393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3ee7af8a-0572-44c3-b14e-ea0c445c88c4 req-370b104b-f3d2-493a-81f8-7b141017b059 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:39.012801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:39.018063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:39.019560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:39.024035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:39.025715 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3ee7af8a-0572-44c3-b14e-ea0c445c88c4 req-370b104b-f3d2-493a-81f8-7b141017b059 service nova] Creating event network-vif-plugged:e32bbce7-9144-4da4-978c-50e99d46f4dc for instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 on n-h2-791135-8 Oct 04 11:39:39.026208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:39.026653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:39.038755 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3ee7af8a-0572-44c3-b14e-ea0c445c88c4 req-370b104b-f3d2-493a-81f8-7b141017b059 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098728 Oct 04 11:39:39.043850 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4252/5882] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:39:39.218750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:39.235251 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1fff8847-6e9a-488b-a687-c07dc97f0879 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.256069 Oct 04 11:39:39.251813 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1631/5883] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:38 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:39.656882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:39.657625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:39.663920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:39.664648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:39.665091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:39.665825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:39.666453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:39.666894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:39.852654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:39.861298 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3b28513c-c7a7-4d02-b3f7-1b24a71abc38 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1271 microversion: 2.1 time: 0.208527 Oct 04 11:39:39.877738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4253/5884] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:39 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:40.264570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:40.265926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:40.275007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:40.275739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:40.276176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:40.277162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:40.277837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:40.279542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:40.321857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:40.584800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:40.594950 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12811816-4c8f-477b-9a3f-a721a47d92fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.335381 Oct 04 11:39:40.596577 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1632/5885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:40 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:40.887582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:40.888237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:40.902234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:40.902786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:40.903589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:40.904749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:40.908219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:40.908691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:41.250170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:41.273447 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4adc4059-dfac-4b19-b875-8b0dd8090162 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1460 microversion: 2.1 time: 0.392008 Oct 04 11:39:41.274739 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4254/5886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:40 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1460 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:41.298261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:41.298875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:41.307144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:41.307882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:41.308520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:41.309436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:41.310062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:41.310646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:41.620989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:41.622004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:41.631180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:41.632110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:41.632799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:41.633789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:41.634495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:41.635149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:41.700035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:41.725548 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-771cfa34-324c-4d0a-98ae-63c4718ea237 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1460 microversion: 2.1 time: 0.431098 Oct 04 11:39:41.727032 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1633/5887] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:41 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1460 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:41.845337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:41.855982 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2193ef01-f054-4bf0-965d-a5cc50993e4e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.240012 Oct 04 11:39:41.857412 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4255/5888] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:41 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:42.882469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:42.884885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:42.899469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:42.900220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:42.901734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:42.904417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:42.905960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:42.906450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:43.250424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:43.264498 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-692a81b4-975a-4d74-a34a-d2e20489d721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.389465 Oct 04 11:39:43.266421 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1634/5889] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:42 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:44.288161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:44.289318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:44.303765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:44.304514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:44.305098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:44.306027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:44.319707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:44.321388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:44.560344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:44.571133 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-407d4990-37df-42fe-9905-fef1406542e7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.287278 Oct 04 11:39:44.572096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4256/5890] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:44 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:44.893238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-21452c90-a9e8-423e-8a17-f13f4fcc168d req-9ac752ed-26f8-436b-9fae-ce1a4d77e6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617", "tag": "e32bbce7-9144-4da4-978c-50e99d46f4dc"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:44.912495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21452c90-a9e8-423e-8a17-f13f4fcc168d req-9ac752ed-26f8-436b-9fae-ce1a4d77e6db service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:44.914081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21452c90-a9e8-423e-8a17-f13f4fcc168d req-9ac752ed-26f8-436b-9fae-ce1a4d77e6db service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:44.916235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-21452c90-a9e8-423e-8a17-f13f4fcc168d req-9ac752ed-26f8-436b-9fae-ce1a4d77e6db service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:44.945162 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-21452c90-a9e8-423e-8a17-f13f4fcc168d req-9ac752ed-26f8-436b-9fae-ce1a4d77e6db service nova] Creating event network-changed:e32bbce7-9144-4da4-978c-50e99d46f4dc for instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 on n-h2-791135-8 Oct 04 11:39:44.961365 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-21452c90-a9e8-423e-8a17-f13f4fcc168d req-9ac752ed-26f8-436b-9fae-ce1a4d77e6db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073865 Oct 04 11:39:44.967665 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1635/5891] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:39:45.600079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:45.601463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:45.617893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:45.623846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:45.624715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:45.626025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:45.626741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:45.627625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:46.267865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:46.277050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32451f96-d598-4b95-a53a-19f7ba285b13 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.681041 Oct 04 11:39:46.284986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4257/5892] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:45 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:47.309053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:47.309686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:47.325304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:47.325822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:47.326261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:47.326971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:47.327425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:47.327852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:47.511118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:47.520327 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0067f3a7-c04d-44ab-90b4-a000e124afa6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.216868 Oct 04 11:39:47.521468 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1636/5893] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:47 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:47.706874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c3c17fce-4eca-47d1-a635-d6e6511be4e7 req-31059c54-a356-4f29-9a23-8561d550e016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617", "tag": "e32bbce7-9144-4da4-978c-50e99d46f4dc"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:47.726208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c3c17fce-4eca-47d1-a635-d6e6511be4e7 req-31059c54-a356-4f29-9a23-8561d550e016 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:47.727499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c3c17fce-4eca-47d1-a635-d6e6511be4e7 req-31059c54-a356-4f29-9a23-8561d550e016 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:47.729829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c3c17fce-4eca-47d1-a635-d6e6511be4e7 req-31059c54-a356-4f29-9a23-8561d550e016 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:47.744679 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c3c17fce-4eca-47d1-a635-d6e6511be4e7 req-31059c54-a356-4f29-9a23-8561d550e016 service nova] Creating event network-changed:e32bbce7-9144-4da4-978c-50e99d46f4dc for instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 on n-h2-791135-8 Oct 04 11:39:47.760767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c3c17fce-4eca-47d1-a635-d6e6511be4e7 req-31059c54-a356-4f29-9a23-8561d550e016 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058475 Oct 04 11:39:47.761600 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4258/5894] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:39:48.547675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:48.548893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:48.566624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:48.567351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:48.568395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:48.570641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:48.575424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:48.576161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:48.946811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:48.957029 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56ee8811-5e6a-48b8-9a83-0c8fcd2d084f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.413957 Oct 04 11:39:48.959446 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1637/5895] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:48 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:49.784078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b12ee109-d779-4ac2-9a6f-f69e5600c747 req-e543a666-bde6-428f-b9b8-13b73921dc5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617", "tag": "e32bbce7-9144-4da4-978c-50e99d46f4dc"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:39:49.797738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b12ee109-d779-4ac2-9a6f-f69e5600c747 req-e543a666-bde6-428f-b9b8-13b73921dc5c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:49.798761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b12ee109-d779-4ac2-9a6f-f69e5600c747 req-e543a666-bde6-428f-b9b8-13b73921dc5c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:49.799465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b12ee109-d779-4ac2-9a6f-f69e5600c747 req-e543a666-bde6-428f-b9b8-13b73921dc5c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:49.819806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b12ee109-d779-4ac2-9a6f-f69e5600c747 req-e543a666-bde6-428f-b9b8-13b73921dc5c service nova] Creating event network-changed:e32bbce7-9144-4da4-978c-50e99d46f4dc for instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 on n-h2-791135-8 Oct 04 11:39:49.826397 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b12ee109-d779-4ac2-9a6f-f69e5600c747 req-e543a666-bde6-428f-b9b8-13b73921dc5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048104 Oct 04 11:39:49.827442 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4259/5896] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:39:49.984637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:49.985270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:50.000119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:50.004709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:50.005552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:50.006463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:50.009751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:50.011084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:50.219137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:50.233208 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82a3d622-4cd3-4255-ab5f-8ea4880a45f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.252777 Oct 04 11:39:50.234724 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1638/5897] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:49 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:51.259391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:51.260887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:51.272034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:51.272795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:51.273440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:51.274696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:51.275674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:51.277204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:51.492412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:51.504009 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-167237ba-1d39-4659-953e-2d4aec5077b1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.249103 Oct 04 11:39:51.505446 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4260/5898] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:51 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:52.531170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:52.531797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:52.538927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:52.539636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:52.540314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:52.541024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:52.541510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:52.541952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:52.709837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:52.718523 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a7ddaf8-d010-45db-a990-70b05e0d5bdb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.191163 Oct 04 11:39:52.719713 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1639/5899] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:52 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:53.745384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:53.746256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:53.755786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:53.756336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:53.756996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:53.757978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:53.758466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:53.759103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:53.946851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:53.983125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73a9fc81-c41b-4065-abdb-455a7fd21250 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1168 microversion: 2.1 time: 0.241495 Oct 04 11:39:53.995788 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4261/5900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:53 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1168 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:55.018482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:55.019152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:55.035607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:55.040077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:55.040870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:55.042098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:55.043806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:55.044636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:55.216509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:55.225050 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43a7ff07-464b-4db6-b7b7-9d8f63597713 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1214 microversion: 2.1 time: 0.210888 Oct 04 11:39:55.227685 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1640/5901] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:55 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:56.253556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:56.254792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:56.268813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:56.269622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:56.270209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:56.271182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:56.271646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:56.272073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:56.291354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:39:56.464519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:56.473301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5de3e650-b473-4eba-ad0e-61c5a2c8c1e8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.227726 Oct 04 11:39:56.473971 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4262/5902] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:56 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:56.955912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:56.956471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:56.963499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:56.964077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:56.964522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:56.965232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:56.965712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:56.966139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:57.052263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lazy-loading 'services' on Instance uuid 7cc64764-2d17-427e-8738-f2dca731aad8 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:39:57.126777 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-67578e4b-ef63-4a8c-b5c6-210ea4e01808 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8/os-volume_attachments/7a69c151-6a41-4124-85a7-5cce13d26ffa" status: 202 len: 0 microversion: 2.1 time: 0.174552 Oct 04 11:39:57.127413 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1641/5903] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 11:39:56 2022] DELETE /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8/os-volume_attachments/7a69c151-6a41-4124-85a7-5cce13d26ffa => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:39:57.496760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:57.497502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:57.505135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:57.505663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:57.506148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:57.506885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:57.507351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:57.507788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:57.672092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:57.680870 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9045010-680d-4f9c-a0e0-19cdaf8c5335 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.188113 Oct 04 11:39:57.693517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4263/5904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:57 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:58.710797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:58.712211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:58.722571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:58.723344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:58.724013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:58.724955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:58.726114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:58.727375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:58.926040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:39:58.939220 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8659408-1868-4a6e-a9e0-b58d9ba19701 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.235279 Oct 04 11:39:58.940594 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1642/5905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:58 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:39:59.963324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:39:59.963920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:39:59.971127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:59.978294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:59.978294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:39:59.978294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:39:59.978294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:39:59.978294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:00.168892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:00.181285 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e7dbb53b-9100-4f42-8b55-fa0ab2f51cb6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.222207 Oct 04 11:40:00.182184 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4264/5906] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:39:59 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:01.207679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:01.208479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:01.215437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:01.216409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:01.217079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:01.229186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:01.231117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:01.231815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:01.494214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:01.503534 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46574e05-2455-46eb-ac5c-e7c119758b17 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.300994 Oct 04 11:40:01.504881 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1643/5907] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:01 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:02.528022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:02.528693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:02.536104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:02.536608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:02.537042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:02.537772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:02.538228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:02.538652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:02.684586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:02.693953 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b8aef58-ccc3-46d8-ad6a-d64d053cb25a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.168738 Oct 04 11:40:02.694998 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4265/5908] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:02 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:02.869599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:02.870987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:02.882032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:02.883025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:02.883475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:02.884190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:02.884825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:02.885453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:02.927669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:40:03.064626 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bfc17d5d-3cb2-4a60-93be-bc3982464474 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 204 len: 0 microversion: 2.1 time: 0.198950 Oct 04 11:40:03.065752 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1644/5909] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:40:02 2022] DELETE /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:03.078081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:03.079917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:03.090399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:03.091345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:03.092042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:03.092887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:03.093608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:03.094222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:03.285629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:03.299535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-855b6a2c-5cd0-4d61-b8aa-5ad16f0b0e70 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1514 microversion: 2.1 time: 0.227097 Oct 04 11:40:03.315356 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4266/5910] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:03 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:03.719949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:03.722389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:03.738516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:03.739283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:03.739928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:03.740674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:03.741126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:03.741607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:03.893634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:03.901981 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e2d0ed48-b5db-4e25-ba42-120ad5d5e4ff tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.187439 Oct 04 11:40:03.902922 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1645/5911] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:03 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:04.328120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:04.329862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:04.349925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:04.350827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:04.351504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:04.352507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:04.353194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:04.353917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:04.570893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:04.582509 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-66d406eb-b8e6-4e5e-97b7-4728577216dd tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1514 microversion: 2.1 time: 0.261963 Oct 04 11:40:04.583886 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4267/5912] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:04 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:04.927022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:04.927751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:04.930982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:04.936712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:04.937364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:04.937908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:04.938703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:04.939256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:04.940529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:05.194039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-cd058595-b939-4777-b40e-0eb56d96b4fa req-38129b8e-449f-4a2e-bc84-f9db1bd7a37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc64764-2d17-427e-8738-f2dca731aad8", "name": "network-vif-deleted", "tag": "e6aa2591-6454-4533-a4b5-9905438723aa"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:40:05.210715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:05.212152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cd058595-b939-4777-b40e-0eb56d96b4fa req-38129b8e-449f-4a2e-bc84-f9db1bd7a37c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:05.214774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cd058595-b939-4777-b40e-0eb56d96b4fa req-38129b8e-449f-4a2e-bc84-f9db1bd7a37c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:05.215435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-cd058595-b939-4777-b40e-0eb56d96b4fa req-38129b8e-449f-4a2e-bc84-f9db1bd7a37c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:05.219084 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79fd71c4-c34e-481d-8f56-e6ee48f99228 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.297322 Oct 04 11:40:05.221559 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1646/5913] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:04 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:05.256855 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-cd058595-b939-4777-b40e-0eb56d96b4fa req-38129b8e-449f-4a2e-bc84-f9db1bd7a37c service nova] Creating event network-vif-deleted:e6aa2591-6454-4533-a4b5-9905438723aa for instance 7cc64764-2d17-427e-8738-f2dca731aad8 on n-h1-791135-8 Oct 04 11:40:05.265643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-cd058595-b939-4777-b40e-0eb56d96b4fa req-38129b8e-449f-4a2e-bc84-f9db1bd7a37c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075937 Oct 04 11:40:05.267508 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4268/5914] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:40:05.413240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-12579d6d-cf1b-48e9-bac6-ee778f96517a req-b311a551-ffd1-48d5-86c8-d58465c185e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4118493b-8dc7-4a16-a834-5f4c69fb9686", "name": "network-vif-plugged", "status": "completed", "tag": "0f848783-f396-4778-afc4-77a8cb5bcde6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:40:05.429785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12579d6d-cf1b-48e9-bac6-ee778f96517a req-b311a551-ffd1-48d5-86c8-d58465c185e4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:05.430723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12579d6d-cf1b-48e9-bac6-ee778f96517a req-b311a551-ffd1-48d5-86c8-d58465c185e4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:05.431398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-12579d6d-cf1b-48e9-bac6-ee778f96517a req-b311a551-ffd1-48d5-86c8-d58465c185e4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:05.447293 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-12579d6d-cf1b-48e9-bac6-ee778f96517a req-b311a551-ffd1-48d5-86c8-d58465c185e4 service nova] Creating event network-vif-plugged:0f848783-f396-4778-afc4-77a8cb5bcde6 for instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 on n-h1-791135-8 Oct 04 11:40:05.455010 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-12579d6d-cf1b-48e9-bac6-ee778f96517a req-b311a551-ffd1-48d5-86c8-d58465c185e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046163 Oct 04 11:40:05.456794 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1647/5915] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:40:05.614176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:05.615644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:05.625372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:05.627432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:05.628073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:05.629266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:05.629928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:05.630544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:05.676699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:05.677196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:05.677888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:05.678512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lazy-loading 'fault' on Instance uuid 7cc64764-2d17-427e-8738-f2dca731aad8 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:40:05.725259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c2d820f8984cc39dd8ac570d697ebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1bece42945476c809344885ea4b21d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:05.734326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3a0b9fc4-d78f-48ad-a2ec-8d3fb4aadd69 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 200 len: 1309 microversion: 2.1 time: 0.125442 Oct 04 11:40:05.735238 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4269/5916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:05 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:06.247403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:06.248164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:06.256041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:06.256527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:06.257032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:06.257841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:06.258318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:06.258755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:06.261438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:06.403864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:06.418042 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-888f5034-887a-4490-a2f1-9fdfecf9151e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1202 microversion: 2.1 time: 0.175464 Oct 04 11:40:06.437380 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1648/5917] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:06 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:06.759871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:06.760627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] [instance: 7cc64764-2d17-427e-8738-f2dca731aad8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:06.763615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=42 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:06.770047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:06.770938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:06.771644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:06.772609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:06.773076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:06.773702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:06.792609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] HTTP exception thrown: Instance 7cc64764-2d17-427e-8738-f2dca731aad8 could not be found. Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Request method failure captured: Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 HTTP/1.1 Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBpk2t9nvTMvkuYztXl3uAdEgE-Ah-yURC8zWyFfSmIIvbigoS746Ms4FUSATr53GE0hhGLZa7JzVBxmRIE9qzxs_9xI-cjUS8qWXKKuIhxV0tD56uH1Lpu-sJcd_v5a9Qz_ctFxVWR1XCodaPcIn8tpmtfUN1FsloEYyzfPyEPRkDk Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 1c1bece42945476c809344885ea4b21d Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1193691461 Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c1bece42945476c809344885ea4b21d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c1bece42945476c809344885ea4b21d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c1bece42945476c809344885ea4b21d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c1bece42945476c809344885ea4b21d"}]}] Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-VolumesSnapshotTestJSON-1193691461 Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 1c1bece42945476c809344885ea4b21d Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1193691461 Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-VolumesSnapshotTestJSON-1193691461-project Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 04c2d820f8984cc39dd8ac570d697ebd Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-VolumesSnapshotTestJSON-1193691461-project Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 7cc64764-2d17-427e-8738-f2dca731aad8 could not be found. Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '7cc64764-2d17-427e-8738-f2dca731aad8'} Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc64764-2d17-427e-8738-f2dca731aad8 could not be found. Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc64764-2d17-427e-8738-f2dca731aad8 could not be found. Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:06.794323 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc64764-2d17-427e-8738-f2dca731aad8 could not be found. Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] Returning 404 to user: Instance 7cc64764-2d17-427e-8738-f2dca731aad8 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:40:06.798560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8adbd716-59b1-48b5-8f9e-472a856a3422 tempest-VolumesSnapshotTestJSON-1193691461 tempest-VolumesSnapshotTestJSON-1193691461-project] 10.222.0.23 "GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8" status: 404 len: 111 microversion: 2.1 time: 0.040585 Oct 04 11:40:06.801729 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4270/5918] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:06 2022] GET /compute/v2.1/servers/7cc64764-2d17-427e-8738-f2dca731aad8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:40:07.453514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:07.454331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:07.463067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:07.463954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:07.464620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:07.465705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:07.466375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:07.467007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:07.634733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:07.647751 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5073cca9-3f35-48c0-98c9-d55688efe904 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1387 microversion: 2.1 time: 0.199476 Oct 04 11:40:07.661626 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1649/5919] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:07 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1387 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:40:07.671043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:07.672186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:07.680441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:07.681464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:07.682099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:07.683089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:07.683789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:07.684391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:07.871779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:07.882315 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d53856a2-bfd0-476b-b187-07c0363ebac2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1387 microversion: 2.1 time: 0.215000 Oct 04 11:40:07.884373 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4271/5920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:07 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1387 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:07.908174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:07.909515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:07.933322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:07.934952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:07.935489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:07.936295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:07.936973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:07.937667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:08.138735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:08.149603 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0fc39ae8-12d4-4d78-976d-dedb3a25eb0c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1387 microversion: 2.1 time: 0.246049 Oct 04 11:40:08.150769 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1650/5921] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:07 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1387 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:08.272202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:08.273206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:08.283564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:08.284465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:08.284939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:08.285841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:08.286334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:08.286841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:08.319550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:40:08.409583 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bfd508f2-d4cc-49c4-a0ed-b6d4ed3ff4da tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 204 len: 0 microversion: 2.1 time: 0.142244 Oct 04 11:40:08.410731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4272/5922] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:40:08 2022] DELETE /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:08.420266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:08.421258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:08.428882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:08.429401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:08.430154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:08.430922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:08.431489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:08.431965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:08.597122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:08.607115 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-55b31763-94e7-4ec2-91e2-e5f16580c259 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1393 microversion: 2.1 time: 0.191669 Oct 04 11:40:08.608132 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1651/5923] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:08 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1393 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:09.633549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:09.634981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:09.642355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:09.643162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:09.644015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:09.644972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:09.645675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:09.646336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:09.800836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:09.811408 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-63a9ba9b-218e-4aba-bb6f-64808b39e212 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1393 microversion: 2.1 time: 0.181938 Oct 04 11:40:09.823925 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4273/5924] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:09 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1393 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:10.836713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:10.837327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:10.853511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:10.854380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:10.855115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:10.856296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:10.857000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:10.858856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:10.892757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a0a684b8-f897-45d2-9c88-865a347a35e8 req-2ff25ceb-df3e-4d1e-867f-b9692957dfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4118493b-8dc7-4a16-a834-5f4c69fb9686", "name": "network-vif-deleted", "tag": "0f848783-f396-4778-afc4-77a8cb5bcde6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:40:10.915200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a0a684b8-f897-45d2-9c88-865a347a35e8 req-2ff25ceb-df3e-4d1e-867f-b9692957dfcc service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:10.918376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a0a684b8-f897-45d2-9c88-865a347a35e8 req-2ff25ceb-df3e-4d1e-867f-b9692957dfcc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:10.919169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a0a684b8-f897-45d2-9c88-865a347a35e8 req-2ff25ceb-df3e-4d1e-867f-b9692957dfcc service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:10.957323 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a0a684b8-f897-45d2-9c88-865a347a35e8 req-2ff25ceb-df3e-4d1e-867f-b9692957dfcc service nova] Creating event network-vif-deleted:0f848783-f396-4778-afc4-77a8cb5bcde6 for instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 on n-h1-791135-8 Oct 04 11:40:10.967288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a0a684b8-f897-45d2-9c88-865a347a35e8 req-2ff25ceb-df3e-4d1e-867f-b9692957dfcc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078218 Oct 04 11:40:10.969499 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4274/5925] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:40:11.005950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:11.018324 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-37d0cdca-5eb8-4b0a-b733-9a2cbfb85bbf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1351 microversion: 2.1 time: 0.185168 Oct 04 11:40:11.020009 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1652/5926] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:10 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1351 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:12.069784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:12.073383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:12.088285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:12.090001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:12.091106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:12.093098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:12.094384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:12.095456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:12.244610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:12.254655 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ded417b2-3d8f-4a00-b4c0-5a81c4a31220 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1187 microversion: 2.1 time: 0.194846 Oct 04 11:40:12.255448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4275/5927] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:12 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1187 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:40:13.287439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:13.288221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:13.303335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:13.304348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:13.309303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:13.310998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:13.312791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:13.313636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:13.408641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:13.418917 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d7b0674-c26f-4974-9aed-a66eb2bd78f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1187 microversion: 2.1 time: 0.134695 Oct 04 11:40:13.419663 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1653/5928] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:13 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1187 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:14.450203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:14.451520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:14.465051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:14.471281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:14.478249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:14.480396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:14.487827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:14.488539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:14.640638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:14.657008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d1a49cc-cb5a-4d5f-a16a-5b2527ec5fd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1187 microversion: 2.1 time: 0.215679 Oct 04 11:40:14.673135 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4276/5929] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:14 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1187 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:15.682001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:15.682618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:15.695104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:15.695900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:15.696337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:15.697038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:15.697524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:15.697955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:15.824277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:15.837326 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7a5627a-984a-4846-9fef-50f35b42932a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1187 microversion: 2.1 time: 0.158994 Oct 04 11:40:15.838740 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1654/5930] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:15 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1187 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:16.896743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:16.902146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:16.936969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:16.937724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:16.938497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:16.940239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:16.941083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:16.941770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:17.024533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:17.033825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-165f495b-4227-4f8e-aa82-0ceb00d08166 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 200 len: 1187 microversion: 2.1 time: 0.174240 Oct 04 11:40:17.059458 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4277/5931] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:16 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 1187 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:18.069027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:18.070823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:18.089700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:18.090557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:18.091238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:18.094209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:18.095335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:18.096745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:18.114582 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 HTTP/1.1 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '4118493b-8dc7-4a16-a834-5f4c69fb9686'} Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:18.117126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:18.122029 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:18.122029 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:18.122029 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:18.122029 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:40:18.122029 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:40:18.122029 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:18.122029 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:18.124119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:40:18.126465 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e3d2f2c7-544d-4e8f-876a-862b5ed0ac46 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 404 len: 111 microversion: 2.1 time: 0.064895 Oct 04 11:40:18.127863 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1655/5932] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:18 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:40:20.677036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:20.677658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:20.679538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-dbbe3487-992b-4cee-87c5-3a2265e71377 req-ae2aac51-d84f-4f35-b0d8-1d01b90cec9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617", "tag": "e32bbce7-9144-4da4-978c-50e99d46f4dc"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:40:20.696615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:20.697113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:20.701179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dbbe3487-992b-4cee-87c5-3a2265e71377 req-ae2aac51-d84f-4f35-b0d8-1d01b90cec9c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:20.701832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dbbe3487-992b-4cee-87c5-3a2265e71377 req-ae2aac51-d84f-4f35-b0d8-1d01b90cec9c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:20.701978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:20.702629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-dbbe3487-992b-4cee-87c5-3a2265e71377 req-ae2aac51-d84f-4f35-b0d8-1d01b90cec9c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:20.702932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:20.703482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:20.703992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:20.722971 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-dbbe3487-992b-4cee-87c5-3a2265e71377 req-ae2aac51-d84f-4f35-b0d8-1d01b90cec9c service nova] Creating event network-changed:e32bbce7-9144-4da4-978c-50e99d46f4dc for instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 on n-h2-791135-8 Oct 04 11:40:20.738439 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-dbbe3487-992b-4cee-87c5-3a2265e71377 req-ae2aac51-d84f-4f35-b0d8-1d01b90cec9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062409 Oct 04 11:40:20.739059 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1656/5933] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:40:20.807612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:40:20.841477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:40:21.042354 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecbfd033-e30d-405e-bab5-79b7dee5ce84 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 204 len: 0 microversion: 2.1 time: 0.368214 Oct 04 11:40:21.047560 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4278/5934] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:40:20 2022] DELETE /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:40:21.053672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:21.054827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:21.091431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:21.092067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:21.092794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:21.093947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:21.094574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:21.095327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:21.369500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:21.380702 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73dc79a8-664e-4657-a599-7d8e73d3366a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1585 microversion: 2.1 time: 0.331859 Oct 04 11:40:21.382781 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1657/5935] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:21 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1585 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:40:22.411081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:22.412830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:22.427040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:22.427722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:22.433079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:22.434105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:22.434751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:22.435442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:22.554750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:22.558792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:22.595826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:22.596605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:22.596605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:22.606260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:22.606757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:22.609315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:22.656891 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 HTTP/1.1 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '4118493b-8dc7-4a16-a834-5f4c69fb9686'} Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:40:22.658877 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.663510 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.665211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:40:22.666819 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7ed2ea45-ee83-4a76-a249-848953c8b187 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 404 len: 111 microversion: 2.1 time: 0.116590 Oct 04 11:40:22.667573 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1658/5936] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:40:22 2022] DELETE /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:40:22.679851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:22.680809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 4118493b-8dc7-4a16-a834-5f4c69fb9686] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:22.692146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:22.697956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:22.698591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:22.699485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:22.700107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:22.700690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:22.739302 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 HTTP/1.1 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '4118493b-8dc7-4a16-a834-5f4c69fb9686'} Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:22.741142 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.747572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:22.747572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:22.747572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:22.747572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:40:22.747572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:40:22.747572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. Oct 04 11:40:22.747572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:40:22.748965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 4118493b-8dc7-4a16-a834-5f4c69fb9686 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:40:22.751338 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c65b7bbd-1d8c-4a70-a222-52793035f2f5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686" status: 404 len: 111 microversion: 2.1 time: 0.074714 Oct 04 11:40:22.752650 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1659/5937] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:22 2022] GET /compute/v2.1/servers/4118493b-8dc7-4a16-a834-5f4c69fb9686 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:40:23.209947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:23.224362 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ee45ea5-6c19-4f90-bb35-2fccfa75d4a6 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1585 microversion: 2.1 time: 0.818458 Oct 04 11:40:23.227829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4279/5938] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:22 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1585 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:24.126264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6277356a-287c-45b8-b0ff-a95aade7d3a6 req-48bc2ad1-9d83-47da-94a3-206c1a9913a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617", "name": "network-vif-deleted", "tag": "e32bbce7-9144-4da4-978c-50e99d46f4dc"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:40:24.144476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6277356a-287c-45b8-b0ff-a95aade7d3a6 req-48bc2ad1-9d83-47da-94a3-206c1a9913a5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:24.145316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6277356a-287c-45b8-b0ff-a95aade7d3a6 req-48bc2ad1-9d83-47da-94a3-206c1a9913a5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:24.145983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6277356a-287c-45b8-b0ff-a95aade7d3a6 req-48bc2ad1-9d83-47da-94a3-206c1a9913a5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:24.183223 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6277356a-287c-45b8-b0ff-a95aade7d3a6 req-48bc2ad1-9d83-47da-94a3-206c1a9913a5 service nova] Creating event network-vif-deleted:e32bbce7-9144-4da4-978c-50e99d46f4dc for instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 on n-h2-791135-8 Oct 04 11:40:24.200871 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6277356a-287c-45b8-b0ff-a95aade7d3a6 req-48bc2ad1-9d83-47da-94a3-206c1a9913a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085675 Oct 04 11:40:24.203150 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1660/5939] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:40:24.249227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:24.253607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:24.276339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:24.285454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:24.286113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:24.288316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:24.294953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:24.295555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:24.481070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:24.489326 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0df98f7-b487-4f82-98e2-1f27d1ab5906 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1230 microversion: 2.1 time: 0.244750 Oct 04 11:40:24.489962 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4280/5940] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:24 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1230 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:25.516533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:25.517281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:25.533594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:25.534089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:25.534533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:25.535259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:25.535702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:25.536196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:25.675645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:25.687176 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b3edf4b-f6ae-4f63-bd33-80e6fa66869b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1230 microversion: 2.1 time: 0.175624 Oct 04 11:40:25.687778 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1661/5941] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:25 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1230 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:26.712947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:26.717103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:26.732069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:26.733978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:26.740079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:26.743455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:26.744134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:26.744764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:26.859841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:26.881746 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-24239b69-8da8-4e3b-87ff-bb3e6938c170 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1230 microversion: 2.1 time: 0.173085 Oct 04 11:40:26.885796 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4281/5942] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:26 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1230 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:27.911431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:27.912921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:27.922698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:27.923617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:27.924298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:27.925259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:27.925963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:27.927763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:28.090144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:28.109780 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab816278-a2b5-46d8-98bb-1ef03114395a tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1230 microversion: 2.1 time: 0.208325 Oct 04 11:40:28.109976 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1662/5943] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:27 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1230 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:29.134026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:29.135325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:29.148463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:29.154100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:29.154849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:29.155786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:29.161151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:29.161926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:30.065259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:30.084720 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c19a780-bbac-420b-bf98-64adcd931ae1 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1230 microversion: 2.1 time: 0.953730 Oct 04 11:40:30.086341 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4282/5944] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:29 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1230 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:31.114230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:31.114865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:31.125224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:31.138584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:31.139431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:31.140998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:31.141793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:31.142952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:31.321633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9383bcc86b444c5cbb3b1a0bec36cd2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91b285e498224baf9c3f880a9dafd398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:40:31.330683 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc6f43a1-29d9-4fc7-a9c7-741e8da0b50b tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 200 len: 1230 microversion: 2.1 time: 0.223060 Oct 04 11:40:31.362816 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1663/5945] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:31 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 1230 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:40:32.359574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:32.360193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] [instance: a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:40:32.372960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:32.373489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:32.373950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:32.375396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:40:32.376132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:40:32.376600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:40:32.400461 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] HTTP exception thrown: Instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 could not be found. Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Request method failure captured: Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 HTTP/1.1 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBpRqu2xDRtetupEP0-s43c23Tg_-a-d5cecILEeM7f5YfNTEo0IgessRAzlFJttOPUbF1wQ05o8ULEBpzQTTzIkiCyADjL7acloyQDFrbvATgDK6UA2uv0BEsflSzUA4O2ZFxpBQXmQbrBpFphpXwhXgt7SW5syKB8M1BCjSG5J7Ww Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 91b285e498224baf9c3f880a9dafd398 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBackupRestore-1808253593 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91b285e498224baf9c3f880a9dafd398"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91b285e498224baf9c3f880a9dafd398"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91b285e498224baf9c3f880a9dafd398"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91b285e498224baf9c3f880a9dafd398"}]}] Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBackupRestore-1808253593 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 91b285e498224baf9c3f880a9dafd398 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1808253593 Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBackupRestore-1808253593-project Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 9383bcc86b444c5cbb3b1a0bec36cd2e Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBackupRestore-1808253593-project Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 could not be found. Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617'} Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 could not be found. Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 could not be found. Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:40:32.402877 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 could not be found. Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Returning 404 to user: Instance a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-662e8587-349e-4f91-b907-50c4022374eb tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617" status: 404 len: 111 microversion: 2.1 time: 0.049217 Oct 04 11:40:32.407127 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4283/5946] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:40:32 2022] GET /compute/v2.1/servers/a7d79f3b-5cb3-4aa2-8d06-20dc1e4d0617 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:40:32.640251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95a2391d-4a80-4442-becf-4458307849a7 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] Calling method '.version_select at 0x7f71cfe660d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:40:32.720920 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95a2391d-4a80-4442-becf-4458307849a7 tempest-TestVolumeBackupRestore-1808253593 tempest-TestVolumeBackupRestore-1808253593-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1943857862" status: 202 len: 0 microversion: 2.1 time: 0.085488 Oct 04 11:40:32.727590 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1664/5947] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 11:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1943857862 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:41:04.741041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1324179273", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5abbdcc7-0dcd-4519-977a-75134eae5e7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "abb967bf-38d8-4c74-bd84-4e529507054d"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:04.766492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:04.779316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:04.842500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] validate_networks() for [('abb967bf-38d8-4c74-bd84-4e529507054d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:41:05.242460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:41:05.242886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:41:05.243363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:41:05.243775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:41:05.244216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:41:05.254800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:05.255523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:05.256195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:05.256931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:05.257844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:05.258281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:05.275485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:41:05.280911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:41:05.342052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:41:05.344244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5abbdcc7-0dcd-4519-977a-75134eae5e7a',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:41:05.490210 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7828895-e7a4-4665-973f-7dacca4e0617 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755960 Oct 04 11:41:05.492337 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4284/5948] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:41:05.502056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=75 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:05.502805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:05.526193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3180b4a6-aa76-4247-b30c-8ecfd7f01831 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:05.542320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3180b4a6-aa76-4247-b30c-8ecfd7f01831 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:05.898315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3180b4a6-aa76-4247-b30c-8ecfd7f01831 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:05.905779 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3180b4a6-aa76-4247-b30c-8ecfd7f01831 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1071 microversion: 2.1 time: 0.406419 Oct 04 11:41:05.921393 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1665/5949] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:05 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1071 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:06.930228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:06.931472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:06.950435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:06.950935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:06.951380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:06.952100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:06.952568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:06.953004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:07.066219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:07.082839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9121141e-65ae-4933-bd3b-d0515434af68 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1187 microversion: 2.1 time: 0.157732 Oct 04 11:41:07.083954 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4285/5950] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:06 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1187 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:08.108672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:08.109298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:08.126372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:08.127110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:08.127721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:08.128635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:08.129279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:08.129900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:08.532408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:08.540904 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f34441e-8639-43ec-a0f7-16514040d590 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1229 microversion: 2.1 time: 0.435998 Oct 04 11:41:08.573544 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1666/5951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:08 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1229 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:08.878273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-de07b0a2-ca04-4164-9af7-82bcf85f305d req-4276af58-0c34-46f3-969a-17b9a8594c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8", "tag": "5ed86102-42c0-4bae-92a4-c5cb0a4795f7"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:08.899406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-de07b0a2-ca04-4164-9af7-82bcf85f305d req-4276af58-0c34-46f3-969a-17b9a8594c19 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:08.900397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-de07b0a2-ca04-4164-9af7-82bcf85f305d req-4276af58-0c34-46f3-969a-17b9a8594c19 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:08.902091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-de07b0a2-ca04-4164-9af7-82bcf85f305d req-4276af58-0c34-46f3-969a-17b9a8594c19 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:08.927133 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-de07b0a2-ca04-4164-9af7-82bcf85f305d req-4276af58-0c34-46f3-969a-17b9a8594c19 service nova] Creating event network-changed:5ed86102-42c0-4bae-92a4-c5cb0a4795f7 for instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 on n-h1-791135-8 Oct 04 11:41:08.934043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-de07b0a2-ca04-4164-9af7-82bcf85f305d req-4276af58-0c34-46f3-969a-17b9a8594c19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060534 Oct 04 11:41:08.935982 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4286/5952] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:41:09.586285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:09.586911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:09.603586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:09.604131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:09.604597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:09.605319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:09.605809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:09.606238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:10.215310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:10.225137 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ee8afc9a-08f9-4b55-945c-737b2b5fab72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1229 microversion: 2.1 time: 0.644112 Oct 04 11:41:10.226887 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1667/5953] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:09 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1229 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:11.248930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:11.252228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:11.261660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:11.262234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:11.262797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:11.263755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:11.264384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:11.264946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:11.417694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:11.426854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a22cb2b-ef9e-4cce-a07e-88b4e438612b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1229 microversion: 2.1 time: 0.182227 Oct 04 11:41:11.427889 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4287/5954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:11 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1229 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:12.454117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:12.454750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:12.462135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:12.462858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:12.463479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:12.464344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:12.464974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:12.465597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:12.631189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:12.639857 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4598d457-bf2e-4b58-95fc-2c8d56777edf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1229 microversion: 2.1 time: 0.190159 Oct 04 11:41:12.642774 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1668/5955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:12 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1229 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:13.665082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:13.665843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:13.673986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:13.674515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:13.674962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:13.675703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:13.676170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:13.676606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:13.861881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:13.871609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53df6c65-e12b-4ee8-b077-0422ae2ece08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.210458 Oct 04 11:41:13.877284 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4288/5956] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:13 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:14.895066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:14.895732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:14.902693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:14.903174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:14.903612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:14.904313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:14.904764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:14.905186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:15.055437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:15.064259 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc39d053-4cbc-4c33-af32-8efa17ae8531 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.173529 Oct 04 11:41:15.064844 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1669/5957] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:14 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:16.087319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:16.088214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:16.092387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:16.093475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:16.099937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:16.100798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:16.101446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:16.102190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:16.102660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:16.103099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:16.241784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:16.252804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-51a3027a-df53-432e-ae63-da53d52843eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.169240 Oct 04 11:41:16.253426 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4289/5958] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:16 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:17.278052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:17.278664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:17.282640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:17.299109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:17.300476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:17.301313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:17.302350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:17.303199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:17.303917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:17.481879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:17.490738 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4dbf010b-71f4-4990-869b-0f5d6a9fffa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.216948 Oct 04 11:41:17.491916 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1670/5959] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:17 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:18.514205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:18.514778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:18.522364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:18.522857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:18.523300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:18.524391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:18.524857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:18.525296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:18.677805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:18.686913 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-318ef73c-e113-4359-9605-027596a1b581 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.175447 Oct 04 11:41:18.688292 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4290/5960] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:18 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:19.712496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:19.714181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:19.724991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:19.726891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:19.727865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:19.729005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:19.729751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:19.730434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:19.989137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:19.997005 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7451ae3e-c79f-4a64-adea-042b65af290a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.289155 Oct 04 11:41:20.010372 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1671/5961] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:19 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:21.020098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:21.020705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:21.034086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:21.035096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:21.035781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:21.036743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:21.037950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:21.038650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:21.206031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:21.218286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1ec2178-394c-468d-9cb0-8390d407216c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.201782 Oct 04 11:41:21.234106 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4291/5962] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:21 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:22.242930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:22.243550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:22.256190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:22.256684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:22.257121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:22.257871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:22.258326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:22.260749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:22.526242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:22.556532 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2d50b719-a6cf-4ccc-8bc7-5dd7c890cb52 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.317265 Oct 04 11:41:22.557472 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1672/5963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:22 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:23.588192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:23.588945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:23.596969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:23.597639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:23.598050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:23.598837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:23.599409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:23.600192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:23.784140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:23.794292 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4912e33f-13f8-447d-9198-3c03c7684b92 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.212688 Oct 04 11:41:23.795017 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4292/5964] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:23 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:23.903941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c4d424b4-a4ce-4caa-9a2f-953eca34bc2b req-032357f0-cca3-4940-a341-dc4facaceb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8", "name": "network-vif-plugged", "status": "completed", "tag": "5ed86102-42c0-4bae-92a4-c5cb0a4795f7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:23.929427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c4d424b4-a4ce-4caa-9a2f-953eca34bc2b req-032357f0-cca3-4940-a341-dc4facaceb77 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:23.930946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c4d424b4-a4ce-4caa-9a2f-953eca34bc2b req-032357f0-cca3-4940-a341-dc4facaceb77 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:23.932715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c4d424b4-a4ce-4caa-9a2f-953eca34bc2b req-032357f0-cca3-4940-a341-dc4facaceb77 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:23.968881 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c4d424b4-a4ce-4caa-9a2f-953eca34bc2b req-032357f0-cca3-4940-a341-dc4facaceb77 service nova] Creating event network-vif-plugged:5ed86102-42c0-4bae-92a4-c5cb0a4795f7 for instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 on n-h1-791135-8 Oct 04 11:41:23.982246 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c4d424b4-a4ce-4caa-9a2f-953eca34bc2b req-032357f0-cca3-4940-a341-dc4facaceb77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082584 Oct 04 11:41:23.983198 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1673/5965] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:24.826074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:24.826632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:24.841570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:24.842072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:24.842512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:24.843449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:24.843914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:24.844347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:25.072729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:25.081233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ccd25791-febf-4ba6-bf89-80e7d5e294e9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1217 microversion: 2.1 time: 0.261044 Oct 04 11:41:25.087394 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4293/5966] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:24 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1217 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:26.107429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:26.108304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:26.117252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:26.117931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:26.118765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:26.119611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:26.120367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:26.120899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:26.364119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:26.373590 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1151923b-4c5e-4e9b-bb03-cae2a3ed67eb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1402 microversion: 2.1 time: 0.270601 Oct 04 11:41:26.374808 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1674/5967] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:26 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1402 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:26.396869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:26.397567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:26.409112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:26.409841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:26.410293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:26.411189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:26.411648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:26.412289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:26.631855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:26.649870 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c653b8b2-c9c2-4031-aae6-710de7d8069f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1402 microversion: 2.1 time: 0.256687 Oct 04 11:41:26.650637 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4294/5968] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:26 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1402 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:26.673987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1327113193"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:26.676603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:26.683182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:26.683732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:26.684161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:26.685038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:26.685528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:26.686040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:26.825604 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.compute.api [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Attempting to quiesce instance before volume snapshot. Oct 04 11:41:26.845840 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.compute.api [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 11:41:27.037924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Creating snapshot from volume 5abbdcc7-0dcd-4519-977a-75134eae5e7a. {{(pid=122408) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 11:41:28.519718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:28.520318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:28.534686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:28.536651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:28.538245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:28.540324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:28.541490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:28.542875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:28.639414 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5025540d-6143-4770-99d1-2a746acf389d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8/action" status: 202 len: 0 microversion: 2.1 time: 1.969848 Oct 04 11:41:28.648431 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1675/5969] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:41:26 2022] POST /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8/action => generated 0 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 11:41:28.686754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:41:28.887625 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8846f3f8-7e82-4aee-85aa-68032a58e594 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "DELETE /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 204 len: 0 microversion: 2.1 time: 0.877985 Oct 04 11:41:28.891336 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4295/5970] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:41:28 2022] DELETE /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 0 bytes in 882 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:41:28.902519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:28.903408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:28.921728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:28.923143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:28.927221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:28.928934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:28.930508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:28.934634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:29.288815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:29.300223 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f9c6fb5d-2014-4af7-873a-7d0f62bfa77b tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1733 microversion: 2.1 time: 0.404319 Oct 04 11:41:29.301144 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1676/5971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:28 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1733 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:30.323976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:30.325287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:30.339008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:30.341441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:30.342542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:30.344837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:30.347669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:30.348488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:30.682363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:30.693699 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7990cbcf-efa8-459b-ada4-f654a3042d38 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1733 microversion: 2.1 time: 0.373934 Oct 04 11:41:30.695062 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4296/5972] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:30 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1733 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:31.153674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1334712201", "imageRef": "906b7064-ef09-4245-98c5-5846d07f1f7f", "flavorRef": "452", "networks": [{"uuid": "abb967bf-38d8-4c74-bd84-4e529507054d"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:31.249536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] validate_networks() for [('abb967bf-38d8-4c74-bd84-4e529507054d', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:41:31.722406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:31.723036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:31.734856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:31.738254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:31.738982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:31.740312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:31.742363 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:31.743987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:32.016300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:32.036038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e62ac7b-c7cf-4a29-8f01-e0c7d50ab7a1 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1733 microversion: 2.1 time: 0.316696 Oct 04 11:41:32.051491 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4297/5973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:31 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1733 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:41:32.167731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e32712e-1475-47de-a395-90df2bb8859d tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-397387147", "availability_zone": "foo_zone"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:32.173043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.aggregate [None req-7e32712e-1475-47de-a395-90df2bb8859d tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Generated uuid 40b4d01f-1d28-41be-bfa3-990424f3cf72 for aggregate {{(pid=122409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 11:41:32.220962 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e32712e-1475-47de-a395-90df2bb8859d tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.145525 Oct 04 11:41:32.222431 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4298/5974] 10.222.0.23 () {60 vars in 1164 bytes} [Tue Oct 4 11:41:32 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:32.233858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c093caef-14cf-47df-961a-92fedee0bc02 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:32.269381 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c093caef-14cf-47df-961a-92fedee0bc02 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.039582 Oct 04 11:41:32.270197 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4299/5975] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 11:41:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:41:32.285445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ccd072f-53bf-4c39-a8e3-cea336cbbde9 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:32.289495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ccd072f-53bf-4c39-a8e3-cea336cbbde9 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:32.290076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ccd072f-53bf-4c39-a8e3-cea336cbbde9 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:32.291124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ccd072f-53bf-4c39-a8e3-cea336cbbde9 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:32.291590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ccd072f-53bf-4c39-a8e3-cea336cbbde9 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:32.292277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ccd072f-53bf-4c39-a8e3-cea336cbbde9 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:32.293534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ccd072f-53bf-4c39-a8e3-cea336cbbde9 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:32.335767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ccd072f-53bf-4c39-a8e3-cea336cbbde9 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057863 Oct 04 11:41:32.336674 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4300/5976] 10.222.0.23 () {58 vars in 1176 bytes} [Tue Oct 4 11:41:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:32.348878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f210187-4644-424b-986e-21e10990e871 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:32.357911 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f210187-4644-424b-986e-21e10990e871 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.012698 Oct 04 11:41:32.358571 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4301/5977] 10.222.0.23 () {58 vars in 1143 bytes} [Tue Oct 4 11:41:32 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:32.373718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebd6b9ef-f08f-4fe0-82dc-ec1afd9af780 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-791135-8"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:32.388168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd6b9ef-f08f-4fe0-82dc-ec1afd9af780 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:32.388771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd6b9ef-f08f-4fe0-82dc-ec1afd9af780 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:32.389277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebd6b9ef-f08f-4fe0-82dc-ec1afd9af780 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:32.731360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:41:32.731845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:41:32.732259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:41:32.732678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:41:32.733095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:41:32.752879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:32.753944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:32.754602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:32.760461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:32.760962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:32.762416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:32.770494 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ebd6b9ef-f08f-4fe0-82dc-ec1afd9af780 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.403472 Oct 04 11:41:32.772057 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4302/5978] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 11:41:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:32.791927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-14610237-f970-4b69-b65e-ec80db1df591 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:32.802069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:41:32.802761 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-14610237-f970-4b69-b65e-ec80db1df591 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.018233 Oct 04 11:41:32.806248 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4303/5979] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:41:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:32.817061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:41:32.823087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-889744e1-acd7-4d17-adc3-e9d7a27717eb tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-118463286", "availability_zone": "foo_zone"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:32.852905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:41:32.862911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='87be7c57-4e66-45fb-9a5b-557510aa5284',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:41:32.957804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-889744e1-acd7-4d17-adc3-e9d7a27717eb tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.142027 Oct 04 11:41:32.961840 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4304/5980] 10.222.0.23 () {60 vars in 1173 bytes} [Tue Oct 4 11:41:32 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:32.974596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9561613-c8fc-4108-9fa4-f1555207472f tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:33.024278 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9561613-c8fc-4108-9fa4-f1555207472f tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.055910 Oct 04 11:41:33.026488 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4305/5981] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 11:41:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:41:33.038846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db31ab08-482f-497d-80e9-1bb1f8c06a09 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:33.047257 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-57f2e1cd-eb16-4cac-8047-89896f4d4899 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.897499 Oct 04 11:41:33.048079 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1677/5982] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:41:33.069261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14146986-9571-41fb-9184-e08788770ae8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:33.069948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14146986-9571-41fb-9184-e08788770ae8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:33.070753 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db31ab08-482f-497d-80e9-1bb1f8c06a09 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.031986 Oct 04 11:41:33.079344 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4306/5983] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Oct 4 11:41:33 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:41:33.097602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:33.099030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:33.128904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:33.129403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:33.129840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:33.130553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:33.131007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:33.131431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:33.276671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-14146986-9571-41fb-9184-e08788770ae8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:33.287067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ea15d991c84397b3ddca848436b83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b674f857e65d4684bc6d371410bff253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:33.287657 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14146986-9571-41fb-9184-e08788770ae8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1230 microversion: 2.1 time: 0.230916 Oct 04 11:41:33.290860 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1678/5984] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:33 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1230 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:33.295832 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-504d9b15-3cb0-4358-867f-bdb5bf4e74ee tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 200 len: 1666 microversion: 2.1 time: 0.217155 Oct 04 11:41:33.300386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4307/5985] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:33 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:33.307458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83713680-b6ae-452c-8476-ae158dd5d210 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-791135-8"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:33.339695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83713680-b6ae-452c-8476-ae158dd5d210 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:33.340197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83713680-b6ae-452c-8476-ae158dd5d210 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:33.340644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83713680-b6ae-452c-8476-ae158dd5d210 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:33.374202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-aca8d4c0-a2cb-4cba-aa68-853ec73bcd05 req-fe1302ea-6728-4223-8b14-8ecf1c034f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544d260c-ff66-46df-84a1-ecb94b2e13db", "name": "network-vif-deleted", "tag": "9a16af60-ed67-47b3-a3cf-d970c9744aa4"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:33.388225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:33.397028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aca8d4c0-a2cb-4cba-aa68-853ec73bcd05 req-fe1302ea-6728-4223-8b14-8ecf1c034f19 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:33.397592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aca8d4c0-a2cb-4cba-aa68-853ec73bcd05 req-fe1302ea-6728-4223-8b14-8ecf1c034f19 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:33.398553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-aca8d4c0-a2cb-4cba-aa68-853ec73bcd05 req-fe1302ea-6728-4223-8b14-8ecf1c034f19 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:33.417997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:33.436207 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-aca8d4c0-a2cb-4cba-aa68-853ec73bcd05 req-fe1302ea-6728-4223-8b14-8ecf1c034f19 service nova] Creating event network-vif-deleted:9a16af60-ed67-47b3-a3cf-d970c9744aa4 for instance 544d260c-ff66-46df-84a1-ecb94b2e13db on n-h2-791135-8 Oct 04 11:41:33.453514 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-aca8d4c0-a2cb-4cba-aa68-853ec73bcd05 req-fe1302ea-6728-4223-8b14-8ecf1c034f19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081873 Oct 04 11:41:33.456239 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4308/5986] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:41:33.703304 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83713680-b6ae-452c-8476-ae158dd5d210 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.409520 Oct 04 11:41:33.704046 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1679/5987] 10.222.0.23 () {60 vars in 1194 bytes} [Tue Oct 4 11:41:33 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:33.722562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e30792b6-c016-49a4-8bc8-768dc078d2c5 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:33.757934 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e30792b6-c016-49a4-8bc8-768dc078d2c5 tempest-TestAggregatesBasicOps-442622633 tempest-TestAggregatesBasicOps-442622633-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.046060 Oct 04 11:41:33.784817 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4309/5988] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Oct 4 11:41:33 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 11:41:34.315132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:34.316446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:34.337884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:34.339955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:34.341797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:34.341957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:34.342760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:34.346770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:34.347580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:34.348291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:34.373727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:34.379981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:34.381666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:34.386208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:34.388197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:34.390826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:34.449115 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] HTTP exception thrown: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Request method failure captured: Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db HTTP/1.1 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBpxOOTrX1_RlvXdYqclczm0p25P3Rj72mcepIZLlSsqKb9BuyqlXmORR0oszYDCko0VloX8eAh3XYW4sDr64nfhJZqKBXZDW8gvOQjejIWJCAuAxIn8KZJ5PckezQJL-ZniitmbyBZUUnloIHPG0xGvJcS_KU0bSoXyB7GTHwKhHwA Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: b674f857e65d4684bc6d371410bff253 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestServerBasicOps-669276426 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b674f857e65d4684bc6d371410bff253"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b674f857e65d4684bc6d371410bff253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b674f857e65d4684bc6d371410bff253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b674f857e65d4684bc6d371410bff253"}]}] Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestServerBasicOps-669276426 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: b674f857e65d4684bc6d371410bff253 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestServerBasicOps-669276426 Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestServerBasicOps-669276426-project Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 18ea15d991c84397b3ddca848436b83f Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestServerBasicOps-669276426-project Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '544d260c-ff66-46df-84a1-ecb94b2e13db'} Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:41:34.450884 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Returning 404 to user: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:41:34.458137 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d7e276b-1e45-4adb-9520-6b626dc9e1d3 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 404 len: 111 microversion: 2.1 time: 0.121026 Oct 04 11:41:34.459276 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4310/5989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:34 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:41:34.529010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:34.543469 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c2cdbd77-02b3-490e-a795-7a2f0f2fdc71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1282 microversion: 2.1 time: 0.235352 Oct 04 11:41:34.546650 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1680/5990] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:34 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:35.575273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:35.576842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:35.587406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:35.589170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:35.590063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:35.591271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:35.592841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:35.594414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:35.820961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:35.841304 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e7ee831-f0a1-4261-bfb2-63f6cbeb6b75 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1300 microversion: 2.1 time: 0.271166 Oct 04 11:41:35.844688 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4311/5991] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:35 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:36.000099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:36.000852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:36.004326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:36.011639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:36.012358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:36.013034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:36.014031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:36.015540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:36.016224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:36.020325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:36.039840 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] HTTP exception thrown: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Request method failure captured: Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db HTTP/1.1 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBpxOOTrX1_RlvXdYqclczm0p25P3Rj72mcepIZLlSsqKb9BuyqlXmORR0oszYDCko0VloX8eAh3XYW4sDr64nfhJZqKBXZDW8gvOQjejIWJCAuAxIn8KZJ5PckezQJL-ZniitmbyBZUUnloIHPG0xGvJcS_KU0bSoXyB7GTHwKhHwA Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: b674f857e65d4684bc6d371410bff253 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestServerBasicOps-669276426 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b674f857e65d4684bc6d371410bff253"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b674f857e65d4684bc6d371410bff253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b674f857e65d4684bc6d371410bff253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b674f857e65d4684bc6d371410bff253"}]}] Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestServerBasicOps-669276426 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: b674f857e65d4684bc6d371410bff253 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestServerBasicOps-669276426 Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestServerBasicOps-669276426-project Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 18ea15d991c84397b3ddca848436b83f Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestServerBasicOps-669276426-project Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '544d260c-ff66-46df-84a1-ecb94b2e13db'} Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:41:36.041843 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.047644 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.049759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Returning 404 to user: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:41:36.050794 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa94ea46-5b6c-45c9-9075-a3fa8a110a8d tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "DELETE /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 404 len: 111 microversion: 2.1 time: 0.055506 Oct 04 11:41:36.052123 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1681/5992] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:41:35 2022] DELETE /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:41:36.063132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:36.066125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] [instance: 544d260c-ff66-46df-84a1-ecb94b2e13db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:36.072773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:36.073438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:36.073887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:36.074591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:36.075040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:36.075464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:36.093809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] HTTP exception thrown: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Request method failure captured: Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db HTTP/1.1 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBpxOOTrX1_RlvXdYqclczm0p25P3Rj72mcepIZLlSsqKb9BuyqlXmORR0oszYDCko0VloX8eAh3XYW4sDr64nfhJZqKBXZDW8gvOQjejIWJCAuAxIn8KZJ5PckezQJL-ZniitmbyBZUUnloIHPG0xGvJcS_KU0bSoXyB7GTHwKhHwA Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: b674f857e65d4684bc6d371410bff253 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestServerBasicOps-669276426 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b674f857e65d4684bc6d371410bff253"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b674f857e65d4684bc6d371410bff253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b674f857e65d4684bc6d371410bff253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b674f857e65d4684bc6d371410bff253"}]}] Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestServerBasicOps-669276426 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: b674f857e65d4684bc6d371410bff253 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestServerBasicOps-669276426 Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestServerBasicOps-669276426-project Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 18ea15d991c84397b3ddca848436b83f Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestServerBasicOps-669276426-project Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '544d260c-ff66-46df-84a1-ecb94b2e13db'} Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:41:36.095553 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Returning 404 to user: Instance 544d260c-ff66-46df-84a1-ecb94b2e13db could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-26cc7842-8e8b-44a5-8c51-25e1b8e5d4e6 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db" status: 404 len: 111 microversion: 2.1 time: 0.040960 Oct 04 11:41:36.101863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4312/5993] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:36 2022] GET /compute/v2.1/servers/544d260c-ff66-46df-84a1-ecb94b2e13db => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:41:36.381085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c025339e-9e44-477c-8324-98f724d7aaf5 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] Calling method '.version_select at 0x7f71cf7a3550>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:36.430155 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c025339e-9e44-477c-8324-98f724d7aaf5 tempest-TestServerBasicOps-669276426 tempest-TestServerBasicOps-669276426-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-342496380" status: 202 len: 0 microversion: 2.1 time: 0.056134 Oct 04 11:41:36.431382 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1682/5994] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 11:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-342496380 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:41:36.868539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:36.869982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:36.904219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:36.909153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:36.910006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:36.910930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:36.915983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:36.917427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:37.501688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:37.516729 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b87e4a3-9d6d-4150-a1d5-de583e079dce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.652226 Oct 04 11:41:37.517708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4313/5995] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:36 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:38.540061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:38.549646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:38.571508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:38.575006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:38.576721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:38.578604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:38.583298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:38.587156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:39.175693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:39.197512 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71aaddf5-930b-41e2-8aff-0269e6512e80 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.661061 Oct 04 11:41:39.199085 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1683/5996] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:38 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:40.221147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:40.222008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:40.235121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:40.236107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:40.236735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:40.238717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:40.242619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:40.243305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:40.760459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-87dfd4c2-3a7e-4e57-9083-e4e8d10984b7 req-81e67bdd-6547-43d1-b58e-bd664fe51c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6bab75d-45c6-4415-b81d-7576bfdeffb2", "tag": "7d1cf5b1-4367-4761-b5f8-4953953fc641"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:40.796949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-87dfd4c2-3a7e-4e57-9083-e4e8d10984b7 req-81e67bdd-6547-43d1-b58e-bd664fe51c13 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:40.797475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-87dfd4c2-3a7e-4e57-9083-e4e8d10984b7 req-81e67bdd-6547-43d1-b58e-bd664fe51c13 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:40.798126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-87dfd4c2-3a7e-4e57-9083-e4e8d10984b7 req-81e67bdd-6547-43d1-b58e-bd664fe51c13 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:40.805076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:40.813901 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d90e6c31-b662-4ae3-afc2-b7d4b9266d91 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.597492 Oct 04 11:41:40.820030 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4314/5997] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:40 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:40.843556 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-87dfd4c2-3a7e-4e57-9083-e4e8d10984b7 req-81e67bdd-6547-43d1-b58e-bd664fe51c13 service nova] Creating event network-changed:7d1cf5b1-4367-4761-b5f8-4953953fc641 for instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 on n-h2-791135-8 Oct 04 11:41:40.851838 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-87dfd4c2-3a7e-4e57-9083-e4e8d10984b7 req-81e67bdd-6547-43d1-b58e-bd664fe51c13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095165 Oct 04 11:41:40.852577 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1684/5998] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:41:41.848505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:41.849130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:41.887454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:41.888318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:41.888495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:41.889506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:41.895030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:41.895502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:42.307719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:42.352510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:42.391293 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4bbc4995-06a9-432f-aa4c-5147a55bda97 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.545827 Oct 04 11:41:42.395444 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4315/5999] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:41 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:43.416962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:43.419609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:41:43.429775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:43.435735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:43.455828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:43.457011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:43.457712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:43.458606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:43.459240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:43.459845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:44.682485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:44.697935 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6d4e774-b812-4931-96ac-c4465bdc6945 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 1.282135 Oct 04 11:41:44.711049 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1685/6000] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:43 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:45.731179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:45.733129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:45.743976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:45.745179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:45.746145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:45.747467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:45.748368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:45.749760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:45.977327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:45.985648 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e123464-a9ca-424a-980c-1e8efa2a1326 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.258988 Oct 04 11:41:46.004775 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4316/6001] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:45 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:47.013952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:47.015402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:47.029765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:47.037574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:47.038450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:47.040372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:47.042868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:47.043552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:47.498254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:47.509267 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc86850a-58b2-461c-9a77-1e6f49fd266f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.500682 Oct 04 11:41:47.516920 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1686/6002] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:47 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:48.584095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:48.585893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:48.602960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:48.604774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:48.606316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:48.608302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:48.609373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:48.614436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:49.244097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:49.272368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5bd5d4ac-b44e-4566-9b62-41ccb1124da1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.701829 Oct 04 11:41:49.286207 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4317/6003] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:48 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:50.306064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:50.307174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:50.316897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:50.317650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:50.318318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:50.319216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:50.319848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:50.320482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:50.611910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:50.637566 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74cf3786-d309-45e7-ad4b-c368f2a8e13e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.333890 Oct 04 11:41:50.638991 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1687/6004] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:50 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:41:51.677590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:51.679244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:51.692574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:51.693574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:51.694991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:51.696128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:51.697052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:51.698246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:51.953456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:51.962264 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93e45930-6f8a-4fd2-8d04-e654cbec313e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.298423 Oct 04 11:41:51.980802 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4318/6005] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:51 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:53.008088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:53.009043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:53.042518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:53.043827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:53.044527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:53.046554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:53.047132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:53.047840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:53.362608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:53.375873 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53cebe4f-d213-4749-b267-652c97aabee9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.389318 Oct 04 11:41:53.390394 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1688/6006] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:52 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:54.406504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:54.407468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:54.419115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:54.420183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:54.421234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:54.422870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:54.424327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:54.425492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:54.683614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:54.705042 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e418d129-01f8-4b3a-82e0-7f9baa226ecd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.294639 Oct 04 11:41:54.706802 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4319/6007] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:54 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:55.306590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c016c1bf-4da7-4feb-bdd8-9851fec9da49 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'create', calling method: .version_select at 0x7f71d874c550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-458702892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzvq+Nt/mx30y0/rQw56/zelwoeDQyP93JAMDsqfwTxYhh8KVl5ldVnjXf7pVzHRHEFAj0L8Huqwn7USIieqm+dw8tpRazWM8yBXAreBeIbnrPo5N506wL5C5nOuj79ag=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:41:55.324944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c016c1bf-4da7-4feb-bdd8-9851fec9da49 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for project 751bf34580b0489bbd182305466ec1dc. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:41:55.332041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-c016c1bf-4da7-4feb-bdd8-9851fec9da49 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for user d1ca89dfc38d4097ae85eb1e0bd0302d and project 751bf34580b0489bbd182305466ec1dc. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:41:55.361465 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c016c1bf-4da7-4feb-bdd8-9851fec9da49 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.261647 Oct 04 11:41:55.369616 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1689/6008] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:41:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:41:55.738585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:55.739214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:55.747835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:55.747835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:55.748446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:55.749226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:55.749748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:55.750355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:55.940090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:55.950093 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ebff74da-7e43-44f5-8c7d-af3353a55fa8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.215581 Oct 04 11:41:55.951244 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4320/6009] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:55 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:41:57.218654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:57.220042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:57.238301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:57.238811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:57.244908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:57.245967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:57.247052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:57.247903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:57.463941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:57.478394 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3a9fd76c-2ed2-44c6-92d9-ed087f61ecd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1342 microversion: 2.1 time: 0.502986 Oct 04 11:41:57.483587 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1690/6010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:56 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1342 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:41:58.510579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:41:58.511408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:41:58.520522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:58.521427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:58.522260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:58.523063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:41:58.523484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:41:58.523945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:41:59.090893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:41:59.099395 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1f0c4ad0-0b57-4ccd-aa24-146de777b94e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.593072 Oct 04 11:41:59.099988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4321/6011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:41:58 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:00.124710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:00.125265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:00.144816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:00.145316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:00.145992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:00.146907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:00.147539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:00.148142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:00.403102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:00.414275 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6bc05b0-fc65-4aff-b27f-7b72118e6ad8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.294243 Oct 04 11:42:00.415611 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1691/6012] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:00 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:01.439225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:01.440469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:01.455106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:01.456210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:01.456210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:01.456747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:01.457210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:01.457690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:01.766706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:01.786117 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc0a0e1a-26ba-4768-8f3b-a74662c46d14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.351265 Oct 04 11:42:01.790143 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4322/6013] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:01 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:02.582210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1406408131", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "47927325-68c4-4fae-b5c1-658b611373f5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-458702892", "security_groups": [{"name": "tempest-secgroup-smoke-814019873"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:02.707010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] validate_networks() for [('47927325-68c4-4fae-b5c1-658b611373f5', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:42:02.813667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:02.815398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:02.836113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:02.836614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:02.837057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:02.838414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:02.838879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:02.839514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:03.089945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:03.116455 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1c453f44-7e33-4e28-9d4f-6a24566d1498 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.304555 Oct 04 11:42:03.136716 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4323/6014] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:02 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:03.366863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:42:03.367771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:42:03.368681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:42:03.369269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:42:03.369875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:42:03.380659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:03.381744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:03.382373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:03.383828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:03.384580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:03.385181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:03.412309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for project 751bf34580b0489bbd182305466ec1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:42:03.418332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for user d1ca89dfc38d4097ae85eb1e0bd0302d and project 751bf34580b0489bbd182305466ec1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:42:03.440667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:42:03.444204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:42:03.515241 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-389e48f1-e65c-495e-b343-864796583646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.936877 Oct 04 11:42:03.517817 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1692/6015] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:42:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:42:03.528648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12f95d0e-d171-4721-b047-8ac7a1a35e18 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:03.530071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12f95d0e-d171-4721-b047-8ac7a1a35e18 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:03.532218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:03.623036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-12f95d0e-d171-4721-b047-8ac7a1a35e18 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:03.631376 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12f95d0e-d171-4721-b047-8ac7a1a35e18 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1266 microversion: 2.1 time: 0.106526 Oct 04 11:42:03.632908 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4324/6016] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:03 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:04.145661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:04.146668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:04.163579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:04.164088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:04.164791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:04.165896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:04.166617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:04.167345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:04.412504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:04.421805 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e3196f5-5c52-4e34-bab9-802e8324a71b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.281217 Oct 04 11:42:04.425782 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1693/6017] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:04 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:04.655351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:04.655971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:04.664302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:04.664794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:04.665280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:04.666014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:04.666438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:04.667202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:04.671682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=77 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:04.743847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:04.753006 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06cc0308-650f-4be3-bb3c-b96261e19ced tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1318 microversion: 2.1 time: 0.102335 Oct 04 11:42:04.753636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4325/6018] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:04 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1318 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:05.446050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:05.446693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:05.462834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:05.463608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:05.464254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:05.465175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:05.465846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:05.466483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:05.762012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:05.772844 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-438c4c46-000a-4abd-8654-e70e82c2453f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.330575 Oct 04 11:42:05.774035 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1694/6019] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:05 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:05.776702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:05.777645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:05.791347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:05.792023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:05.792484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:05.793262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:05.793724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:05.794190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:05.881913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:05.893779 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-60f06e3b-d476-4cf1-b0c7-2d51e9083c92 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1324 microversion: 2.1 time: 0.121454 Oct 04 11:42:05.894523 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4326/6020] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:05 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1324 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:06.799330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:06.800633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:06.803667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:06.809792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:06.810598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:06.811762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:06.812690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:06.813378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:06.814155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:06.819201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=60 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:06.918649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:06.919438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:06.927312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:06.927916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:06.928466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:06.929263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:06.930085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:06.930581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:07.142381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:07.156620 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efce1336-abf4-42d4-8b65-07d6f31f8649 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.360009 Oct 04 11:42:07.159527 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1695/6021] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:06 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:07.188498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:07.203522 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-778c43fb-f4f4-40b7-a66b-e20aa2ecb9a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1391 microversion: 2.1 time: 0.288553 Oct 04 11:42:07.204488 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4327/6022] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:06 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:07.439323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0c9c861c-1b86-4b5c-968e-fa0a406dd312 req-cb0d56e0-be72-4599-b576-9578a55b70a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fa0bd3-d231-4b88-896e-e6d9e047a3df", "tag": "f4103237-3139-4067-a441-ffd00881219f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:07.487396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c9c861c-1b86-4b5c-968e-fa0a406dd312 req-cb0d56e0-be72-4599-b576-9578a55b70a1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:07.488094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c9c861c-1b86-4b5c-968e-fa0a406dd312 req-cb0d56e0-be72-4599-b576-9578a55b70a1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:07.488587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c9c861c-1b86-4b5c-968e-fa0a406dd312 req-cb0d56e0-be72-4599-b576-9578a55b70a1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:07.505808 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0c9c861c-1b86-4b5c-968e-fa0a406dd312 req-cb0d56e0-be72-4599-b576-9578a55b70a1 service nova] Creating event network-changed:f4103237-3139-4067-a441-ffd00881219f for instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df on n-h1-791135-8 Oct 04 11:42:07.519634 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0c9c861c-1b86-4b5c-968e-fa0a406dd312 req-cb0d56e0-be72-4599-b576-9578a55b70a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088086 Oct 04 11:42:07.522581 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1696/6023] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:42:08.191549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:08.192210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:08.200160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:08.200816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:08.201956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:08.202736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:08.203276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:08.203792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:08.230805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:08.231576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:08.239479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:08.239978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:08.240431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:08.241143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:08.241638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:08.242082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:08.345490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:08.354904 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3d3e6772-2068-49d8-8507-54e392301ff0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.167317 Oct 04 11:42:08.355778 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4328/6024] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:08 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:08.392400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:08.400947 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-38661377-ec1c-4fbb-bccc-6049c011a42e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1391 microversion: 2.1 time: 0.174336 Oct 04 11:42:08.401556 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1697/6025] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:08 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:09.384112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:09.385617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:09.395636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:09.396195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:09.396646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:09.397582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:09.398048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:09.398485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:09.422252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1264b1fb-38f2-4b1e-8740-42a079764a28 req-3b454e91-0cb3-4f44-92db-5527eac554c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bab75d-45c6-4415-b81d-7576bfdeffb2", "name": "network-vif-plugged", "status": "completed", "tag": "7d1cf5b1-4367-4761-b5f8-4953953fc641"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:09.439845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1264b1fb-38f2-4b1e-8740-42a079764a28 req-3b454e91-0cb3-4f44-92db-5527eac554c1 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:09.440727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1264b1fb-38f2-4b1e-8740-42a079764a28 req-3b454e91-0cb3-4f44-92db-5527eac554c1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:09.441241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1264b1fb-38f2-4b1e-8740-42a079764a28 req-3b454e91-0cb3-4f44-92db-5527eac554c1 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:09.456738 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1264b1fb-38f2-4b1e-8740-42a079764a28 req-3b454e91-0cb3-4f44-92db-5527eac554c1 service nova] Creating event network-vif-plugged:7d1cf5b1-4367-4761-b5f8-4953953fc641 for instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 on n-h2-791135-8 Oct 04 11:42:09.473072 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1264b1fb-38f2-4b1e-8740-42a079764a28 req-3b454e91-0cb3-4f44-92db-5527eac554c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054604 Oct 04 11:42:09.474867 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1698/6026] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:42:09.480409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:09.481390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:09.490346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:09.490854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:09.492045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:09.493001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:09.494181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:09.494798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:09.579904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:09.588331 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bb8713ab-abb5-48f3-a3c0-902deff18ac4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.210339 Oct 04 11:42:09.588965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4329/6027] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:09 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:09.729192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:09.738764 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e350b35f-7d2f-406b-81e3-c07ec92cb000 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1391 microversion: 2.1 time: 0.262617 Oct 04 11:42:09.755218 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1699/6028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:09 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:10.610978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:10.611719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:10.618698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:10.619285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:10.619798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:10.620567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:10.621112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:10.621643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:10.759548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:10.763135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:10.764330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:10.769383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7dfbc4e-ebd6-417a-9ef0-bc3349793de9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1376 microversion: 2.1 time: 0.162191 Oct 04 11:42:10.770411 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4330/6029] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:10 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:10.771204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:10.771691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:10.772297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:10.773565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:10.774401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:10.775200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:10.924527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:10.933009 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cab0310e-a2e6-47de-a110-172f20fd55db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1391 microversion: 2.1 time: 0.173746 Oct 04 11:42:10.933713 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1700/6030] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:10 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:11.765629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e6b55541-604c-4fac-ae6b-aad0c87a56b1 req-033fb4f5-4553-4101-8bd5-8e89c1a247f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fa0bd3-d231-4b88-896e-e6d9e047a3df", "name": "network-vif-plugged", "status": "completed", "tag": "f4103237-3139-4067-a441-ffd00881219f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:11.776200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e6b55541-604c-4fac-ae6b-aad0c87a56b1 req-033fb4f5-4553-4101-8bd5-8e89c1a247f7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:11.776682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e6b55541-604c-4fac-ae6b-aad0c87a56b1 req-033fb4f5-4553-4101-8bd5-8e89c1a247f7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:11.777114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e6b55541-604c-4fac-ae6b-aad0c87a56b1 req-033fb4f5-4553-4101-8bd5-8e89c1a247f7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:11.789152 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e6b55541-604c-4fac-ae6b-aad0c87a56b1 req-033fb4f5-4553-4101-8bd5-8e89c1a247f7 service nova] Creating event network-vif-plugged:f4103237-3139-4067-a441-ffd00881219f for instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df on n-h1-791135-8 Oct 04 11:42:11.794435 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e6b55541-604c-4fac-ae6b-aad0c87a56b1 req-033fb4f5-4553-4101-8bd5-8e89c1a247f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032570 Oct 04 11:42:11.795695 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4331/6031] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:42:11.796574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:11.797395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:11.806811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:11.807519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:11.808129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:11.809028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:11.810019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:11.810757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:11.958287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:11.959002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:11.965188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:11.965902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:11.966539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:11.967467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:11.968094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:11.968696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:12.052453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:12.062081 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d3b4edb8-2d22-4c97-be10-0410c7a9efac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1562 microversion: 2.1 time: 0.272007 Oct 04 11:42:12.062941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1701/6032] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:11 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:12.085790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:12.086709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:12.094214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:12.094925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:12.095539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:12.096326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:12.096899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:12.097465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:12.142392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:12.154295 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9baa62f8-0410-4f00-861f-cacb9775b154 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1391 microversion: 2.1 time: 0.200131 Oct 04 11:42:12.155443 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4332/6033] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:11 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:12.255487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:12.263359 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33b099fa-1b40-4237-96e5-02445d4b0ec1 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1562 microversion: 2.1 time: 0.182481 Oct 04 11:42:12.264486 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1702/6034] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:12 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:12.345744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:12.346233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:12.352379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:12.352858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:12.353295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:12.354047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:12.354503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:12.354923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:12.383002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:42:12.466411 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3460f77b-6f44-42bf-b48a-8f4007749721 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 204 len: 0 microversion: 2.1 time: 0.125049 Oct 04 11:42:12.467136 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4333/6035] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:42:12 2022] DELETE /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:42:12.477142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:12.479864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:12.486299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:12.486793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:12.487268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:12.487972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:12.488455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:12.488890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:12.631106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:12.639864 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-991f7a64-76cb-47e9-86d8-fd6417d38abb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1568 microversion: 2.1 time: 0.167874 Oct 04 11:42:12.640467 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1703/6036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:12 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:13.179699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:13.180369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:13.187912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:13.188405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:13.188850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:13.189637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:13.190036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:13.190471 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:13.324583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:13.332504 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bae5a5a5-4240-4dc8-9307-3a9948b2c047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1564 microversion: 2.1 time: 0.157255 Oct 04 11:42:13.333187 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4334/6037] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:13 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:13.355201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:13.356014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:13.363974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:13.364110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:13.364555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:13.365270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:13.365810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:13.366303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:13.399758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:13.434550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:13.509121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:13.517789 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed327076-6942-4c23-bdd7-8d6c94cd345f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1564 microversion: 2.1 time: 0.166579 Oct 04 11:42:13.518375 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1704/6038] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:13 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:13.663028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:13.663765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:13.667069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:13.671193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:13.671762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:13.672489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:13.673263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:13.673828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:13.674358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:13.832572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:13.840593 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-66236faf-8395-4bcd-a925-a3ec5d5ede73 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1568 microversion: 2.1 time: 0.181753 Oct 04 11:42:13.841175 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4335/6039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:13 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:14.866173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:14.866879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:14.874958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:14.875512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:14.876297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:14.877434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:14.877923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:14.878365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:14.987477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:15.006120 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4b79570-718d-4002-86d5-fa7d44c3e06d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1526 microversion: 2.1 time: 0.144414 Oct 04 11:42:15.007262 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1705/6040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:14 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1526 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:15.078511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-980bb478-08c3-41d8-8d49-207e352ba87c req-2740bd15-9930-486f-8471-04ec2c379c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6bab75d-45c6-4415-b81d-7576bfdeffb2", "name": "network-vif-deleted", "tag": "7d1cf5b1-4367-4761-b5f8-4953953fc641"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:15.124816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-980bb478-08c3-41d8-8d49-207e352ba87c req-2740bd15-9930-486f-8471-04ec2c379c21 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:15.126836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-980bb478-08c3-41d8-8d49-207e352ba87c req-2740bd15-9930-486f-8471-04ec2c379c21 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:15.128457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-980bb478-08c3-41d8-8d49-207e352ba87c req-2740bd15-9930-486f-8471-04ec2c379c21 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:15.154517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-980bb478-08c3-41d8-8d49-207e352ba87c req-2740bd15-9930-486f-8471-04ec2c379c21 service nova] Creating event network-vif-deleted:7d1cf5b1-4367-4761-b5f8-4953953fc641 for instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 on n-h2-791135-8 Oct 04 11:42:15.162165 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-980bb478-08c3-41d8-8d49-207e352ba87c req-2740bd15-9930-486f-8471-04ec2c379c21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092770 Oct 04 11:42:15.163254 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4336/6041] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:42:15.659439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:15.660069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:15.666342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:15.666775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:15.667227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:15.668184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:15.668866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:15.669306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:15.816776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:15.825023 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7635d1d1-de3d-4b8c-a73a-2f562c9078b2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1564 microversion: 2.1 time: 0.169403 Oct 04 11:42:15.825689 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1706/6042] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:15 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:16.031136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:16.032131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:16.038570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:16.039189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:16.039734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:16.040569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:16.041136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:16.041734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:16.108365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:16.118178 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1566a7a-1d6d-4b58-a4dc-cffd98fb40ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1361 microversion: 2.1 time: 0.092032 Oct 04 11:42:16.119703 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4337/6043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:16 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1361 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:17.141871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:17.142503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:17.149450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:17.149957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:17.150410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:17.151115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:17.151583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:17.152022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:17.224924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:17.225448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4da94014-f143-43a4-99be-2de46fe63393 req-a7c665ee-afe5-45a5-a49c-7de051521f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fa0bd3-d231-4b88-896e-e6d9e047a3df", "tag": "f4103237-3139-4067-a441-ffd00881219f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:17.233444 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2c71db84-713e-4ee4-804c-81a3fab342a3 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1361 microversion: 2.1 time: 0.095382 Oct 04 11:42:17.234286 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1707/6044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:17 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:17.236982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4da94014-f143-43a4-99be-2de46fe63393 req-a7c665ee-afe5-45a5-a49c-7de051521f61 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:17.237567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4da94014-f143-43a4-99be-2de46fe63393 req-a7c665ee-afe5-45a5-a49c-7de051521f61 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:17.238090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4da94014-f143-43a4-99be-2de46fe63393 req-a7c665ee-afe5-45a5-a49c-7de051521f61 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:17.250057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4da94014-f143-43a4-99be-2de46fe63393 req-a7c665ee-afe5-45a5-a49c-7de051521f61 service nova] Creating event network-changed:f4103237-3139-4067-a441-ffd00881219f for instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df on n-h1-791135-8 Oct 04 11:42:17.255373 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4da94014-f143-43a4-99be-2de46fe63393 req-a7c665ee-afe5-45a5-a49c-7de051521f61 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034166 Oct 04 11:42:17.256068 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4338/6045] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:42:18.257676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:18.258309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:18.265661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:18.266164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:18.266613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:18.267365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:18.267863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:18.268299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:18.331511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:18.339338 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-83d1321d-fddf-444a-806c-50ab9938fbcf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1361 microversion: 2.1 time: 0.085691 Oct 04 11:42:18.339910 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1708/6046] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:18 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1361 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:19.364682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:19.365442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:19.371937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:19.372575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:19.373070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:19.373810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:19.374273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:19.374709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:19.445936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:19.454910 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5d7986d3-88bd-4527-bba4-5bbae2f2aeb2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1361 microversion: 2.1 time: 0.095521 Oct 04 11:42:19.455483 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4339/6047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:19 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:20.477576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:20.478179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:20.485654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:20.486146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:20.486595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:20.487294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:20.487760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:20.488222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:20.552640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:20.562354 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1eade08a-a7d5-421c-a33b-19e2b300da74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 200 len: 1361 microversion: 2.1 time: 0.088766 Oct 04 11:42:20.563442 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1709/6048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:20 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:21.585980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:21.586714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:21.593852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:21.594723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:21.595126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:21.595831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:21.596293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:21.596852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:21.610844 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 HTTP/1.1 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'e6bab75d-45c6-4415-b81d-7576bfdeffb2'} Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:21.612494 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7fa010c5-8791-467d-ac67-2e8a12cec262 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 404 len: 111 microversion: 2.1 time: 0.033046 Oct 04 11:42:21.617498 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4340/6049] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:21 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:42:26.996965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:26.997588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:27.005433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:27.005924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:27.006366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:27.007058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:27.007515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:27.007944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:27.034468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:42:27.110719 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed7829e3-65e3-4120-8db1-5b8f7c88772d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 204 len: 0 microversion: 2.1 time: 0.117269 Oct 04 11:42:27.114412 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1710/6050] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:42:26 2022] DELETE /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:42:27.119717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:27.120338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:27.128180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:27.128674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:27.129114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:27.129874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:27.130338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:27.130772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:27.267928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:27.275992 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4c732082-7883-4c3d-b311-45f7d7f9fa43 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1408 microversion: 2.1 time: 0.160233 Oct 04 11:42:27.276662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4341/6051] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:27 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:28.299559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:28.300262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:28.307134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:28.307626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:28.308073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:28.308773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:28.309237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:28.309701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:28.325374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:28.455048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:28.463488 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95b83451-71b5-4031-ae4c-b894d5008407 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1408 microversion: 2.1 time: 0.168180 Oct 04 11:42:28.464383 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1711/6052] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:28 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:29.212913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2ef127d3-5804-4c2a-9d35-0468b3fed4c7 req-9b79708a-e9c4-41a7-9c59-c32290c50e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8", "name": "network-vif-deleted", "tag": "5ed86102-42c0-4bae-92a4-c5cb0a4795f7"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:29.233153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2ef127d3-5804-4c2a-9d35-0468b3fed4c7 req-9b79708a-e9c4-41a7-9c59-c32290c50e11 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:29.234036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2ef127d3-5804-4c2a-9d35-0468b3fed4c7 req-9b79708a-e9c4-41a7-9c59-c32290c50e11 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:29.239351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2ef127d3-5804-4c2a-9d35-0468b3fed4c7 req-9b79708a-e9c4-41a7-9c59-c32290c50e11 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:29.249530 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2ef127d3-5804-4c2a-9d35-0468b3fed4c7 req-9b79708a-e9c4-41a7-9c59-c32290c50e11 service nova] Creating event network-vif-deleted:5ed86102-42c0-4bae-92a4-c5cb0a4795f7 for instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 on n-h1-791135-8 Oct 04 11:42:29.257246 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2ef127d3-5804-4c2a-9d35-0468b3fed4c7 req-9b79708a-e9c4-41a7-9c59-c32290c50e11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047776 Oct 04 11:42:29.258272 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4342/6053] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:42:29.487475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:29.488723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:29.495977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:29.496479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:29.497104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:29.498195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:29.498696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:29.499141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:29.603021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:29.611942 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fbea8d69-0095-46ec-985e-d7b8ae37b7ad tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1202 microversion: 2.1 time: 0.129045 Oct 04 11:42:29.612647 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1712/6054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:29 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1202 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:30.637006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:30.638594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:30.645166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:30.645701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:30.646146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:30.646850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:30.647309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:30.647740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:30.663942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:30.752331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:30.760773 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35d3f1f7-c309-4148-9e1f-1b1fa91fc888 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1202 microversion: 2.1 time: 0.128990 Oct 04 11:42:30.761371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4343/6055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:30 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1202 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:31.787663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:31.788295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:31.795535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:31.796347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:31.797006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:31.798001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:31.798678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:31.799322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:31.868576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:31.880030 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-edbcb916-454c-4329-8130-1b9513222f8c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1202 microversion: 2.1 time: 0.096480 Oct 04 11:42:31.888682 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1713/6056] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:31 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:32.904005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:32.904622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:32.912150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:32.912750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:32.913267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:32.914264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:32.914796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:32.915467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:32.993102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:33.002516 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-015c0f8f-94b1-426c-8dec-3813a09df542 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1202 microversion: 2.1 time: 0.102878 Oct 04 11:42:33.003636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4344/6057] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:32 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:34.028073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:34.029279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:34.040069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:34.040815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:34.041270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:34.042010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:34.042654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:34.043276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:34.077221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:34.078058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:34.078514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:34.078982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lazy-loading 'fault' on Instance uuid 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:42:34.139020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:34.147138 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ebbafcb4-e96f-45c6-a365-552dc30a2560 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 200 len: 1207 microversion: 2.1 time: 0.125097 Oct 04 11:42:34.147716 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1714/6058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:34 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 1207 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:35.171131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:35.171849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:35.174314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:35.181795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:35.182361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:35.182871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:35.183640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:35.184165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:35.184686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:35.199332 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 HTTP/1.1 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8'} Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:35.201618 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-27a2f31e-8563-417e-9aaf-55a10582e380 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 404 len: 111 microversion: 2.1 time: 0.036959 Oct 04 11:42:35.209695 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4345/6059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:35 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:42:37.363060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:37.363565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:37.366677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:37.381914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:37.382403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:37.382867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:37.383563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:37.384026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:37.384462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:37.398490 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 HTTP/1.1 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'e6bab75d-45c6-4415-b81d-7576bfdeffb2'} Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:42:37.400484 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f58cf277-3de8-469b-8778-4416914d409a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 404 len: 111 microversion: 2.1 time: 0.042925 Oct 04 11:42:37.405720 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1715/6060] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:42:37 2022] DELETE /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:42:37.411797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:37.412545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: e6bab75d-45c6-4415-b81d-7576bfdeffb2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:37.420452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:37.421058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:37.421628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:37.422558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:37.423089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:37.423589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:37.437954 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 HTTP/1.1 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'e6bab75d-45c6-4415-b81d-7576bfdeffb2'} Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:37.439694 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.444981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:37.444981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:37.444981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:37.444981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:42:37.444981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:42:37.444981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. Oct 04 11:42:37.444981 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:37.444981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance e6bab75d-45c6-4415-b81d-7576bfdeffb2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:42:37.446064 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-918b9c95-8190-4bf3-833e-2ed4282d6936 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2" status: 404 len: 111 microversion: 2.1 time: 0.037849 Oct 04 11:42:37.447163 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4346/6061] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:37 2022] GET /compute/v2.1/servers/e6bab75d-45c6-4415-b81d-7576bfdeffb2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:42:37.996300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:37.996810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:38.003307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:38.003806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:38.004475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:38.005186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:38.005680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:38.006117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:38.020386 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 HTTP/1.1 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8'} Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:42:38.022196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d96db2f4-7546-4dec-9ee3-05278bf50ec2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 404 len: 111 microversion: 2.1 time: 0.031268 Oct 04 11:42:38.027428 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1716/6062] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:42:37 2022] DELETE /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:42:38.038235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:38.038748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:38.045876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:38.046456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:38.046921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:38.055313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:38.055803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:38.056243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:38.073806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 HTTP/1.1 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8'} Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:42:38.076294 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d8e3096-8f83-4ea1-933f-a410ad6e9443 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8" status: 404 len: 111 microversion: 2.1 time: 0.044707 Oct 04 11:42:38.080879 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4347/6063] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:38 2022] GET /compute/v2.1/servers/8bb9230f-8739-4fb9-ba1a-e555d8bb2ac8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:42:38.158792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-52f3c39e-df41-439e-93e9-58be03ce8f42 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: .version_select at 0x7f71d874c040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-153425603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCNfT6FPNnxxlYHrMYaaWnMhZmywe2iKYIdAjLkhW8WNmt/7j/m98ux5nKSlDtYcF5Jkkc5JIo0YMKmRSMN80O+gjjDKNvJ3HCXi/p9hpofznI03WVA6tW4t22Nt/ZgeQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:38.176692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-52f3c39e-df41-439e-93e9-58be03ce8f42 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:42:38.182485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-52f3c39e-df41-439e-93e9-58be03ce8f42 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:42:38.206288 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-52f3c39e-df41-439e-93e9-58be03ce8f42 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.054105 Oct 04 11:42:38.206809 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1717/6064] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:42:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:42:39.083610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:39.085845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:39.093105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:39.093627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:39.094072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:39.094776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:39.095233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:39.095663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:39.153943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4398e655-cfee-43ed-82fc-0759f8eba219 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action" status: 200 len: 24572 microversion: 2.1 time: 0.071406 Oct 04 11:42:39.155258 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4348/6065] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:42:39 2022] POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action => generated 24572 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:42:45.574165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:45.574873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:45.582590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:45.583175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:45.583687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:45.584611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:45.585153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:45.585710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:45.806081 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-162d35e4-614b-4678-a5de-03251732a27b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1834 microversion: 2.1 time: 0.236570 Oct 04 11:42:45.807253 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1718/6066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:45 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1834 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:45.830878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:45.832202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:45.839104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:45.839607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:45.840049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:45.841932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:45.842857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:45.843852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:46.009496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:46.017901 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-06191e4c-c0fd-4d10-8247-7b61edfa8e20 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1683 microversion: 2.1 time: 0.191186 Oct 04 11:42:46.018432 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4349/6067] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:45 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:46.129493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:46.132600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:46.147226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:46.147736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:46.148189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:46.148918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:46.149402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:46.149841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:46.211295 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-263e9759-c093-4d4b-b213-b796ddd07983 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action" status: 200 len: 32633 microversion: 2.1 time: 0.086369 Oct 04 11:42:46.217443 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1719/6068] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:42:46 2022] POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action => generated 32633 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:42:46.365943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:46.366541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:46.373674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:46.374158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:46.374596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:46.375286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:46.375997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:46.376875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:46.427764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5db9c21afff94d0cbebc187874256c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2725ff8b806461984f60a08b12ccbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:46.428381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] flavor_id is None. Assuming migration. {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 11:42:46.428840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:42:46.582795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5716193c-b9dd-4da0-ab1d-ae4a0b72e544 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action" status: 202 len: 0 microversion: 2.1 time: 0.220361 Oct 04 11:42:46.585527 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4350/6069] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:42:46 2022] POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:42:46.592571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:46.593851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:46.601151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:46.601911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:46.602352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:46.603232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:46.603868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:46.604298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:46.804291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:46.814507 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb2052f6-6c6f-4e47-9a9d-68dd040462df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1692 microversion: 2.1 time: 0.226050 Oct 04 11:42:46.815804 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1720/6070] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:46 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1692 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:47.843088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:47.844389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:47.851954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:47.852963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:47.854101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:47.855090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:47.855656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:47.856268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:48.014362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:48.023305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5d20e84-af23-407d-b706-b9cdbc5bafad tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1692 microversion: 2.1 time: 0.185284 Oct 04 11:42:48.024235 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4351/6071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:47 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:49.048207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:49.049545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:49.052651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:49.060841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:49.061343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:49.062028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:49.062923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:49.063356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:49.063897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:49.226100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:49.235843 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72759ea5-5c2b-4899-9204-a9438c92d05b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.192798 Oct 04 11:42:49.242378 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1721/6072] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:49 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:50.260049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:50.260679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:50.268214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:50.268712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:50.269158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:50.269891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:50.270535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:50.271165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:50.423602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:50.432168 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f45bc755-610b-446d-af4c-5c0e19997d60 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.176183 Oct 04 11:42:50.433070 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4352/6073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:50 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:51.457680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:51.458683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:51.466480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:51.467088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:51.467625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:51.468581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:51.469174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:51.469738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:51.642239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:51.650478 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b0aaa70-27c6-4d00-bbcb-c3cbc0de4fc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.196782 Oct 04 11:42:51.651070 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1722/6074] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:51 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:52.674785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:52.675469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:52.682630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:52.683188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:52.683653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:52.684998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:52.685491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:52.685933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:52.831288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:52.840226 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-67d98756-5f9b-4000-b5af-ab8f94a741b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.168654 Oct 04 11:42:52.840954 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4353/6075] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:52 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:53.863952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:53.864608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:53.871949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:53.872445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:53.873101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:53.873850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:53.874321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:53.874763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:54.014246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:54.022668 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3cc3f97c-cc48-4e6a-b1e4-d2f226fa3802 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.162631 Oct 04 11:42:54.023963 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1723/6076] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:53 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:55.046304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:55.047500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:55.054566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:55.055150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:55.055694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:55.056790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:55.057403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:55.057870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:55.205200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:55.214079 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-928e165a-64ab-4864-a050-544aeb3634a3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.171625 Oct 04 11:42:55.214862 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4354/6077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:55 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:56.238163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:56.238784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:56.245889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:56.246392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:56.246894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:56.247606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:56.248079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:56.248518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:56.380872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:56.389325 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-61429974-39da-4fc0-a227-5c6c2a9a776e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.155089 Oct 04 11:42:56.389951 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1724/6078] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:56 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:56.697294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1989308948", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153425603", "security_groups": [{"name": "tempest-secgroup-smoke-1385016960"}], "block_device_mapping_v2": [{"uuid": "f1911168-797e-4e0f-8892-85972b0554b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abb967bf-38d8-4c74-bd84-4e529507054d"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:42:56.815849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] validate_networks() for [('abb967bf-38d8-4c74-bd84-4e529507054d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:42:57.213970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:42:57.214454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:42:57.214935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:42:57.215999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:42:57.216413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:42:57.225593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:57.226075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:57.226508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:57.227227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:57.227699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:57.228252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:57.245640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:42:57.251549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:42:57.309636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:42:57.311799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1911168-797e-4e0f-8892-85972b0554b3',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:42:57.412488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:57.413289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:57.420324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:57.420958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:57.421556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:57.422328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:57.422806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:57.423249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:57.438767 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e2ef83e0-35c1-4cd8-bf1e-80888e08f107 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745301 Oct 04 11:42:57.439818 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4355/6079] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:42:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:42:57.451129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36fcaaa6-7921-48e5-9f63-a311ace376d2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:57.452591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36fcaaa6-7921-48e5-9f63-a311ace376d2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:57.512034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-36fcaaa6-7921-48e5-9f63-a311ace376d2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:57.519949 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36fcaaa6-7921-48e5-9f63-a311ace376d2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1094 microversion: 2.1 time: 0.073152 Oct 04 11:42:57.520794 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4356/6080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:57 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:57.579421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:57.587322 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a15c281-5577-4f91-9080-12b3d12fb8fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.178926 Oct 04 11:42:57.587916 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1725/6081] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:57 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:58.544919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:58.549919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:58.559825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:58.560601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:58.561226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:58.562218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:58.563046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:58.563700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:58.613152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:58.618622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:58.639981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:58.640892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:58.642042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:58.643066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:58.643767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:58.644539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:58.655230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=74 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:42:58.681656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:58.690920 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3a7a2f8-95c8-4ef6-ada2-b8f8f406adc7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1200 microversion: 2.1 time: 0.151248 Oct 04 11:42:58.691761 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4357/6082] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:58 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1200 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:42:58.935742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:58.944186 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b89255a-2deb-4cad-9641-5499dc45aaa9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.336971 Oct 04 11:42:58.945001 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1726/6083] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:58 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:59.714424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:59.715046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:59.726792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:59.730577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:59.731067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:59.731803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:59.732260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:59.732688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:59.910956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:42:59.919024 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4633b314-ef63-43b6-a932-81dc1086d908 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1278 microversion: 2.1 time: 0.208473 Oct 04 11:42:59.919619 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4358/6084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:59 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:42:59.966751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:42:59.968140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:42:59.976092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:59.976943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:59.977692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:42:59.978660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:42:59.979350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:42:59.980000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:00.207381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:00.215729 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f10f921a-462e-48b3-a51f-cc865537a9b3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.253037 Oct 04 11:43:00.216315 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1727/6085] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:42:59 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:00.365826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6ee18f6c-6a06-4b56-a875-56f6bb862be2 req-b4065fa1-2ebc-4a35-a7a2-3c9394d011f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a70b0aa-7eae-418e-a1c1-b01a81c0b910", "tag": "319cda41-28a1-4397-90f8-ee8374efc54c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:43:00.381511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6ee18f6c-6a06-4b56-a875-56f6bb862be2 req-b4065fa1-2ebc-4a35-a7a2-3c9394d011f3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:00.381771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6ee18f6c-6a06-4b56-a875-56f6bb862be2 req-b4065fa1-2ebc-4a35-a7a2-3c9394d011f3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:00.382011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6ee18f6c-6a06-4b56-a875-56f6bb862be2 req-b4065fa1-2ebc-4a35-a7a2-3c9394d011f3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:00.393878 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6ee18f6c-6a06-4b56-a875-56f6bb862be2 req-b4065fa1-2ebc-4a35-a7a2-3c9394d011f3 service nova] Creating event network-changed:319cda41-28a1-4397-90f8-ee8374efc54c for instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 on n-h2-791135-8 Oct 04 11:43:00.401938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6ee18f6c-6a06-4b56-a875-56f6bb862be2 req-b4065fa1-2ebc-4a35-a7a2-3c9394d011f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041349 Oct 04 11:43:00.403466 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4359/6086] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:43:00.943388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:00.944126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:00.951329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:00.951864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:00.952380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:00.953162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:00.953741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:00.954254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:01.168590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:01.183211 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5f4e694-87f8-4b4f-84f0-c933158a8947 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1278 microversion: 2.1 time: 0.244436 Oct 04 11:43:01.184660 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1728/6087] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:00 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:01.240229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:01.241890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:01.250387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:01.251167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:01.251989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:01.252703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:01.253339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:01.253800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:01.261338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:01.396887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:01.406104 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b54914f-d577-4f82-992f-cd17aad67303 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.170094 Oct 04 11:43:01.407088 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4360/6088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:01 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:02.206709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:02.207337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:02.214372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:02.214791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:02.215278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:02.215979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:02.216449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:02.216887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:02.352605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:02.361080 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3afca749-ab2e-4199-a7a5-352d076ae459 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1278 microversion: 2.1 time: 0.158273 Oct 04 11:43:02.361824 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1729/6089] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:02 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:02.429921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:02.430533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:02.438688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:02.439190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:02.439638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:02.440353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:02.440815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:02.441253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:02.578533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:02.586615 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-909e5ea8-4346-4131-975a-6a6602845d6f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.160616 Oct 04 11:43:02.587281 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4361/6090] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:02 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:03.384052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:03.384759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:03.392365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:03.392934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:03.393474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:03.394242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:03.394738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:03.395171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:03.535645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:03.543611 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-517422e2-82ec-4347-8dc8-758eaa40f74b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1278 microversion: 2.1 time: 0.163395 Oct 04 11:43:03.544197 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1730/6091] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:03 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:03.609643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:03.610340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:03.617274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:03.617794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:03.618237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:03.618938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:03.619399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:03.619825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:03.755458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:03.763671 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cc90a778-5e19-4483-8c92-5220715ff4fa tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.157994 Oct 04 11:43:03.764352 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4362/6092] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:03 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:04.566641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:04.567258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:04.575025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:04.575558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:04.576004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:04.576695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:04.577154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:04.577607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:04.710524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:04.718937 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f4b93f2-9f84-4861-b6a9-efa3089e5b24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1278 microversion: 2.1 time: 0.156350 Oct 04 11:43:04.719512 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1731/6093] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:04 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:43:04.786942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:04.787581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:04.794510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:04.794996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:04.795431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:04.796121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:04.796599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:04.797023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:04.931689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:04.941035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80deb1db-88a8-4815-8d5a-9ce42a1f5d64 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.157987 Oct 04 11:43:04.941657 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4363/6094] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:04 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:05.741343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:05.741998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:05.748990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:05.749550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:05.750001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:05.750711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:05.751179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:05.751881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:05.932444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:05.941578 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-52297914-3928-4ab5-a30c-80b996ac924f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1278 microversion: 2.1 time: 0.203956 Oct 04 11:43:05.942919 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1732/6095] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:05 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:05.963965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:05.964580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:05.968082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:05.974734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:05.975224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:05.975881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:05.977025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:05.977674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:05.978265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:06.141286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:06.150089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bc689021-43fc-4a49-b382-ceda25faf9dc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1697 microversion: 2.1 time: 0.189854 Oct 04 11:43:06.150684 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4364/6096] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:05 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:06.965845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:06.966477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:06.973475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:06.973965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:06.974373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:06.975082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:06.975552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:06.975992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:07.113096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:07.120852 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd785f7e-cf3d-4b5f-9162-dbc6d9746e79 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.158978 Oct 04 11:43:07.121775 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1733/6097] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:06 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:07.174625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:07.175259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:07.182394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:07.182884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:07.183324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:07.184059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:07.184514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:07.184942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:07.235293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:07.321259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:07.330713 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b6c6d81-8a07-4ad3-9dac-eda5285a2048 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1696 microversion: 2.1 time: 0.159850 Oct 04 11:43:07.336386 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4365/6098] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:07 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:07.654526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b1421d82-473c-4a6e-899a-0bda5d6b2d43 req-19ad4569-46af-4847-80c8-047934039a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fa0bd3-d231-4b88-896e-e6d9e047a3df", "name": "network-vif-unplugged", "status": "completed", "tag": "f4103237-3139-4067-a441-ffd00881219f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:43:07.660467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:07.672781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1421d82-473c-4a6e-899a-0bda5d6b2d43 req-19ad4569-46af-4847-80c8-047934039a2e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:07.673222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1421d82-473c-4a6e-899a-0bda5d6b2d43 req-19ad4569-46af-4847-80c8-047934039a2e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:07.673995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1421d82-473c-4a6e-899a-0bda5d6b2d43 req-19ad4569-46af-4847-80c8-047934039a2e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:07.691017 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b1421d82-473c-4a6e-899a-0bda5d6b2d43 req-19ad4569-46af-4847-80c8-047934039a2e service nova] Creating event network-vif-unplugged:f4103237-3139-4067-a441-ffd00881219f for instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df on n-h2-791135-8 Oct 04 11:43:07.696909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-b1421d82-473c-4a6e-899a-0bda5d6b2d43 req-19ad4569-46af-4847-80c8-047934039a2e service nova] Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:43:07.708811 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b1421d82-473c-4a6e-899a-0bda5d6b2d43 req-19ad4569-46af-4847-80c8-047934039a2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059491 Oct 04 11:43:07.709698 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1734/6099] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:43:08.144621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:08.145467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:08.147360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:08.153431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:08.153956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:08.154404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:08.155179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:08.155634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:08.156076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:08.300457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:08.308375 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ee95ba72-8de0-4f12-850c-9d551e676c1c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.168096 Oct 04 11:43:08.309033 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4366/6100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:08 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:08.356657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:08.357393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:08.363590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:08.364090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:08.364546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:08.365262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:08.365763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:08.366204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:08.581424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:08.589786 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f20d7a1f-0326-491f-815b-77763daa07c5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1696 microversion: 2.1 time: 0.238097 Oct 04 11:43:08.590921 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1735/6101] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:08 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1696 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:09.457884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:09.457884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:09.457884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:09.457884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:09.457884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:09.457884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:09.457884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:09.457884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:09.491834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:09.500677 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-327d2070-8dd5-42df-9a8f-c66fa03ae744 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.173034 Oct 04 11:43:09.501658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4367/6102] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:09 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:09.613506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:09.614180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:09.622792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:09.623309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:09.623765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:09.625133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:09.626618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:09.627253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:09.735222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-5ec0574d-e492-4409-8c36-2fb8ca6d1b5a req-1ff70b37-bb71-4450-a98a-1e2d1eec635d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fa0bd3-d231-4b88-896e-e6d9e047a3df", "tag": "f4103237-3139-4067-a441-ffd00881219f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:43:09.747243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ec0574d-e492-4409-8c36-2fb8ca6d1b5a req-1ff70b37-bb71-4450-a98a-1e2d1eec635d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:09.747722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ec0574d-e492-4409-8c36-2fb8ca6d1b5a req-1ff70b37-bb71-4450-a98a-1e2d1eec635d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:09.748157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-5ec0574d-e492-4409-8c36-2fb8ca6d1b5a req-1ff70b37-bb71-4450-a98a-1e2d1eec635d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:09.760634 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-5ec0574d-e492-4409-8c36-2fb8ca6d1b5a req-1ff70b37-bb71-4450-a98a-1e2d1eec635d service nova] Creating event network-changed:f4103237-3139-4067-a441-ffd00881219f for instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df on n-h2-791135-8 Oct 04 11:43:09.766175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-5ec0574d-e492-4409-8c36-2fb8ca6d1b5a req-1ff70b37-bb71-4450-a98a-1e2d1eec635d service nova] Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:43:09.774504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:09.777020 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-5ec0574d-e492-4409-8c36-2fb8ca6d1b5a req-1ff70b37-bb71-4450-a98a-1e2d1eec635d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045480 Oct 04 11:43:09.777671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4368/6103] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:43:09.785588 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5e42152b-d761-44c2-8957-fc9e0a0c7697 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1694 microversion: 2.1 time: 0.176024 Oct 04 11:43:09.786172 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1736/6104] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:09 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:10.528807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:10.530374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:10.537125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:10.537638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:10.538072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:10.538773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:10.539408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:10.539998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:10.685934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:10.694136 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9fb443e-f27e-4812-bfed-f8a471e4d171 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.169621 Oct 04 11:43:10.694733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4369/6105] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:10 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:10.812359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:10.812979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:10.820301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:10.820812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:10.821261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:10.822019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:10.822491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:10.822933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:10.967706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:10.975561 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4c03fd69-e2c6-4888-bb9c-15739d143847 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1694 microversion: 2.1 time: 0.167745 Oct 04 11:43:10.976143 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1737/6106] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:10 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:11.716771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:11.718311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:11.725341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:11.725920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:11.726445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:11.727270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:11.727732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:11.728159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:11.875357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:11.884020 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5066aa88-a4cf-4e9e-a30f-944cd0b08d74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.171282 Oct 04 11:43:11.884619 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4370/6107] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:11 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:12.002916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:12.004446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:12.018078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:12.019047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:12.019506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:12.020278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:12.020745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:12.021185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:12.284066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:12.292207 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25dca213-f4cd-46e5-a4fd-24bc763ca6f8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1691 microversion: 2.1 time: 0.296875 Oct 04 11:43:12.305796 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1738/6108] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:11 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1691 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:12.316394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:43:12.317115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:12.323381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:12.323868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:12.324838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:12.325627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:12.326086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:12.326514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:12.395162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e98874b3-30d5-461f-b4c0-674bad7f99db tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action" status: 204 len: 0 microversion: 2.1 time: 0.083370 Oct 04 11:43:12.396670 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4371/6109] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:43:12 2022] POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:43:12.405622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:12.408508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:12.419695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:12.420982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:12.421976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:12.423058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:12.424780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:12.428790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:12.721527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:12.734220 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5aa9c9cf-e57f-4475-8385-922d2f9bd225 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1691 microversion: 2.1 time: 0.331441 Oct 04 11:43:12.735156 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1739/6110] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:12 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1691 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:12.908575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:12.910838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:12.919743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:12.920656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:12.921296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:12.922217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:12.922839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:12.923750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:13.096656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:13.110799 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ea6e98e-0781-4a3d-a7ad-6ba621ed9ffd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.206257 Oct 04 11:43:13.111390 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4372/6111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:12 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:13.697394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1da6b204-4c4c-414b-ae42-992bbea0deb2 req-cd149377-31dd-48bb-996e-dc3afeb9513a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fa0bd3-d231-4b88-896e-e6d9e047a3df", "name": "network-vif-plugged", "status": "completed", "tag": "f4103237-3139-4067-a441-ffd00881219f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:43:13.708310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1da6b204-4c4c-414b-ae42-992bbea0deb2 req-cd149377-31dd-48bb-996e-dc3afeb9513a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:13.708804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1da6b204-4c4c-414b-ae42-992bbea0deb2 req-cd149377-31dd-48bb-996e-dc3afeb9513a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:13.709660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1da6b204-4c4c-414b-ae42-992bbea0deb2 req-cd149377-31dd-48bb-996e-dc3afeb9513a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:13.723405 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1da6b204-4c4c-414b-ae42-992bbea0deb2 req-cd149377-31dd-48bb-996e-dc3afeb9513a service nova] Creating event network-vif-plugged:f4103237-3139-4067-a441-ffd00881219f for instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df on n-h2-791135-8 Oct 04 11:43:13.731434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-1da6b204-4c4c-414b-ae42-992bbea0deb2 req-cd149377-31dd-48bb-996e-dc3afeb9513a service nova] Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:43:13.743030 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1da6b204-4c4c-414b-ae42-992bbea0deb2 req-cd149377-31dd-48bb-996e-dc3afeb9513a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149677 Oct 04 11:43:13.743752 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1740/6112] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:43:13.763067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:13.764016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:13.771648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:13.772291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:13.772828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:13.773816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:13.774481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:13.774913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:13.929864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:13.939174 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0c1d99c-7480-4a54-a25c-c38dffb33905 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1691 microversion: 2.1 time: 0.181349 Oct 04 11:43:13.939976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4373/6113] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:13 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:14.133939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:14.134655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:14.141540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:14.142045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:14.142499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:14.143211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:14.143688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:14.144129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:14.285994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:14.294667 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c76cee3e-b446-4196-8b5a-8460e3d74aa9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.165034 Oct 04 11:43:14.295373 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1741/6114] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:14 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:14.965307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:14.965930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:14.972896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:14.973230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:14.973715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:14.974522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:14.974985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:14.975417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:15.133191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:15.141885 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d763e9cb-ee90-4bdb-b7f2-b38d20dc9027 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1683 microversion: 2.1 time: 0.181368 Oct 04 11:43:15.142495 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4374/6115] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:14 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:15.317944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:15.318635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:15.326098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:15.326592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:15.327039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:15.327748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:15.328219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:15.328659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:15.487714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:15.496465 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2aa9b717-3928-426e-8b87-91f2b12935dc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.181866 Oct 04 11:43:15.497758 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1742/6116] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:15 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:16.520779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:16.522119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:16.530790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:16.531290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:16.531733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:16.532675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:16.533142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:16.533607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:16.672494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:16.676056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:16.681581 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a0462ec4-8442-4ace-abb6-3b041443fbbb tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.164925 Oct 04 11:43:16.682165 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4375/6117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:16 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:17.617051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-992dc206-2518-4388-81ad-0d97127eedfe req-7f6aa3ca-ca90-41e9-8706-ceb8f72ee92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a70b0aa-7eae-418e-a1c1-b01a81c0b910", "name": "network-vif-plugged", "status": "completed", "tag": "319cda41-28a1-4397-90f8-ee8374efc54c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:43:17.629067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-992dc206-2518-4388-81ad-0d97127eedfe req-7f6aa3ca-ca90-41e9-8706-ceb8f72ee92c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:17.629931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-992dc206-2518-4388-81ad-0d97127eedfe req-7f6aa3ca-ca90-41e9-8706-ceb8f72ee92c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:17.630381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-992dc206-2518-4388-81ad-0d97127eedfe req-7f6aa3ca-ca90-41e9-8706-ceb8f72ee92c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:17.643350 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-992dc206-2518-4388-81ad-0d97127eedfe req-7f6aa3ca-ca90-41e9-8706-ceb8f72ee92c service nova] Creating event network-vif-plugged:319cda41-28a1-4397-90f8-ee8374efc54c for instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 on n-h2-791135-8 Oct 04 11:43:17.649135 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-992dc206-2518-4388-81ad-0d97127eedfe req-7f6aa3ca-ca90-41e9-8706-ceb8f72ee92c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035921 Oct 04 11:43:17.649800 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1743/6118] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:43:17.705857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:17.706514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:17.717175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:17.717807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:17.718257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:17.718977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:17.719441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:17.719873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:17.889420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:17.910627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e0f2d52-401c-4831-8ba5-1fbc3f791284 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.209239 Oct 04 11:43:17.911217 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4376/6119] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:17 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:18.936210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:18.937021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:18.943988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:18.944862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:18.945290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:18.945983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:18.946514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:18.947048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:18.950346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:19.101950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:19.111363 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8df62b18-569a-4193-bf80-4798fb22be07 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1266 microversion: 2.1 time: 0.180704 Oct 04 11:43:19.112588 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1744/6120] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:18 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:20.134746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:20.135270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:20.142946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:20.143430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:20.143865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:20.144557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:20.145019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:20.145484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:20.279291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:20.287221 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be2c2196-ad42-4f47-8da5-1f31e7891bd9 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1452 microversion: 2.1 time: 0.156481 Oct 04 11:43:20.287803 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4377/6121] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:20 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:43:20.310160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:43:20.310790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:20.317704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:20.318205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:20.318643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:20.319338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:20.319798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:20.320233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:20.464183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:43:20.472671 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-984af0ef-c5d0-492d-884b-863c18ec4e72 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1452 microversion: 2.1 time: 0.166821 Oct 04 11:43:20.473273 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1745/6122] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:43:20 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:43:22.249559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c437c343-6e31-4950-8a60-be199051fc7e req-2c900736-a63b-4db2-8fd0-ce0744c9589c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a70b0aa-7eae-418e-a1c1-b01a81c0b910", "tag": "319cda41-28a1-4397-90f8-ee8374efc54c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:43:22.264495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c437c343-6e31-4950-8a60-be199051fc7e req-2c900736-a63b-4db2-8fd0-ce0744c9589c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:22.265155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c437c343-6e31-4950-8a60-be199051fc7e req-2c900736-a63b-4db2-8fd0-ce0744c9589c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:22.265833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c437c343-6e31-4950-8a60-be199051fc7e req-2c900736-a63b-4db2-8fd0-ce0744c9589c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:22.278805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c437c343-6e31-4950-8a60-be199051fc7e req-2c900736-a63b-4db2-8fd0-ce0744c9589c service nova] Creating event network-changed:319cda41-28a1-4397-90f8-ee8374efc54c for instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 on n-h2-791135-8 Oct 04 11:43:22.284408 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c437c343-6e31-4950-8a60-be199051fc7e req-2c900736-a63b-4db2-8fd0-ce0744c9589c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039349 Oct 04 11:43:22.285373 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4378/6123] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:43:45.380249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:43:45.382809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:43:45.384918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=23 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:45.385752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=11 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:43:45.392911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:45.393682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:45.394137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:45.394850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:43:45.395414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:43:45.395891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:43:45.472460 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dafc0faa-d647-4b83-a59b-92bf5f011112 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action" status: 200 len: 24575 microversion: 2.1 time: 0.096697 Oct 04 11:43:45.473159 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1746/6124] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:43:45 2022] POST /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df/action => generated 24575 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:44:08.296375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=29 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:08.297141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=14 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:08.301414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:08.302107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:08.308998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:08.309739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:08.310252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:08.311094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:08.311650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:08.312105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:08.443637 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-31d1e85d-35d2-4ec9-a48f-fc82c86d671b tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1834 microversion: 2.1 time: 0.149441 Oct 04 11:44:08.444209 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4379/6125] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:08 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1834 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:09.566693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:09.567298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:09.571824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:09.572109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:09.578960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:09.579471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:09.579922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:09.581031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:09.582192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:09.583380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:09.617440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:44:09.701105 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efbc5ebd-9ea3-4fe1-ae37-0e14e31bad00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "DELETE /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 204 len: 0 microversion: 2.1 time: 0.139429 Oct 04 11:44:09.704845 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1747/6126] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:44:09 2022] DELETE /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:44:09.710440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:09.711162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:09.718155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:09.718870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:09.719319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:09.720034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:09.720519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:09.720935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:09.722315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-20aaa688-2254-4ce9-b5e8-1ec980b8d1e7 req-30007f0a-ce55-45bb-bcd6-c93cb824dddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fa0bd3-d231-4b88-896e-e6d9e047a3df", "tag": "f4103237-3139-4067-a441-ffd00881219f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:44:09.732190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-20aaa688-2254-4ce9-b5e8-1ec980b8d1e7 req-30007f0a-ce55-45bb-bcd6-c93cb824dddb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:09.732674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-20aaa688-2254-4ce9-b5e8-1ec980b8d1e7 req-30007f0a-ce55-45bb-bcd6-c93cb824dddb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:09.733105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-20aaa688-2254-4ce9-b5e8-1ec980b8d1e7 req-30007f0a-ce55-45bb-bcd6-c93cb824dddb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:09.747583 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-20aaa688-2254-4ce9-b5e8-1ec980b8d1e7 req-30007f0a-ce55-45bb-bcd6-c93cb824dddb service nova] Creating event network-changed:f4103237-3139-4067-a441-ffd00881219f for instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df on n-h2-791135-8 Oct 04 11:44:09.753753 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-20aaa688-2254-4ce9-b5e8-1ec980b8d1e7 req-30007f0a-ce55-45bb-bcd6-c93cb824dddb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188677 Oct 04 11:44:09.754373 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4380/6127] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:44:09.865035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:09.873167 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ea00fe4-d92e-403d-a457-8288f358616b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1689 microversion: 2.1 time: 0.166911 Oct 04 11:44:09.873851 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1748/6128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:09 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:44:10.898939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:10.899791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:10.906717 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:10.907211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:10.907651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:10.908358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:10.908818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:10.909278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:11.040220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:11.048620 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d06884a-6ee9-476e-bf88-dcd32176ac00 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1689 microversion: 2.1 time: 0.155006 Oct 04 11:44:11.049193 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4381/6129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:10 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:11.768606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f2dc62e1-9192-40f1-be2a-a7496015b2c0 req-e828d9ce-a324-48f3-ad0f-c71791438e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fa0bd3-d231-4b88-896e-e6d9e047a3df", "name": "network-vif-deleted", "tag": "f4103237-3139-4067-a441-ffd00881219f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:44:11.780090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f2dc62e1-9192-40f1-be2a-a7496015b2c0 req-e828d9ce-a324-48f3-ad0f-c71791438e14 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:11.780594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f2dc62e1-9192-40f1-be2a-a7496015b2c0 req-e828d9ce-a324-48f3-ad0f-c71791438e14 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:11.781043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f2dc62e1-9192-40f1-be2a-a7496015b2c0 req-e828d9ce-a324-48f3-ad0f-c71791438e14 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:11.793972 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f2dc62e1-9192-40f1-be2a-a7496015b2c0 req-e828d9ce-a324-48f3-ad0f-c71791438e14 service nova] Creating event network-vif-deleted:f4103237-3139-4067-a441-ffd00881219f for instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df on n-h2-791135-8 Oct 04 11:44:11.799167 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f2dc62e1-9192-40f1-be2a-a7496015b2c0 req-e828d9ce-a324-48f3-ad0f-c71791438e14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034466 Oct 04 11:44:11.799767 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1749/6130] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:44:12.071917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:12.073301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:12.080435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:12.080934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:12.081435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:12.082147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:12.082602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:12.083148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:12.118250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:12.118743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:12.119210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:12.119660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lazy-loading 'fault' on Instance uuid 64fa0bd3-d231-4b88-896e-e6d9e047a3df {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:44:12.164106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:12.172260 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-795329e3-7651-4c28-b9a4-189570b67c05 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 200 len: 1508 microversion: 2.1 time: 0.104201 Oct 04 11:44:12.172845 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4382/6131] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:12 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 1508 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:13.196856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:13.197607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 64fa0bd3-d231-4b88-896e-e6d9e047a3df] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:13.204006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:13.204503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:13.204954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:13.205683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:13.206182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:13.206644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:13.220181 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] HTTP exception thrown: Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df could not be found. Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Request method failure captured: Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df HTTP/1.1 Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBwCqqNL-i3EZa7z0tpU4Mae_8QnJlkN2Y2XQIbrVHtgJVOxnCjzuIo2R_vuXGYjyDzYD5E1yQ-R0GEbaoxg4lKgRb4lYuCl3yNdqTmruXRq1-kOgP6K2KwEmHUPH-Ov7FVtUeOAnvw8mCpjRInzw-see2wIdHGohbTTl1FO87uNuAc Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 751bf34580b0489bbd182305466ec1dc Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751bf34580b0489bbd182305466ec1dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751bf34580b0489bbd182305466ec1dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751bf34580b0489bbd182305466ec1dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751bf34580b0489bbd182305466ec1dc"}]}] Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 751bf34580b0489bbd182305466ec1dc Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-206792760-project Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: d1ca89dfc38d4097ae85eb1e0bd0302d Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206792760-project Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df could not be found. Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '64fa0bd3-d231-4b88-896e-e6d9e047a3df'} Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df could not be found. Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df could not be found. Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:44:13.221824 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df could not be found. Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Returning 404 to user: Instance 64fa0bd3-d231-4b88-896e-e6d9e047a3df could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33c847a4-23e1-4ff1-a6c5-463302b83334 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df" status: 404 len: 111 microversion: 2.1 time: 0.031461 Oct 04 11:44:13.229945 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1750/6132] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:13 2022] GET /compute/v2.1/servers/64fa0bd3-d231-4b88-896e-e6d9e047a3df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:44:16.215099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4101ffe-d787-42f0-8ce8-dbf2c5532a30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '.version_select at 0x7f71ceea6280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:16.219711 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f4101ffe-d787-42f0-8ce8-dbf2c5532a30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [3ba564bb-cde8-4079-bd63-cad7bb0f661d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 11:44:17.226597 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [None req-f4101ffe-d787-42f0-8ce8-dbf2c5532a30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [3ba564bb-cde8-4079-bd63-cad7bb0f661d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60384. Oct 04 11:44:17.246115 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4101ffe-d787-42f0-8ce8-dbf2c5532a30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-458702892" status: 202 len: 0 microversion: 2.1 time: 1.034885 Oct 04 11:44:17.246691 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4383/6133] 10.222.0.23 () {58 vars in 1281 bytes} [Tue Oct 4 11:44:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-458702892 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:44:17.282783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7fcd13d8-a88a-4b50-9ddc-0ec7a557a1fe tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'create', calling method: .version_select at 0x7f71cfe4c700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1005104616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL6RdhmA5gnYw6sOJ4Qf63kldhHyEY8L82c0Ls1BcoRqeJtu0yEm1DMD4S2yXe6bU+rsyhseebzKJ2yUG/gzYPtFWm6HHAWUBPfx2CG8a6EEbjOcTbpLHGbJhhgirGdxg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:44:17.298694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7fcd13d8-a88a-4b50-9ddc-0ec7a557a1fe tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for project 751bf34580b0489bbd182305466ec1dc. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:44:17.304828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7fcd13d8-a88a-4b50-9ddc-0ec7a557a1fe tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for user d1ca89dfc38d4097ae85eb1e0bd0302d and project 751bf34580b0489bbd182305466ec1dc. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:44:17.328217 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7fcd13d8-a88a-4b50-9ddc-0ec7a557a1fe tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049664 Oct 04 11:44:17.328800 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1751/6134] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:44:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:44:22.843968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=22 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:22.848459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-168907948", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "8db276ad-7113-4dae-9095-5a0a796bd756"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1005104616", "security_groups": [{"name": "tempest-secgroup-smoke-1452872716"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:44:23.132388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] validate_networks() for [('8db276ad-7113-4dae-9095-5a0a796bd756', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:44:23.922950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:44:23.923575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:44:23.923828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:44:23.924264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:44:23.925555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:44:23.934987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:23.935472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:23.935908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:23.936626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:23.937076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:23.937537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:23.955101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for project 751bf34580b0489bbd182305466ec1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:44:23.960319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for user d1ca89dfc38d4097ae85eb1e0bd0302d and project 751bf34580b0489bbd182305466ec1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:44:23.975354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:44:23.977736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:44:24.026158 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9666c718-98dd-4488-8ff7-ce18df231d95 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.188906 Oct 04 11:44:24.026980 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4384/6135] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:44:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:44:24.036116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:24.043621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6042483-5fb7-4142-833e-577d629f59b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:24.044519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6042483-5fb7-4142-833e-577d629f59b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:24.108808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6042483-5fb7-4142-833e-577d629f59b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:24.115849 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6042483-5fb7-4142-833e-577d629f59b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1266 microversion: 2.1 time: 0.081630 Oct 04 11:44:24.116423 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1752/6136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:24 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:25.142737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:25.144110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:25.154513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:25.155670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:25.156385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:25.157595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:25.158304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:25.158962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:25.242622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:25.255074 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b0705e2d-f7bc-4262-a872-ceba54a7b719 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1336 microversion: 2.1 time: 0.117494 Oct 04 11:44:25.255880 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4385/6137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:25 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:44:26.279773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:26.280491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:26.288270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:26.288942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:26.289421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:26.290139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:26.290804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:26.291248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:26.511837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:26.519629 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-be6dd06c-9a0c-4740-a913-b2eac9a136e9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1392 microversion: 2.1 time: 0.244387 Oct 04 11:44:26.520420 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1753/6138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:26 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:26.765023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4f872f7b-6a0f-46bb-a7b0-38e909814212 req-9757dc5e-452a-46e7-820c-7819b2ccda43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:44:26.774608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4f872f7b-6a0f-46bb-a7b0-38e909814212 req-9757dc5e-452a-46e7-820c-7819b2ccda43 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:26.775090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4f872f7b-6a0f-46bb-a7b0-38e909814212 req-9757dc5e-452a-46e7-820c-7819b2ccda43 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:26.775520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4f872f7b-6a0f-46bb-a7b0-38e909814212 req-9757dc5e-452a-46e7-820c-7819b2ccda43 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:26.787074 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4f872f7b-6a0f-46bb-a7b0-38e909814212 req-9757dc5e-452a-46e7-820c-7819b2ccda43 service nova] Creating event network-changed:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h1-791135-8 Oct 04 11:44:26.792051 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4f872f7b-6a0f-46bb-a7b0-38e909814212 req-9757dc5e-452a-46e7-820c-7819b2ccda43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098174 Oct 04 11:44:26.792658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4386/6139] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:44:27.543451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:27.544120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:27.550851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:27.551351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:27.551803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:27.552517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:27.552988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:27.553583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:27.697133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:27.705433 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-441def35-fc27-4e43-9d86-e9239019bfb6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1392 microversion: 2.1 time: 0.166461 Oct 04 11:44:27.706043 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1754/6140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:27 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:28.730172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:28.730794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:28.737036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:28.737555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:28.737993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:28.738685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:28.739141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:28.739571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:28.875658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:28.883596 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4dab185a-41d5-47e6-8e8a-762463ce938f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1392 microversion: 2.1 time: 0.159205 Oct 04 11:44:28.884187 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4387/6141] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:28 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:29.906915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:29.907517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:29.914180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:29.914675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:29.915181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:29.915887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:29.916933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:29.917395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:30.050561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:30.058385 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c876b487-8e51-4b37-8944-c458140970cc tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1392 microversion: 2.1 time: 0.155334 Oct 04 11:44:30.058958 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1755/6142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:29 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:30.499542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-922fb248-7d52-4d07-a097-dd23bd78f5f2 req-9d80bdd1-34b1-415c-aa2f-e31ca77e2695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "name": "network-vif-plugged", "status": "completed", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:44:30.511240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-922fb248-7d52-4d07-a097-dd23bd78f5f2 req-9d80bdd1-34b1-415c-aa2f-e31ca77e2695 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:30.512434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-922fb248-7d52-4d07-a097-dd23bd78f5f2 req-9d80bdd1-34b1-415c-aa2f-e31ca77e2695 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:30.512876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-922fb248-7d52-4d07-a097-dd23bd78f5f2 req-9d80bdd1-34b1-415c-aa2f-e31ca77e2695 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:30.524338 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-922fb248-7d52-4d07-a097-dd23bd78f5f2 req-9d80bdd1-34b1-415c-aa2f-e31ca77e2695 service nova] Creating event network-vif-plugged:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h1-791135-8 Oct 04 11:44:30.529124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-922fb248-7d52-4d07-a097-dd23bd78f5f2 req-9d80bdd1-34b1-415c-aa2f-e31ca77e2695 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033293 Oct 04 11:44:30.529750 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4388/6143] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:44:31.081634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:31.082323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:31.089673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:31.090167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:31.090610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:31.091312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:31.091778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:31.092214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:31.252527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:31.260240 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-741d374a-95e7-4dce-b2b8-15fefaf4e5b6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1392 microversion: 2.1 time: 0.182501 Oct 04 11:44:31.260830 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1756/6144] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:31 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:32.283371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:32.284017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:32.291738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:32.292222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:32.292659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:32.293371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:32.293836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:32.294263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:32.424974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:32.433492 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70beab3e-f41e-40e7-879f-c1785e2d19e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1564 microversion: 2.1 time: 0.154491 Oct 04 11:44:32.434074 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4389/6145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:32 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:32.455289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:32.455922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:32.462529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:32.463028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:32.463476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:32.464188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:32.464713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:32.465129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:32.596862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:32.605175 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b350668-2704-4206-951b-b18f68d8d3f5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1564 microversion: 2.1 time: 0.153715 Oct 04 11:44:32.605778 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1757/6146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:32 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:34.238570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:44:34.239195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:34.241761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:34.242448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:34.242715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-373dd088-2eca-4071-84e3-2828705f8c7d req-6caf1c4b-d9bc-4d1c-a4f2-367092fb8385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:44:34.251353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:34.257440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-373dd088-2eca-4071-84e3-2828705f8c7d req-6caf1c4b-d9bc-4d1c-a4f2-367092fb8385 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:34.258428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-373dd088-2eca-4071-84e3-2828705f8c7d req-6caf1c4b-d9bc-4d1c-a4f2-367092fb8385 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:34.259209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-373dd088-2eca-4071-84e3-2828705f8c7d req-6caf1c4b-d9bc-4d1c-a4f2-367092fb8385 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:34.259485 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:34.260664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:34.261196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:34.262024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:34.262556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:34.263208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:34.277036 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-373dd088-2eca-4071-84e3-2828705f8c7d req-6caf1c4b-d9bc-4d1c-a4f2-367092fb8385 service nova] Creating event network-changed:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h1-791135-8 Oct 04 11:44:34.284139 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-373dd088-2eca-4071-84e3-2828705f8c7d req-6caf1c4b-d9bc-4d1c-a4f2-367092fb8385 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045355 Oct 04 11:44:34.286204 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1758/6147] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:44:34.429421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:44:34.440453 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-38d68ec0-ef7c-47ef-9ccf-1954b0a0d1ca tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1564 microversion: 2.1 time: 0.205823 Oct 04 11:44:34.441061 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4390/6148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:44:34 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1564 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:44:55.753561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:55.754402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:44:55.758935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:44:55.761317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:44:55.769067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:55.769594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:55.770069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:55.770792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:44:55.771257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:44:55.771698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:44:55.829457 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5d178b6-672a-4e7a-8921-f93934f116d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action" status: 200 len: 24567 microversion: 2.1 time: 0.078017 Oct 04 11:44:55.830063 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1759/6149] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:44:55 2022] POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action => generated 24567 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:45:06.871129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:06.871704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:06.874229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:06.874981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=30 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:06.882025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:06.882507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:06.882938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:06.883622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:06.884072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:06.884495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:07.014071 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6007f6d0-6d29-48a9-91c2-88bd8b393dcb tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1834 microversion: 2.1 time: 0.147073 Oct 04 11:45:07.014650 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4391/6150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:06 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1834 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:07.037125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:07.037873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:07.040514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:07.041197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:07.047802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:07.048298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:07.048743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:07.049466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:07.049938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:07.050376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:07.181338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:07.189891 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ca90329b-94e3-47af-9db2-1d997760c9b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1683 microversion: 2.1 time: 0.157058 Oct 04 11:45:07.190452 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1760/6151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:07 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:07.294031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:07.296258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:07.302403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:07.302896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:07.303338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:07.304037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:07.304496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:07.304925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:07.356434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b96f5f28-2fda-4675-9b5e-3ca1bd043a39 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action" status: 200 len: 32634 microversion: 2.1 time: 0.066272 Oct 04 11:45:07.357285 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4392/6152] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:45:07 2022] POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action => generated 32634 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:45:07.515788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:07.516383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:07.522891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:07.523380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:07.523819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:07.524512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:07.524968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:07.525423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:07.657431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5db9c21afff94d0cbebc187874256c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2725ff8b806461984f60a08b12ccbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:07.658054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] flavor_id is None. Assuming migration. {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 11:45:07.658500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:45:07.816292 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [035c307e-6fc7-432e-b1fc-71b35a66877d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 11:45:08.824387 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [035c307e-6fc7-432e-b1fc-71b35a66877d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60510. Oct 04 11:45:08.827601 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8a9a43f-1101-45bc-b5aa-e58b9d0a0daa tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action" status: 202 len: 0 microversion: 2.1 time: 1.315658 Oct 04 11:45:08.828217 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1761/6153] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:45:07 2022] POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action => generated 0 bytes in 1317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:45:08.837091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:08.837818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:08.846325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:08.846825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:08.847269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:08.848004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:08.848473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:08.848890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:09.023206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:09.032125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1584d601-c2f1-4317-8028-d968327f764a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1692 microversion: 2.1 time: 0.199127 Oct 04 11:45:09.032900 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4393/6154] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:08 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:10.059884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:10.060515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:10.067550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:10.068048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:10.068504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:10.069216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:10.069725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:10.070167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:10.208035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:10.217331 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b919432-be1b-476f-96df-77d0fcee98c2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1692 microversion: 2.1 time: 0.162655 Oct 04 11:45:10.217941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1762/6155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:10 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:11.240114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:11.240732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:11.249040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:11.249557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:11.250002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:11.250698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:11.251158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:11.251585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:11.384693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:11.392398 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7fef7149-0b9e-4313-a9ad-a09ccdf9fab3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.156252 Oct 04 11:45:11.392964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4394/6156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:11 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:12.415742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:12.416943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:12.423742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:12.424230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:12.424673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:12.425389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:12.425843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:12.426272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:12.559398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:12.567142 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f72bb5cb-6eec-4c76-a245-0b0a6c2e4fdb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.155400 Oct 04 11:45:12.567709 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1763/6157] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:12 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:13.590243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:13.590856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:13.597672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:13.598156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:13.598595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:13.599288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:13.599742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:13.600187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:13.732750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:13.740441 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a9f7315-4eab-4b30-8e5d-a410229b6956 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.154122 Oct 04 11:45:13.741018 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4395/6158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:13 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:14.765227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:14.765890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:14.772764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:14.773258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:14.773738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:14.774441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:14.774910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:14.775349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:14.904263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:14.912049 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ddb1737-d1ae-4a09-8789-bc12294fc5c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.150761 Oct 04 11:45:14.912627 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1764/6159] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:14 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:15.935604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:15.936218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:15.943047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:15.943527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:15.943959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:15.944647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:15.945103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:15.945561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:16.079999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:16.087601 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e4d0dee-bb0d-43f8-ab6f-bfbf46e46281 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.155888 Oct 04 11:45:16.088176 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4396/6160] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:15 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:17.110915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:17.111548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:17.118573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:17.119070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:17.120023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:17.120727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:17.121196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:17.121663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:17.254132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:17.261822 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e689637a-35b6-4a86-80ef-f695bc51d0dd tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.154849 Oct 04 11:45:17.262384 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1765/6161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:17 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:45:17.413977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:17.414522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:17.421975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:17.422461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:17.422911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:17.423594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:17.424045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:17.424463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:17.449738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:45:17.523873 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0380c78c-fee8-4d4f-8ae4-46ca875f7e87 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 204 len: 0 microversion: 2.1 time: 0.113520 Oct 04 11:45:17.524476 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4397/6162] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:45:17 2022] DELETE /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:45:17.535122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:17.536037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:17.541966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:17.543101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:17.543546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:17.544238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:17.544698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:17.545128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:17.679682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:17.688369 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a696f3e5-3163-404e-90bd-f04b8a1b50c4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1577 microversion: 2.1 time: 0.158159 Oct 04 11:45:17.689073 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1766/6163] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:17 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:18.285207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:18.285948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:18.292040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:18.292556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:18.292993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:18.293716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:18.294174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:18.294601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:18.425553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:18.433770 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-653a574f-ff68-4a40-804e-0e83122fd125 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.152297 Oct 04 11:45:18.434347 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4398/6164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:18 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:18.711523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:18.712136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:18.719836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:18.720323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:18.720764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:18.721484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:18.722028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:18.722547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:18.852158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:18.860644 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f4fbb1b7-3c84-4d7b-bb7a-75c93a100fea tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1577 microversion: 2.1 time: 0.153004 Oct 04 11:45:18.861434 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1767/6165] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:18 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:19.457396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:19.458162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:19.466031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:19.466523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:19.466985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:19.467677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:19.468139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:19.468763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:19.611468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:19.619263 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71f7a84f-ddc5-43de-817c-153fd7c3a387 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.165840 Oct 04 11:45:19.619844 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4399/6166] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:19 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:19.884633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:19.885215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:19.892418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:19.892908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:19.893369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:19.894075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:19.894534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:19.894966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:19.992761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:20.001317 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c010cf58-fa32-4de9-acd6-f293cb7abc64 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1509 microversion: 2.1 time: 0.120703 Oct 04 11:45:20.002204 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1768/6167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:19 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1509 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:20.255872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-659bfb22-9ddc-4160-b64d-60cda0d81a3d req-41b88fc1-3f37-4371-b789-fa3931e6275b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a70b0aa-7eae-418e-a1c1-b01a81c0b910", "name": "network-vif-deleted", "tag": "319cda41-28a1-4397-90f8-ee8374efc54c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:20.270492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-659bfb22-9ddc-4160-b64d-60cda0d81a3d req-41b88fc1-3f37-4371-b789-fa3931e6275b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:20.272483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-659bfb22-9ddc-4160-b64d-60cda0d81a3d req-41b88fc1-3f37-4371-b789-fa3931e6275b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:20.273267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-659bfb22-9ddc-4160-b64d-60cda0d81a3d req-41b88fc1-3f37-4371-b789-fa3931e6275b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:20.285420 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-659bfb22-9ddc-4160-b64d-60cda0d81a3d req-41b88fc1-3f37-4371-b789-fa3931e6275b service nova] Creating event network-vif-deleted:319cda41-28a1-4397-90f8-ee8374efc54c for instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 on n-h2-791135-8 Oct 04 11:45:20.296480 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-659bfb22-9ddc-4160-b64d-60cda0d81a3d req-41b88fc1-3f37-4371-b789-fa3931e6275b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044591 Oct 04 11:45:20.297416 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4400/6168] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:45:20.642818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:20.643442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:20.649570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:20.650073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:20.650521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:20.651230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:20.652309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:20.652754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:20.787735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:20.796324 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-92fc6f90-22a8-4b01-acc4-76ce0a3583ce tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.157246 Oct 04 11:45:20.796919 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1769/6169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:20 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:21.027585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:21.028532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:21.035150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:21.035680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:21.036268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:21.037160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:21.037655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:21.038086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:21.108855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:21.117135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3b45c02-d1f3-4222-a80d-76e9801f917a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1225 microversion: 2.1 time: 0.095889 Oct 04 11:45:21.117751 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4401/6170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:21 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:21.819799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:21.820376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:21.827195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:21.827690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:21.828139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:21.828857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:21.829313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:21.829783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:21.973434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:21.981915 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3694fc12-a7e8-4fe8-9996-8d8e91917929 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1697 microversion: 2.1 time: 0.166160 Oct 04 11:45:21.982504 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1770/6171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:21 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:22.140609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:22.141313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:22.148335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:22.148895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:22.149422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:22.150179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:22.150723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:22.151218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:22.215114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:22.223052 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf2e5271-f7b3-4c50-9524-1c5dff43c8bf tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1225 microversion: 2.1 time: 0.086409 Oct 04 11:45:22.223678 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4402/6172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:22 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:23.006173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:23.007006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:23.015027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:23.015663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:23.016229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:23.017039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:23.017625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:23.018153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:23.247014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:23.248416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:23.256899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:23.257487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:23.258074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:23.259007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:23.259562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:23.260642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:23.303964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:23.313815 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7f9bfbc-e8e2-4783-881b-720a6029858b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1696 microversion: 2.1 time: 0.311720 Oct 04 11:45:23.314557 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1771/6173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:23 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1696 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:45:23.327905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:23.337875 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-62b92ee4-ed81-4020-b3eb-174d55b7bfa0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1225 microversion: 2.1 time: 0.095123 Oct 04 11:45:23.338469 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4403/6174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:23 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:23.356660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9cdf51da-1acb-4d68-805d-aad21b0ac9be req-b3685946-960b-4f21-ab6a-03d0afed5e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "name": "network-vif-unplugged", "status": "completed", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:23.367284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9cdf51da-1acb-4d68-805d-aad21b0ac9be req-b3685946-960b-4f21-ab6a-03d0afed5e1e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:23.367851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9cdf51da-1acb-4d68-805d-aad21b0ac9be req-b3685946-960b-4f21-ab6a-03d0afed5e1e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:23.368491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9cdf51da-1acb-4d68-805d-aad21b0ac9be req-b3685946-960b-4f21-ab6a-03d0afed5e1e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:23.384930 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9cdf51da-1acb-4d68-805d-aad21b0ac9be req-b3685946-960b-4f21-ab6a-03d0afed5e1e service nova] Creating event network-vif-unplugged:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h2-791135-8 Oct 04 11:45:23.390618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-9cdf51da-1acb-4d68-805d-aad21b0ac9be req-b3685946-960b-4f21-ab6a-03d0afed5e1e service nova] Instance 0559682f-a54a-404b-8298-6bb2b0687347 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:45:23.402220 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9cdf51da-1acb-4d68-805d-aad21b0ac9be req-b3685946-960b-4f21-ab6a-03d0afed5e1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052298 Oct 04 11:45:23.403346 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1772/6175] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:45:24.338676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:24.339860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:24.347290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:24.348573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:24.349093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:24.350028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:24.350493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:24.351165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:24.363831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:24.364717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:24.375943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:24.376997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:24.377622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:24.378583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:24.379228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:24.379882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:24.472030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:24.481259 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15f90471-5892-4ebe-b217-5d40fc944cd6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1225 microversion: 2.1 time: 0.122073 Oct 04 11:45:24.492501 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1773/6176] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:24 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:45:24.530441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:24.538386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5c2cc30-52af-422d-ba59-1e3d552f2533 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1696 microversion: 2.1 time: 0.204049 Oct 04 11:45:24.538965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4404/6177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:24 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:25.444120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-6f6083c4-b03c-4115-81bc-1d320d3260be req-89ff0a3d-3680-44b4-8ffb-5b31f27bc134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:25.454786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f6083c4-b03c-4115-81bc-1d320d3260be req-89ff0a3d-3680-44b4-8ffb-5b31f27bc134 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:25.455292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f6083c4-b03c-4115-81bc-1d320d3260be req-89ff0a3d-3680-44b4-8ffb-5b31f27bc134 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:25.455717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-6f6083c4-b03c-4115-81bc-1d320d3260be req-89ff0a3d-3680-44b4-8ffb-5b31f27bc134 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:25.467251 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-6f6083c4-b03c-4115-81bc-1d320d3260be req-89ff0a3d-3680-44b4-8ffb-5b31f27bc134 service nova] Creating event network-changed:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h2-791135-8 Oct 04 11:45:25.472456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-6f6083c4-b03c-4115-81bc-1d320d3260be req-89ff0a3d-3680-44b4-8ffb-5b31f27bc134 service nova] Instance 0559682f-a54a-404b-8298-6bb2b0687347 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:45:25.483456 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-6f6083c4-b03c-4115-81bc-1d320d3260be req-89ff0a3d-3680-44b4-8ffb-5b31f27bc134 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043055 Oct 04 11:45:25.484102 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1774/6178] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:45:25.504361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:25.505583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:25.512623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:25.513113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:25.513588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:25.514293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:25.514754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:25.515187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:25.550655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:25.550655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:25.550655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:25.550655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lazy-loading 'fault' on Instance uuid 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:45:25.563481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:25.564571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:25.572702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:25.573000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:25.573482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:25.574485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:25.574949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:25.575380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:25.590424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:25.595991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:25.598586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0a4c9541-da7f-44a1-966e-f5cc4a329dae tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1230 microversion: 2.1 time: 0.098414 Oct 04 11:45:25.599372 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4405/6179] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:25 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:25.794308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:25.802013 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90952c19-1168-485a-9d94-caee1ddd8201 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1694 microversion: 2.1 time: 0.242769 Oct 04 11:45:25.802586 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1775/6180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:25 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1694 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:26.623150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:26.623803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:26.630912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:26.631390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:26.631821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:26.632507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:26.632958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:26.633401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:26.652614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:26.701187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:26.701187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:26.701187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:26.701187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lazy-loading 'fault' on Instance uuid 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:45:26.714556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:26.722407 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-39c082b2-d6a5-4993-a446-9b594c411045 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 200 len: 1230 microversion: 2.1 time: 0.103642 Oct 04 11:45:26.722988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4406/6181] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:26 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:26.826821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:26.827730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:26.834152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:26.834638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:26.835078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:26.835767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:26.836226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:26.836711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:26.967462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:26.975834 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6bd16c2-7423-4aa5-9308-912c1d78025f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1694 microversion: 2.1 time: 0.153551 Oct 04 11:45:26.976403 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1776/6182] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:26 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:27.744826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:27.745581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:27.752913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:27.753538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:27.754055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:27.754834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:27.755301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:27.755730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:27.772447 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 HTTP/1.1 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '3a70b0aa-7eae-418e-a1c1-b01a81c0b910'} Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:45:27.774158 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-845b893b-e37d-4ce4-b363-b525f2937d4c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 404 len: 111 microversion: 2.1 time: 0.034698 Oct 04 11:45:27.787370 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4407/6183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:27 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:45:27.875846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1068314822", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153425603", "security_groups": [{"name": "tempest-secgroup-smoke-1385016960"}], "block_device_mapping_v2": [{"uuid": "f1911168-797e-4e0f-8892-85972b0554b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abb967bf-38d8-4c74-bd84-4e529507054d"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:27.989851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] validate_networks() for [('abb967bf-38d8-4c74-bd84-4e529507054d', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:45:28.000505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:28.001527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:28.008073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:28.008647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:28.009170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:28.009972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:28.010508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:28.011063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:28.155284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:28.163367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a92918e3-012d-4252-bf69-6e441239a1d9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1691 microversion: 2.1 time: 0.167274 Oct 04 11:45:28.164471 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4408/6184] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:27 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:45:28.186738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:28.187278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:28.193406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:28.193908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:28.194352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:28.195059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:28.195690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:28.196126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:28.311411 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8c02de7e-f560-438d-b6eb-347a37e0dc9d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action" status: 202 len: 0 microversion: 2.1 time: 0.128988 Oct 04 11:45:28.312569 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4409/6185] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:45:28 2022] POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:45:28.321569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:28.322413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:28.330540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:28.331301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:28.332035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:28.333148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:28.333890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:28.334801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:28.482052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:45:28.482570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:45:28.483165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:45:28.483659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:45:28.484158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:45:28.493783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:28.494284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:28.494793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:28.495477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:28.495944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:28.496383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:28.496599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:28.505800 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-acef0121-1263-4cf2-8491-d5f874bcaa7a tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1690 microversion: 2.1 time: 0.188862 Oct 04 11:45:28.506393 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4410/6186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:28 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:45:28.518185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:45:28.523538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:45:28.583983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:45:28.586266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1911168-797e-4e0f-8892-85972b0554b3',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:45:28.724210 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fd088c39-a3cd-44f0-9252-4e8b11f8319e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.852184 Oct 04 11:45:28.725205 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1777/6187] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:45:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:45:28.737446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-104325f1-8d92-4ae2-abd9-59d5b7648e86 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:28.737607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-104325f1-8d92-4ae2-abd9-59d5b7648e86 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:28.796260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-104325f1-8d92-4ae2-abd9-59d5b7648e86 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:28.803240 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-104325f1-8d92-4ae2-abd9-59d5b7648e86 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1094 microversion: 2.1 time: 0.070099 Oct 04 11:45:28.810888 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4411/6188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:28 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:29.528347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:29.528973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:29.536081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:29.536580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:29.537031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:29.537773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:29.538242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:29.538687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:29.674260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:29.682203 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2edaed53-3f7d-49ce-853e-2b42b55d53a5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1690 microversion: 2.1 time: 0.157825 Oct 04 11:45:29.682774 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1778/6189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:29 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:29.827487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:29.828012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:29.835583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:29.836061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:29.836519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:29.837203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:29.837681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:29.838105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:29.902500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:29.910477 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1f2bcf48-5629-4f73-8d98-f2e18f2fe7ab tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1144 microversion: 2.1 time: 0.087517 Oct 04 11:45:29.911049 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4412/6190] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:29 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:30.326239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-3d377196-c5c3-4577-8e4e-e6a3df70ab89 req-414ef9bb-0953-4d6b-87f9-5280ff54b027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "name": "network-vif-plugged", "status": "completed", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:30.336684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d377196-c5c3-4577-8e4e-e6a3df70ab89 req-414ef9bb-0953-4d6b-87f9-5280ff54b027 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:30.337598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d377196-c5c3-4577-8e4e-e6a3df70ab89 req-414ef9bb-0953-4d6b-87f9-5280ff54b027 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:30.338758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-3d377196-c5c3-4577-8e4e-e6a3df70ab89 req-414ef9bb-0953-4d6b-87f9-5280ff54b027 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:30.354712 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-3d377196-c5c3-4577-8e4e-e6a3df70ab89 req-414ef9bb-0953-4d6b-87f9-5280ff54b027 service nova] Creating event network-vif-plugged:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h2-791135-8 Oct 04 11:45:30.361027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-3d377196-c5c3-4577-8e4e-e6a3df70ab89 req-414ef9bb-0953-4d6b-87f9-5280ff54b027 service nova] Instance 0559682f-a54a-404b-8298-6bb2b0687347 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:45:30.372278 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-3d377196-c5c3-4577-8e4e-e6a3df70ab89 req-414ef9bb-0953-4d6b-87f9-5280ff54b027 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049621 Oct 04 11:45:30.373132 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1779/6191] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:45:30.706505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:30.707121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:30.713291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:30.713834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:30.714262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:30.714958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:30.715453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:30.716497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:30.847477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:30.855253 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5799674c-1836-4c7f-8852-7e8a23612505 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1690 microversion: 2.1 time: 0.152944 Oct 04 11:45:30.855834 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4413/6192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:30 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:30.934996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:30.935702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:30.941884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:30.942376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:30.942823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:30.943520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:30.943990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:30.944427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:31.014380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:31.025870 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e809c8e4-19d1-4d90-98af-0eabe75ebe7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1192 microversion: 2.1 time: 0.094965 Oct 04 11:45:31.026805 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1780/6193] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:30 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:31.878800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:31.879603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:31.887501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:31.888092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:31.888596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:31.889392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:31.889945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:31.890436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:32.033606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:32.050819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:32.051449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:32.060562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:32.063229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:32.063960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:32.064885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:32.065564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:32.066157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:32.066332 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8db797c-ba40-48a2-9001-f259333af2e6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1690 microversion: 2.1 time: 0.190649 Oct 04 11:45:32.082775 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4414/6194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:31 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:32.209881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:32.220839 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-205c44a7-2f92-4564-9837-ba0148b7769c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1210 microversion: 2.1 time: 0.173882 Oct 04 11:45:32.225982 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1781/6195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:32 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1210 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:32.803312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-74694425-2395-4f57-8494-56d5ed6d93ae req-eba09d9a-ffa5-4965-91f7-bc4f2f28a72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "name": "network-vif-unplugged", "status": "completed", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:32.815079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-74694425-2395-4f57-8494-56d5ed6d93ae req-eba09d9a-ffa5-4965-91f7-bc4f2f28a72b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:32.815613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-74694425-2395-4f57-8494-56d5ed6d93ae req-eba09d9a-ffa5-4965-91f7-bc4f2f28a72b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:32.816044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-74694425-2395-4f57-8494-56d5ed6d93ae req-eba09d9a-ffa5-4965-91f7-bc4f2f28a72b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:32.829288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-74694425-2395-4f57-8494-56d5ed6d93ae req-eba09d9a-ffa5-4965-91f7-bc4f2f28a72b service nova] Creating event network-vif-unplugged:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h1-791135-8 Oct 04 11:45:32.835404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-74694425-2395-4f57-8494-56d5ed6d93ae req-eba09d9a-ffa5-4965-91f7-bc4f2f28a72b service nova] Instance 0559682f-a54a-404b-8298-6bb2b0687347 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:45:32.847840 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-74694425-2395-4f57-8494-56d5ed6d93ae req-eba09d9a-ffa5-4965-91f7-bc4f2f28a72b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048978 Oct 04 11:45:32.848553 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4415/6196] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:45:33.093097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:33.093764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:33.101592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:33.102306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:33.102974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:33.103902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:33.104590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:33.105670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:33.250055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:33.250854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:33.257689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:33.258308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:33.258849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:33.259667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:33.260334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:33.260960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:33.411408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:33.421518 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ea0f67ae-1ae6-419e-814d-8366f4bfb158 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1278 microversion: 2.1 time: 0.176572 Oct 04 11:45:33.423305 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4416/6197] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:33 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:33.443543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:33.451727 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc82e318-23e1-4c4d-beee-e5cdeb03ba2f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1690 microversion: 2.1 time: 0.362415 Oct 04 11:45:33.452601 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1782/6198] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:33 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1690 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:34.445877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:34.446919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:34.455199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:34.455913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:34.457125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:34.457877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:34.458344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:34.458779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:34.476258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:34.477010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:34.491418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:34.491862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:34.492311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:34.493063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:34.497267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:34.497681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:34.647535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:34.659174 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8a081a1-0ade-46cd-b077-cac2132daa37 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1278 microversion: 2.1 time: 0.217361 Oct 04 11:45:34.677382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4417/6199] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:34 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1278 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:34.913673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-885ce27c-66f0-4659-aa95-49c49ec5002f req-e02fd81b-edc9-40dd-a8ad-bfa2e654036c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}, {"name": "network-changed", "server_uuid": "fee68849-1cf6-4f88-95dc-901afbf47b38", "tag": "576adb7d-76a8-40ad-adaa-585e54e20a3b"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:34.926133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-885ce27c-66f0-4659-aa95-49c49ec5002f req-e02fd81b-edc9-40dd-a8ad-bfa2e654036c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:34.926827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-885ce27c-66f0-4659-aa95-49c49ec5002f req-e02fd81b-edc9-40dd-a8ad-bfa2e654036c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:34.927405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-885ce27c-66f0-4659-aa95-49c49ec5002f req-e02fd81b-edc9-40dd-a8ad-bfa2e654036c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:34.946183 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-885ce27c-66f0-4659-aa95-49c49ec5002f req-e02fd81b-edc9-40dd-a8ad-bfa2e654036c service nova] Creating event network-changed:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h1-791135-8 Oct 04 11:45:34.947138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-885ce27c-66f0-4659-aa95-49c49ec5002f req-e02fd81b-edc9-40dd-a8ad-bfa2e654036c service nova] Creating event network-changed:576adb7d-76a8-40ad-adaa-585e54e20a3b for instance fee68849-1cf6-4f88-95dc-901afbf47b38 on n-h2-791135-8 Oct 04 11:45:34.952937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-885ce27c-66f0-4659-aa95-49c49ec5002f req-e02fd81b-edc9-40dd-a8ad-bfa2e654036c service nova] Instance 0559682f-a54a-404b-8298-6bb2b0687347 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:45:34.967589 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-885ce27c-66f0-4659-aa95-49c49ec5002f req-e02fd81b-edc9-40dd-a8ad-bfa2e654036c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058027 Oct 04 11:45:34.968379 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4418/6200] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:45:35.047525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:35.056148 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74c2e5ab-9c38-4a66-a610-08e65978faf7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1690 microversion: 2.1 time: 0.583781 Oct 04 11:45:35.062846 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1783/6201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:34 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1690 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:45:35.685191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:35.685851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:35.693508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:35.694000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:35.694440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:35.695141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:35.695595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:35.696025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:35.917004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:35.925837 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9021bd90-08c9-4a76-9292-f96dc875281a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1278 microversion: 2.1 time: 0.245319 Oct 04 11:45:35.926597 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4419/6202] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:35 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:36.079441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:36.080682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:36.089128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:36.089894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:36.090595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:36.091529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:36.092205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:36.092854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:36.314137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:36.322126 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-77807f37-ffbb-4eb2-a575-8379b3f53292 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1690 microversion: 2.1 time: 0.246632 Oct 04 11:45:36.322699 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1784/6203] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:36 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1690 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:36.948644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:36.949251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:36.952095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:36.957520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:36.958010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:36.958445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:36.959142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:36.959591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:36.960022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:37.095722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:37.103657 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49008193-18c3-4f5c-929a-e29b2cbf481c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.158912 Oct 04 11:45:37.104438 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4420/6204] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:36 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:37.345876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:37.346429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:37.349229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:37.354789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:37.355283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:37.355727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:37.356427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:37.356892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:37.357328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:37.490381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:37.497998 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33dea96c-6737-48ca-8371-7556bf46953f tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1683 microversion: 2.1 time: 0.156104 Oct 04 11:45:37.498578 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1785/6205] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:37 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:38.127896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:38.128624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:38.135670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:38.136151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:38.136777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:38.138085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:38.138541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:38.138964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:38.268535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:38.276286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96dbf807-4e29-4e41-8dbb-ddd00e6cb5fe tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.153041 Oct 04 11:45:38.276854 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4421/6206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:38 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:45:39.300178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:39.300877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:39.303533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:39.304200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:39.310162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:39.310642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:39.311082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:39.311773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:39.312232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:39.312693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:39.446454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:39.454265 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5973ab9-c76c-48dd-97ea-fc88fcc88f8e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.157906 Oct 04 11:45:39.454834 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1786/6207] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:39 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:40.477404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:40.478018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:40.480044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:40.486311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:40.486795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:40.487227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:40.487969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:40.488468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:40.488940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:40.623212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:40.631596 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bfb0280f-f43b-423c-8a36-7be6f0462f74 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.158153 Oct 04 11:45:40.632262 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4422/6208] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:40 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:40.810412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b2a3d934-c290-460c-ae35-95b1b89c7e1d req-0146b220-274f-4d04-8d94-29a39f735bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "name": "network-vif-plugged", "status": "completed", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:40.821069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b2a3d934-c290-460c-ae35-95b1b89c7e1d req-0146b220-274f-4d04-8d94-29a39f735bc2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:40.821726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b2a3d934-c290-460c-ae35-95b1b89c7e1d req-0146b220-274f-4d04-8d94-29a39f735bc2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:40.822436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b2a3d934-c290-460c-ae35-95b1b89c7e1d req-0146b220-274f-4d04-8d94-29a39f735bc2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:40.834575 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b2a3d934-c290-460c-ae35-95b1b89c7e1d req-0146b220-274f-4d04-8d94-29a39f735bc2 service nova] Creating event network-vif-plugged:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h1-791135-8 Oct 04 11:45:40.839700 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b2a3d934-c290-460c-ae35-95b1b89c7e1d req-0146b220-274f-4d04-8d94-29a39f735bc2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Oct 04 11:45:40.840296 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1787/6209] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:45:41.656913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:41.657637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:41.664548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:41.665039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:41.665506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:41.666207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:41.666663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:41.667088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:41.682484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:45:41.807153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:41.814970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be17b4de-62c1-460a-9f47-b5ba30336d9b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.162401 Oct 04 11:45:41.815483 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4423/6210] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:41 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:42.839603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:42.841110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:42.847353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:42.847841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:42.848280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:42.848968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:42.849460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:42.849891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:42.977819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:42.985379 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da425cc5-04b0-4fcc-a480-df8c5e0ac9d4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.151083 Oct 04 11:45:42.985943 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1788/6211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:42 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:44.008724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:44.009390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:44.016697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:44.017177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:44.017644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:44.018331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:44.018785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:44.019206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:44.150439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:44.158135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b328236e-028e-4f57-a5a3-9b9ad3f41cca tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.153290 Oct 04 11:45:44.158704 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4424/6212] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:44 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:45.181120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:45.181784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:45.189208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:45.189762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:45.190214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:45.190917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:45.191388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:45.191828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:45.320223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:45.328482 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ead0c5a9-5bf4-4812-9df2-37184f903748 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.151250 Oct 04 11:45:45.329005 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1789/6213] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:45 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:46.351153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:46.351881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:46.359194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:46.359685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:46.360120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:46.360947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:46.361520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:46.362074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:46.408700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bb0ef327-2480-41f8-9862-72940091f3a7 req-4921aa78-7e9d-43b7-ade5-de9778efa7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee68849-1cf6-4f88-95dc-901afbf47b38", "name": "network-vif-plugged", "status": "completed", "tag": "576adb7d-76a8-40ad-adaa-585e54e20a3b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:46.419244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bb0ef327-2480-41f8-9862-72940091f3a7 req-4921aa78-7e9d-43b7-ade5-de9778efa7bd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:46.419740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bb0ef327-2480-41f8-9862-72940091f3a7 req-4921aa78-7e9d-43b7-ade5-de9778efa7bd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:46.420184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bb0ef327-2480-41f8-9862-72940091f3a7 req-4921aa78-7e9d-43b7-ade5-de9778efa7bd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:46.431929 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bb0ef327-2480-41f8-9862-72940091f3a7 req-4921aa78-7e9d-43b7-ade5-de9778efa7bd service nova] Creating event network-vif-plugged:576adb7d-76a8-40ad-adaa-585e54e20a3b for instance fee68849-1cf6-4f88-95dc-901afbf47b38 on n-h2-791135-8 Oct 04 11:45:46.436861 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bb0ef327-2480-41f8-9862-72940091f3a7 req-4921aa78-7e9d-43b7-ade5-de9778efa7bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Oct 04 11:45:46.437697 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1790/6214] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:45:46.502186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:46.510794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b7b0fcf-a2d5-42d3-a4c3-e91430bd100c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.163565 Oct 04 11:45:46.516984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4425/6215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:46 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:47.535508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:47.536223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:47.542422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:47.542913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:47.543387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:47.544662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:47.545131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:47.545684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:47.680131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:47.687800 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f3311019-4852-4c4b-b0a3-7ebf2af20a66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1266 microversion: 2.1 time: 0.157410 Oct 04 11:45:47.688389 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1791/6216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:47 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:48.710429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:48.711023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:48.717958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:48.718435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:48.718867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:48.719548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:48.720000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:48.720424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:48.848685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:48.856485 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73c50531-a2a4-4924-a3b9-0f5a91388c03 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1451 microversion: 2.1 time: 0.150040 Oct 04 11:45:48.857610 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4426/6217] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:48 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:48.879715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:45:48.880339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:45:48.887152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:48.887645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:48.888097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:48.888798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:48.889267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:48.889731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:49.021082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:45:49.029285 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-993fc511-95a4-40bf-9a81-7b893343b02c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1451 microversion: 2.1 time: 0.153120 Oct 04 11:45:49.029902 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1792/6218] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:45:48 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:45:50.613004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a3178ebe-cf24-4370-8be3-db7927a93b9d req-0cea40b1-2589-4d3c-bca7-6e613d237c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee68849-1cf6-4f88-95dc-901afbf47b38", "tag": "576adb7d-76a8-40ad-adaa-585e54e20a3b"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:45:50.624225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a3178ebe-cf24-4370-8be3-db7927a93b9d req-0cea40b1-2589-4d3c-bca7-6e613d237c6c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:45:50.624720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a3178ebe-cf24-4370-8be3-db7927a93b9d req-0cea40b1-2589-4d3c-bca7-6e613d237c6c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:45:50.625156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a3178ebe-cf24-4370-8be3-db7927a93b9d req-0cea40b1-2589-4d3c-bca7-6e613d237c6c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:45:50.636529 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a3178ebe-cf24-4370-8be3-db7927a93b9d req-0cea40b1-2589-4d3c-bca7-6e613d237c6c service nova] Creating event network-changed:576adb7d-76a8-40ad-adaa-585e54e20a3b for instance fee68849-1cf6-4f88-95dc-901afbf47b38 on n-h2-791135-8 Oct 04 11:45:50.642263 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a3178ebe-cf24-4370-8be3-db7927a93b9d req-0cea40b1-2589-4d3c-bca7-6e613d237c6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033122 Oct 04 11:45:50.642860 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4427/6219] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:46:01.695849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:01.698063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:01.701251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=15 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:01.701953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=90 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:01.708593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:01.709021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:01.709484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:01.710177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:01.710630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:01.711053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:01.767691 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b23e587d-9edf-4bbe-93fd-2a73247bbe54 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action" status: 200 len: 63184 microversion: 2.1 time: 0.075544 Oct 04 11:46:01.768391 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1793/6220] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:46:01 2022] POST /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347/action => generated 63184 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:46:07.991782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=15 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:07.992529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=23 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:07.996612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:07.997373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:08.004470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:08.004924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:08.005810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:08.006052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:08.006514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:08.006934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:08.144138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72737704-20f3-43aa-b20a-8d196fdb8783 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1834 microversion: 2.1 time: 0.154093 Oct 04 11:46:08.145084 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4428/6221] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:07 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1834 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:09.288531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:09.289157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:09.291511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a7c8f800-9893-4adb-aeab-fd298b3f8e7d req-110f4cb0-370e-444a-9183-706c310d4742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:09.297646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:09.298069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:09.298514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:09.299418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:09.299892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:09.300328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:09.303404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a7c8f800-9893-4adb-aeab-fd298b3f8e7d req-110f4cb0-370e-444a-9183-706c310d4742 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:09.304112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a7c8f800-9893-4adb-aeab-fd298b3f8e7d req-110f4cb0-370e-444a-9183-706c310d4742 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:09.304607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a7c8f800-9893-4adb-aeab-fd298b3f8e7d req-110f4cb0-370e-444a-9183-706c310d4742 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:09.320254 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a7c8f800-9893-4adb-aeab-fd298b3f8e7d req-110f4cb0-370e-444a-9183-706c310d4742 service nova] Creating event network-changed:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h1-791135-8 Oct 04 11:46:09.325919 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a7c8f800-9893-4adb-aeab-fd298b3f8e7d req-110f4cb0-370e-444a-9183-706c310d4742 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038598 Oct 04 11:46:09.326964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4429/6222] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:46:09.328711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:46:09.427471 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3d5034dd-f58f-4f08-8975-b1e82db4a661 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 204 len: 0 microversion: 2.1 time: 0.142983 Oct 04 11:46:09.429928 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1794/6223] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:46:09 2022] DELETE /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:46:09.439789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:09.440724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:09.447160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:09.447829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:09.448428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:09.449279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:09.449918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:09.450490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:09.603868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:09.613208 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bbbcc51b-faa1-49a0-861c-c09697e9efb1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1689 microversion: 2.1 time: 0.178538 Oct 04 11:46:09.613985 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4430/6224] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:09 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:10.637014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:10.638525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:10.646480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:10.646973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:10.647416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:10.648147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:10.648606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:10.649038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:10.892400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:10.900214 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdc57414-e0c4-4d3b-84f9-da962fb87538 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 200 len: 1689 microversion: 2.1 time: 0.267482 Oct 04 11:46:10.900824 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1795/6225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:10 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:11.177994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e808ca4e-eb10-41ab-9b06-3778e1931961 req-f7df70e9-8688-4c9a-a14d-0bd7100d0e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0559682f-a54a-404b-8298-6bb2b0687347", "name": "network-vif-deleted", "tag": "4fd64294-0b26-4424-9e1a-72ea7279c1ae"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:11.189804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e808ca4e-eb10-41ab-9b06-3778e1931961 req-f7df70e9-8688-4c9a-a14d-0bd7100d0e65 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:11.190296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e808ca4e-eb10-41ab-9b06-3778e1931961 req-f7df70e9-8688-4c9a-a14d-0bd7100d0e65 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:11.190715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e808ca4e-eb10-41ab-9b06-3778e1931961 req-f7df70e9-8688-4c9a-a14d-0bd7100d0e65 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:11.203595 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e808ca4e-eb10-41ab-9b06-3778e1931961 req-f7df70e9-8688-4c9a-a14d-0bd7100d0e65 service nova] Creating event network-vif-deleted:4fd64294-0b26-4424-9e1a-72ea7279c1ae for instance 0559682f-a54a-404b-8298-6bb2b0687347 on n-h1-791135-8 Oct 04 11:46:11.208301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e808ca4e-eb10-41ab-9b06-3778e1931961 req-f7df70e9-8688-4c9a-a14d-0bd7100d0e65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034263 Oct 04 11:46:11.209170 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4431/6226] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:46:11.925464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:11.926092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 0559682f-a54a-404b-8298-6bb2b0687347] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:11.933197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:11.933740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:11.934168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:11.935494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:11.935962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:11.936396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:11.949957 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] HTTP exception thrown: Instance 0559682f-a54a-404b-8298-6bb2b0687347 could not be found. Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Request method failure captured: Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 HTTP/1.1 Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBwCqqNL-i3EZa7z0tpU4Mae_8QnJlkN2Y2XQIbrVHtgJVOxnCjzuIo2R_vuXGYjyDzYD5E1yQ-R0GEbaoxg4lKgRb4lYuCl3yNdqTmruXRq1-kOgP6K2KwEmHUPH-Ov7FVtUeOAnvw8mCpjRInzw-see2wIdHGohbTTl1FO87uNuAc Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 751bf34580b0489bbd182305466ec1dc Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751bf34580b0489bbd182305466ec1dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751bf34580b0489bbd182305466ec1dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751bf34580b0489bbd182305466ec1dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751bf34580b0489bbd182305466ec1dc"}]}] Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 751bf34580b0489bbd182305466ec1dc Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-206792760-project Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: d1ca89dfc38d4097ae85eb1e0bd0302d Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206792760-project Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 0559682f-a54a-404b-8298-6bb2b0687347 could not be found. Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '0559682f-a54a-404b-8298-6bb2b0687347'} Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0559682f-a54a-404b-8298-6bb2b0687347 could not be found. Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0559682f-a54a-404b-8298-6bb2b0687347 could not be found. Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:46:11.951655 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0559682f-a54a-404b-8298-6bb2b0687347 could not be found. Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Returning 404 to user: Instance 0559682f-a54a-404b-8298-6bb2b0687347 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9793879b-5ab3-42f8-9774-ecd554c20b78 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347" status: 404 len: 111 microversion: 2.1 time: 0.031620 Oct 04 11:46:11.954971 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1796/6227] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:11 2022] GET /compute/v2.1/servers/0559682f-a54a-404b-8298-6bb2b0687347 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:46:14.904543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-864a74bf-2f71-40b4-9f3c-70623c42f2e0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '.version_select at 0x7f71ceea6280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:14.933293 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-864a74bf-2f71-40b4-9f3c-70623c42f2e0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1005104616" status: 202 len: 0 microversion: 2.1 time: 0.034291 Oct 04 11:46:14.938663 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4432/6228] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 4 11:46:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1005104616 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:46:14.966816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7058ac02-a86b-4007-8ad4-83f070cf26f9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'create', calling method: .version_select at 0x7f71d8779ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-815241346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/edn0C9n2yiYKvaxlDJAoI4dVO4pycSW+BCfkjOPxRa69XrrPr7D13Uj/zqNbxquXU0ThUSyYWE0T5r9ZQh3iUdA1QCTaYQT9KJbrcg7W3d9mmM3G2p4sd6zQpYfh+fQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:14.984529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7058ac02-a86b-4007-8ad4-83f070cf26f9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for project 751bf34580b0489bbd182305466ec1dc. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:46:14.990264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7058ac02-a86b-4007-8ad4-83f070cf26f9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for user d1ca89dfc38d4097ae85eb1e0bd0302d and project 751bf34580b0489bbd182305466ec1dc. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:46:15.014545 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7058ac02-a86b-4007-8ad4-83f070cf26f9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052054 Oct 04 11:46:15.015176 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1797/6229] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:46:14 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:46:20.577295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1122571178", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "3ad0957b-faaa-489d-8f29-4e872416a889"}], "key_name": "tempest-TestNetworkAdvancedServerOps-815241346", "security_groups": [{"name": "tempest-secgroup-smoke-493825092"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:20.695480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] validate_networks() for [('3ad0957b-faaa-489d-8f29-4e872416a889', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:46:21.195957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=16 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:21.461628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:46:21.462229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:46:21.462935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:46:21.463350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:46:21.463766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:46:21.474854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:21.475355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:21.475794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:21.476515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:21.483737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:21.484229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:21.504362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for project 751bf34580b0489bbd182305466ec1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:46:21.512288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for user d1ca89dfc38d4097ae85eb1e0bd0302d and project 751bf34580b0489bbd182305466ec1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:46:21.525194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:46:21.528285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:46:21.581720 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a444b4a1-bd7a-4625-8945-3589c50e7842 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.010013 Oct 04 11:46:21.596625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6d46c65-3c7f-463d-b35d-57fa98e294b5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:21.613766 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4433/6230] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:46:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:46:21.614130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6d46c65-3c7f-463d-b35d-57fa98e294b5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:21.676742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6d46c65-3c7f-463d-b35d-57fa98e294b5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:21.685058 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6d46c65-3c7f-463d-b35d-57fa98e294b5 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1266 microversion: 2.1 time: 0.093704 Oct 04 11:46:21.686488 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1798/6231] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:21 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:22.709573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:22.710718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:22.720091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:22.720971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:22.721622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:22.722497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:22.723103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:22.723690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:22.815690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:22.823550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e35f8703-1f23-4c14-a2df-3b9b415b6a21 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1324 microversion: 2.1 time: 0.117983 Oct 04 11:46:22.824103 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4434/6232] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:22 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1324 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:23.848749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:23.849595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:23.851949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:23.860049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:23.860571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:23.861016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:23.861749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:23.862209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:23.862645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:24.002928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:24.010785 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-16bb95f9-7de2-4800-a9c0-132d5ee0cf83 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1391 microversion: 2.1 time: 0.166285 Oct 04 11:46:24.011290 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1799/6233] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:23 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:24.184532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2b4b8828-ce2d-4a97-856b-da2be7a98a4b req-997d167b-5fb0-480a-84f3-76285b0ae0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228ab30a-aef2-4178-a15d-f5260f916a0e", "tag": "c98f5a17-869a-4176-b5a3-8adf314f18e7"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:24.195768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2b4b8828-ce2d-4a97-856b-da2be7a98a4b req-997d167b-5fb0-480a-84f3-76285b0ae0e8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:24.196251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2b4b8828-ce2d-4a97-856b-da2be7a98a4b req-997d167b-5fb0-480a-84f3-76285b0ae0e8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:24.196922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2b4b8828-ce2d-4a97-856b-da2be7a98a4b req-997d167b-5fb0-480a-84f3-76285b0ae0e8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:24.208353 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2b4b8828-ce2d-4a97-856b-da2be7a98a4b req-997d167b-5fb0-480a-84f3-76285b0ae0e8 service nova] Creating event network-changed:c98f5a17-869a-4176-b5a3-8adf314f18e7 for instance 228ab30a-aef2-4178-a15d-f5260f916a0e on n-h1-791135-8 Oct 04 11:46:24.213673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2b4b8828-ce2d-4a97-856b-da2be7a98a4b req-997d167b-5fb0-480a-84f3-76285b0ae0e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034259 Oct 04 11:46:24.214290 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4435/6234] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:46:25.033629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:25.034255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:25.041070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:25.041629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:25.042083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:25.042786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:25.043258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:25.043697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:25.180659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:25.188888 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5d179c61-6eb9-4903-b51f-56b3896915ab tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1391 microversion: 2.1 time: 0.159165 Oct 04 11:46:25.189513 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1800/6235] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:25 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:26.212587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:26.213283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:26.220921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:26.221433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:26.221868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:26.222554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:26.223007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:26.223431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:26.352974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:26.360616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-111a30f1-4b39-4e12-9eff-f4299b860ba0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1391 microversion: 2.1 time: 0.152289 Oct 04 11:46:26.361217 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4436/6236] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:26 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:27.383832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:27.384390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:27.391510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:27.392004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:27.392477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:27.393340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:27.393828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:27.394278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:27.536217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:27.544642 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c023ea5-9d03-4da8-996c-1ae2cd405858 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1391 microversion: 2.1 time: 0.165072 Oct 04 11:46:27.545218 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1801/6237] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:27 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:28.567065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:28.567685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:28.575296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:28.575720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:28.576161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:28.576905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:28.577373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:28.577836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:28.718632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:28.727572 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95b2f583-9d46-43d6-94cd-a1a566537b29 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1391 microversion: 2.1 time: 0.164348 Oct 04 11:46:28.728261 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4437/6238] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:28 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:29.751831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:29.752714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:29.759580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:29.760076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:29.760531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:29.761233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:29.762327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:29.762786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:29.898093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:29.905709 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ce390b9-5ea8-4ff6-87bd-9fb83d63df12 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1391 microversion: 2.1 time: 0.157860 Oct 04 11:46:29.906288 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1802/6239] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:29 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:30.928818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:30.929495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:30.936424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:30.936987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:30.937443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:30.938092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:30.938560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:30.938992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:31.025924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-05acb358-a562-4574-bab0-ab6b66a70474 req-7297cfd6-3e88-4780-9229-95bcd7c466cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228ab30a-aef2-4178-a15d-f5260f916a0e", "name": "network-vif-plugged", "status": "completed", "tag": "c98f5a17-869a-4176-b5a3-8adf314f18e7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:31.039608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-05acb358-a562-4574-bab0-ab6b66a70474 req-7297cfd6-3e88-4780-9229-95bcd7c466cb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:31.040106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-05acb358-a562-4574-bab0-ab6b66a70474 req-7297cfd6-3e88-4780-9229-95bcd7c466cb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:31.040766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-05acb358-a562-4574-bab0-ab6b66a70474 req-7297cfd6-3e88-4780-9229-95bcd7c466cb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:31.052810 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-05acb358-a562-4574-bab0-ab6b66a70474 req-7297cfd6-3e88-4780-9229-95bcd7c466cb service nova] Creating event network-vif-plugged:c98f5a17-869a-4176-b5a3-8adf314f18e7 for instance 228ab30a-aef2-4178-a15d-f5260f916a0e on n-h1-791135-8 Oct 04 11:46:31.060078 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-05acb358-a562-4574-bab0-ab6b66a70474 req-7297cfd6-3e88-4780-9229-95bcd7c466cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038600 Oct 04 11:46:31.060883 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1803/6240] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:46:31.092609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:31.112621 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e45f59ad-0270-4de5-b53f-dde01945dab2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1391 microversion: 2.1 time: 0.187646 Oct 04 11:46:31.113266 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4438/6241] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:30 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:32.139398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:32.140721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:32.142951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:32.144912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:32.151548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:32.152037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:32.153172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:32.153907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:32.154372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:32.154801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:32.299844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:32.307807 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-423f9888-4128-45da-b251-921b1d66b4cb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1391 microversion: 2.1 time: 0.173102 Oct 04 11:46:32.308376 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1804/6242] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:32 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:33.331532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:33.332101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:33.334094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:33.334757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:33.341408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:33.341893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:33.342332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:33.343023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:33.343480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:33.343907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:33.477930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:33.485603 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6559fa73-1ec8-4d10-b741-ce3fa00ac42c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1562 microversion: 2.1 time: 0.158100 Oct 04 11:46:33.486179 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4439/6243] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:33 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:33.508038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:33.508692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:33.516121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:33.516615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:33.517060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:33.517784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:33.518252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:33.518687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:33.647680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:33.655664 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9a5c47f5-f51d-4ddc-a7e0-d42964c4e831 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1562 microversion: 2.1 time: 0.151436 Oct 04 11:46:33.656230 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1805/6244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:33 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:35.536151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:46:35.536767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:35.542523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e6af9a76-a823-43c7-88f7-4ea33f4389e7 req-389070e1-b84e-4617-99f0-172bd673159c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228ab30a-aef2-4178-a15d-f5260f916a0e", "tag": "c98f5a17-869a-4176-b5a3-8adf314f18e7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:35.557564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6af9a76-a823-43c7-88f7-4ea33f4389e7 req-389070e1-b84e-4617-99f0-172bd673159c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:35.557564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6af9a76-a823-43c7-88f7-4ea33f4389e7 req-389070e1-b84e-4617-99f0-172bd673159c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:35.557836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:35.557920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6af9a76-a823-43c7-88f7-4ea33f4389e7 req-389070e1-b84e-4617-99f0-172bd673159c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:35.557994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:35.557994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:35.557994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:35.558196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:35.559038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:35.569760 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e6af9a76-a823-43c7-88f7-4ea33f4389e7 req-389070e1-b84e-4617-99f0-172bd673159c service nova] Creating event network-changed:c98f5a17-869a-4176-b5a3-8adf314f18e7 for instance 228ab30a-aef2-4178-a15d-f5260f916a0e on n-h1-791135-8 Oct 04 11:46:35.576704 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e6af9a76-a823-43c7-88f7-4ea33f4389e7 req-389070e1-b84e-4617-99f0-172bd673159c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037114 Oct 04 11:46:35.577314 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1806/6245] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:46:35.785504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:46:35.794792 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36d5f79c-0336-4483-82a1-e266ff44ef14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1562 microversion: 2.1 time: 0.262834 Oct 04 11:46:35.804457 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4440/6246] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:46:35 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:46:57.049610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=5 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:57.050369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=40 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:46:57.110971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:46:57.112904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:46:57.119160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:57.119658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:57.120105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:57.120800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:46:57.121264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:46:57.121729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:46:57.174507 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-586e0539-2e24-4be4-8cfe-1538fa18f0be tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e/action" status: 200 len: 24562 microversion: 2.1 time: 0.126650 Oct 04 11:46:57.175120 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1807/6247] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:46:57 2022] POST /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e/action => generated 24562 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:47:03.570402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:03.571021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:03.573693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:03.574362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=40 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:03.581152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:03.581673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:03.582121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:03.582818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:03.583282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:03.583713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:03.717420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:03.725129 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f872da72-3517-468c-95ac-440fb9955745 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1681 microversion: 2.1 time: 0.158624 Oct 04 11:47:03.725737 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4441/6248] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:03 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:03.831365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:03.833652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:03.840904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:03.841417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:03.841862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:03.842560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:03.843017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:03.843978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:03.900376 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-738b026b-119f-4b8c-8602-83f81f054d8d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e/action" status: 200 len: 32635 microversion: 2.1 time: 0.073130 Oct 04 11:47:03.901055 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1808/6249] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:47:03 2022] POST /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e/action => generated 32635 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:47:04.248824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:04.249710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:04.256071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:04.256565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:04.257007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:04.257742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:04.258206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:04.258638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:04.460110 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-40a7104a-9057-47a9-b44d-c61b4bec3bf3 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1832 microversion: 2.1 time: 0.322581 Oct 04 11:47:04.460702 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4442/6250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:04 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1832 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:04.490235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:04.492786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:04.500914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:04.501575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:04.502021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:04.503028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:04.503486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:04.503919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:04.529467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lazy-loading 'flavor' on Instance uuid 228ab30a-aef2-4178-a15d-f5260f916a0e {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:47:04.542003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Going to try to live migrate instance to another host {{(pid=122408) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 11:47:06.046282 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5b22a9c9-7d83-4fd2-9fd0-f7543f2f4190 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e/action" status: 202 len: 0 microversion: 2.1 time: 1.560093 Oct 04 11:47:06.047826 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1809/6251] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:47:04 2022] POST /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e/action => generated 0 bytes in 1563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:47:06.056820 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:06.057470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:06.065239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:06.065755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:06.066195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:06.066891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:06.067348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:06.067776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:06.210235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:06.218783 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-538fbe3e-5a6e-4ef0-bf0b-8f4039f221d8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.165454 Oct 04 11:47:06.219381 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4443/6252] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:06 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:07.243500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:07.244130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:07.251528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:07.252022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:07.252743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:07.253483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:07.253957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:07.254397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:07.388719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:07.396951 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-35aa5b6a-9f72-457d-8274-6ca9781b651c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.157354 Oct 04 11:47:07.397562 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1810/6253] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:07 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:07.413758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8f39632a-302b-4187-9a06-4b7a9b59e938 req-70d473b3-a357-4980-85f9-bee86227d7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228ab30a-aef2-4178-a15d-f5260f916a0e", "name": "network-vif-unplugged", "status": "completed", "tag": "c98f5a17-869a-4176-b5a3-8adf314f18e7"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:07.424932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8f39632a-302b-4187-9a06-4b7a9b59e938 req-70d473b3-a357-4980-85f9-bee86227d7ff service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:07.425412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8f39632a-302b-4187-9a06-4b7a9b59e938 req-70d473b3-a357-4980-85f9-bee86227d7ff service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:07.425847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8f39632a-302b-4187-9a06-4b7a9b59e938 req-70d473b3-a357-4980-85f9-bee86227d7ff service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:07.439957 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8f39632a-302b-4187-9a06-4b7a9b59e938 req-70d473b3-a357-4980-85f9-bee86227d7ff service nova] Creating event network-vif-unplugged:c98f5a17-869a-4176-b5a3-8adf314f18e7 for instance 228ab30a-aef2-4178-a15d-f5260f916a0e on n-h1-791135-8 Oct 04 11:47:07.445267 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8f39632a-302b-4187-9a06-4b7a9b59e938 req-70d473b3-a357-4980-85f9-bee86227d7ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036603 Oct 04 11:47:07.446227 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4444/6254] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:47:08.420605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:08.421876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:08.428758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:08.429244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:08.429719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:08.430411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:08.430875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:08.431307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:08.570036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:08.577824 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da4efab0-53a1-4505-b363-9d57c2c2b9d2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.161097 Oct 04 11:47:08.578396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1811/6255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:08 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:09.503755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3905f23b-f1cc-4f1e-b102-cea685ca4990 req-4b81c40f-a98d-4ac6-8ae3-07b7c1ce3c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228ab30a-aef2-4178-a15d-f5260f916a0e", "tag": "c98f5a17-869a-4176-b5a3-8adf314f18e7"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:09.514352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3905f23b-f1cc-4f1e-b102-cea685ca4990 req-4b81c40f-a98d-4ac6-8ae3-07b7c1ce3c67 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:09.514834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3905f23b-f1cc-4f1e-b102-cea685ca4990 req-4b81c40f-a98d-4ac6-8ae3-07b7c1ce3c67 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:09.515267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3905f23b-f1cc-4f1e-b102-cea685ca4990 req-4b81c40f-a98d-4ac6-8ae3-07b7c1ce3c67 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:09.525798 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3905f23b-f1cc-4f1e-b102-cea685ca4990 req-4b81c40f-a98d-4ac6-8ae3-07b7c1ce3c67 service nova] Creating event network-changed:c98f5a17-869a-4176-b5a3-8adf314f18e7 for instance 228ab30a-aef2-4178-a15d-f5260f916a0e on n-h1-791135-8 Oct 04 11:47:09.530566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3905f23b-f1cc-4f1e-b102-cea685ca4990 req-4b81c40f-a98d-4ac6-8ae3-07b7c1ce3c67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Oct 04 11:47:09.531143 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4445/6256] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:47:09.601700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:09.602329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:09.609871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:09.610360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:09.610806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:09.611511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:09.611971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:09.612407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:09.746146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:09.754818 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a200e6a-083c-4a11-8ece-71407c2851c4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.157103 Oct 04 11:47:09.755422 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1812/6257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:09 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:10.778483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:10.779182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:10.786388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:10.786869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:10.787301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:10.787982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:10.788435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:10.788859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:10.922635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:10.930387 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94977382-3818-4bec-8020-a86e1948cdfb tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.156196 Oct 04 11:47:10.930964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4446/6258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:10 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:11.954050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:11.954674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:11.961562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:11.962057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:11.962502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:11.963200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:11.963663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:11.964106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:12.097749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:12.105425 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc2d5364-bb92-4512-88e0-835e81dc7bc2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.155301 Oct 04 11:47:12.105995 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1813/6259] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:11 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:13.130715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:13.131339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:13.138202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:13.138694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:13.139141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:13.139842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:13.140967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:13.141428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:13.269438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:13.277128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a59b3327-12e6-482e-af19-728de2970446 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.150635 Oct 04 11:47:13.277743 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4447/6260] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:13 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:14.300105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:14.300740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:14.307484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:14.307970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:14.308411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:14.309100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:14.309591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:14.310025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:14.439186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:14.446831 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af153077-e142-47bc-a659-9248f9ceb400 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.150638 Oct 04 11:47:14.447396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1814/6261] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:14 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:15.471020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:15.471639 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:15.478697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:15.479171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:15.479612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:15.480306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:15.480761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:15.481188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:15.614964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:15.622805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b93a470-00dd-458a-ad8a-1b006f6a1612 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.156400 Oct 04 11:47:15.623383 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4448/6262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:15 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:16.646256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:16.647043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:16.653961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:16.654548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:16.654997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:16.656203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:16.656749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:16.657193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:16.794953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:16.803804 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58ca6050-7c6e-45c8-858b-749875364401 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1691 microversion: 2.1 time: 0.161540 Oct 04 11:47:16.804394 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1815/6263] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:16 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:17.826117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:17.826729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:17.833629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:17.834126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:17.834568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:17.835265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:17.835722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:17.836152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:17.989989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:17.997997 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-230fb4e1-a147-4c45-8b51-d50b475e6f16 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1681 microversion: 2.1 time: 0.175782 Oct 04 11:47:17.998577 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4449/6264] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:17 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:18.020529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:18.021160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:18.028059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:18.028554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:18.029002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:18.029742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:18.030212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:18.030658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:18.179701 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf56e2d6-7e5b-4873-b6b7-c1cb292e4c41 tempest-TestNetworkAdvancedServerOps-1714646620 tempest-TestNetworkAdvancedServerOps-1714646620-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1832 microversion: 2.1 time: 0.162600 Oct 04 11:47:18.189589 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1816/6265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:18 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1832 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:18.212916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:18.213574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:18.221980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:18.222650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:18.223106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:18.223818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:18.224272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:18.224730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:18.388592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:18.396627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-edb4f1a5-02d3-4be8-8b65-e929cbf9db42 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1681 microversion: 2.1 time: 0.187988 Oct 04 11:47:18.397227 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4450/6266] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:18 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:18.493951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:18.496239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:18.503095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:18.503589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:18.504037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:18.504745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:18.505209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:18.505670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:18.567862 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-15c44615-8374-494e-99f0-b4c74198f9f1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e/action" status: 200 len: 38483 microversion: 2.1 time: 0.077645 Oct 04 11:47:18.575396 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1817/6267] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:47:18 2022] POST /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e/action => generated 38483 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:47:19.577886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:19.578391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:19.585217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:19.585981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:19.586312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-94d32504-1297-4073-a26c-5276581bbe1f req-27b8473f-2da0-4168-a836-1ace0d97119c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228ab30a-aef2-4178-a15d-f5260f916a0e", "tag": "c98f5a17-869a-4176-b5a3-8adf314f18e7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:19.587074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:19.588092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:19.588690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:19.589301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:19.639335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-94d32504-1297-4073-a26c-5276581bbe1f req-27b8473f-2da0-4168-a836-1ace0d97119c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:19.639715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-94d32504-1297-4073-a26c-5276581bbe1f req-27b8473f-2da0-4168-a836-1ace0d97119c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:19.640173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-94d32504-1297-4073-a26c-5276581bbe1f req-27b8473f-2da0-4168-a836-1ace0d97119c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:19.661012 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-94d32504-1297-4073-a26c-5276581bbe1f req-27b8473f-2da0-4168-a836-1ace0d97119c service nova] Creating event network-changed:c98f5a17-869a-4176-b5a3-8adf314f18e7 for instance 228ab30a-aef2-4178-a15d-f5260f916a0e on n-h2-791135-8 Oct 04 11:47:19.678801 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-94d32504-1297-4073-a26c-5276581bbe1f req-27b8473f-2da0-4168-a836-1ace0d97119c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095785 Oct 04 11:47:19.682333 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1818/6268] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:47:19.703374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:47:20.103634 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-830ddad3-f019-4979-b96b-5c711c7dde14 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "DELETE /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 204 len: 0 microversion: 2.1 time: 0.529140 Oct 04 11:47:20.104909 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4451/6269] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:47:19 2022] DELETE /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:47:20.114480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:20.115193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:20.121323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:20.122028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:20.122480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:20.123188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:20.123651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:20.124671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:20.266789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:20.274692 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0847a3bb-7571-4292-9d5d-03cbcd20ddc8 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1687 microversion: 2.1 time: 0.164869 Oct 04 11:47:20.275474 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1819/6270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:20 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:21.299817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:21.300501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:21.307933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:21.308515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:21.309019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:21.309970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:21.310490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:21.310872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:21.321103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5ad61273-fd66-4498-92e3-c7dc44b3a76e req-33060bf9-1ae8-43f5-8f0b-0d0c10790aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228ab30a-aef2-4178-a15d-f5260f916a0e", "name": "network-vif-deleted", "tag": "c98f5a17-869a-4176-b5a3-8adf314f18e7"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:21.333300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5ad61273-fd66-4498-92e3-c7dc44b3a76e req-33060bf9-1ae8-43f5-8f0b-0d0c10790aa4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:21.333846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5ad61273-fd66-4498-92e3-c7dc44b3a76e req-33060bf9-1ae8-43f5-8f0b-0d0c10790aa4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:21.334271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5ad61273-fd66-4498-92e3-c7dc44b3a76e req-33060bf9-1ae8-43f5-8f0b-0d0c10790aa4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:21.347129 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5ad61273-fd66-4498-92e3-c7dc44b3a76e req-33060bf9-1ae8-43f5-8f0b-0d0c10790aa4 service nova] Creating event network-vif-deleted:c98f5a17-869a-4176-b5a3-8adf314f18e7 for instance 228ab30a-aef2-4178-a15d-f5260f916a0e on n-h2-791135-8 Oct 04 11:47:21.361326 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5ad61273-fd66-4498-92e3-c7dc44b3a76e req-33060bf9-1ae8-43f5-8f0b-0d0c10790aa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043684 Oct 04 11:47:21.362344 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1820/6271] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:47:21.388432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:21.400586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32cf557c-d2cb-4828-bf83-007910706de7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 200 len: 1501 microversion: 2.1 time: 0.104851 Oct 04 11:47:21.413375 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4452/6272] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:21 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 1501 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:22.426765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:22.427671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 228ab30a-aef2-4178-a15d-f5260f916a0e] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:22.433902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:22.434403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:22.434849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:22.435558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:22.436039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:22.436461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:22.449638 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] HTTP exception thrown: Instance 228ab30a-aef2-4178-a15d-f5260f916a0e could not be found. Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Request method failure captured: Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e HTTP/1.1 Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBwCqqNL-i3EZa7z0tpU4Mae_8QnJlkN2Y2XQIbrVHtgJVOxnCjzuIo2R_vuXGYjyDzYD5E1yQ-R0GEbaoxg4lKgRb4lYuCl3yNdqTmruXRq1-kOgP6K2KwEmHUPH-Ov7FVtUeOAnvw8mCpjRInzw-see2wIdHGohbTTl1FO87uNuAc Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 751bf34580b0489bbd182305466ec1dc Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751bf34580b0489bbd182305466ec1dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751bf34580b0489bbd182305466ec1dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751bf34580b0489bbd182305466ec1dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751bf34580b0489bbd182305466ec1dc"}]}] Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 751bf34580b0489bbd182305466ec1dc Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-206792760-project Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: d1ca89dfc38d4097ae85eb1e0bd0302d Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206792760-project Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 228ab30a-aef2-4178-a15d-f5260f916a0e could not be found. Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '228ab30a-aef2-4178-a15d-f5260f916a0e'} Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228ab30a-aef2-4178-a15d-f5260f916a0e could not be found. Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228ab30a-aef2-4178-a15d-f5260f916a0e could not be found. Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:47:22.451269 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228ab30a-aef2-4178-a15d-f5260f916a0e could not be found. Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Returning 404 to user: Instance 228ab30a-aef2-4178-a15d-f5260f916a0e could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9b45cd92-cfbf-420c-83aa-9c537828efa0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e" status: 404 len: 111 microversion: 2.1 time: 0.031626 Oct 04 11:47:22.459225 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1821/6273] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:22 2022] GET /compute/v2.1/servers/228ab30a-aef2-4178-a15d-f5260f916a0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:47:26.905878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75b06498-d523-47a3-ad50-f47d87b8a18d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '.version_select at 0x7f71cecbc310>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:26.937850 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75b06498-d523-47a3-ad50-f47d87b8a18d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-815241346" status: 202 len: 0 microversion: 2.1 time: 0.035821 Oct 04 11:47:26.938782 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4453/6274] 10.222.0.23 () {58 vars in 1281 bytes} [Tue Oct 4 11:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-815241346 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:47:26.966120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e970b94-7c6f-4ed1-bfd5-afcc7feea916 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'create', calling method: .version_select at 0x7f71cf7324c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1931178807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlwgkxMDkJsKIZYd6+aX4+nJM6mGzxOJAhyGs+5GYlGAVTssE128/0so4Yg/ozoHZ+QEB+ziYaAaY8hDdmM4HyTLDX9jKxrYgoLmguhyq7F2sIglveLAUDAaEqbJefCCw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:26.984279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-2e970b94-7c6f-4ed1-bfd5-afcc7feea916 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for project 751bf34580b0489bbd182305466ec1dc. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:47:26.991037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-2e970b94-7c6f-4ed1-bfd5-afcc7feea916 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for user d1ca89dfc38d4097ae85eb1e0bd0302d and project 751bf34580b0489bbd182305466ec1dc. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:47:27.019561 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e970b94-7c6f-4ed1-bfd5-afcc7feea916 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057533 Oct 04 11:47:27.020287 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1822/6275] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:47:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:47:30.669826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1585785932", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153425603", "security_groups": [{"name": "tempest-secgroup-smoke-1385016960"}], "block_device_mapping_v2": [{"uuid": "e5d379bd-7846-4750-9c99-99fd4f96b9e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abb967bf-38d8-4c74-bd84-4e529507054d"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:30.906033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] validate_networks() for [('abb967bf-38d8-4c74-bd84-4e529507054d', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:47:31.395527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:31.693345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:47:31.694078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:47:31.694406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:47:31.694883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:47:31.695364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:47:31.705189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:31.706107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:31.706731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:31.707456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:31.707915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:31.708345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:31.736271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:47:31.742344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Getting quotas for user 4ac84039f33d46b1b83b2334c76cf067 and project 261d437e74f2469b9156f089d745a082. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:47:31.822106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:47:31.824544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5d379bd-7846-4750-9c99-99fd4f96b9e5',volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:47:31.980029 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1cfaa66-d560-4133-a7d4-80970fb90bd8 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.321826 Oct 04 11:47:31.989240 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4454/6276] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:47:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:47:31.992855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d5d9fb11-e86f-4a6c-a10b-526b539cd9a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:31.993649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d5d9fb11-e86f-4a6c-a10b-526b539cd9a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:31.996795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:32.117883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d5d9fb11-e86f-4a6c-a10b-526b539cd9a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:32.129491 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d5d9fb11-e86f-4a6c-a10b-526b539cd9a5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1094 microversion: 2.1 time: 0.137468 Oct 04 11:47:32.130112 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1823/6277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:31 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1094 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:33.159697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:33.160449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:33.175431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:33.179343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:33.180525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:33.182713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:33.184265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:33.184787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:33.316217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:33.325769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c805b563-a7f0-4666-bf7a-2a7599186231 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1192 microversion: 2.1 time: 0.172884 Oct 04 11:47:33.327340 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4455/6278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:33 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1192 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:33.787750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-310830754", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "de28d52e-91da-4c0a-ad16-7e947122e1b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1931178807", "security_groups": [{"name": "tempest-secgroup-smoke-423492394"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:33.810792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:33.945124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] validate_networks() for [('de28d52e-91da-4c0a-ad16-7e947122e1b4', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:47:34.349599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:34.350347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:34.353054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:34.362624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:34.374859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:34.375634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:34.376629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:34.377604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:34.378348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:34.744597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:34.760034 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4db957a-84fb-49d8-95e3-0e56976edfd4 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1278 microversion: 2.1 time: 0.414256 Oct 04 11:47:34.760955 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4456/6279] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:34 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1278 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:34.878208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:47:34.878695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:47:34.879512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:47:34.879947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:47:34.880426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:47:34.894987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:34.896871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:34.897582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:34.898652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:34.899310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:34.900019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:34.923204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for project 751bf34580b0489bbd182305466ec1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:47:34.941276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Getting quotas for user d1ca89dfc38d4097ae85eb1e0bd0302d and project 751bf34580b0489bbd182305466ec1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:47:34.958916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:47:34.961602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:47:35.040966 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de917ff1-284a-4723-a73f-3e097d3cfa30 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.256917 Oct 04 11:47:35.048103 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1824/6280] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:47:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:47:35.053759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96391751-8745-48f5-a56e-53b364641a79 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:35.054768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96391751-8745-48f5-a56e-53b364641a79 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:35.150492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96391751-8745-48f5-a56e-53b364641a79 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:35.165337 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96391751-8745-48f5-a56e-53b364641a79 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1266 microversion: 2.1 time: 0.115468 Oct 04 11:47:35.180328 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4457/6281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:35 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:35.696393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b384cc2b-d92f-4fcb-801c-947920c822ec req-519bacd7-4f2d-46e3-a4d2-247487e885ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847ab89a-5c6a-497a-a35b-a1b7da8ebc01", "tag": "0dd4a281-1551-4db3-9b7a-6b282ad892ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:35.726188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b384cc2b-d92f-4fcb-801c-947920c822ec req-519bacd7-4f2d-46e3-a4d2-247487e885ee service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:35.727001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b384cc2b-d92f-4fcb-801c-947920c822ec req-519bacd7-4f2d-46e3-a4d2-247487e885ee service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:35.728064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b384cc2b-d92f-4fcb-801c-947920c822ec req-519bacd7-4f2d-46e3-a4d2-247487e885ee service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:35.791303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:35.792654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:35.802033 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b384cc2b-d92f-4fcb-801c-947920c822ec req-519bacd7-4f2d-46e3-a4d2-247487e885ee service nova] Creating event network-changed:0dd4a281-1551-4db3-9b7a-6b282ad892ea for instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 on n-h1-791135-8 Oct 04 11:47:35.805360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:35.809786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:35.810247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:35.811138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:35.811720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:35.812168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:35.813167 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b384cc2b-d92f-4fcb-801c-947920c822ec req-519bacd7-4f2d-46e3-a4d2-247487e885ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120672 Oct 04 11:47:35.813826 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1825/6282] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:47:36.078620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:36.090147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95e7a75e-5692-4fcb-9735-723633ff0049 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1278 microversion: 2.1 time: 0.306479 Oct 04 11:47:36.092781 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4458/6283] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:35 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1278 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:36.193964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:36.195760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:36.205840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:36.206688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:36.207472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:36.208386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:36.209031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:36.209711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:36.284894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:36.294098 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-effb23a6-eb6c-4441-810a-23e4c7343949 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1318 microversion: 2.1 time: 0.105086 Oct 04 11:47:36.295238 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1826/6284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:36 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:37.116679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:37.118035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:37.132229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:37.132745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:37.133191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:37.133954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:37.134408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:37.134841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:37.322823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:37.324123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:37.331928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:37.332730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:37.333444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:37.334361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:37.335021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:37.335654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:37.374429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:37.384188 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-396e9db9-55e3-424d-8899-5ff47ba44aac tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1278 microversion: 2.1 time: 0.272346 Oct 04 11:47:37.385502 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4459/6285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:37 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:37.438719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:37.446727 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e9aa7b68-63b8-44e4-b00a-1d63d0d1fb3e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1324 microversion: 2.1 time: 0.128982 Oct 04 11:47:37.447840 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1827/6286] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:37 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1324 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:38.408101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:38.409252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:38.416907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:38.417656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:38.418607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:38.426574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-70b7c292-1f4f-4943-a88e-6940fb9b0166 req-486f427c-6e67-43b5-9dbe-480845073426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5215fe-a321-46d4-aba2-90e4bb6859b1", "tag": "ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:38.432029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:38.433909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:38.434565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:38.443349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70b7c292-1f4f-4943-a88e-6940fb9b0166 req-486f427c-6e67-43b5-9dbe-480845073426 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:38.444072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70b7c292-1f4f-4943-a88e-6940fb9b0166 req-486f427c-6e67-43b5-9dbe-480845073426 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:38.444537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-70b7c292-1f4f-4943-a88e-6940fb9b0166 req-486f427c-6e67-43b5-9dbe-480845073426 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:38.461859 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-70b7c292-1f4f-4943-a88e-6940fb9b0166 req-486f427c-6e67-43b5-9dbe-480845073426 service nova] Creating event network-changed:ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf for instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 on n-h2-791135-8 Oct 04 11:47:38.469142 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-70b7c292-1f4f-4943-a88e-6940fb9b0166 req-486f427c-6e67-43b5-9dbe-480845073426 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048445 Oct 04 11:47:38.471335 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1828/6287] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:47:38.480476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:38.481950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:38.491080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:38.492048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:38.492842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:38.493913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:38.494834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:38.495634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:38.684978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:38.693817 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8a62757-0eed-4ba9-ad32-57ef250ef176 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1391 microversion: 2.1 time: 0.220874 Oct 04 11:47:38.703531 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1829/6288] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:38 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:38.760330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:38.768915 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5513d705-74a2-4a59-9600-45bf945ee900 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1278 microversion: 2.1 time: 0.365241 Oct 04 11:47:38.769535 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4460/6289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:38 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1278 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:39.716777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:39.717435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:39.725601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:39.726293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:39.727007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:39.727799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:39.728301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:39.728811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:39.791685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:39.792488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:39.799933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:39.800887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:39.801101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:39.801984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:39.802565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:39.803012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:39.887837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:39.896290 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0bfedd42-efa4-4ee2-854d-6a2c048ba6df tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1391 microversion: 2.1 time: 0.183561 Oct 04 11:47:39.896876 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1830/6290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:39 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:39.970848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:39.980750 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69e66302-ee05-43bf-8c89-7e4a921da5a6 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.193040 Oct 04 11:47:39.981590 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4461/6291] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:39 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:40.919592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:40.920113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:40.927032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:40.927527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:40.927964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:40.928669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:40.929129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:40.929591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:41.007054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:41.007802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:41.014727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:41.015121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:41.015634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:41.016659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:41.017198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:41.017734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:41.070464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:41.081024 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d8a20790-68ab-4e4b-9727-0a297944b646 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1391 microversion: 2.1 time: 0.165305 Oct 04 11:47:41.081737 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1831/6292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:40 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:41.195802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:41.204816 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b9f7185-dde8-482d-a0a2-a313f78599ec tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.201654 Oct 04 11:47:41.221540 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4462/6293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:41 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:42.104038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:42.104652 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:42.111366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:42.111857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:42.112294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:42.112985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:42.113473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:42.113939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:42.228151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:42.228879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:42.230867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:42.237202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:42.237750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:42.238195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:42.238904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:42.239366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:42.239804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:42.247340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:42.256058 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7899ee67-814c-44f2-911c-b7891e6e0e1c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1391 microversion: 2.1 time: 0.155898 Oct 04 11:47:42.256633 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1832/6294] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:42 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:42.368254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:42.376474 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8af474ae-ef19-4dea-a6fe-1ebaf9f324a0 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.152334 Oct 04 11:47:42.377051 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4463/6295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:42 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:43.278840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:43.279468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:43.286400 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:43.286898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:43.287351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:43.288058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:43.288528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:43.288969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:43.400337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:43.401162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:43.407873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:43.408441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:43.408952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:43.409693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:43.410153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:43.410615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:43.424459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:43.433469 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-74b33703-e8ff-47c8-957a-c8d85bf39d07 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1391 microversion: 2.1 time: 0.158353 Oct 04 11:47:43.448999 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1833/6296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:43 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:43.556884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:43.565918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-734ffff5-222c-4916-96d3-ac7bfc8ee959 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.169570 Oct 04 11:47:43.566770 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4464/6297] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:43 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:44.456193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:44.456818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:44.463711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:44.464209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:44.464655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:44.465376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:44.465836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:44.466268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:44.588075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:44.588685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:44.595414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:44.595897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:44.596343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:44.597040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:44.597540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:44.597968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:44.598492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:44.606224 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f74edcd-1291-401c-a4d5-ddd5e78d78b1 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1391 microversion: 2.1 time: 0.154413 Oct 04 11:47:44.606832 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1834/6298] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:44 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:44.730571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:44.738831 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a889622-2cb3-4ef9-b46a-c14b590f94dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.154677 Oct 04 11:47:44.739412 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4465/6299] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:44 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:44.917487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9c173195-6dfa-42c7-86f7-9baad2bac66a req-11e8a635-08d2-4dcd-ae1b-858c63b06424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5215fe-a321-46d4-aba2-90e4bb6859b1", "name": "network-vif-plugged", "status": "completed", "tag": "ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:44.922978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:44.928803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9c173195-6dfa-42c7-86f7-9baad2bac66a req-11e8a635-08d2-4dcd-ae1b-858c63b06424 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:44.929286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9c173195-6dfa-42c7-86f7-9baad2bac66a req-11e8a635-08d2-4dcd-ae1b-858c63b06424 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:44.929763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9c173195-6dfa-42c7-86f7-9baad2bac66a req-11e8a635-08d2-4dcd-ae1b-858c63b06424 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:44.941745 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9c173195-6dfa-42c7-86f7-9baad2bac66a req-11e8a635-08d2-4dcd-ae1b-858c63b06424 service nova] Creating event network-vif-plugged:ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf for instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 on n-h2-791135-8 Oct 04 11:47:44.947393 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9c173195-6dfa-42c7-86f7-9baad2bac66a req-11e8a635-08d2-4dcd-ae1b-858c63b06424 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033470 Oct 04 11:47:44.948301 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1835/6300] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:47:45.629128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:45.629774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:45.631624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:45.637574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:45.638062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:45.638503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:45.639688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:45.640145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:45.640587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:45.759573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:45.764707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:45.765947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:45.772388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:45.772881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:45.773326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:45.774181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:45.774651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:45.775086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:45.777206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:45.785475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18d903b3-72cd-4a0a-b1a9-07608233fda2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1391 microversion: 2.1 time: 0.160480 Oct 04 11:47:45.786157 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4466/6301] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:45 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:45.913494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:45.921171 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65a5f764-b9dc-4192-b537-77507440c8fc tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.162541 Oct 04 11:47:45.921781 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1836/6302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:45 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:46.808922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:46.809484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:46.816284 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:46.816768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:46.817208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:46.817944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:46.818405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:46.818845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:46.943395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:46.944022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:46.950108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:46.950948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:46.951457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:46.951915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:46.953180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:46.953680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:46.954125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:46.958399 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5614603c-47b1-4ec4-92f6-6fe681ba58c3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1563 microversion: 2.1 time: 0.153506 Oct 04 11:47:46.958973 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4467/6303] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:46 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:46.980629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:46.981243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:46.987360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:46.987889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:46.988333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:46.989044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:46.989675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:46.990132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:47.085069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:47.093804 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8755602b-c30b-4ffe-80ed-f697695f1f7b tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.153607 Oct 04 11:47:47.094516 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1837/6304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:46 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:47.122660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:47.130989 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-482875f2-92cc-49c8-9f38-c59d062499ef tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1563 microversion: 2.1 time: 0.154091 Oct 04 11:47:47.131567 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4468/6305] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:46 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:47:48.116529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:48.117161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:48.123914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:48.124443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:48.124927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:48.125662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:48.126132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:48.126566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:48.268667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:48.276716 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f0dcc66f-0f83-4923-92d0-b96f76d99e4a tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.164092 Oct 04 11:47:48.277529 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1838/6306] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:48 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:48.726938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:48.727563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:48.729468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5428387a-dc5e-41dd-9ae3-504307e27812 req-4060707a-d2a2-4a6f-acd9-fff186c7b42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5215fe-a321-46d4-aba2-90e4bb6859b1", "tag": "ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:48.735407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:48.735921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:48.736367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:48.737084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:48.737579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:48.738019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:48.739679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5428387a-dc5e-41dd-9ae3-504307e27812 req-4060707a-d2a2-4a6f-acd9-fff186c7b42b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:48.740167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5428387a-dc5e-41dd-9ae3-504307e27812 req-4060707a-d2a2-4a6f-acd9-fff186c7b42b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:48.740745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5428387a-dc5e-41dd-9ae3-504307e27812 req-4060707a-d2a2-4a6f-acd9-fff186c7b42b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:48.752858 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5428387a-dc5e-41dd-9ae3-504307e27812 req-4060707a-d2a2-4a6f-acd9-fff186c7b42b service nova] Creating event network-changed:ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf for instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 on n-h2-791135-8 Oct 04 11:47:48.757778 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5428387a-dc5e-41dd-9ae3-504307e27812 req-4060707a-d2a2-4a6f-acd9-fff186c7b42b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032421 Oct 04 11:47:48.758689 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1839/6307] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:47:48.956669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:48.964650 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db2ef603-d6d2-434e-8076-a1b84e9539f4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1563 microversion: 2.1 time: 0.241974 Oct 04 11:47:48.965574 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4469/6308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:48 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:49.300693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:49.302041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:49.309226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:49.309981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:49.310588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:49.311453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:49.312089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:49.312813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:49.369727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0567728f-ef3f-4e24-a6b6-5d6596798ee1 req-c968e9af-b1b5-45d0-b3d0-8de6db2874a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847ab89a-5c6a-497a-a35b-a1b7da8ebc01", "name": "network-vif-plugged", "status": "completed", "tag": "0dd4a281-1551-4db3-9b7a-6b282ad892ea"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:49.385076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0567728f-ef3f-4e24-a6b6-5d6596798ee1 req-c968e9af-b1b5-45d0-b3d0-8de6db2874a8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:49.385869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0567728f-ef3f-4e24-a6b6-5d6596798ee1 req-c968e9af-b1b5-45d0-b3d0-8de6db2874a8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:49.387369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0567728f-ef3f-4e24-a6b6-5d6596798ee1 req-c968e9af-b1b5-45d0-b3d0-8de6db2874a8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:49.408299 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0567728f-ef3f-4e24-a6b6-5d6596798ee1 req-c968e9af-b1b5-45d0-b3d0-8de6db2874a8 service nova] Creating event network-vif-plugged:0dd4a281-1551-4db3-9b7a-6b282ad892ea for instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 on n-h1-791135-8 Oct 04 11:47:49.416185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0567728f-ef3f-4e24-a6b6-5d6596798ee1 req-c968e9af-b1b5-45d0-b3d0-8de6db2874a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058782 Oct 04 11:47:49.417269 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4470/6309] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:47:49.504523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:49.512766 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f030257a-a875-4a0b-99dc-9b8e270e7287 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.217043 Oct 04 11:47:49.513679 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1840/6310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:49 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:50.536517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:50.537237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:50.544479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:50.544973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:50.545499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:50.551332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:50.551332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:50.551332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:50.690173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:50.697956 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-27fd06d0-55fa-4320-b972-5cdb3c04bd0f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1266 microversion: 2.1 time: 0.165958 Oct 04 11:47:50.698536 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4471/6311] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:50 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:51.720879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:51.721532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:51.728444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:51.728941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:51.729415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:51.730121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:51.730593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:51.731030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:51.866291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:51.874491 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47491ed4-89a9-49c5-ad27-c620fc8a81ed tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1451 microversion: 2.1 time: 0.157585 Oct 04 11:47:51.875077 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1841/6312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:51 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:51.896907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:47:51.897549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:47:51.904282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:51.904762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:51.905218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:51.905925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:51.906381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:51.906804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:52.038142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:47:52.041682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:47:52.047055 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e216337-603a-40e3-bb3f-bda32a1be57d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1451 microversion: 2.1 time: 0.153991 Oct 04 11:47:52.047631 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4472/6313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:47:51 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:47:53.618343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-836e1ecf-182d-45f5-85c5-0071cf914ebd req-f030bac1-1a63-490b-93f6-7290368bf46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847ab89a-5c6a-497a-a35b-a1b7da8ebc01", "tag": "0dd4a281-1551-4db3-9b7a-6b282ad892ea"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:47:53.629785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-836e1ecf-182d-45f5-85c5-0071cf914ebd req-f030bac1-1a63-490b-93f6-7290368bf46b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:47:53.630383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-836e1ecf-182d-45f5-85c5-0071cf914ebd req-f030bac1-1a63-490b-93f6-7290368bf46b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:47:53.630860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-836e1ecf-182d-45f5-85c5-0071cf914ebd req-f030bac1-1a63-490b-93f6-7290368bf46b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:47:53.643162 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-836e1ecf-182d-45f5-85c5-0071cf914ebd req-f030bac1-1a63-490b-93f6-7290368bf46b service nova] Creating event network-changed:0dd4a281-1551-4db3-9b7a-6b282ad892ea for instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 on n-h1-791135-8 Oct 04 11:47:53.648232 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-836e1ecf-182d-45f5-85c5-0071cf914ebd req-f030bac1-1a63-490b-93f6-7290368bf46b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 Oct 04 11:47:53.648860 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1842/6314] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:48:22.264519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:48:22.266741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:48:22.269525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=35 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:48:22.274810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:48:22.275299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:48:22.275736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:48:22.276435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:48:22.276890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:48:22.277316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:48:22.343129 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4eb1f3ff-5d8e-4077-9399-18c36a64370b tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1/action" status: 200 len: 24569 microversion: 2.1 time: 0.082780 Oct 04 11:48:22.343757 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4473/6315] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:48:22 2022] POST /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1/action => generated 24569 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:49:01.393215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:49:01.394001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=90 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:49:01.400318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:49:01.403260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:01.413852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:01.414358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:01.414782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:01.415476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:01.415936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:01.416365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:01.493671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:49:01.494114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:49:01.494604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:49:01.495031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:49:01.495456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:49:01.555017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:01.561164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:01.561712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:01.562169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:01.563290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:01.563399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:01.564034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:01.590325 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e2c88ea0-4670-4a99-9980-dc3381acb7cf tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1/action" status: 202 len: 1137 microversion: 2.1 time: 0.199749 Oct 04 11:49:01.591002 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1843/6316] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:49:01 2022] POST /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1/action => generated 1137 bytes in 201 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 04 11:49:01.611255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:01.611969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:01.615264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:49:01.615937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:49:01.623519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:01.624203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:01.624596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:01.625537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:01.626008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:01.626449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:01.769198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:01.777281 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c749a977-6bcb-4b11-8227-85e696419dac tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.170369 Oct 04 11:49:01.778070 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4474/6317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:01 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:02.800984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:02.801622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:02.807960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:02.808446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:02.808889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:02.809610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:02.810072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:02.810500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:02.948891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:02.956542 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef507462-465b-4d8d-8fc2-a6959fa7dbd2 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.159664 Oct 04 11:49:02.957102 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1844/6318] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:02 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:03.982207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:03.982823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:03.989304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:03.989818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:03.990256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:03.990944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:03.991398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:03.991825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:04.120662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:04.128670 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bfa6eff8-d73b-498c-a910-7a584fb5d578 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.150663 Oct 04 11:49:04.129773 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4475/6319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:03 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:05.152356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:05.153008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:05.159924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:05.161006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:05.161510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:05.162220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:05.162691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:05.163129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:05.296015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:05.303990 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c4704cc-292f-4578-9c86-5cca0637a451 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.155567 Oct 04 11:49:05.304753 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1845/6320] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:05 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:06.326895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:06.327536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:06.334569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:06.335215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:06.335932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:06.336638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:06.337100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:06.337566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:06.471693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:06.480138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc259f16-9399-4a08-9da2-4eb896e26a67 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.157475 Oct 04 11:49:06.480711 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4476/6321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:06 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:07.504816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:07.505403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:07.512933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:07.513457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:07.513898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:07.514591 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:07.515051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:07.515482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:07.653190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:07.661389 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12d95516-5684-40fd-ba2d-b297ab779804 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.161031 Oct 04 11:49:07.661969 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1846/6322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:07 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:08.684437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:08.685057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:08.691895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:08.692387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:08.692834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:08.693564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:08.694029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:08.694463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:08.831091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:08.838913 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bce784be-282e-45bc-90dc-5dbba065cd03 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.158444 Oct 04 11:49:08.839499 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4477/6323] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:08 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:09.863109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:09.863792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:09.870565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:09.871058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:09.871535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:09.872237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:09.872704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:09.873140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:10.005430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:10.013067 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c29756b9-9ef0-4887-90e5-fd2e8c243fa4 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.154074 Oct 04 11:49:10.013689 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1847/6324] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:09 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:11.036767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:11.037418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:11.043937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:11.044425 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:11.044869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:11.045602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:11.046056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:11.046487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:11.185708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:11.193683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a789e053-be75-49c2-a38c-1565f6443047 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.161477 Oct 04 11:49:11.194263 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4478/6325] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:11 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:12.217185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:12.217828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:12.224786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:12.225279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:12.225751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:12.226451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:12.226920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:12.227350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:12.589973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:12.598122 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62dc35ad-d1d5-47d4-9fc9-828e5cb47811 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1691 microversion: 2.1 time: 0.384234 Oct 04 11:49:12.598695 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1848/6326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:12 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1691 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:13.621210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:13.621862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:13.629710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:13.630204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:13.630649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:13.631353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:13.631818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:13.632251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:13.769552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:13.777320 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-86645fde-b40c-4dee-b5d2-80e5293eeaa6 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1697 microversion: 2.1 time: 0.160129 Oct 04 11:49:13.777921 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4479/6327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:13 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:14.801650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:14.802304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:14.809096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:14.809629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:14.810088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:14.810792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:14.811286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:14.811776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:14.944027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:14.951725 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46330ac8-4345-4a45-9d04-2d6043d1724d tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1697 microversion: 2.1 time: 0.154011 Oct 04 11:49:14.952292 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1849/6328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:14 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:15.975524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:15.976107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:15.982997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:15.983483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:15.983964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:15.984680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:15.985140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:15.985601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:16.149761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:16.157616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb598088-49c1-48eb-a1ca-bc7279bc58c9 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1697 microversion: 2.1 time: 0.186236 Oct 04 11:49:16.158194 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4480/6329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:15 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:17.182641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:17.183261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:17.189973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:17.190462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:17.190938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:17.192238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:17.192700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:17.193132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:17.327208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:17.335468 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99d44a7b-1771-4c64-9734-b7f75e8ad621 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1697 microversion: 2.1 time: 0.156605 Oct 04 11:49:17.336049 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1850/6330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:17 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:17.687233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b05ae787-75fe-4097-81fe-25bccded34db req-b7dc8bf8-bcc2-4ccd-b22c-21d5444e5b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5215fe-a321-46d4-aba2-90e4bb6859b1", "name": "network-vif-unplugged", "status": "completed", "tag": "ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:49:17.697243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b05ae787-75fe-4097-81fe-25bccded34db req-b7dc8bf8-bcc2-4ccd-b22c-21d5444e5b1f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:17.697767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b05ae787-75fe-4097-81fe-25bccded34db req-b7dc8bf8-bcc2-4ccd-b22c-21d5444e5b1f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:17.698207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b05ae787-75fe-4097-81fe-25bccded34db req-b7dc8bf8-bcc2-4ccd-b22c-21d5444e5b1f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:17.709892 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b05ae787-75fe-4097-81fe-25bccded34db req-b7dc8bf8-bcc2-4ccd-b22c-21d5444e5b1f service nova] Creating event network-vif-unplugged:ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf for instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 on n-h2-791135-8 Oct 04 11:49:17.714973 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b05ae787-75fe-4097-81fe-25bccded34db req-b7dc8bf8-bcc2-4ccd-b22c-21d5444e5b1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123481 Oct 04 11:49:17.715768 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4481/6331] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:49:18.359859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:18.360490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:18.367435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:18.367958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:18.368410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:18.369115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:18.369607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:18.370045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:18.503030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:18.511227 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-656eff57-14d3-488e-a86f-43ee985ab5f3 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1682 microversion: 2.1 time: 0.155214 Oct 04 11:49:18.511785 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1851/6332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:18 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:19.737435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6aac689c-6fcd-47ae-8ccf-6982c9025db1 req-39d8d139-1a47-4db8-873c-09ecec891d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5215fe-a321-46d4-aba2-90e4bb6859b1", "name": "network-vif-plugged", "status": "completed", "tag": "ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:49:19.747553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6aac689c-6fcd-47ae-8ccf-6982c9025db1 req-39d8d139-1a47-4db8-873c-09ecec891d12 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:19.747963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6aac689c-6fcd-47ae-8ccf-6982c9025db1 req-39d8d139-1a47-4db8-873c-09ecec891d12 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:19.748397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6aac689c-6fcd-47ae-8ccf-6982c9025db1 req-39d8d139-1a47-4db8-873c-09ecec891d12 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:19.760175 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6aac689c-6fcd-47ae-8ccf-6982c9025db1 req-39d8d139-1a47-4db8-873c-09ecec891d12 service nova] Creating event network-vif-plugged:ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf for instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 on n-h2-791135-8 Oct 04 11:49:19.764995 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6aac689c-6fcd-47ae-8ccf-6982c9025db1 req-39d8d139-1a47-4db8-873c-09ecec891d12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032555 Oct 04 11:49:19.765647 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4482/6333] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:49:21.766076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:21.766597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:21.773613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:21.774120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:21.774574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:21.775291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:21.775758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:21.776197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:21.802997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:49:21.831110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7da91597-cbbe-4cdb-a71d-a79786c34a61 req-9eb1f733-5044-42ac-9bd3-9827f2f68d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847ab89a-5c6a-497a-a35b-a1b7da8ebc01", "tag": "0dd4a281-1551-4db3-9b7a-6b282ad892ea"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:49:21.842350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7da91597-cbbe-4cdb-a71d-a79786c34a61 req-9eb1f733-5044-42ac-9bd3-9827f2f68d0b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:21.842860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7da91597-cbbe-4cdb-a71d-a79786c34a61 req-9eb1f733-5044-42ac-9bd3-9827f2f68d0b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:21.843466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7da91597-cbbe-4cdb-a71d-a79786c34a61 req-9eb1f733-5044-42ac-9bd3-9827f2f68d0b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:21.855396 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7da91597-cbbe-4cdb-a71d-a79786c34a61 req-9eb1f733-5044-42ac-9bd3-9827f2f68d0b service nova] Creating event network-changed:0dd4a281-1551-4db3-9b7a-6b282ad892ea for instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 on n-h1-791135-8 Oct 04 11:49:21.861697 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7da91597-cbbe-4cdb-a71d-a79786c34a61 req-9eb1f733-5044-42ac-9bd3-9827f2f68d0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105082 Oct 04 11:49:21.862666 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4483/6334] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:49:21.885712 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ce65a1ba-1c13-4865-8203-1abb21717376 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 204 len: 0 microversion: 2.1 time: 0.132021 Oct 04 11:49:21.886815 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1852/6335] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:49:21 2022] DELETE /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:49:21.896015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:21.896948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:21.906983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:21.907775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:21.908227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:21.909135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:21.909670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:21.910107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:22.046650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:22.055235 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d41d32fd-d7e9-452a-90a4-fbc00092ae24 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1575 microversion: 2.1 time: 0.163960 Oct 04 11:49:22.055814 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4484/6336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:21 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:23.078806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:23.079519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:23.087050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:23.087547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:23.087990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:23.088702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:23.089165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:23.089627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:23.231328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:23.239824 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9348ddd9-1a1c-4ae7-b132-2288d3bded61 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1575 microversion: 2.1 time: 0.164783 Oct 04 11:49:23.240430 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1853/6337] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:23 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:23.852375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-06c5721c-af48-4dd8-b47d-066f4eebdc85 req-9faeda58-fcb3-42c8-abce-85601023b421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847ab89a-5c6a-497a-a35b-a1b7da8ebc01", "name": "network-vif-deleted", "tag": "0dd4a281-1551-4db3-9b7a-6b282ad892ea"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:49:23.868145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-06c5721c-af48-4dd8-b47d-066f4eebdc85 req-9faeda58-fcb3-42c8-abce-85601023b421 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:23.868631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-06c5721c-af48-4dd8-b47d-066f4eebdc85 req-9faeda58-fcb3-42c8-abce-85601023b421 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:23.869064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-06c5721c-af48-4dd8-b47d-066f4eebdc85 req-9faeda58-fcb3-42c8-abce-85601023b421 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:23.886103 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-06c5721c-af48-4dd8-b47d-066f4eebdc85 req-9faeda58-fcb3-42c8-abce-85601023b421 service nova] Creating event network-vif-deleted:0dd4a281-1551-4db3-9b7a-6b282ad892ea for instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 on n-h1-791135-8 Oct 04 11:49:23.890909 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-06c5721c-af48-4dd8-b47d-066f4eebdc85 req-9faeda58-fcb3-42c8-abce-85601023b421 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043059 Oct 04 11:49:23.891528 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4485/6338] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:49:24.264110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:24.264859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:24.272316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:24.272814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:24.273279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:24.274011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:24.274484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:24.274959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:24.340058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:24.347960 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c41a950d-af97-4765-b384-5cfa957facf5 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1225 microversion: 2.1 time: 0.087721 Oct 04 11:49:24.348536 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1854/6339] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:24 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:25.371781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:25.372481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:25.379955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:25.380442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:25.380875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:25.381599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:25.382055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:25.382483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:25.510105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:25.521606 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-da1f52c1-6b6a-4639-b7c3-b67e2e7ed70e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1225 microversion: 2.1 time: 0.154034 Oct 04 11:49:25.522583 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4486/6340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:25 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:49:26.552227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:26.553616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:26.560671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:26.561174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:26.561654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:26.562382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:26.563266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:26.563266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:26.625442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:26.629726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:49:26.635523 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8a4f1bb4-01b3-439a-8e85-72786cf68e14 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1225 microversion: 2.1 time: 0.087335 Oct 04 11:49:26.636128 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1855/6341] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:26 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:27.659428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:27.660060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:27.670675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:27.671179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:27.671628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:27.672352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:27.672818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:27.673255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:27.742380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:27.752587 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53c5c05c-d271-4d13-9595-417416b12b66 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 200 len: 1225 microversion: 2.1 time: 0.098570 Oct 04 11:49:27.753552 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4487/6342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:27 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:49:28.775733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:28.776356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 847ab89a-5c6a-497a-a35b-a1b7da8ebc01] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:28.784200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:28.784696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:28.785201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:28.786450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:28.786925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:28.787369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:28.800789 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 could not be found. Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 HTTP/1.1 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 could not be found. Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '847ab89a-5c6a-497a-a35b-a1b7da8ebc01'} Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 could not be found. Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 could not be found. Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:49:28.803084 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 could not be found. Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 847ab89a-5c6a-497a-a35b-a1b7da8ebc01 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d30130aa-9302-4be9-b297-23665029c3dd tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01" status: 404 len: 111 microversion: 2.1 time: 0.033324 Oct 04 11:49:28.808062 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1856/6343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:28 2022] GET /compute/v2.1/servers/847ab89a-5c6a-497a-a35b-a1b7da8ebc01 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:49:35.304521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:35.305039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:35.307611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8a971ec5-23c2-4504-a80a-2c404630040b req-6914d087-ad01-4fed-8c5b-b9823a725cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fee68849-1cf6-4f88-95dc-901afbf47b38", "tag": "576adb7d-76a8-40ad-adaa-585e54e20a3b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:49:35.308028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=29 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:49:35.313074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:49:35.313913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:35.314489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:35.315336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:35.316580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:35.316580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:35.317139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:35.318560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8a971ec5-23c2-4504-a80a-2c404630040b req-6914d087-ad01-4fed-8c5b-b9823a725cdd service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:35.319052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8a971ec5-23c2-4504-a80a-2c404630040b req-6914d087-ad01-4fed-8c5b-b9823a725cdd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:35.319495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8a971ec5-23c2-4504-a80a-2c404630040b req-6914d087-ad01-4fed-8c5b-b9823a725cdd service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:35.322643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=69 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:49:35.332931 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8a971ec5-23c2-4504-a80a-2c404630040b req-6914d087-ad01-4fed-8c5b-b9823a725cdd service nova] Creating event network-changed:576adb7d-76a8-40ad-adaa-585e54e20a3b for instance fee68849-1cf6-4f88-95dc-901afbf47b38 on n-h2-791135-8 Oct 04 11:49:35.338227 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8a971ec5-23c2-4504-a80a-2c404630040b req-6914d087-ad01-4fed-8c5b-b9823a725cdd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034506 Oct 04 11:49:35.339151 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1857/6344] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:49:35.346065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:49:35.433576 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5691086f-754c-4924-90af-6ef56c041f7e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 204 len: 0 microversion: 2.1 time: 0.130432 Oct 04 11:49:35.435421 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4488/6345] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:49:35 2022] DELETE /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:49:35.444480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:35.445338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:35.451700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:35.452200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:35.452651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:35.453373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:35.453851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:35.454295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:35.592071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:35.599970 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df3ba314-6770-47d2-b8e0-91439a50ac6d tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1575 microversion: 2.1 time: 0.160050 Oct 04 11:49:35.600548 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1858/6346] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:35 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:49:36.623969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:36.624747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:36.631997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:36.632495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:36.632937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:36.633781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:36.634121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:36.634555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:36.813646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:36.821578 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ee08502-8a73-4780-ad0b-39c4f0672d6f tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1575 microversion: 2.1 time: 0.202003 Oct 04 11:49:36.822158 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4489/6347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:36 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:37.811267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b79c87e7-3f01-4d60-a43a-472614a775f1 req-2bd3d8ef-0956-477c-89a2-6b3653161bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fee68849-1cf6-4f88-95dc-901afbf47b38", "name": "network-vif-deleted", "tag": "576adb7d-76a8-40ad-adaa-585e54e20a3b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:49:37.821596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b79c87e7-3f01-4d60-a43a-472614a775f1 req-2bd3d8ef-0956-477c-89a2-6b3653161bad service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:37.822091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b79c87e7-3f01-4d60-a43a-472614a775f1 req-2bd3d8ef-0956-477c-89a2-6b3653161bad service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:37.822542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b79c87e7-3f01-4d60-a43a-472614a775f1 req-2bd3d8ef-0956-477c-89a2-6b3653161bad service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:37.833675 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b79c87e7-3f01-4d60-a43a-472614a775f1 req-2bd3d8ef-0956-477c-89a2-6b3653161bad service nova] Creating event network-vif-deleted:576adb7d-76a8-40ad-adaa-585e54e20a3b for instance fee68849-1cf6-4f88-95dc-901afbf47b38 on n-h2-791135-8 Oct 04 11:49:37.838610 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b79c87e7-3f01-4d60-a43a-472614a775f1 req-2bd3d8ef-0956-477c-89a2-6b3653161bad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031100 Oct 04 11:49:37.839216 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1859/6348] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:49:37.845145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:37.845793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:37.853157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:37.853698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:37.854132 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:37.854832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:37.855298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:37.855733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:37.925071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:37.933893 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d3ba39c2-0bd6-4ea7-a37d-c14b8538ed9e tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1225 microversion: 2.1 time: 0.092587 Oct 04 11:49:37.934482 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4490/6349] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:37 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:38.958080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:38.958802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:38.964919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:38.965442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:38.965894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:38.966598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:38.967067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:38.967512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:39.036632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:39.044485 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0af874c-378f-496e-b729-858e8d5d6bd2 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1225 microversion: 2.1 time: 0.091691 Oct 04 11:49:39.045058 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1860/6350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:38 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:40.068330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:40.068937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:40.075455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:40.075942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:40.076380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:40.077077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:40.077569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:40.078002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:40.144793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:40.153524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0321c9b8-3cfa-4d2c-9724-a48fe1bb0397 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1225 microversion: 2.1 time: 0.089656 Oct 04 11:49:40.154137 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4491/6351] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:40 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:41.176341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:41.176999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:41.184552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:41.185054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:41.185561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:41.186285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:41.186750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:41.187188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:41.254886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:41.262990 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3eb31056-2244-420c-b4b4-448a94b3fd08 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1225 microversion: 2.1 time: 0.090636 Oct 04 11:49:41.263763 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1861/6352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:41 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:42.285952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:42.286571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:42.293377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:42.293883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:42.294345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:42.295041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:42.295508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:42.295939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:42.327745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:42.328235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:42.328679 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:42.329148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lazy-loading 'fault' on Instance uuid fee68849-1cf6-4f88-95dc-901afbf47b38 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:49:42.370219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac84039f33d46b1b83b2334c76cf067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d437e74f2469b9156f089d745a082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:49:42.378793 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-38dfa20a-b3e9-4ddc-97c4-8a0af456f0ce tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 200 len: 1230 microversion: 2.1 time: 0.096753 Oct 04 11:49:42.379881 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4492/6353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:42 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:49:43.404447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:43.405099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: fee68849-1cf6-4f88-95dc-901afbf47b38] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:43.412513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:43.413009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:43.413483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:43.414194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:43.414662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:43.415099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:43.428620 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance fee68849-1cf6-4f88-95dc-901afbf47b38 could not be found. Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 HTTP/1.1 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance fee68849-1cf6-4f88-95dc-901afbf47b38 could not be found. Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'fee68849-1cf6-4f88-95dc-901afbf47b38'} Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fee68849-1cf6-4f88-95dc-901afbf47b38 could not be found. Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fee68849-1cf6-4f88-95dc-901afbf47b38 could not be found. Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:49:43.430346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fee68849-1cf6-4f88-95dc-901afbf47b38 could not be found. Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance fee68849-1cf6-4f88-95dc-901afbf47b38 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-03e6ae11-97dd-4c24-b9c9-0cf216754b63 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38" status: 404 len: 111 microversion: 2.1 time: 0.031403 Oct 04 11:49:43.434174 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1862/6354] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:43 2022] GET /compute/v2.1/servers/fee68849-1cf6-4f88-95dc-901afbf47b38 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:49:43.874081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:43.874604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:43.882651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:43.883140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:43.883583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:43.884280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:43.884739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:43.885171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:43.899332 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 HTTP/1.1 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '3a70b0aa-7eae-418e-a1c1-b01a81c0b910'} Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:49:43.901043 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5e49af50-45de-41df-9cba-dc0963a7ea71 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 404 len: 111 microversion: 2.1 time: 0.032309 Oct 04 11:49:43.905069 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4493/6355] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:49:43 2022] DELETE /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:49:43.911149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:43.911821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] [instance: 3a70b0aa-7eae-418e-a1c1-b01a81c0b910] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:43.917748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:43.918246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:43.918697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:43.919403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:43.919877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:43.920322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:43.933955 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] HTTP exception thrown: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Request method failure captured: Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 HTTP/1.1 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBrOkRibhIbo5cj7OnekbVwruqoUfTJ2UXlESJcQDF4UPxWz1EtpQVwmL3_aJDV1TEGJoHjuASSQqEQeZ5PNNruiQSPzfn-2cQJUq0MQ29zcKUqE17lDwTqKUZOtFVrWEnSgcavw-Zdh6l618wMBvabS_nZIoflazRq51vOEVVeN4q0 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_261d437e74f2469b9156f089d745a082"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/261d437e74f2469b9156f089d745a082"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/261d437e74f2469b9156f089d745a082"}]}] Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 261d437e74f2469b9156f089d745a082 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestVolumeBootPattern-254496804 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4ac84039f33d46b1b83b2334c76cf067 Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestVolumeBootPattern-254496804-project Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '3a70b0aa-7eae-418e-a1c1-b01a81c0b910'} Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:49:43.935827 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Returning 404 to user: Instance 3a70b0aa-7eae-418e-a1c1-b01a81c0b910 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d570736-3482-489e-aa4b-bdec108f2bd7 tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910" status: 404 len: 111 microversion: 2.1 time: 0.030043 Oct 04 11:49:43.939579 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1863/6356] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:49:43 2022] GET /compute/v2.1/servers/3a70b0aa-7eae-418e-a1c1-b01a81c0b910 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:49:47.358153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a67021d5-bc84-4f91-8d99-c687e5f3c27c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] Calling method '.version_select at 0x7f71cf0c29d0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:49:47.380474 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a67021d5-bc84-4f91-8d99-c687e5f3c27c tempest-TestVolumeBootPattern-254496804 tempest-TestVolumeBootPattern-254496804-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153425603" status: 202 len: 0 microversion: 2.1 time: 0.026160 Oct 04 11:49:47.381124 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4494/6357] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Oct 4 11:49:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153425603 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 11:49:52.903611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:49:52.906429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:49:52.914893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:52.915660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:52.916310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:52.917044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:49:52.917547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:49:52.918163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:49:52.987242 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5aeba6ab-64a5-4a6b-83b0-7d20011d30c0 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "POST /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1/action" status: 200 len: 24553 microversion: 2.1 time: 0.087589 Oct 04 11:49:52.992509 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1864/6358] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:49:52 2022] POST /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1/action => generated 24553 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:50:32.869183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-243d4604-0b7c-4e9e-9b1c-efcaf4637e15 req-adb111f4-9d7f-461f-9802-1211c67144a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5215fe-a321-46d4-aba2-90e4bb6859b1", "tag": "ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:50:32.872018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:32.872567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:32.876740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:50:32.877547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:50:32.887511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:32.887696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=15 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:50:32.888229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:32.888368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:50:32.888453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:32.889626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:32.889925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:32.890305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:32.895973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-243d4604-0b7c-4e9e-9b1c-efcaf4637e15 req-adb111f4-9d7f-461f-9802-1211c67144a5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:32.896822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-243d4604-0b7c-4e9e-9b1c-efcaf4637e15 req-adb111f4-9d7f-461f-9802-1211c67144a5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:32.897269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-243d4604-0b7c-4e9e-9b1c-efcaf4637e15 req-adb111f4-9d7f-461f-9802-1211c67144a5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:32.909711 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-243d4604-0b7c-4e9e-9b1c-efcaf4637e15 req-adb111f4-9d7f-461f-9802-1211c67144a5 service nova] Creating event network-changed:ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf for instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 on n-h2-791135-8 Oct 04 11:50:32.914731 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-243d4604-0b7c-4e9e-9b1c-efcaf4637e15 req-adb111f4-9d7f-461f-9802-1211c67144a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049676 Oct 04 11:50:32.915719 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1865/6359] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:50:32.921210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:50:33.014493 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f1a47549-fe53-4b2c-994a-49cb194bb694 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 204 len: 0 microversion: 2.1 time: 0.152858 Oct 04 11:50:33.015096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4495/6360] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:50:32 2022] DELETE /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:50:33.024804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:33.025692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:33.031930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:33.032424 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:33.032868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:33.033606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:33.034069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:33.034503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:33.186560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:33.194453 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1050e874-a22a-447c-b116-442033a18b5e tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1688 microversion: 2.1 time: 0.174459 Oct 04 11:50:33.195023 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1866/6361] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:33 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:50:34.219097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:34.219900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:34.226495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:34.226995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:34.227435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:34.228134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:34.228594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:34.229081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:34.385014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:34.393341 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-44067a5f-a9a8-49aa-8a2e-48f8ec05414c tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1688 microversion: 2.1 time: 0.178546 Oct 04 11:50:34.393935 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4496/6362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:34 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:50:35.255366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c10cbb4e-c4cc-4426-90a7-a7388ac926f1 req-eefd9674-3f20-4e41-8392-5d75fe8ba486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5215fe-a321-46d4-aba2-90e4bb6859b1", "name": "network-vif-deleted", "tag": "ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:50:35.265748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c10cbb4e-c4cc-4426-90a7-a7388ac926f1 req-eefd9674-3f20-4e41-8392-5d75fe8ba486 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:35.266183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c10cbb4e-c4cc-4426-90a7-a7388ac926f1 req-eefd9674-3f20-4e41-8392-5d75fe8ba486 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:35.266624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c10cbb4e-c4cc-4426-90a7-a7388ac926f1 req-eefd9674-3f20-4e41-8392-5d75fe8ba486 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:35.277080 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c10cbb4e-c4cc-4426-90a7-a7388ac926f1 req-eefd9674-3f20-4e41-8392-5d75fe8ba486 service nova] Creating event network-vif-deleted:ec2e7dd0-a5b6-4f9f-a034-77805b19ecbf for instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 on n-h2-791135-8 Oct 04 11:50:35.281917 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c10cbb4e-c4cc-4426-90a7-a7388ac926f1 req-eefd9674-3f20-4e41-8392-5d75fe8ba486 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221094 Oct 04 11:50:35.282498 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1867/6363] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:50:35.416686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:35.417439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:35.425177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:35.425731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:35.426176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:35.426901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:35.427370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:35.427805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:35.461467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:35.461877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:35.462323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:35.462783 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lazy-loading 'fault' on Instance uuid 1c5215fe-a321-46d4-aba2-90e4bb6859b1 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:50:35.513415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ca89dfc38d4097ae85eb1e0bd0302d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751bf34580b0489bbd182305466ec1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:35.522191 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-03eb3e8b-6c25-4152-8254-b9b22cd10603 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 200 len: 1356 microversion: 2.1 time: 0.109496 Oct 04 11:50:35.522791 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4497/6364] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:35 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:50:36.548231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:36.549064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] [instance: 1c5215fe-a321-46d4-aba2-90e4bb6859b1] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:36.555328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:36.555823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:36.556271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:36.556984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:36.557479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:36.557916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:36.571664 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] HTTP exception thrown: Instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 could not be found. Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Request method failure captured: Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 HTTP/1.1 Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPBwCqqNL-i3EZa7z0tpU4Mae_8QnJlkN2Y2XQIbrVHtgJVOxnCjzuIo2R_vuXGYjyDzYD5E1yQ-R0GEbaoxg4lKgRb4lYuCl3yNdqTmruXRq1-kOgP6K2KwEmHUPH-Ov7FVtUeOAnvw8mCpjRInzw-see2wIdHGohbTTl1FO87uNuAc Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 751bf34580b0489bbd182305466ec1dc Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_751bf34580b0489bbd182305466ec1dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751bf34580b0489bbd182305466ec1dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/751bf34580b0489bbd182305466ec1dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/751bf34580b0489bbd182305466ec1dc"}]}] Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 751bf34580b0489bbd182305466ec1dc Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206792760 Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-206792760-project Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: d1ca89dfc38d4097ae85eb1e0bd0302d Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206792760-project Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 could not be found. Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '1c5215fe-a321-46d4-aba2-90e4bb6859b1'} Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 could not be found. Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 could not be found. Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:50:36.573329 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 could not be found. Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Returning 404 to user: Instance 1c5215fe-a321-46d4-aba2-90e4bb6859b1 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-206abbae-b315-4ccc-9d61-1d2231875a99 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1" status: 404 len: 111 microversion: 2.1 time: 0.031675 Oct 04 11:50:36.577627 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1868/6365] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:36 2022] GET /compute/v2.1/servers/1c5215fe-a321-46d4-aba2-90e4bb6859b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:50:39.825872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0414fcc1-2cec-4258-a2a0-5143d22633b7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] Calling method '.version_select at 0x7f71cf0a8790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:39.852400 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0414fcc1-2cec-4258-a2a0-5143d22633b7 tempest-TestNetworkAdvancedServerOps-206792760 tempest-TestNetworkAdvancedServerOps-206792760-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1931178807" status: 202 len: 0 microversion: 2.1 time: 0.030919 Oct 04 11:50:39.853086 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4498/6366] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 4 11:50:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1931178807 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:50:51.507635 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:50:51.508143 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 11:50:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 04 11:50:51.508794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:50:51.510585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:50:51.624091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1123600629", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:50:51.682633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] validate_networks() for None {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:50:51.958981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:50:51.959418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:50:51.959916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:50:51.960345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:50:51.960773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:50:51.970753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:51.971258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:51.971710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:51.972454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:51.972926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:51.973389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:51.991217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Getting quotas for project fc9375e080b84ec2af1aa2692a137dec. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:50:51.997089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Getting quotas for user b50f13bfa4c14a0b913f33dc6cbf0764 and project fc9375e080b84ec2af1aa2692a137dec. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:50:52.009504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:50:52.011813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:50:52.055499 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bef24ede-fc39-4210-aea0-96b27bfbf100 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553997 Oct 04 11:50:52.056158 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1869/6367] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:50:52.068527 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:50:52.069055 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 11:50:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 (ip 10.222.0.23) !!! Oct 04 11:50:52.071064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:50:52.071869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:50:52.076042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01b35384-30d8-4c66-a305-4c7b226dc896 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:52.076661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-01b35384-30d8-4c66-a305-4c7b226dc896 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:52.139534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-01b35384-30d8-4c66-a305-4c7b226dc896 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:52.146516 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01b35384-30d8-4c66-a305-4c7b226dc896 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1222 microversion: 2.1 time: 0.081211 Oct 04 11:50:52.147081 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4499/6368] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:52 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:50:53.170403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a4e934c0-fee9-4771-8cac-eadf3e8b36af tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:53.171034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a4e934c0-fee9-4771-8cac-eadf3e8b36af tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:53.225633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4e934c0-fee9-4771-8cac-eadf3e8b36af tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:53.233190 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a4e934c0-fee9-4771-8cac-eadf3e8b36af tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1222 microversion: 2.1 time: 0.067673 Oct 04 11:50:53.233787 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1870/6369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:53 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:50:54.256596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:54.257136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:54.267918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:54.268412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:54.268844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:54.269577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:54.270037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:54.270500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:54.330422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:54.338680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4108a556-8b7b-4107-a678-9ca4e1cd3943 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1226 microversion: 2.1 time: 0.085699 Oct 04 11:50:54.339268 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4500/6370] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:54 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:50:55.361307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:55.361964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:55.368717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:55.369266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:55.370536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:55.371304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:55.371779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:55.372233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:55.435258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:55.442907 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91b6abd0-46b3-494e-9bff-623262b9f4a6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1292 microversion: 2.1 time: 0.085689 Oct 04 11:50:55.443475 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1871/6371] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:55 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:50:56.465867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:56.466516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:56.473584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:56.474076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:56.474516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:56.475219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:56.475693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:56.476108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:56.616034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:56.624515 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae44deeb-a981-48e1-84a1-2f453550a12f tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.162692 Oct 04 11:50:56.625099 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4501/6372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:56 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:50:56.780310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5be530ef-9101-4269-9885-85982f12c373 req-33b39c58-9ff2-4e4d-9c13-9d4a3587cec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01fba18-f68a-444e-a850-95f896747d06", "tag": "6fef5768-9e8f-4005-973e-c11bbee38582"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:50:56.792636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5be530ef-9101-4269-9885-85982f12c373 req-33b39c58-9ff2-4e4d-9c13-9d4a3587cec0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:56.793142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5be530ef-9101-4269-9885-85982f12c373 req-33b39c58-9ff2-4e4d-9c13-9d4a3587cec0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:56.793610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5be530ef-9101-4269-9885-85982f12c373 req-33b39c58-9ff2-4e4d-9c13-9d4a3587cec0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:56.804708 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5be530ef-9101-4269-9885-85982f12c373 req-33b39c58-9ff2-4e4d-9c13-9d4a3587cec0 service nova] Creating event network-changed:6fef5768-9e8f-4005-973e-c11bbee38582 for instance d01fba18-f68a-444e-a850-95f896747d06 on n-h2-791135-8 Oct 04 11:50:56.811336 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5be530ef-9101-4269-9885-85982f12c373 req-33b39c58-9ff2-4e4d-9c13-9d4a3587cec0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035473 Oct 04 11:50:56.811946 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1872/6373] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:50:57.648171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:57.648791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:57.656313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:57.656800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:57.657240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:57.658034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:57.658497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:57.658927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:57.786662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:57.794383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75fc2c3f-b35c-476e-a113-654e6a86eb2b tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.150209 Oct 04 11:50:57.794957 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4502/6374] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:57 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:50:58.816632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:58.817267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:58.824317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:58.824808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:58.825254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:58.825978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:58.826443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:58.826880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:58.953947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:50:58.961531 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd180a65-40c9-4e96-8c53-9055a25a84ef tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.149188 Oct 04 11:50:58.962099 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1873/6375] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:58 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:50:59.984364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:50:59.984987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:50:59.992252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:59.992748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:59.993192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:50:59.994534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:50:59.994998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:50:59.995430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:00.127347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:00.135978 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-36a07d3e-c954-4984-9b4a-48ccad086a0e tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.155575 Oct 04 11:51:00.136563 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4503/6376] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:50:59 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:01.158548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:01.159156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:01.166417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:01.166920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:01.167373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:01.168086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:01.168561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:01.169010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:01.299930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:01.307621 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-865bec80-042e-46d8-9af0-e89ecf3394e0 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.153226 Oct 04 11:51:01.308203 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1874/6377] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:01 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:02.330214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:02.330778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:02.333607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:02.339177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:02.339665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:02.340111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:02.340812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:02.341275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:02.341736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:02.474073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:02.481825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52d5a2b9-a584-4a0a-a075-0f9103869ca7 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.155548 Oct 04 11:51:02.482409 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4504/6378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:02 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:03.505079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:03.505671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:03.507642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:03.509068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:03.516110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:03.516604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:03.517049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:03.517774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:03.518243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:03.518682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:03.649847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:03.658113 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d7ee0138-8853-42fd-9c57-2b4f22f2f048 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.157473 Oct 04 11:51:03.658690 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1875/6379] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:03 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:04.245336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4d87d274-b5a0-4900-8626-2f552f75a85a req-f5228f3a-96cc-42eb-ac35-cc97e5336261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01fba18-f68a-444e-a850-95f896747d06", "name": "network-vif-plugged", "status": "completed", "tag": "6fef5768-9e8f-4005-973e-c11bbee38582"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:04.256514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4d87d274-b5a0-4900-8626-2f552f75a85a req-f5228f3a-96cc-42eb-ac35-cc97e5336261 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:04.257023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4d87d274-b5a0-4900-8626-2f552f75a85a req-f5228f3a-96cc-42eb-ac35-cc97e5336261 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:04.257491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4d87d274-b5a0-4900-8626-2f552f75a85a req-f5228f3a-96cc-42eb-ac35-cc97e5336261 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:04.269305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4d87d274-b5a0-4900-8626-2f552f75a85a req-f5228f3a-96cc-42eb-ac35-cc97e5336261 service nova] Creating event network-vif-plugged:6fef5768-9e8f-4005-973e-c11bbee38582 for instance d01fba18-f68a-444e-a850-95f896747d06 on n-h2-791135-8 Oct 04 11:51:04.274384 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4d87d274-b5a0-4900-8626-2f552f75a85a req-f5228f3a-96cc-42eb-ac35-cc97e5336261 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033006 Oct 04 11:51:04.274992 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4505/6380] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:51:04.681028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:04.682192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:04.688987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:04.689517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:04.689969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:04.690667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:04.691128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:04.691563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:04.820513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:04.828326 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e20cf300-2bee-40f2-b74c-9f8c3e220067 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.151207 Oct 04 11:51:04.828908 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1876/6381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:04 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:05.852550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:05.853680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:05.859861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:05.860341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:05.860777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:05.861493 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:05.861951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:05.862378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:05.998294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:06.006231 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d3a7dee9-9fb5-41ac-9b55-06b98decc9e6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1322 microversion: 2.1 time: 0.158916 Oct 04 11:51:06.006800 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4506/6382] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:05 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:07.028712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:07.029474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:07.036329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.036825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.037274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.038007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.038483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.038923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.165157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:07.172880 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3777ae1b-bc39-4be7-bf2a-70ebd41885b6 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1471 microversion: 2.1 time: 0.148164 Oct 04 11:51:07.173475 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1877/6383] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:07 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:07.264644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6ec26b31-e125-4ef5-9d95-d8c6a4b529d0 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Calling method '.version_select at 0x7f71cfad0c10>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:07.330864 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6ec26b31-e125-4ef5-9d95-d8c6a4b529d0 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/38e5d21d31d841c09140bdc824b5b665" status: 200 len: 371 microversion: 2.1 time: 0.137184 Oct 04 11:51:07.331433 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4507/6384] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:51:07 2022] GET /compute/v2.1/os-quota-sets/38e5d21d31d841c09140bdc824b5b665 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:51:07.343233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ed846c6-606b-4e85-ae07-fb2ca604721c tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-51668586", "id": 264645876, "os-flavor-access:is_public": "True"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:07.360973 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ed846c6-606b-4e85-ae07-fb2ca604721c tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021388 Oct 04 11:51:07.361591 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1878/6385] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:51:07 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:51:07.374203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "264645876"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:07.376488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:07.382836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.383326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.383768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.384517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.384982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.385446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.566680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b98b7b50781e4213a786fcb64ded8307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e5d21d31d841c09140bdc824b5b665', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:07.572947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] [instance: d01fba18-f68a-444e-a850-95f896747d06] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-51668586 {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:51:07.579577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.580063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.580507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.581238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.581729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.582160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.608008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Getting quotas for project fc9375e080b84ec2af1aa2692a137dec. Resources: {'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:51:07.615072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Getting quotas for user b50f13bfa4c14a0b913f33dc6cbf0764 and project fc9375e080b84ec2af1aa2692a137dec. Resources: {'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:51:07.627769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.api [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] ram quota exceeded for 38e5d21d31d841c09140bdc824b5b665, tried to resize instance. Oct 04 11:51:07.628576 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Request method failure captured: Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06/action HTTP/1.1 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 38 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB4buf-ylm8x_3yVqwHepKPgvYt8u_L5VE50g9kMWUwM4-05Uv5K8m-EeTLaB5XoRuM5RxIKroKVMDW_Vej5w1660GwnbKf32OCV1EnfJqJ1o2RYV1MVH2xGRdHlbEINm7435Rl9zH2avRHY0WoosUHD1orf9PG5DPS6meMv2V3KJZM Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 38e5d21d31d841c09140bdc824b5b665 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2067757139 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member,admin Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member,admin Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38e5d21d31d841c09140bdc824b5b665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38e5d21d31d841c09140bdc824b5b665"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38e5d21d31d841c09140bdc824b5b665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38e5d21d31d841c09140bdc824b5b665"}]}] Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2067757139 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 38e5d21d31d841c09140bdc824b5b665 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2067757139 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersAdminNegativeTestJSON-2067757139-project-admin Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: b98b7b50781e4213a786fcb64ded8307 Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2067757139-project-admin Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: {"resize": {"flavorRef": "264645876"}} Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'd01fba18-f68a-444e-a850-95f896747d06', 'body': {'resize': {'flavorRef': '264645876'}}} Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:51:07.632690 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a77c3ffd-5e15-428d-88b6-2abc58825842 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06/action" status: 403 len: 118 microversion: 2.1 time: 0.263849 Oct 04 11:51:07.637050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4508/6386] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:51:07 2022] POST /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06/action => generated 118 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:51:07.643245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a52f9ac2-2fb4-40b9-887b-58d02e986c72 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:07.660030 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a52f9ac2-2fb4-40b9-887b-58d02e986c72 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/264645876" status: 202 len: 0 microversion: 2.1 time: 0.020531 Oct 04 11:51:07.660580 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1879/6387] 10.222.0.23 () {58 vars in 1158 bytes} [Tue Oct 4 11:51:07 2022] DELETE /compute/v2.1/flavors/264645876 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:51:07.668780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32b233e5-4617-4ef7-87b2-8b89c4d27448 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:07.688543 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32b233e5-4617-4ef7-87b2-8b89c4d27448 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023959 Oct 04 11:51:07.689104 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4509/6388] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:51:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:07.709121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ec1f935-4e5c-4a82-b155-353361679299 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Calling method '.version_select at 0x7f71cf7a7700>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:07.779510 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ec1f935-4e5c-4a82-b155-353361679299 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/38e5d21d31d841c09140bdc824b5b665" status: 200 len: 371 microversion: 2.1 time: 0.074071 Oct 04 11:51:07.780091 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1880/6389] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 4 11:51:07 2022] GET /compute/v2.1/os-quota-sets/38e5d21d31d841c09140bdc824b5b665 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:51:07.792437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-38f353e4-ad9d-4da4-913d-d1fa11f35105 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-324434524", "id": 1872394635, "os-flavor-access:is_public": "True"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:07.811820 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-38f353e4-ad9d-4da4-913d-d1fa11f35105 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.023159 Oct 04 11:51:07.812728 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4510/6390] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:51:07 2022] POST /compute/v2.1/flavors => generated 436 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:51:07.824812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1872394635"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:07.827334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:07.833439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.833948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.834404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.835122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.835594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.836033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.981022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b98b7b50781e4213a786fcb64ded8307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38e5d21d31d841c09140bdc824b5b665', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:07.987228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] [instance: d01fba18-f68a-444e-a850-95f896747d06] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-324434524 {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:51:07.994432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.994927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.995378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:07.996116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:07.996583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:07.997016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:08.018729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Getting quotas for project fc9375e080b84ec2af1aa2692a137dec. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:51:08.023795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Getting quotas for user b50f13bfa4c14a0b913f33dc6cbf0764 and project fc9375e080b84ec2af1aa2692a137dec. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:51:08.037291 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.compute.api [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] cores quota exceeded for 38e5d21d31d841c09140bdc824b5b665, tried to resize instance. Oct 04 11:51:08.037974 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Request method failure captured: Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06/action HTTP/1.1 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 39 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB4buf-ylm8x_3yVqwHepKPgvYt8u_L5VE50g9kMWUwM4-05Uv5K8m-EeTLaB5XoRuM5RxIKroKVMDW_Vej5w1660GwnbKf32OCV1EnfJqJ1o2RYV1MVH2xGRdHlbEINm7435Rl9zH2avRHY0WoosUHD1orf9PG5DPS6meMv2V3KJZM Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 38e5d21d31d841c09140bdc824b5b665 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2067757139 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member,admin Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member,admin Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38e5d21d31d841c09140bdc824b5b665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38e5d21d31d841c09140bdc824b5b665"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38e5d21d31d841c09140bdc824b5b665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38e5d21d31d841c09140bdc824b5b665"}]}] Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2067757139 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 38e5d21d31d841c09140bdc824b5b665 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2067757139 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersAdminNegativeTestJSON-2067757139-project-admin Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: b98b7b50781e4213a786fcb64ded8307 Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2067757139-project-admin Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: {"resize": {"flavorRef": "1872394635"}} Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'd01fba18-f68a-444e-a850-95f896747d06', 'body': {'resize': {'flavorRef': '1872394635'}}} Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:51:08.039944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47d5134d-bd37-4210-b508-d91b6a4398d6 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06/action" status: 403 len: 113 microversion: 2.1 time: 0.220633 Oct 04 11:51:08.044163 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1881/6391] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:51:07 2022] POST /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06/action => generated 113 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:51:08.052386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f61629e7-1e16-42fe-933d-77081d825949 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:08.069459 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f61629e7-1e16-42fe-933d-77081d825949 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1872394635" status: 202 len: 0 microversion: 2.1 time: 0.020694 Oct 04 11:51:08.070055 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4511/6392] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 4 11:51:08 2022] DELETE /compute/v2.1/flavors/1872394635 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:51:08.078910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91cc5bc7-388a-4b44-bc02-1a4217668591 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:08.100156 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91cc5bc7-388a-4b44-bc02-1a4217668591 tempest-ServersAdminNegativeTestJSON-2067757139 tempest-ServersAdminNegativeTestJSON-2067757139-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025090 Oct 04 11:51:08.101082 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1882/6393] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 4 11:51:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:51:08.121465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:08.122086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:08.128539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:08.129018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:08.129484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:08.130184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:08.130645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:08.131074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:08.157724 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:51:08.237694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5366842-837d-4ede-9348-634d09563d80 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 204 len: 0 microversion: 2.1 time: 0.119932 Oct 04 11:51:08.239149 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4512/6394] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:51:08 2022] DELETE /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:51:08.247976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:08.248618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:08.254872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:08.255380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:08.255835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:08.256636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:08.257110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:08.257583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:08.404701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:08.412609 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3678b80-cc37-48a7-8bf4-29c826167315 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1477 microversion: 2.1 time: 0.169033 Oct 04 11:51:08.413187 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1883/6395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:08 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:09.436978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:09.437745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:09.445809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:09.446309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:09.446857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:09.448108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:09.448603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:09.449044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:09.605965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:09.613664 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aab02a0d-5a76-4413-83de-113968d5e5bd tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1477 microversion: 2.1 time: 0.181258 Oct 04 11:51:09.614540 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4513/6396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:09 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:10.216630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a195f8fe-e3bd-4195-b433-635ff1cf4375 req-fe144c40-3aca-49a2-8453-84447faa7ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01fba18-f68a-444e-a850-95f896747d06", "name": "network-vif-deleted", "tag": "6fef5768-9e8f-4005-973e-c11bbee38582"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:10.226925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a195f8fe-e3bd-4195-b433-635ff1cf4375 req-fe144c40-3aca-49a2-8453-84447faa7ff4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:10.227419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a195f8fe-e3bd-4195-b433-635ff1cf4375 req-fe144c40-3aca-49a2-8453-84447faa7ff4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:10.227879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a195f8fe-e3bd-4195-b433-635ff1cf4375 req-fe144c40-3aca-49a2-8453-84447faa7ff4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:10.240783 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a195f8fe-e3bd-4195-b433-635ff1cf4375 req-fe144c40-3aca-49a2-8453-84447faa7ff4 service nova] Creating event network-vif-deleted:6fef5768-9e8f-4005-973e-c11bbee38582 for instance d01fba18-f68a-444e-a850-95f896747d06 on n-h2-791135-8 Oct 04 11:51:10.246322 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a195f8fe-e3bd-4195-b433-635ff1cf4375 req-fe144c40-3aca-49a2-8453-84447faa7ff4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034856 Oct 04 11:51:10.246937 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1884/6397] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:51:10.636718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:10.637264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:10.643897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:10.644382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:10.644827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:10.645557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:10.646024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:10.646454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:10.677293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:10.677811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:10.678255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:10.678708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lazy-loading 'fault' on Instance uuid d01fba18-f68a-444e-a850-95f896747d06 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 11:51:10.721394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f13bfa4c14a0b913f33dc6cbf0764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc9375e080b84ec2af1aa2692a137dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:10.729202 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-58fc245b-c047-4ee9-95e8-fd3d8af53792 tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 200 len: 1312 microversion: 2.1 time: 0.096958 Oct 04 11:51:10.729958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4514/6398] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:10 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:11.753839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:11.754614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] [instance: d01fba18-f68a-444e-a850-95f896747d06] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:11.760711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:11.761208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:11.761682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:11.762384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:11.762853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:11.763293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:11.776868 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] HTTP exception thrown: Instance d01fba18-f68a-444e-a850-95f896747d06 could not be found. Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Request method failure captured: Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 HTTP/1.1 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB4aFRADtiai1njVD7fM7ctJ4-tC1Bg7GW092XJfGVtI3X7ReOu3yJMCgpZrX1mzJd2p_5FrPsd5GXY3NnREaryezae2fDgdFSBrhr0mLE088pRUxKYmAIDo0Hy9qxT47YVNtUFBQcBskYT7IrVgYnCpUorIbj_wKP_GRb6qymJKnM0 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: fc9375e080b84ec2af1aa2692a137dec Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1154441773 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fc9375e080b84ec2af1aa2692a137dec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9375e080b84ec2af1aa2692a137dec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fc9375e080b84ec2af1aa2692a137dec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fc9375e080b84ec2af1aa2692a137dec"}]}] Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1154441773 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: fc9375e080b84ec2af1aa2692a137dec Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1154441773 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersAdminNegativeTestJSON-1154441773-project Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: b50f13bfa4c14a0b913f33dc6cbf0764 Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1154441773-project Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance d01fba18-f68a-444e-a850-95f896747d06 could not be found. Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'd01fba18-f68a-444e-a850-95f896747d06'} Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01fba18-f68a-444e-a850-95f896747d06 could not be found. Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01fba18-f68a-444e-a850-95f896747d06 could not be found. Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:11.778581 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01fba18-f68a-444e-a850-95f896747d06 could not be found. Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] Returning 404 to user: Instance d01fba18-f68a-444e-a850-95f896747d06 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29990a1b-d8c3-4254-9f4c-ec67fa9fdfad tempest-ServersAdminNegativeTestJSON-1154441773 tempest-ServersAdminNegativeTestJSON-1154441773-project] 10.222.0.23 "GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06" status: 404 len: 111 microversion: 2.1 time: 0.031655 Oct 04 11:51:11.782981 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1885/6399] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:11 2022] GET /compute/v2.1/servers/d01fba18-f68a-444e-a850-95f896747d06 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:51:17.437588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:17.582310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-108447987", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "0ed73885-c71d-4989-b00a-e4ca0c7215e8"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:17.602749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:17.638257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] validate_networks() for [('0ed73885-c71d-4989-b00a-e4ca0c7215e8', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:51:18.036893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:51:18.037325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:51:18.037876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:51:18.038288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:51:18.038702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:51:18.047852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:18.048341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:18.048777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:18.049539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:18.049995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:18.050419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:18.067782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Getting quotas for project 29d72ae5ddcc46febde5b5ad4cde4186. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:51:18.073969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Getting quotas for user 09d46214a5bd4c9ca4d96fa43fd282f4 and project 29d72ae5ddcc46febde5b5ad4cde4186. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:51:18.086927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:51:18.089872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:51:18.138765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c130a4f3-74d1-49a4-ba05-5ef5917c73fb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707608 Oct 04 11:51:18.139422 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4515/6400] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:51:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:51:18.150702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b8ba87c-b6c3-4313-b116-d84a87b57b6c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:18.151539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b8ba87c-b6c3-4313-b116-d84a87b57b6c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:18.154592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:18.155755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:18.291428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b8ba87c-b6c3-4313-b116-d84a87b57b6c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:18.301336 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b8ba87c-b6c3-4313-b116-d84a87b57b6c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1214 microversion: 2.1 time: 0.154381 Oct 04 11:51:18.301956 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1886/6401] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:18 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:19.331412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:19.333557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:19.359697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:19.360548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:19.361660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:19.363397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:19.364768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:19.365608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:19.473252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:19.488246 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6279eea6-9f74-4001-bf9e-76742c6514c9 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1274 microversion: 2.1 time: 0.166212 Oct 04 11:51:19.490096 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4516/6402] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:19 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:20.518485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:20.519710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:20.528310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:20.528809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:20.529254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:20.530241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:20.530466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:20.531067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:20.775080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:20.783203 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2be1435b-1a79-46de-8809-94aac312a638 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1314 microversion: 2.1 time: 0.269415 Oct 04 11:51:20.783780 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1887/6403] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:20 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:20.962660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-457347c9-20a4-4488-85f9-a0d3d64aeffe req-373553fa-e2cf-486a-8ee9-6a395bd68c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fe0320-9f1e-4185-a5f3-69f1b3189333", "tag": "75eca270-1566-49ac-9e93-412aa7023422"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:20.975458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-457347c9-20a4-4488-85f9-a0d3d64aeffe req-373553fa-e2cf-486a-8ee9-6a395bd68c5f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:20.976126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-457347c9-20a4-4488-85f9-a0d3d64aeffe req-373553fa-e2cf-486a-8ee9-6a395bd68c5f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:20.976653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-457347c9-20a4-4488-85f9-a0d3d64aeffe req-373553fa-e2cf-486a-8ee9-6a395bd68c5f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:20.989709 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-457347c9-20a4-4488-85f9-a0d3d64aeffe req-373553fa-e2cf-486a-8ee9-6a395bd68c5f service nova] Creating event network-changed:75eca270-1566-49ac-9e93-412aa7023422 for instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 on n-h2-791135-8 Oct 04 11:51:20.996384 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-457347c9-20a4-4488-85f9-a0d3d64aeffe req-373553fa-e2cf-486a-8ee9-6a395bd68c5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043980 Oct 04 11:51:20.997571 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4517/6404] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:51:21.806343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:21.807006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:21.809724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:21.814899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:21.815395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:21.815843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:21.816544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:21.817010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:21.817588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:21.822650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=70 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:21.955789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:21.963428 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-07eae90f-ee3d-4e72-8ac7-69a6bd68334a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1314 microversion: 2.1 time: 0.161053 Oct 04 11:51:21.964000 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1888/6405] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:21 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:22.987460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:22.988172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:22.990150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:22.996282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:22.996770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:22.997209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:22.997946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:22.998411 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:22.998843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:23.002458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:23.132745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:23.140365 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d80b5417-b5de-43b2-9a09-9731e9274855 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1314 microversion: 2.1 time: 0.158135 Oct 04 11:51:23.140932 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4518/6406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:22 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:24.162863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:24.163436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:24.170837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:24.171336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:24.171787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:24.172497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:24.172963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:24.173440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:24.304672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:24.312241 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a833781-fcda-4993-b187-cec9d702da05 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1314 microversion: 2.1 time: 0.153404 Oct 04 11:51:24.312877 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1889/6407] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:24 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:25.334928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:25.335542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:25.343099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:25.343588 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:25.344033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:25.344733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:25.345195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:25.345659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:25.474856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:25.482524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7c579b53-19e8-455f-a547-ffa6343a5514 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1314 microversion: 2.1 time: 0.151562 Oct 04 11:51:25.483097 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4519/6408] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:25 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:26.506624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:26.507261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:26.514646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:26.515140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:26.515588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:26.516295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:26.516763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:26.517205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:26.645800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:26.653622 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24812472-3921-4f97-b203-135b28826bae tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1314 microversion: 2.1 time: 0.151208 Oct 04 11:51:26.654196 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1890/6409] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:26 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:27.676902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:27.677568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:27.684393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:27.684879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:27.685317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:27.686027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:27.686483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:27.686908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:27.824305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:27.831951 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-42ec4b9a-ab34-4a70-a46d-a5a738bbcb55 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1314 microversion: 2.1 time: 0.158925 Oct 04 11:51:27.832538 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4520/6410] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:27 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:28.329055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a48b12b0-8bbd-4879-a1d4-3dd05467a3a1 req-c6e541d5-b2f7-4e64-912b-70a3394ad897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fe0320-9f1e-4185-a5f3-69f1b3189333", "name": "network-vif-plugged", "status": "completed", "tag": "75eca270-1566-49ac-9e93-412aa7023422"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:28.334734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:28.340026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a48b12b0-8bbd-4879-a1d4-3dd05467a3a1 req-c6e541d5-b2f7-4e64-912b-70a3394ad897 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:28.340568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a48b12b0-8bbd-4879-a1d4-3dd05467a3a1 req-c6e541d5-b2f7-4e64-912b-70a3394ad897 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:28.340960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a48b12b0-8bbd-4879-a1d4-3dd05467a3a1 req-c6e541d5-b2f7-4e64-912b-70a3394ad897 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:28.352593 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a48b12b0-8bbd-4879-a1d4-3dd05467a3a1 req-c6e541d5-b2f7-4e64-912b-70a3394ad897 service nova] Creating event network-vif-plugged:75eca270-1566-49ac-9e93-412aa7023422 for instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 on n-h2-791135-8 Oct 04 11:51:28.357276 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a48b12b0-8bbd-4879-a1d4-3dd05467a3a1 req-c6e541d5-b2f7-4e64-912b-70a3394ad897 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031980 Oct 04 11:51:28.357911 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1891/6411] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:51:28.855716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:28.856342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:28.858318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:28.858999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:28.865802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:28.866292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:28.866738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:28.867440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:28.867905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:28.868904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:29.001720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:29.009561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b0879a6-1794-4b88-877f-b93e5811f1f8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1314 microversion: 2.1 time: 0.158301 Oct 04 11:51:29.010133 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4521/6412] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:28 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:30.033835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:30.034546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:30.041056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:30.041633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:30.042082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:30.042789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:30.043282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:30.043714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:30.174475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:30.182953 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b4db6a87-0c84-427b-851d-9230b969cbdb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1500 microversion: 2.1 time: 0.154318 Oct 04 11:51:30.183550 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1892/6413] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:30 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:30.205004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:51:30.207266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:30.214060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:30.214549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:30.214992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:30.215687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:30.216145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:30.216574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:30.245179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:30.250592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Old instance type m1.heat2, new instance type m1.heat {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:51:30.257300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:51:30.257746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:51:30.258227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:51:30.258668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:51:30.259081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:51:30.322871 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8aa2e8fa-63bf-4f30-9f41-72d780828708 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "POST /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333/action" status: 202 len: 0 microversion: 2.1 time: 0.121731 Oct 04 11:51:30.323406 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4522/6414] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:51:30 2022] POST /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:51:30.331562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:30.332187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:30.338170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:30.338642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:30.339090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:30.339803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:30.340273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:30.340711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:30.470727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:30.479550 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f20a0596-0c49-4111-bb08-3ebd6e470802 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1509 microversion: 2.1 time: 0.151958 Oct 04 11:51:30.480135 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1893/6415] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:30 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:31.503751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:31.504280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:31.511291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:31.511775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:31.512212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:31.512899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:31.513372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:31.513953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:31.651591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:31.659568 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b325c28e-ebb9-4a2c-b1b0-8031e6a63175 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1509 microversion: 2.1 time: 0.161062 Oct 04 11:51:31.660434 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4523/6416] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:31 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:32.684038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:32.684663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:32.691125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:32.691617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:32.692063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:32.692762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:32.693224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:32.693689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:32.821204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:32.828969 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0102051a-d6de-49a8-9f5a-8ffc7d90234b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.149547 Oct 04 11:51:32.829571 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1894/6417] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:32 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:33.852954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:33.853521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:33.860103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:33.860590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:33.861035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:33.861767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:33.862230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:33.862660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:33.998880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:34.006965 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9d073d02-9177-488e-89bf-ae09ef231116 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.158314 Oct 04 11:51:34.007547 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4524/6418] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:33 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:35.031018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:35.031648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:35.038509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:35.039004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:35.039454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:35.040734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:35.041202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:35.041673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:35.167627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:35.175283 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-41d7937e-d3f5-4a71-98dd-d2e8f6e03f52 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.148248 Oct 04 11:51:35.175861 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1895/6419] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:35 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:51:36.198576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:36.199194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:36.206033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:36.206519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:36.206961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:36.207661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:36.208120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:36.208549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:36.334661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:36.342903 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-799df108-8de2-4e2b-8d8f-9df40726f33c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.148824 Oct 04 11:51:36.343486 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4525/6420] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:36 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:37.364695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:37.365319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:37.372743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:37.373230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:37.373710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:37.374411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:37.374873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:37.375341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:37.506033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:37.514352 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1d425482-efb2-49bd-9626-448b0411aa9a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.153600 Oct 04 11:51:37.514992 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1896/6421] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:37 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:38.537568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:38.538183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:38.545048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:38.545572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:38.546010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:38.546705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:38.547164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:38.547589 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:38.681682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:38.689442 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d2dc58a4-90d1-4845-b3e6-0b86d2650722 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.155778 Oct 04 11:51:38.690016 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4526/6422] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:38 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:39.712669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:39.713271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:39.720135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:39.720623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:39.721071 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:39.721796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:39.722262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:39.722698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:39.851748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:39.859606 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b84cef39-ab81-43b7-9626-5f901bf394f7 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.151393 Oct 04 11:51:39.860194 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1897/6423] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:39 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:40.882998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:40.884069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:40.890988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:40.891475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:40.891913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:40.892615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:40.893073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:40.893538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:41.024253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:41.032163 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7bf27300-eea9-4cdf-91a5-cbcf51027a48 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.153497 Oct 04 11:51:41.032756 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4527/6424] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:40 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:42.055205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:42.055879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:42.063117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:42.063651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:42.064101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:42.064830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:42.065285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:42.065761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:42.200458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:42.208174 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a400b5d8-84e6-4cfc-8b9e-21586b08dd36 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.156896 Oct 04 11:51:42.208755 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1898/6425] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:42 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:43.231765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:43.232391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:43.239301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:43.239800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:43.240250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:43.240959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:43.241453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:43.241895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:43.375103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:43.382999 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9db8af0-537f-4a02-8bdf-de31b25d9762 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.155729 Oct 04 11:51:43.383576 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4528/6426] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:43 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:44.406388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:44.407016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:44.413973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:44.414466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:44.414951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:44.416198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:44.416666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:44.417104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:44.544462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:44.552229 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-399fd6fd-8245-49f4-92c9-f1ab02f74deb tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.149715 Oct 04 11:51:44.552800 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1899/6427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:44 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:45.574280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:45.574894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:45.581818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:45.582301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:45.582740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:45.583432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:45.583889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:45.584316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:45.711102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:45.719083 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a2c26532-be79-4809-9391-e1f3554d417c tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.148790 Oct 04 11:51:45.719655 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4529/6428] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:45 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:46.741994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:46.742678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:46.750099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:46.750595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:46.751045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:46.751753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:46.752231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:46.752671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:46.884335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:46.892157 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45a43259-5931-480b-84ff-b4fba1d2b3b8 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.154066 Oct 04 11:51:46.892734 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1900/6429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:46 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:47.916327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:47.916967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:47.924176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:47.924831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:47.925275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:47.926032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:47.926534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:47.926975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:48.066240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:48.074066 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dff42e09-c962-4871-9402-bc2df93e731a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.163263 Oct 04 11:51:48.074639 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4530/6430] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:47 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:49.096120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:49.096749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:49.104602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:49.105097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:49.105583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:49.106285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:49.106747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:49.107184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:49.238097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:49.245812 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fe21a9a3-641a-4b6f-9f38-081164f47f5b tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.153593 Oct 04 11:51:49.246377 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1901/6431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:49 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:50.269871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:50.270486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:50.277921 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:50.278403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:50.278843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:50.279531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:50.279987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:50.280415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:50.406146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:50.413782 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-30bf641a-8429-447f-bbe1-1cc890646a0a tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.147780 Oct 04 11:51:50.414356 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4531/6432] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:50 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:51.437605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:51.438232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:51.445113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:51.445638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:51.446086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:51.446782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:51.447248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:51.447679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:51.577014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:51.584734 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef3da9bd-fc2d-4c1f-859c-011723291c34 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.151031 Oct 04 11:51:51.585308 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1902/6433] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:51 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:52.608161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:52.608778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:52.616023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:52.616521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:52.616967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:52.617714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:52.618769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:52.619240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:52.751390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:52.759568 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8ee0a870-664f-42e7-a69b-686b9e7dcc19 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.155335 Oct 04 11:51:52.760152 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4532/6434] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:52 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:53.783028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:53.783686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:53.786560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=30 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:53.792350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:53.792848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:53.793300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:53.794033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:53.794499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:53.794937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:53.797663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=86 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:53.928739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:53.937034 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-751c7949-8b91-46b9-a529-1079ad6674ac tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.157987 Oct 04 11:51:53.937641 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1903/6435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:53 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:54.959576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:54.960193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:54.962896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=34 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:54.968138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:54.968621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:54.969059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:54.969786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:54.970246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:54.970675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:54.974618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:51:55.105058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:55.112802 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e976ec9-8b21-4030-8eea-9632bffcf7ed tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.157226 Oct 04 11:51:55.113588 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4533/6436] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:54 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:56.136912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:56.137586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:56.144587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:56.145085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:56.145568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:56.146278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:56.146761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:56.147240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:56.277881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:56.285523 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-45d2eee2-222b-40d7-840d-1d582be62126 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.153011 Oct 04 11:51:56.286113 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1904/6437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:56 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:57.308526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:57.309146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:57.316035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:57.316526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:57.316972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:57.317699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:57.318160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:57.318593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:57.446058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:57.454654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-614464ca-7bfb-4a21-89d8-8b2ad0e7a815 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.150446 Oct 04 11:51:57.455235 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4534/6438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:57 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:58.477906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:58.479019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:58.485832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:58.486319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:58.486756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:58.487449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:58.487910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:58.488341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:58.620654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:58.628723 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b175d9b-0c88-4688-aacc-95ad0e3f71fc tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1514 microversion: 2.1 time: 0.154464 Oct 04 11:51:58.629314 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1905/6439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:58 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:51:59.651333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:51:59.651955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:51:59.659176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:59.659678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:59.660127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:59.660953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:51:59.661457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:51:59.661924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:51:59.798027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:51:59.805774 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4edd7d5e-00b7-40fd-bcdb-63e5cca604d3 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1513 microversion: 2.1 time: 0.158298 Oct 04 11:51:59.806346 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4535/6440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:51:59 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:00.122227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c7baa6b0-e868-405c-9ede-aff8c438ff94 req-9cdc4453-3800-4cdd-9294-a06d4bbf797c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fe0320-9f1e-4185-a5f3-69f1b3189333", "name": "network-vif-unplugged", "status": "completed", "tag": "75eca270-1566-49ac-9e93-412aa7023422"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:00.132526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7baa6b0-e868-405c-9ede-aff8c438ff94 req-9cdc4453-3800-4cdd-9294-a06d4bbf797c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:00.133008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7baa6b0-e868-405c-9ede-aff8c438ff94 req-9cdc4453-3800-4cdd-9294-a06d4bbf797c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:00.133477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7baa6b0-e868-405c-9ede-aff8c438ff94 req-9cdc4453-3800-4cdd-9294-a06d4bbf797c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:00.145652 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c7baa6b0-e868-405c-9ede-aff8c438ff94 req-9cdc4453-3800-4cdd-9294-a06d4bbf797c service nova] Creating event network-vif-unplugged:75eca270-1566-49ac-9e93-412aa7023422 for instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 on n-h1-791135-8 Oct 04 11:52:00.151604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-c7baa6b0-e868-405c-9ede-aff8c438ff94 req-9cdc4453-3800-4cdd-9294-a06d4bbf797c service nova] Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:52:00.162467 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c7baa6b0-e868-405c-9ede-aff8c438ff94 req-9cdc4453-3800-4cdd-9294-a06d4bbf797c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044143 Oct 04 11:52:00.163289 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1906/6441] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:52:00.829314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:00.829990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:00.836813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:00.837374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:00.838306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:00.839060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:00.839527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:00.839961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:00.975841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:00.984940 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b08a501c-111b-4227-8b23-d3fc3ab17eef tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1513 microversion: 2.1 time: 0.159633 Oct 04 11:52:00.985549 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4536/6442] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:00 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:02.011116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:02.011830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:02.018036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:02.018533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:02.018978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:02.019682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:02.020153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:02.020598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:02.149926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:02.158251 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65ad9ac9-448b-4ec0-a392-e9f97a7ea554 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1511 microversion: 2.1 time: 0.153035 Oct 04 11:52:02.158829 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1907/6443] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:02 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:02.195553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-2c920cf3-e533-4d79-a440-2a092206830f req-099c38d7-5f2f-44a8-8c69-7dc2952a7d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fe0320-9f1e-4185-a5f3-69f1b3189333", "tag": "75eca270-1566-49ac-9e93-412aa7023422"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:02.206392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c920cf3-e533-4d79-a440-2a092206830f req-099c38d7-5f2f-44a8-8c69-7dc2952a7d97 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:02.206866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c920cf3-e533-4d79-a440-2a092206830f req-099c38d7-5f2f-44a8-8c69-7dc2952a7d97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:02.207294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-2c920cf3-e533-4d79-a440-2a092206830f req-099c38d7-5f2f-44a8-8c69-7dc2952a7d97 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:02.219468 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-2c920cf3-e533-4d79-a440-2a092206830f req-099c38d7-5f2f-44a8-8c69-7dc2952a7d97 service nova] Creating event network-changed:75eca270-1566-49ac-9e93-412aa7023422 for instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 on n-h1-791135-8 Oct 04 11:52:02.224674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-2c920cf3-e533-4d79-a440-2a092206830f req-099c38d7-5f2f-44a8-8c69-7dc2952a7d97 service nova] Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:52:02.235578 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-2c920cf3-e533-4d79-a440-2a092206830f req-099c38d7-5f2f-44a8-8c69-7dc2952a7d97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043708 Oct 04 11:52:02.236179 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4537/6444] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:52:03.181547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:03.182178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:03.188955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:03.189481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:03.189930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:03.190632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:03.191096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:03.191532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:03.323654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:03.331359 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cfa04905-4d3b-48ba-8505-17a6603a8927 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1508 microversion: 2.1 time: 0.153769 Oct 04 11:52:03.331939 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1908/6445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:03 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:52:03.355758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:03.356345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:03.362577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:03.363067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:03.363505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:03.364257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:03.364704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:03.365133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:03.393939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:52:03.442352 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.compute.api [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 11:52:04.869891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-affb592b-aa36-4e9a-9f49-8ba5131c6e01 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 204 len: 0 microversion: 2.1 time: 1.519120 Oct 04 11:52:04.870524 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4538/6446] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:52:03 2022] DELETE /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 0 bytes in 1521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:52:04.878904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:04.879561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:04.887238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:04.887735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:04.888185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:04.888897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:04.889383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:04.889826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:05.024448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:05.032365 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-22f9c78d-81d1-4583-93db-bae496d30070 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1500 microversion: 2.1 time: 0.157719 Oct 04 11:52:05.032943 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1909/6447] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:04 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:06.057400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:06.058111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:06.066211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:06.066701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:06.067138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:06.067834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:06.068288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:06.068711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:06.207378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d46214a5bd4c9ca4d96fa43fd282f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d72ae5ddcc46febde5b5ad4cde4186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:06.215716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b4e3518-96ca-4588-a0cd-02fd07f92ee2 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 200 len: 1500 microversion: 2.1 time: 0.163375 Oct 04 11:52:06.216296 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4539/6448] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:06 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:06.569933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-18d9e57e-c516-4219-98f9-a72b90c37bc8 req-f5fec908-d506-4e9e-895b-21dbfb401657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fe0320-9f1e-4185-a5f3-69f1b3189333", "name": "network-vif-deleted", "tag": "75eca270-1566-49ac-9e93-412aa7023422"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:06.587006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-18d9e57e-c516-4219-98f9-a72b90c37bc8 req-f5fec908-d506-4e9e-895b-21dbfb401657 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:06.588110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-18d9e57e-c516-4219-98f9-a72b90c37bc8 req-f5fec908-d506-4e9e-895b-21dbfb401657 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:06.588563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-18d9e57e-c516-4219-98f9-a72b90c37bc8 req-f5fec908-d506-4e9e-895b-21dbfb401657 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:06.601062 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-18d9e57e-c516-4219-98f9-a72b90c37bc8 req-f5fec908-d506-4e9e-895b-21dbfb401657 service nova] Creating event network-vif-deleted:75eca270-1566-49ac-9e93-412aa7023422 for instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 on n-h1-791135-8 Oct 04 11:52:06.606702 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-18d9e57e-c516-4219-98f9-a72b90c37bc8 req-f5fec908-d506-4e9e-895b-21dbfb401657 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040343 Oct 04 11:52:06.607248 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1910/6449] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:52:07.239763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:07.240407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:07.247787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:07.248274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:07.248710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:07.249432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:07.249898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:07.250329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:07.264121 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] HTTP exception thrown: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Request method failure captured: Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 HTTP/1.1 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB41nZDOfGRuXoq0XHEWVbazbpvaQbvtGt2lza-zq7ovsXy5EduJjSZCY5vIPjGSOt6b8KH5AdJykHXsZ7477YORNDmgQK8dFSpt1HFfmQa0tlD8bm2uBfyquBymrqMJJ4mGkdvShQ_l7EwSERVDwK0g26d5Nz43wa-pzLa1hmV1vVs Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 29d72ae5ddcc46febde5b5ad4cde4186 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29d72ae5ddcc46febde5b5ad4cde4186"}]}] Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 29d72ae5ddcc46febde5b5ad4cde4186 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1288096456-project Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 09d46214a5bd4c9ca4d96fa43fd282f4 Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1288096456-project Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '97fe0320-9f1e-4185-a5f3-69f1b3189333'} Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:52:07.265793 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Returning 404 to user: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-60a8aeed-45f4-478d-ad91-4ab6bb97a32e tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 404 len: 111 microversion: 2.1 time: 0.031375 Oct 04 11:52:07.269935 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4540/6450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:07 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:52:07.282647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:07.283251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:07.289515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:07.290011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:07.290460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:07.291654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:07.292139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:07.292536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:07.305659 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] HTTP exception thrown: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Request method failure captured: Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 HTTP/1.1 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB41nZDOfGRuXoq0XHEWVbazbpvaQbvtGt2lza-zq7ovsXy5EduJjSZCY5vIPjGSOt6b8KH5AdJykHXsZ7477YORNDmgQK8dFSpt1HFfmQa0tlD8bm2uBfyquBymrqMJJ4mGkdvShQ_l7EwSERVDwK0g26d5Nz43wa-pzLa1hmV1vVs Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 29d72ae5ddcc46febde5b5ad4cde4186 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29d72ae5ddcc46febde5b5ad4cde4186"}]}] Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 29d72ae5ddcc46febde5b5ad4cde4186 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-DeleteServersTestJSON-1288096456-project Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 09d46214a5bd4c9ca4d96fa43fd282f4 Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-DeleteServersTestJSON-1288096456-project Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '97fe0320-9f1e-4185-a5f3-69f1b3189333'} Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:52:07.307944 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Returning 404 to user: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa25ce53-a29c-4b4e-a70e-0317a87e8ce6 tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 404 len: 111 microversion: 2.1 time: 0.031028 Oct 04 11:52:07.312051 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1911/6451] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:52:07 2022] DELETE /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:52:07.317841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:07.318462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] [instance: 97fe0320-9f1e-4185-a5f3-69f1b3189333] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:07.324407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:07.324896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:07.325336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:07.326060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:07.326521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:07.326954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:07.340404 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] HTTP exception thrown: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Request method failure captured: Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 HTTP/1.1 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB41nZDOfGRuXoq0XHEWVbazbpvaQbvtGt2lza-zq7ovsXy5EduJjSZCY5vIPjGSOt6b8KH5AdJykHXsZ7477YORNDmgQK8dFSpt1HFfmQa0tlD8bm2uBfyquBymrqMJJ4mGkdvShQ_l7EwSERVDwK0g26d5Nz43wa-pzLa1hmV1vVs Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 29d72ae5ddcc46febde5b5ad4cde4186 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/29d72ae5ddcc46febde5b5ad4cde4186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/29d72ae5ddcc46febde5b5ad4cde4186"}]}] Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 29d72ae5ddcc46febde5b5ad4cde4186 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-DeleteServersTestJSON-1288096456 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-DeleteServersTestJSON-1288096456-project Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 09d46214a5bd4c9ca4d96fa43fd282f4 Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-DeleteServersTestJSON-1288096456-project Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '97fe0320-9f1e-4185-a5f3-69f1b3189333'} Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:52:07.341945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] Returning 404 to user: Instance 97fe0320-9f1e-4185-a5f3-69f1b3189333 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b65f267b-801b-4e43-876d-f5f3fb047eee tempest-DeleteServersTestJSON-1288096456 tempest-DeleteServersTestJSON-1288096456-project] 10.222.0.23 "GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333" status: 404 len: 111 microversion: 2.1 time: 0.029339 Oct 04 11:52:07.346372 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4541/6452] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:07 2022] GET /compute/v2.1/servers/97fe0320-9f1e-4185-a5f3-69f1b3189333 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:52:15.939453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1915208446", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "518f7f1e-2a87-49be-a990-987dfa6c2f82"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:15.997729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] validate_networks() for [('518f7f1e-2a87-49be-a990-987dfa6c2f82', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:52:16.653667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:52:16.654101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:52:16.654586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:52:16.655019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:52:16.655441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:52:16.664286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:16.664769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:16.665823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:16.666574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:16.667032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:16.667494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:16.683917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Getting quotas for project 3c3aebf19237457ba93e9515ac2d9802. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:52:16.689340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Getting quotas for user 4894efa6e7a34d5ba3404baa059ae0e0 and project 3c3aebf19237457ba93e9515ac2d9802. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:52:16.702636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:52:16.704892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:52:16.751054 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3dff641b-dff7-4c65-a247-407eae709012 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952415 Oct 04 11:52:16.751941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1912/6453] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:52:16.763081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6db4ce7f-b52b-4e34-b90c-7e05a24862c1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:16.763715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6db4ce7f-b52b-4e34-b90c-7e05a24862c1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:16.835015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6db4ce7f-b52b-4e34-b90c-7e05a24862c1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:16.842862 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6db4ce7f-b52b-4e34-b90c-7e05a24862c1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1218 microversion: 2.1 time: 0.083598 Oct 04 11:52:16.843447 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4542/6454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:16 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:17.866423 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:17.867039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:17.874237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:17.874728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:17.875170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:17.875883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:17.876330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:17.876761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:17.944528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:17.954211 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f7c56fb9-1ea4-4cc1-bf36-4e44f0911f0e tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1270 microversion: 2.1 time: 0.092465 Oct 04 11:52:17.956483 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1913/6455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:17 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:18.980577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:18.981380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:18.984043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:18.992316 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:18.992923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:18.994021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:18.994828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:18.995366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:18.995876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:19.155279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:19.163824 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-709d818a-1e16-4024-8c8f-b2b962d8bba2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1318 microversion: 2.1 time: 0.187521 Oct 04 11:52:19.177775 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4543/6456] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:18 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:19.561747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-54b51fa0-766d-4627-8a14-ed524478add6 req-b2ca0e4e-46f7-4444-ab37-f33818403700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63083d7d-3fa5-4e46-9fdd-96946b96f129", "tag": "c7f91731-eb4d-492b-b79f-91e8857bf258"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:19.577237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-54b51fa0-766d-4627-8a14-ed524478add6 req-b2ca0e4e-46f7-4444-ab37-f33818403700 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:19.577890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-54b51fa0-766d-4627-8a14-ed524478add6 req-b2ca0e4e-46f7-4444-ab37-f33818403700 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:19.578602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-54b51fa0-766d-4627-8a14-ed524478add6 req-b2ca0e4e-46f7-4444-ab37-f33818403700 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:19.592674 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-54b51fa0-766d-4627-8a14-ed524478add6 req-b2ca0e4e-46f7-4444-ab37-f33818403700 service nova] Creating event network-changed:c7f91731-eb4d-492b-b79f-91e8857bf258 for instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 on n-h2-791135-8 Oct 04 11:52:19.598124 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-54b51fa0-766d-4627-8a14-ed524478add6 req-b2ca0e4e-46f7-4444-ab37-f33818403700 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040632 Oct 04 11:52:19.599444 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1914/6457] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:52:20.186887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:20.187501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:20.194364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:20.194859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:20.195288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:20.195975 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:20.196433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:20.196858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:20.322963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:20.330602 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8780e6e6-913c-4770-a48f-83372e83dd7a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1318 microversion: 2.1 time: 0.147726 Oct 04 11:52:20.331176 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4544/6458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:20 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:21.355875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:21.356673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:21.363174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:21.363775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:21.364227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:21.364938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:21.365441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:21.365897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:21.504698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:21.512956 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2b5cf7f0-7a90-4292-831d-1a43b8816733 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1318 microversion: 2.1 time: 0.163016 Oct 04 11:52:21.513558 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1915/6459] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:21 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:22.535389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:22.536038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:22.543373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:22.543866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:22.544341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:22.545060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:22.545558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:22.545997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:22.685190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:22.693033 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-717e5d14-54f3-4e83-a568-b6e43b0241d6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1318 microversion: 2.1 time: 0.161588 Oct 04 11:52:22.693663 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4545/6460] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:22 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:23.714980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:23.715605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:23.722481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:23.722971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:23.723419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:23.724121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:23.724665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:23.725114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:23.854765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:23.857076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=64 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:23.863954 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f36e15b3-e757-4a90-b5d2-f7d960dcdeba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1318 microversion: 2.1 time: 0.152922 Oct 04 11:52:23.864533 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1916/6461] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:23 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:24.888911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:24.889568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:24.896398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:24.896884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:24.897327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:24.898039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:24.898494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:24.898922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:25.031027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:25.038762 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb7ec102-d47d-4f6c-9e82-a1d6ede4b50f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1318 microversion: 2.1 time: 0.153870 Oct 04 11:52:25.039343 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4546/6462] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:24 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:26.061531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:26.062150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:26.064827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:26.070027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:26.070515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:26.070956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:26.072203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:26.072666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:26.073096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:26.201742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:26.209619 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f4e4558-a231-402c-8c37-f163a46dc05a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1318 microversion: 2.1 time: 0.152020 Oct 04 11:52:26.210228 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1917/6463] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:26 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:26.577688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-eff4fd9c-cce5-43f4-948f-0e5f46bf6b20 req-37275103-d394-46c2-91d9-77468a95da23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63083d7d-3fa5-4e46-9fdd-96946b96f129", "name": "network-vif-plugged", "status": "completed", "tag": "c7f91731-eb4d-492b-b79f-91e8857bf258"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:26.583459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:26.589315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eff4fd9c-cce5-43f4-948f-0e5f46bf6b20 req-37275103-d394-46c2-91d9-77468a95da23 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:26.589852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eff4fd9c-cce5-43f4-948f-0e5f46bf6b20 req-37275103-d394-46c2-91d9-77468a95da23 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:26.590305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-eff4fd9c-cce5-43f4-948f-0e5f46bf6b20 req-37275103-d394-46c2-91d9-77468a95da23 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:26.603781 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-eff4fd9c-cce5-43f4-948f-0e5f46bf6b20 req-37275103-d394-46c2-91d9-77468a95da23 service nova] Creating event network-vif-plugged:c7f91731-eb4d-492b-b79f-91e8857bf258 for instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 on n-h2-791135-8 Oct 04 11:52:26.608794 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-eff4fd9c-cce5-43f4-948f-0e5f46bf6b20 req-37275103-d394-46c2-91d9-77468a95da23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034925 Oct 04 11:52:26.609427 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4547/6464] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:52:27.232129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:27.232760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:27.234917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:27.235601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:27.242404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:27.242902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:27.243853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:27.244560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:27.245025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:27.245507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:27.370961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:27.378831 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d8b4367-9dd8-42a5-90a9-3036c355ad4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1318 microversion: 2.1 time: 0.150434 Oct 04 11:52:27.379455 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1918/6465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:27 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:28.399127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:28.404813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:28.405559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:28.412061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:28.412548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:28.412992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:28.413713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:28.414173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:28.414605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:28.542560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:28.550434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb918421-df1a-4449-9433-5141b8f6f824 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1507 microversion: 2.1 time: 0.152293 Oct 04 11:52:28.551018 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4548/6466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:28 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:28.572957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:28.573608 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:28.580697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:28.581184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:28.581683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:28.582380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:28.582836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:28.583268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:28.715380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:28.723294 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c6232c1-0416-403d-b952-eb982ff342f0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1507 microversion: 2.1 time: 0.154754 Oct 04 11:52:28.723889 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1919/6467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:28 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:52:28.746473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:28.749020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:28.755382 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:28.755904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:28.756350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:28.757080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:28.757575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:28.758011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:28.820038 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c205ee63-099f-450e-8fbc-7ee9d8cf87fb tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "PUT /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1079 microversion: 2.1 time: 0.078002 Oct 04 11:52:28.823976 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4549/6468] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 4 11:52:28 2022] PUT /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1079 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:28.839207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:28.839833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:28.845806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:28.846303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:28.846750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:28.847449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:28.847915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:28.848351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:28.980109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:28.987988 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4ab6e48-b573-4ef9-9cec-82c079e38cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1505 microversion: 2.1 time: 0.152643 Oct 04 11:52:28.988560 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1920/6469] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:28 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:29.010354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:29.010976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:29.016976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:29.017619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:29.018069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:29.018767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:29.019230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:29.019664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:29.153968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:29.161784 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8a01046b-bcf4-4452-9099-c8876c364524 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1505 microversion: 2.1 time: 0.155380 Oct 04 11:52:29.162362 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4550/6470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:29 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:29.184408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:29.186743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:29.192693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:29.193184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:29.193682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:29.194377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:29.194835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:29.195272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:29.268531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:29.274014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Old instance type m1.heat2, new instance type m1.heat {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:52:29.280479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:52:29.280890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:52:29.281393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:52:29.281818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:52:29.282250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:52:29.387482 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa6246c5-ba0f-4bbe-8a5d-9684bf90235a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "POST /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129/action" status: 202 len: 0 microversion: 2.1 time: 0.207440 Oct 04 11:52:29.388025 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1921/6471] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:52:29 2022] POST /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:52:29.396209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:29.396828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:29.404392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:29.404890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:29.405303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:29.406033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:29.406491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:29.406922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:29.574571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:29.582536 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4b75f16a-5fa9-4c3f-9c8c-a17804c45b4c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1516 microversion: 2.1 time: 0.190214 Oct 04 11:52:29.583111 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4551/6472] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:29 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:30.605513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:30.606150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:30.617002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:30.617540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:30.618644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:30.619371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:30.619841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:30.620286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:30.817512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:30.825238 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1bbdc45a-d024-40f8-b82c-98793dde1941 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1516 microversion: 2.1 time: 0.224246 Oct 04 11:52:30.825852 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1922/6473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:30 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:31.848407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:31.848917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:31.856202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:31.856685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:31.857122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:31.857920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:31.858376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:31.858802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:31.988309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:31.996560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e5d7e591-62f5-4b7d-b43b-bd845371fe4b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.152162 Oct 04 11:52:31.997127 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4552/6474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:31 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:33.020002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:33.020632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:33.028372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:33.028869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:33.029319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:33.030050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:33.030519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:33.030968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:33.164215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:33.172512 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2f6e1eb7-b65f-491d-a836-2885966f1174 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.156657 Oct 04 11:52:33.173090 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1923/6475] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:33 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:34.197527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:34.198289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:34.206075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:34.206564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:34.207007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:34.207709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:34.208174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:34.208605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:34.344351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:34.352223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b391ec03-e28f-474d-8f3f-56f45c222842 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.158897 Oct 04 11:52:34.352793 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4553/6476] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:34 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:35.375065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:35.375692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:35.383303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:35.383806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:35.384258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:35.384961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:35.385452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:35.385892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:35.522428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:35.530598 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c270278-5fc6-4def-9789-e84faf478c2c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.159513 Oct 04 11:52:35.531171 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1924/6477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:35 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:36.553845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:36.554464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:36.562868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:36.562868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:36.563317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:36.564031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:36.564490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:36.564922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:36.691251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:36.698912 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5d971fd-c6ab-4c9b-bad5-040a305afbf3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.149058 Oct 04 11:52:36.699492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4554/6478] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:36 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:37.721374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:37.722075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:37.728944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:37.729507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:37.729999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:37.730700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:37.731160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:37.731593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:37.859628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:37.867396 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2234e97a-4f3c-4127-8e4f-7c9626b949fc tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.149863 Oct 04 11:52:37.868040 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1925/6479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:37 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:38.891478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:38.892058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:38.899494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:38.899986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:38.900431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:38.901143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:38.901641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:38.902078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:39.029574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:39.037554 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b2f21105-7a3c-488a-9b80-732b24f096e4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.150088 Oct 04 11:52:39.038134 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4555/6480] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:38 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:40.061283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:40.061948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:40.068911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:40.069433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:40.069884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:40.070587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:40.071643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:40.072083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:40.206525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:40.214141 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c7210691-d58e-42ef-ba35-e64804d6d4ca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.156761 Oct 04 11:52:40.214724 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1926/6481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:40 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:41.237336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:41.237971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:41.244758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:41.245265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:41.245725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:41.246415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:41.246865 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:41.247288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:41.381748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:41.390161 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1303e169-b49b-45c3-9a0e-722fb497e7d4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.156867 Oct 04 11:52:41.390755 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4556/6482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:41 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:42.413621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:42.414240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:42.420999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:42.421527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:42.421976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:42.422678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:42.423143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:42.423580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:42.550979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:42.559287 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a28f8c26-7e4e-4d21-b4c0-49b6f282709b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.149546 Oct 04 11:52:42.559863 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1927/6483] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:42 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:52:43.582384 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:43.583012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:43.590613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:43.591101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:43.591570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:43.592268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:43.592727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:43.593157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:43.723531 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:43.731368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1bc5bef5-04a8-408a-8bc5-32c347f61d23 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.153017 Oct 04 11:52:43.731943 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4557/6484] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:43 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:44.754963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:44.755594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:44.763021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:44.763519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:44.763965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:44.764666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:44.765134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:44.765605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:44.900440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:44.908208 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4837bf73-d1e1-46dd-be7a-d81760b90243 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.157477 Oct 04 11:52:44.908797 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1928/6485] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:44 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:45.931344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:45.931954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:45.938798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:45.939279 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:45.939714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:45.940403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:45.940855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:45.941280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:46.073419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:46.081134 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fcd6e92e-4de6-4cbe-a036-3485b0214cfa tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.154184 Oct 04 11:52:46.081738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4558/6486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:45 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:47.104883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:47.105542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:47.112461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:47.112957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:47.113442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:47.114146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:47.114617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:47.115052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:47.241702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:47.250012 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6ab8e8be-f935-4b81-92dc-c7435b5cafea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.149575 Oct 04 11:52:47.250596 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1929/6487] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:47 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:48.272699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:48.273405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:48.280834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:48.281319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:48.281789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:48.282494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:48.282947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:48.283373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:48.301109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:48.413511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:48.421108 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6a477488-37cd-4cd9-81f0-6375cabc23ba tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.152382 Oct 04 11:52:48.421708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4559/6488] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:48 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:49.444894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:49.446040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:49.452951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:49.453475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:49.453934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:49.454629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:49.455094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:49.455528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:49.587007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:49.594777 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90098c12-1e5d-4abd-9625-e5f6c87a63b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.153789 Oct 04 11:52:49.595350 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1930/6489] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:49 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:50.617707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:50.618326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:50.625245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:50.625756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:50.626199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:50.626918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:50.627373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:50.627800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:50.761344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:50.769043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-615a245f-18a7-4c18-bfeb-215350576c6b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.155375 Oct 04 11:52:50.769649 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4560/6490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:50 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:51.792865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:51.793516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:51.800308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:51.800802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:51.801246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:51.801972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:51.802433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:51.802868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:51.935754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:51.943383 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1c65942e-d680-415a-b6b8-0c8ca75dd273 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.154945 Oct 04 11:52:51.943948 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1931/6491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:51 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:52.966678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:52.967301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:52.974201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:52.974689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:52.975129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:52.975824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:52.976285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:52.977214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:53.105150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:53.112884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-410a3484-b771-4112-b448-56e10127a278 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.150188 Oct 04 11:52:53.113491 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4561/6492] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:52 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:54.137128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:54.137808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:54.144575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:54.145065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:54.145548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:54.146247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:54.146714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:54.147147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:54.149875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:54.278530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:54.286162 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-98a2b9fc-a218-43a9-a205-9ca68bd4bfcd tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.153939 Oct 04 11:52:54.286735 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1932/6493] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:54 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:55.309407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:55.309794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:55.316452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:55.316942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:55.317410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:55.318146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:55.318604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:55.319035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:55.446311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:55.453994 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-666c7c26-2fb6-436c-a390-3994f828bb75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.148782 Oct 04 11:52:55.454561 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4562/6494] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:55 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:56.476090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:56.476710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:56.479409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=36 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:56.485177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:56.485700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:56.486149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:56.486855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:56.487433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:56.487876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:56.618257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:56.626146 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0175ca35-df82-4511-a6c4-5660c311d304 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.153980 Oct 04 11:52:56.626726 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1933/6495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:56 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:57.650758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:57.651377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:57.654082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=32 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:52:57.659497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:57.659988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:57.660430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:57.661124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:57.661608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:57.662045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:57.796031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:57.803627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d337eed7-bff3-4dd1-8be3-bf407c120a75 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1521 microversion: 2.1 time: 0.157423 Oct 04 11:52:57.804218 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4563/6496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:57 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:52:58.515523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1419fc30-8438-45c9-bcf4-1e52ca13e6d0 req-7e301ee6-08ca-4def-94c8-f331bd353736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63083d7d-3fa5-4e46-9fdd-96946b96f129", "name": "network-vif-unplugged", "status": "completed", "tag": "c7f91731-eb4d-492b-b79f-91e8857bf258"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:52:58.526300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1419fc30-8438-45c9-bcf4-1e52ca13e6d0 req-7e301ee6-08ca-4def-94c8-f331bd353736 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:58.526790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1419fc30-8438-45c9-bcf4-1e52ca13e6d0 req-7e301ee6-08ca-4def-94c8-f331bd353736 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:58.527231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1419fc30-8438-45c9-bcf4-1e52ca13e6d0 req-7e301ee6-08ca-4def-94c8-f331bd353736 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:58.542159 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1419fc30-8438-45c9-bcf4-1e52ca13e6d0 req-7e301ee6-08ca-4def-94c8-f331bd353736 service nova] Creating event network-vif-unplugged:c7f91731-eb4d-492b-b79f-91e8857bf258 for instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 on n-h1-791135-8 Oct 04 11:52:58.547719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-1419fc30-8438-45c9-bcf4-1e52ca13e6d0 req-7e301ee6-08ca-4def-94c8-f331bd353736 service nova] Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:52:58.559748 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1419fc30-8438-45c9-bcf4-1e52ca13e6d0 req-7e301ee6-08ca-4def-94c8-f331bd353736 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047983 Oct 04 11:52:58.560786 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1934/6497] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:52:58.825736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:58.826512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:52:58.833476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:58.833973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:58.834421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:58.835134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:58.835601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:58.836542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:58.969438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:52:58.978947 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9faf0af9-0417-4de7-aea4-62e66df81709 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1520 microversion: 2.1 time: 0.157224 Oct 04 11:52:58.979521 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4564/6498] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:58 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:00.003530 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:00.004512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:00.010674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:00.011162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:00.011607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:00.012306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:00.012771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:00.013207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:00.149715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:00.157316 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4d12c774-268b-4bcd-9579-0e1af6897fb6 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1518 microversion: 2.1 time: 0.159068 Oct 04 11:53:00.157911 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1935/6499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:52:59 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:00.577800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-0c223942-cbc4-414e-9a2b-b2af211f2e34 req-f1668aba-c014-4e5f-90a2-aadfde4fdfbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63083d7d-3fa5-4e46-9fdd-96946b96f129", "tag": "c7f91731-eb4d-492b-b79f-91e8857bf258"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:00.588631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0c223942-cbc4-414e-9a2b-b2af211f2e34 req-f1668aba-c014-4e5f-90a2-aadfde4fdfbb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:00.589148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0c223942-cbc4-414e-9a2b-b2af211f2e34 req-f1668aba-c014-4e5f-90a2-aadfde4fdfbb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:00.589622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-0c223942-cbc4-414e-9a2b-b2af211f2e34 req-f1668aba-c014-4e5f-90a2-aadfde4fdfbb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:00.601039 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-0c223942-cbc4-414e-9a2b-b2af211f2e34 req-f1668aba-c014-4e5f-90a2-aadfde4fdfbb service nova] Creating event network-changed:c7f91731-eb4d-492b-b79f-91e8857bf258 for instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 on n-h1-791135-8 Oct 04 11:53:00.606313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-0c223942-cbc4-414e-9a2b-b2af211f2e34 req-f1668aba-c014-4e5f-90a2-aadfde4fdfbb service nova] Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:53:00.616836 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-0c223942-cbc4-414e-9a2b-b2af211f2e34 req-f1668aba-c014-4e5f-90a2-aadfde4fdfbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042770 Oct 04 11:53:00.617655 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4565/6500] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:53:01.181609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:01.182229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:01.189521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:01.190016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:01.190458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:01.191170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:01.191630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:01.192058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:01.552645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:01.561440 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4804353a-64f3-481e-aa9c-0e7642b90ba0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1515 microversion: 2.1 time: 0.384239 Oct 04 11:53:01.563005 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1936/6501] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:01 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:01.585432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:01.586574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:01.593873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:01.594360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:01.594800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:01.595496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:01.595955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:01.596385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:01.654481 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-860eedbd-b899-495f-a7a9-386cb816685d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "POST /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129/action" status: 204 len: 0 microversion: 2.1 time: 0.073036 Oct 04 11:53:01.655407 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4566/6502] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:53:01 2022] POST /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:53:01.669887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:01.670540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:01.686599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:01.687224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:01.687683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:01.688628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:01.689117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:01.689596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:01.937888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:01.946223 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-076c32aa-ed43-4228-bb5e-80662069e382 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1515 microversion: 2.1 time: 0.286387 Oct 04 11:53:01.947506 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1937/6503] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:01 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:02.970535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:02.971564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:02.979429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:02.979914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:02.980348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:02.981052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:02.981558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:02.981989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:03.128699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:03.139398 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-62c47253-5215-45b0-920e-4672d230eb43 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1515 microversion: 2.1 time: 0.173129 Oct 04 11:53:03.140517 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4567/6504] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:02 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:04.164863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:04.165517 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:04.172323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:04.172818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:04.173262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:04.173997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:04.174464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:04.174904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:04.302102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:04.309776 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f72f7f62-973d-4c2c-8b59-2293eb753626 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1507 microversion: 2.1 time: 0.149414 Oct 04 11:53:04.310348 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1938/6505] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:04 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:04.331940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:04.332566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:04.339816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:04.340299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:04.340738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:04.341456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:04.341919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:04.342351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:04.472512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:04.480211 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7dddaacc-0958-4dfa-ac55-8562ec661ada tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1507 microversion: 2.1 time: 0.152169 Oct 04 11:53:04.480788 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4568/6506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:04 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:04.505496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0046e564-cc62-400a-84da-d0d31dee10b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Action: 'create', calling method: .version_select at 0x7f71cfef2ee0>, body: {"keypair": {"name": "tempest-keypair-2115514315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8xKvnSEofxISVJBpRm9/+A+X6CKMc+hilgkKufH4hzAbbiMNF0ce/aeNTSzP5W8dL7cA2h5VIES0N22OMeWcajLTWwaK04eu9AtWWAsl1+mGgul2eIcfyxgziHBnc5TQ=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:04.521029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0046e564-cc62-400a-84da-d0d31dee10b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Getting quotas for project 3c3aebf19237457ba93e9515ac2d9802. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:53:04.526676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-0046e564-cc62-400a-84da-d0d31dee10b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Getting quotas for user 4894efa6e7a34d5ba3404baa059ae0e0 and project 3c3aebf19237457ba93e9515ac2d9802. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:53:04.554417 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0046e564-cc62-400a-84da-d0d31dee10b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052987 Oct 04 11:53:04.559649 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1939/6507] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:53:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:53:04.982103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ac6dc02e-f676-470e-b6cb-badf2a9c78ca req-3156a4f7-123a-4026-9dba-637d7f7cba19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63083d7d-3fa5-4e46-9fdd-96946b96f129", "name": "network-vif-plugged", "status": "completed", "tag": "c7f91731-eb4d-492b-b79f-91e8857bf258"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:04.992559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ac6dc02e-f676-470e-b6cb-badf2a9c78ca req-3156a4f7-123a-4026-9dba-637d7f7cba19 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:04.993235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ac6dc02e-f676-470e-b6cb-badf2a9c78ca req-3156a4f7-123a-4026-9dba-637d7f7cba19 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:04.993992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ac6dc02e-f676-470e-b6cb-badf2a9c78ca req-3156a4f7-123a-4026-9dba-637d7f7cba19 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:05.005912 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ac6dc02e-f676-470e-b6cb-badf2a9c78ca req-3156a4f7-123a-4026-9dba-637d7f7cba19 service nova] Creating event network-vif-plugged:c7f91731-eb4d-492b-b79f-91e8857bf258 for instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 on n-h1-791135-8 Oct 04 11:53:05.011809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ac6dc02e-f676-470e-b6cb-badf2a9c78ca req-3156a4f7-123a-4026-9dba-637d7f7cba19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033746 Oct 04 11:53:05.012420 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4569/6508] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:53:05.729864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:05.730525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:05.737188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:05.737656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:05.738086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:05.738783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:05.739252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:05.739686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:05.872018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:05.880123 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b1c99c0b-b343-4ae4-a1f3-8e62843e4b73 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 200 len: 1507 microversion: 2.1 time: 0.155620 Oct 04 11:53:05.880696 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1940/6509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:05 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:05.904906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:05.905551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:05.911686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:05.912170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:05.912604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:05.913322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:05.914306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:05.914733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:05.943017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:53:06.015990 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-93efbdfd-e852-474c-9f4a-99216d0c0ac9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 204 len: 0 microversion: 2.1 time: 0.116170 Oct 04 11:53:06.016521 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4570/6510] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:53:05 2022] DELETE /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:53:06.088188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-100304444", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "518f7f1e-2a87-49be-a990-987dfa6c2f82"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:06.140750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] validate_networks() for [('518f7f1e-2a87-49be-a990-987dfa6c2f82', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:53:06.511129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:53:06.511565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:53:06.512055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:53:06.512477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:53:06.512943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:53:06.521733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:06.522253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:06.522701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:06.524045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:06.524516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:06.524956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:06.541150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Getting quotas for project 3c3aebf19237457ba93e9515ac2d9802. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:53:06.546375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Getting quotas for user 4894efa6e7a34d5ba3404baa059ae0e0 and project 3c3aebf19237457ba93e9515ac2d9802. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:53:06.558695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:53:06.561054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:53:06.606404 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a155f022-661c-4197-ae9a-4db0b8e2f189 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522507 Oct 04 11:53:06.606987 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1941/6511] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:53:06.618957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-610b508b-13cb-4b8d-a022-050ec7bf4fef tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:06.619668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-610b508b-13cb-4b8d-a022-050ec7bf4fef tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:06.674804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-610b508b-13cb-4b8d-a022-050ec7bf4fef tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:06.681916 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-610b508b-13cb-4b8d-a022-050ec7bf4fef tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1217 microversion: 2.1 time: 0.067224 Oct 04 11:53:06.682597 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4571/6512] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:06 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:07.708559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:07.710245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:07.721007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:07.721544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:07.722000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:07.722727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:07.723203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:07.723758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:07.873793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:07.882927 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43f05660-ed4c-48f9-a34e-f9788c0e2dae tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1277 microversion: 2.1 time: 0.180927 Oct 04 11:53:07.901260 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1942/6513] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:07 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:07.902344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ab0ba3ac-54ff-431a-bbd0-3d426e05d70a req-cea852ea-aa99-4e68-91b5-e11c73f43c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63083d7d-3fa5-4e46-9fdd-96946b96f129", "name": "network-vif-deleted", "tag": "c7f91731-eb4d-492b-b79f-91e8857bf258"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:07.916582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ab0ba3ac-54ff-431a-bbd0-3d426e05d70a req-cea852ea-aa99-4e68-91b5-e11c73f43c84 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:07.917009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ab0ba3ac-54ff-431a-bbd0-3d426e05d70a req-cea852ea-aa99-4e68-91b5-e11c73f43c84 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:07.917481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ab0ba3ac-54ff-431a-bbd0-3d426e05d70a req-cea852ea-aa99-4e68-91b5-e11c73f43c84 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:07.930063 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ab0ba3ac-54ff-431a-bbd0-3d426e05d70a req-cea852ea-aa99-4e68-91b5-e11c73f43c84 service nova] Creating event network-vif-deleted:c7f91731-eb4d-492b-b79f-91e8857bf258 for instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 on n-h1-791135-8 Oct 04 11:53:07.936654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ab0ba3ac-54ff-431a-bbd0-3d426e05d70a req-cea852ea-aa99-4e68-91b5-e11c73f43c84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039422 Oct 04 11:53:07.937374 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4572/6514] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:53:08.910375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:08.911024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:08.918098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:08.918350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:08.918794 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:08.919497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:08.919959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:08.920390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:09.057625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:09.065494 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-131f55ee-8a4a-4f32-a28b-c29fbd11b619 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1317 microversion: 2.1 time: 0.159050 Oct 04 11:53:09.066355 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1943/6515] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:08 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:09.193919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4a3605ed-9b7d-4022-a29c-f1d04ce8442a req-b3f2fdde-a2b9-40b8-a2ab-e253082d8589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d2b25e-7ece-419f-b8d4-25e8bba494d5", "tag": "2731f41e-4bce-43c0-a0c7-48697cf3a56c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:09.207662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a3605ed-9b7d-4022-a29c-f1d04ce8442a req-b3f2fdde-a2b9-40b8-a2ab-e253082d8589 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:09.208145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a3605ed-9b7d-4022-a29c-f1d04ce8442a req-b3f2fdde-a2b9-40b8-a2ab-e253082d8589 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:09.208577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a3605ed-9b7d-4022-a29c-f1d04ce8442a req-b3f2fdde-a2b9-40b8-a2ab-e253082d8589 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:09.220472 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4a3605ed-9b7d-4022-a29c-f1d04ce8442a req-b3f2fdde-a2b9-40b8-a2ab-e253082d8589 service nova] Creating event network-changed:2731f41e-4bce-43c0-a0c7-48697cf3a56c for instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 on n-h1-791135-8 Oct 04 11:53:09.225750 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4a3605ed-9b7d-4022-a29c-f1d04ce8442a req-b3f2fdde-a2b9-40b8-a2ab-e253082d8589 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036681 Oct 04 11:53:09.226361 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4573/6516] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:53:10.089312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:10.089963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:10.097042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:10.097848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:10.098332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:10.099210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:10.099821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:10.100268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:10.233449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:10.241068 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ae1dd1f2-cbcc-486d-8213-afb5f80c5cb3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1317 microversion: 2.1 time: 0.156244 Oct 04 11:53:10.241678 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1944/6517] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:10 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:11.263757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:11.264497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:11.271413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:11.271899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:11.272337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:11.273029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:11.273526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:11.273961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:11.402855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:11.410683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1e4bdf72-1444-4b12-9a13-f2a25f04c97a tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1317 microversion: 2.1 time: 0.151237 Oct 04 11:53:11.411261 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4574/6518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:11 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:12.434303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:12.434935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:12.441840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:12.442338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:12.442787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:12.443503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:12.443960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:12.444401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:12.573031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:12.580750 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7e9c350d-e2d0-470a-bf14-68273953e532 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1317 microversion: 2.1 time: 0.150820 Oct 04 11:53:12.581329 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1945/6519] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:12 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:13.604183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:13.604831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:13.611966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:13.612457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:13.612904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:13.613636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:13.614099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:13.614535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:13.741525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:13.749272 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b7a34865-03a6-40b6-bdee-b3fca59e68b2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1317 microversion: 2.1 time: 0.149780 Oct 04 11:53:13.749923 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4575/6520] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:13 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:14.771982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:14.772628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:14.779582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:14.780070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:14.780513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:14.781212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:14.781710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:14.782147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:14.911601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:14.920474 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-68b94975-3ff9-45ad-a164-0477e7228228 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1317 microversion: 2.1 time: 0.152315 Oct 04 11:53:14.921056 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1946/6521] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:14 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:15.010388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d6795ba9-1056-480c-80fd-fcb0837847b6 req-b6ea7b2d-dc15-4daf-a5ba-7b43f2b53990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d2b25e-7ece-419f-b8d4-25e8bba494d5", "name": "network-vif-plugged", "status": "completed", "tag": "2731f41e-4bce-43c0-a0c7-48697cf3a56c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:15.020788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d6795ba9-1056-480c-80fd-fcb0837847b6 req-b6ea7b2d-dc15-4daf-a5ba-7b43f2b53990 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:15.021496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d6795ba9-1056-480c-80fd-fcb0837847b6 req-b6ea7b2d-dc15-4daf-a5ba-7b43f2b53990 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:15.021932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d6795ba9-1056-480c-80fd-fcb0837847b6 req-b6ea7b2d-dc15-4daf-a5ba-7b43f2b53990 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:15.033000 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d6795ba9-1056-480c-80fd-fcb0837847b6 req-b6ea7b2d-dc15-4daf-a5ba-7b43f2b53990 service nova] Creating event network-vif-plugged:2731f41e-4bce-43c0-a0c7-48697cf3a56c for instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 on n-h1-791135-8 Oct 04 11:53:15.037939 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d6795ba9-1056-480c-80fd-fcb0837847b6 req-b6ea7b2d-dc15-4daf-a5ba-7b43f2b53990 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031316 Oct 04 11:53:15.038528 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4576/6522] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:53:15.943534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:15.944164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:15.951614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:15.952118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:15.952565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:15.953272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:15.953769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:15.954212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:16.085453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:16.093103 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d38fb006-0b06-4687-9d4b-5430b6457020 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1317 microversion: 2.1 time: 0.153468 Oct 04 11:53:16.093700 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1947/6523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:15 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:17.115366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:17.120345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:17.121086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:17.127595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:17.128083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:17.128525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:17.129519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:17.129977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:17.130412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:17.145522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:17.261600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:17.269345 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fcc36b10-f535-47eb-85b7-9185dda6f51b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1507 microversion: 2.1 time: 0.155883 Oct 04 11:53:17.269948 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4577/6524] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:17 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:17.292034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:17.292659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:17.294727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:17.295390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=10 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:17.302688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:17.303179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:17.303623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:17.304319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:17.304781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:17.305858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:17.438169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:17.446568 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df00fba6-d1d8-46e8-bfb0-b30ed0ffe42b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1507 microversion: 2.1 time: 0.157773 Oct 04 11:53:17.447161 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1948/6525] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:17 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:17.468335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:17.470605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:17.476547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:17.477037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:17.477515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:17.478217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:17.478677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:17.479109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:17.511249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:17.516790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Old instance type m1.heat2, new instance type m1.heat {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:53:17.523206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:53:17.523625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:53:17.524145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:53:17.524556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:53:17.524962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:53:17.587833 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8b501e8d-86ed-4235-9b6d-6d3f60629c74 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "POST /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5/action" status: 202 len: 0 microversion: 2.1 time: 0.123458 Oct 04 11:53:17.588472 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4578/6526] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:53:17 2022] POST /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:53:17.596469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:17.597281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:17.603565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:17.604056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:17.604512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:17.605192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:17.605879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:17.606346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:17.745756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:17.754796 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e2df917-ccbf-4890-97c7-74612daedaea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1514 microversion: 2.1 time: 0.162097 Oct 04 11:53:17.755374 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1949/6527] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:17 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:18.778509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:18.779131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:18.786144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:18.786632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:18.787074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:18.787770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:18.788230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:18.788663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:19.003794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:19.012213 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6bdb0eed-ce4e-4c28-a173-dcf30d348d56 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1514 microversion: 2.1 time: 0.238488 Oct 04 11:53:19.012807 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4579/6528] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:18 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:20.039612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:20.040239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:20.047103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:20.047600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:20.048050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:20.048755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:20.049222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:20.049697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:20.179433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:20.181663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=100 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:20.188602 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-75528dde-97ec-4a9d-9c30-b297c39ab3b3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.152848 Oct 04 11:53:20.189191 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1950/6529] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:20 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:21.212984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:21.213650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:21.220487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:21.220973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:21.221438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:21.222139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:21.222597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:21.223028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:21.352537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:21.360233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b69a478-d10b-4f0e-81c5-f99981bfc331 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.151625 Oct 04 11:53:21.360808 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4580/6530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:21 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:22.383189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:22.383829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:22.390590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:22.391077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:22.391519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:22.392207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:22.392674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:22.393106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:22.519979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:22.528079 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e139a57d-868a-4f9a-a446-59191cd5cb7b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.149040 Oct 04 11:53:22.528658 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1951/6531] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:22 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:23.552057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:23.552836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:23.560291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:23.560778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:23.561260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:23.561930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:23.562401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:23.562952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:23.694004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:23.702445 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-433e4f3f-ccd3-4c04-b9d3-222ff852320b tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.154284 Oct 04 11:53:23.703025 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4581/6532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:23 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:24.725285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:24.725931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:24.733299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:24.733817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:24.734258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:24.734949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:24.735406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:24.735838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:24.873344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:24.881721 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a289ac3c-80f5-4eb7-b57d-27809a733aea tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.160333 Oct 04 11:53:24.882333 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1952/6533] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:24 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:25.907546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:25.908060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:25.914950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:25.915431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:25.915873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:25.916563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:25.917014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:25.917465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:26.044580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:26.052380 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-058983c0-5fa8-4b04-8f7a-a70fc8919fca tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.148829 Oct 04 11:53:26.052960 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4582/6534] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:25 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:27.076714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:27.077342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:27.080075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:27.085087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:27.085619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:27.086063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:27.086763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:27.087228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:27.087664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:27.215483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:27.223176 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dce0c3de-ec4b-4b53-92d3-5c55651d74b5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.150899 Oct 04 11:53:27.223748 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1953/6535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:27 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:28.245556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:28.246196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:28.248965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:28.254596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:28.255091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:28.255536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:28.256236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:28.256702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:28.257137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:28.389627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:28.397447 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4afa8742-4112-48ec-b48c-99ad139a59b4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.155883 Oct 04 11:53:28.398026 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4583/6536] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:28 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:29.420257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:29.420875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:29.427796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:29.428282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:29.428739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:29.429445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:29.430435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:29.430869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:29.569125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:29.577493 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-efff16f6-4bfb-4276-9da6-a4069d531d4d tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.161107 Oct 04 11:53:29.578131 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1954/6537] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:29 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:30.600325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:30.600938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:30.607886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:30.608366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:30.608800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:30.609514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:30.609970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:30.610397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:30.742730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:30.750938 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-80da28ff-cafc-45dc-b14c-beec005f8e32 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.154446 Oct 04 11:53:30.751532 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4584/6538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:30 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:31.776204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:31.776818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:31.782982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:31.783466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:31.783902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:31.784588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:31.785045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:31.785509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:31.913803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:31.922220 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71b41aa7-d262-40ed-9f6c-368018f7d211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.150658 Oct 04 11:53:31.922792 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1955/6539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:31 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:32.944059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:32.944684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:32.951532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:32.952018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:32.952458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:32.953149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:32.953633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:32.954065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:33.081808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:33.090095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-777b27a5-7bc1-4160-8011-7e11c3588341 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.149971 Oct 04 11:53:33.090676 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4585/6540] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:32 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:34.112920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:34.113592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:34.120435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:34.120920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:34.121389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:34.122083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:34.122547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:34.122984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:34.255083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:34.263280 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1bf7bdc9-e554-4c3b-ba3c-33e0b8dba9db tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.154294 Oct 04 11:53:34.263862 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1956/6541] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:34 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:35.286978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:35.287755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:35.294838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:35.295318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:35.295754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:35.296436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:35.296889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:35.297315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:35.429695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:35.437488 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7623c9cb-ed70-41c6-a051-d095707fd963 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.154659 Oct 04 11:53:35.438074 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4586/6542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:35 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:36.460490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:36.461116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:36.467933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:36.468425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:36.468874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:36.469597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:36.470062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:36.470499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:36.599599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:36.607898 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89262741-aa4d-418b-bd22-eb1f12ffbcc4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.151356 Oct 04 11:53:36.608469 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1957/6543] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:36 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:37.631730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:37.632280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:37.639841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:37.640391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:37.640843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:37.641577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:37.642043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:37.642480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:37.770751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:37.778560 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-333666fe-e9d1-4223-9886-b369874b40e1 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.151168 Oct 04 11:53:37.779145 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4587/6544] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:37 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:38.801800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:38.802425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:38.809234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:38.809756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:38.810202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:38.810955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:38.811376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:38.811813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:38.942699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:38.950977 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1d67639-5c04-4b0f-babc-3c4554972bc3 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.153106 Oct 04 11:53:38.951559 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1958/6545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:38 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:39.973986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:39.974607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:39.981133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:39.981657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:39.982098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:39.982794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:39.983253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:39.983684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:40.116143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:40.124641 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-092032e5-fa03-4c3e-8051-fe816a7c0862 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.154584 Oct 04 11:53:40.125226 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4588/6546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:39 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:53:41.147901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:41.149077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:41.156324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:41.156829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:41.157280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:41.158037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:41.158505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:41.158950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:41.296774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:41.305200 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e4decf5-ce63-4cb1-876c-bc254c3ee8c4 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.161404 Oct 04 11:53:41.317555 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1959/6547] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:41 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:42.329718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:42.330331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:42.337300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:42.337817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:42.338255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:42.338940 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:42.339412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:42.339819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:42.467302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:42.474882 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2a5dd125-7e33-4fb2-8d1f-78d1d2d61d4f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.149210 Oct 04 11:53:42.475457 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4589/6548] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:42 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:43.498259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:43.498883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:43.508790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:43.509294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:43.509764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:43.510511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:43.510979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:43.511417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:43.640360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:43.647981 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-960e45a3-6526-4a30-810c-4f29ccbeefda tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.153644 Oct 04 11:53:43.648544 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1960/6549] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:43 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:44.670797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:44.671421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:44.678240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:44.678727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:44.679169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:44.679864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:44.680322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:44.680750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:44.815017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:44.823368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4dc876d-66cf-4718-bd45-5da36e4cb7b0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.156500 Oct 04 11:53:44.823953 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4590/6550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:44 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:45.846973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:45.847592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:45.854495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:45.854980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:45.855419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:45.856109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:45.856572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:45.857001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:45.992009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:45.999742 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-481caf08-ca92-4192-bf47-1bd79d2c346c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1519 microversion: 2.1 time: 0.156779 Oct 04 11:53:46.000323 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1961/6551] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:45 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:46.699664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-914ce283-6eb0-4175-922c-6e83f691e967 req-e428847a-ad69-4fee-962f-daee7e74da2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d2b25e-7ece-419f-b8d4-25e8bba494d5", "name": "network-vif-unplugged", "status": "completed", "tag": "2731f41e-4bce-43c0-a0c7-48697cf3a56c"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:46.710337 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-914ce283-6eb0-4175-922c-6e83f691e967 req-e428847a-ad69-4fee-962f-daee7e74da2b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:46.710941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-914ce283-6eb0-4175-922c-6e83f691e967 req-e428847a-ad69-4fee-962f-daee7e74da2b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:46.711524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-914ce283-6eb0-4175-922c-6e83f691e967 req-e428847a-ad69-4fee-962f-daee7e74da2b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:46.724808 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-914ce283-6eb0-4175-922c-6e83f691e967 req-e428847a-ad69-4fee-962f-daee7e74da2b service nova] Creating event network-vif-unplugged:2731f41e-4bce-43c0-a0c7-48697cf3a56c for instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 on n-h2-791135-8 Oct 04 11:53:46.730468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-914ce283-6eb0-4175-922c-6e83f691e967 req-e428847a-ad69-4fee-962f-daee7e74da2b service nova] Instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:53:46.742395 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-914ce283-6eb0-4175-922c-6e83f691e967 req-e428847a-ad69-4fee-962f-daee7e74da2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045945 Oct 04 11:53:46.743020 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4591/6552] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:53:47.023262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:47.024055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:47.031049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:47.031592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:47.032043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:47.032763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:47.033232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:47.033705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:47.171436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:47.179801 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a397877-f6c1-41bf-bf53-765010324cb5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1518 microversion: 2.1 time: 0.159945 Oct 04 11:53:47.180419 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1962/6553] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:47 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:48.204021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:48.204733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:48.211000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:48.211484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:48.211923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:48.212615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:48.213075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:48.213539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:48.216156 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:48.349105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:48.356919 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-79ecd0d1-a448-4414-b712-0d8fba8a4146 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1516 microversion: 2.1 time: 0.158029 Oct 04 11:53:48.357527 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4592/6554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:48 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:48.766918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-d2f09fa8-898f-4233-96fb-2b4e5514d275 req-96ddee5d-49ef-41ff-8ddc-05231692fe1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d2b25e-7ece-419f-b8d4-25e8bba494d5", "tag": "2731f41e-4bce-43c0-a0c7-48697cf3a56c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:48.777212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d2f09fa8-898f-4233-96fb-2b4e5514d275 req-96ddee5d-49ef-41ff-8ddc-05231692fe1b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:48.777727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d2f09fa8-898f-4233-96fb-2b4e5514d275 req-96ddee5d-49ef-41ff-8ddc-05231692fe1b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:48.778164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-d2f09fa8-898f-4233-96fb-2b4e5514d275 req-96ddee5d-49ef-41ff-8ddc-05231692fe1b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:48.790024 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-d2f09fa8-898f-4233-96fb-2b4e5514d275 req-96ddee5d-49ef-41ff-8ddc-05231692fe1b service nova] Creating event network-changed:2731f41e-4bce-43c0-a0c7-48697cf3a56c for instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 on n-h2-791135-8 Oct 04 11:53:48.795147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-d2f09fa8-898f-4233-96fb-2b4e5514d275 req-96ddee5d-49ef-41ff-8ddc-05231692fe1b service nova] Instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:53:48.806223 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-d2f09fa8-898f-4233-96fb-2b4e5514d275 req-96ddee5d-49ef-41ff-8ddc-05231692fe1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042976 Oct 04 11:53:48.806804 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1963/6555] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:53:49.381328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:49.382472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:49.389266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:49.389786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:49.390226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:49.390926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:49.391392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:49.391827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:49.525576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:49.533277 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-35f2a448-820c-4600-9e0b-67e7df477310 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1516 microversion: 2.1 time: 0.156087 Oct 04 11:53:49.534034 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4593/6556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:49 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:50.557134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:50.557877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:50.565128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:50.565655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:50.566123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:50.566821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:50.567288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:50.567732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:50.571018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=78 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:53:50.708709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:50.718377 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c0985e7-5257-49eb-822a-74e51eec7211 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1516 microversion: 2.1 time: 0.165896 Oct 04 11:53:50.719251 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1964/6557] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:50 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:51.742451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:51.743072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:51.750066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:51.750553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:51.750993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:51.751723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:51.752184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:51.752616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:51.881155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:51.890891 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-11ef188c-07b5-43b8-8082-a65c82ba5a67 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1513 microversion: 2.1 time: 0.152333 Oct 04 11:53:51.891482 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4594/6558] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:51 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:51.913081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:51.914288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:51.921106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:51.921738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:51.922187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:51.922886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:51.923344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:51.923776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:51.980754 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d0653a14-3bbc-4742-b45d-afd14e010979 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "POST /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5/action" status: 204 len: 0 microversion: 2.1 time: 0.071448 Oct 04 11:53:51.981409 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1965/6559] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:53:51 2022] POST /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:53:51.989907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:51.990511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:51.997343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:51.997908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:51.998415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:51.999144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:51.999607 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:52.000045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:52.212590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:52.220429 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c1b376c3-2d55-4d28-a386-e92b5526aa70 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1513 microversion: 2.1 time: 0.234486 Oct 04 11:53:52.221007 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4595/6560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:51 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:53.245972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:53.246888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:53.253235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.253861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.254646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.255434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.255970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.256479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.392737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:53.400695 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-201f15ec-2ad2-403f-b724-10f9d6b6c47c tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1505 microversion: 2.1 time: 0.159811 Oct 04 11:53:53.401279 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1966/6561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:53 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:53.422478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:53.423094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:53.430389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.430875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.431317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.432019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.432476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.432904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.573359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:53.581312 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff5ebc1c-5f12-4da6-8c50-4768d9b31e65 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1505 microversion: 2.1 time: 0.162732 Oct 04 11:53:53.582014 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4596/6562] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:53 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:53.603073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:53.603633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:53.609573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.610067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.610510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.611215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.611681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.612117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.743632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:53.751623 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-158c9d0c-35ad-4c57-aace-afeb7831cff5 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1505 microversion: 2.1 time: 0.152475 Oct 04 11:53:53.752206 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1967/6563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:53 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:53.773578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:53.774109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:53.780096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.780587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.781022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.781766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.782225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.782655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.808464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:53:53.883233 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-090895e1-dce8-498d-a13b-b5c4a5e971a9 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 204 len: 0 microversion: 2.1 time: 0.113205 Oct 04 11:53:53.883991 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4597/6564] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:53:53 2022] DELETE /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:53:53.897480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:53.897986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:53.904012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.904507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.904950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.905692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.906156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.906587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.931822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:53:53.974058 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.compute.api [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Instance is already in deleting state, ignoring this request Oct 04 11:53:53.974882 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c916f864-61c1-412a-8112-0e6c263a1943 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 204 len: 0 microversion: 2.1 time: 0.081377 Oct 04 11:53:53.975449 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1968/6565] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:53:53 2022] DELETE /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:53:53.984441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:53.985150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:53.991067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.992126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.992569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:53.993256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:53.993747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:53.994176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:54.126586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:54.134566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f4a3d06d-2e64-4143-a157-2fd256962678 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1511 microversion: 2.1 time: 0.154279 Oct 04 11:53:54.135079 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4598/6566] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:53 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:55.147715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-10ecb262-b08e-4aed-8cc2-bd333878570f req-fae48367-d839-4e07-8b23-acb997026439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d2b25e-7ece-419f-b8d4-25e8bba494d5", "name": "network-vif-plugged", "status": "completed", "tag": "2731f41e-4bce-43c0-a0c7-48697cf3a56c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:55.158719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:55.159345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:55.161225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-10ecb262-b08e-4aed-8cc2-bd333878570f req-fae48367-d839-4e07-8b23-acb997026439 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:55.161820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-10ecb262-b08e-4aed-8cc2-bd333878570f req-fae48367-d839-4e07-8b23-acb997026439 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:55.162336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-10ecb262-b08e-4aed-8cc2-bd333878570f req-fae48367-d839-4e07-8b23-acb997026439 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:55.165693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:55.166189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:55.166807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:55.167781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:55.168253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:55.168692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:55.174219 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-10ecb262-b08e-4aed-8cc2-bd333878570f req-fae48367-d839-4e07-8b23-acb997026439 service nova] Creating event network-vif-plugged:2731f41e-4bce-43c0-a0c7-48697cf3a56c for instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 on n-h2-791135-8 Oct 04 11:53:55.180709 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-10ecb262-b08e-4aed-8cc2-bd333878570f req-fae48367-d839-4e07-8b23-acb997026439 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037122 Oct 04 11:53:55.181569 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1969/6567] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:53:55.301475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4894efa6e7a34d5ba3404baa059ae0e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3aebf19237457ba93e9515ac2d9802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:53:55.309798 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6e7fb381-eaef-4f8c-add4-c724f4a1b724 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 200 len: 1511 microversion: 2.1 time: 0.155877 Oct 04 11:53:55.310371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4599/6568] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:55 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:53:55.882345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-50b8c35f-5444-4e74-b9a3-d325759e101f req-a19513b5-f72e-4497-86fd-91c47f6d22ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d2b25e-7ece-419f-b8d4-25e8bba494d5", "name": "network-vif-deleted", "tag": "2731f41e-4bce-43c0-a0c7-48697cf3a56c"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:53:55.893865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50b8c35f-5444-4e74-b9a3-d325759e101f req-a19513b5-f72e-4497-86fd-91c47f6d22ec service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:55.894348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50b8c35f-5444-4e74-b9a3-d325759e101f req-a19513b5-f72e-4497-86fd-91c47f6d22ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:55.895439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50b8c35f-5444-4e74-b9a3-d325759e101f req-a19513b5-f72e-4497-86fd-91c47f6d22ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:55.908055 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-50b8c35f-5444-4e74-b9a3-d325759e101f req-a19513b5-f72e-4497-86fd-91c47f6d22ec service nova] Creating event network-vif-deleted:2731f41e-4bce-43c0-a0c7-48697cf3a56c for instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 on n-h2-791135-8 Oct 04 11:53:55.914119 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-50b8c35f-5444-4e74-b9a3-d325759e101f req-a19513b5-f72e-4497-86fd-91c47f6d22ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035674 Oct 04 11:53:55.914728 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1970/6569] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:53:56.333338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:56.333981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: b4d2b25e-7ece-419f-b8d4-25e8bba494d5] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:56.340807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:56.341295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:56.341818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:56.342517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:56.342977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:56.343406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:56.357137 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] HTTP exception thrown: Instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 could not be found. Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Request method failure captured: Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 HTTP/1.1 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB5vuBxhkQYKh84FpfTIZ2pROemPALIaX61qiINqMnef2qIsxu4yskeTeCYZZj3vpy3G2aEYVkq6qRlgJ23ppoZxsD2Xa4W3aRF5OPls7VXhyF1-6IzXcCL23-81LvRhZmZZoHZC5-n7B9lN4DanZBJnD7wxvMT5Lwf8iE7mjEkSKcQ Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3c3aebf19237457ba93e9515ac2d9802 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c3aebf19237457ba93e9515ac2d9802"}]}] Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3c3aebf19237457ba93e9515ac2d9802 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiskConfigTestJSON-728852047-project Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4894efa6e7a34d5ba3404baa059ae0e0 Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiskConfigTestJSON-728852047-project Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 could not be found. Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'b4d2b25e-7ece-419f-b8d4-25e8bba494d5'} Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 could not be found. Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 could not be found. Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:53:56.358828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 could not be found. Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Returning 404 to user: Instance b4d2b25e-7ece-419f-b8d4-25e8bba494d5 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98039115-f0ac-40d9-9f13-125fd6509d5f tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5" status: 404 len: 111 microversion: 2.1 time: 0.030883 Oct 04 11:53:56.363432 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4600/6570] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:56 2022] GET /compute/v2.1/servers/b4d2b25e-7ece-419f-b8d4-25e8bba494d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:53:56.370302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-201f0d47-4753-450c-964b-6d7a0aa0b9c2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '.version_select at 0x7f71cfe5adc0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:56.390688 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-201f0d47-4753-450c-964b-6d7a0aa0b9c2 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115514315" status: 202 len: 0 microversion: 2.1 time: 0.025145 Oct 04 11:53:56.391272 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1971/6571] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 11:53:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115514315 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:53:56.988786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:56.989287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:56.996038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:56.996526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:56.996961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:56.997694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:56.998153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:56.998581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:57.012228 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] HTTP exception thrown: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Request method failure captured: Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 HTTP/1.1 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB5vuBxhkQYKh84FpfTIZ2pROemPALIaX61qiINqMnef2qIsxu4yskeTeCYZZj3vpy3G2aEYVkq6qRlgJ23ppoZxsD2Xa4W3aRF5OPls7VXhyF1-6IzXcCL23-81LvRhZmZZoHZC5-n7B9lN4DanZBJnD7wxvMT5Lwf8iE7mjEkSKcQ Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3c3aebf19237457ba93e9515ac2d9802 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c3aebf19237457ba93e9515ac2d9802"}]}] Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3c3aebf19237457ba93e9515ac2d9802 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerDiskConfigTestJSON-728852047-project Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 4894efa6e7a34d5ba3404baa059ae0e0 Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerDiskConfigTestJSON-728852047-project Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '63083d7d-3fa5-4e46-9fdd-96946b96f129'} Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:53:57.013828 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Returning 404 to user: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4de05e50-c82c-47b5-a35b-4d04a807f5c0 tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 404 len: 111 microversion: 2.1 time: 0.030485 Oct 04 11:53:57.017839 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4601/6572] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:53:56 2022] DELETE /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:53:57.024163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:53:57.024978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] [instance: 63083d7d-3fa5-4e46-9fdd-96946b96f129] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:53:57.032853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:57.033402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:57.033823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:57.034531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:53:57.035008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:53:57.035450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:53:57.048930 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] HTTP exception thrown: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Request method failure captured: Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 HTTP/1.1 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB5vuBxhkQYKh84FpfTIZ2pROemPALIaX61qiINqMnef2qIsxu4yskeTeCYZZj3vpy3G2aEYVkq6qRlgJ23ppoZxsD2Xa4W3aRF5OPls7VXhyF1-6IzXcCL23-81LvRhZmZZoHZC5-n7B9lN4DanZBJnD7wxvMT5Lwf8iE7mjEkSKcQ Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3c3aebf19237457ba93e9515ac2d9802 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c3aebf19237457ba93e9515ac2d9802"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c3aebf19237457ba93e9515ac2d9802"}]}] Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3c3aebf19237457ba93e9515ac2d9802 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-728852047 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerDiskConfigTestJSON-728852047-project Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 4894efa6e7a34d5ba3404baa059ae0e0 Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerDiskConfigTestJSON-728852047-project Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '63083d7d-3fa5-4e46-9fdd-96946b96f129'} Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:53:57.050586 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] Returning 404 to user: Instance 63083d7d-3fa5-4e46-9fdd-96946b96f129 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08147bf9-854a-47b0-91c4-ff0c65ed4aff tempest-ServerDiskConfigTestJSON-728852047 tempest-ServerDiskConfigTestJSON-728852047-project] 10.222.0.23 "GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129" status: 404 len: 111 microversion: 2.1 time: 0.031864 Oct 04 11:53:57.055658 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1972/6573] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:53:57 2022] GET /compute/v2.1/servers/63083d7d-3fa5-4e46-9fdd-96946b96f129 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:54:05.605872 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-133485fb-be38-4ed7-8a3f-473ca5d40a8e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'create', calling method: .version_select at 0x7f71d4251ee0>, body: {"keypair": {"name": "tempest-keypair-2054538442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ZJAVY3QZmlGjGFCUfk997ckSRXS6GZp9SG7JJ4rZYcZh8ppRMSbzkRuq58yajigv1ogM+uKb7nFU0lEANhL6i82wqPSIiGIDUhQh8DkA+YpPvgus8WjB6B95slQ924A=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:05.611380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:05.624287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-133485fb-be38-4ed7-8a3f-473ca5d40a8e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for project 733639ce17264784894a065d5406670e. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:54:05.630121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-133485fb-be38-4ed7-8a3f-473ca5d40a8e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for user e21298423c97470ebaca987598a8ce8d and project 733639ce17264784894a065d5406670e. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:54:05.657167 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-133485fb-be38-4ed7-8a3f-473ca5d40a8e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.230248 Oct 04 11:54:05.659770 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4602/6574] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 11:54:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:54:06.955791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1150886012", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "595ce718-19ef-45fd-bf46-f216de20fae5"}], "security_groups": [{"name": "tempest-securitygroup--35547156"}], "key_name": "tempest-keypair-2054538442", "user_data": "}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:06.965445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:07.041435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:07.068326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] validate_networks() for [('595ce718-19ef-45fd-bf46-f216de20fae5', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:54:07.483332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:54:07.484030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:54:07.485245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:54:07.485741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:54:07.486237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:54:07.495374 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:07.496171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:07.496698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:07.497544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:07.498227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:07.498864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:07.519546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for project 733639ce17264784894a065d5406670e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:54:07.525796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for user e21298423c97470ebaca987598a8ce8d and project 733639ce17264784894a065d5406670e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:54:07.538745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:54:07.541211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:54:07.592952 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-041ec7af-b8bf-444b-82e2-cbd80280057f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.641813 Oct 04 11:54:07.594192 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1973/6575] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:54:06 2022] POST /compute/v2.1/servers => generated 407 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:54:07.605116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8997f5c9-2fd4-4f4d-b9ba-08dc80b18e97 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:07.606680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8997f5c9-2fd4-4f4d-b9ba-08dc80b18e97 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:07.609917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:07.684983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8997f5c9-2fd4-4f4d-b9ba-08dc80b18e97 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:07.692521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8997f5c9-2fd4-4f4d-b9ba-08dc80b18e97 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1239 microversion: 2.1 time: 0.091308 Oct 04 11:54:07.705836 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4603/6576] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:07 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1239 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:08.719359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:08.720698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:08.729207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:08.730015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:08.730623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:08.731337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:08.731951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:08.732537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:08.810468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:08.819897 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08ff6df8-1f7d-4b41-87b9-837fc19fc406 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1309 microversion: 2.1 time: 0.107219 Oct 04 11:54:08.821084 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1974/6577] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:08 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:09.843584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:09.844396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:09.851640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:09.852129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:09.852564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:09.853479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:09.853971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:09.854396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:10.081646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:10.090081 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-12ddcb31-d899-45fb-89ba-5e5c7df07bf4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1363 microversion: 2.1 time: 0.250635 Oct 04 11:54:10.090661 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4604/6578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:09 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:10.261303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-80ec36b0-fc7f-4c5f-ac11-719a2b6d37ab req-31529924-480e-4d97-b75d-1fcb12c42a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2467b055-6749-493c-90f9-6383396068eb", "tag": "ebba3925-06d0-4c44-8e3d-4c2bb2ada66f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:10.273048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80ec36b0-fc7f-4c5f-ac11-719a2b6d37ab req-31529924-480e-4d97-b75d-1fcb12c42a94 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:10.273584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80ec36b0-fc7f-4c5f-ac11-719a2b6d37ab req-31529924-480e-4d97-b75d-1fcb12c42a94 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:10.274032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-80ec36b0-fc7f-4c5f-ac11-719a2b6d37ab req-31529924-480e-4d97-b75d-1fcb12c42a94 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:10.285681 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-80ec36b0-fc7f-4c5f-ac11-719a2b6d37ab req-31529924-480e-4d97-b75d-1fcb12c42a94 service nova] Creating event network-changed:ebba3925-06d0-4c44-8e3d-4c2bb2ada66f for instance 2467b055-6749-493c-90f9-6383396068eb on n-h1-791135-8 Oct 04 11:54:10.290687 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-80ec36b0-fc7f-4c5f-ac11-719a2b6d37ab req-31529924-480e-4d97-b75d-1fcb12c42a94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034112 Oct 04 11:54:10.291623 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1975/6579] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:54:11.115460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:11.116255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:11.123655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:11.124157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:11.124602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:11.125305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:11.125800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:11.126240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:11.259072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:11.266854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84bf81f8-ca13-4f8b-b89a-76ecdeee5eb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1363 microversion: 2.1 time: 0.155329 Oct 04 11:54:11.267427 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4605/6580] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:11 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:12.291475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:12.292258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:12.298364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:12.298852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:12.299291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:12.299985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:12.300443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:12.300873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:12.434472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:12.442362 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2a5b5d07-b097-4f5f-86bb-e10e0dc1ca3c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1363 microversion: 2.1 time: 0.156796 Oct 04 11:54:12.442941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1976/6581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:12 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:13.466206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:13.466944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:13.473862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:13.474348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:13.474785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:13.475502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:13.475963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:13.476386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:13.615029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:13.623190 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-435f0914-c126-4680-83d7-fb521eac3496 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1363 microversion: 2.1 time: 0.160972 Oct 04 11:54:13.623774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4606/6582] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:13 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:14.646383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:14.647024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:14.654296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:14.654795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:14.655248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:14.655952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:14.656521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:14.656969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:14.784855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:14.793068 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7c47fbd5-5893-4a1b-a19c-161590acd3b5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1363 microversion: 2.1 time: 0.150610 Oct 04 11:54:14.793666 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1977/6583] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:14 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:15.216687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1678418c-dbf4-45a7-b6ec-5f5792ecd6f1 req-55d1777f-dc02-475f-80ce-e8385896fd3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2467b055-6749-493c-90f9-6383396068eb", "name": "network-vif-plugged", "status": "completed", "tag": "ebba3925-06d0-4c44-8e3d-4c2bb2ada66f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:15.227934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1678418c-dbf4-45a7-b6ec-5f5792ecd6f1 req-55d1777f-dc02-475f-80ce-e8385896fd3b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:15.228420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1678418c-dbf4-45a7-b6ec-5f5792ecd6f1 req-55d1777f-dc02-475f-80ce-e8385896fd3b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:15.228854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1678418c-dbf4-45a7-b6ec-5f5792ecd6f1 req-55d1777f-dc02-475f-80ce-e8385896fd3b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:15.240035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1678418c-dbf4-45a7-b6ec-5f5792ecd6f1 req-55d1777f-dc02-475f-80ce-e8385896fd3b service nova] Creating event network-vif-plugged:ebba3925-06d0-4c44-8e3d-4c2bb2ada66f for instance 2467b055-6749-493c-90f9-6383396068eb on n-h1-791135-8 Oct 04 11:54:15.245545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1678418c-dbf4-45a7-b6ec-5f5792ecd6f1 req-55d1777f-dc02-475f-80ce-e8385896fd3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032673 Oct 04 11:54:15.246222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4607/6584] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:54:15.816324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:15.816941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:15.824321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:15.824808 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:15.825247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:15.825979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:15.826439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:15.826877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:15.958304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:15.965988 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58447e17-d258-466a-bd32-dc5a5e9f8e3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1363 microversion: 2.1 time: 0.153815 Oct 04 11:54:15.966556 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1978/6585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:15 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:16.989592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:16.990299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:16.997214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:16.997738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:16.998179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:16.998873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:16.999333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:16.999770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:17.132181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:17.140008 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73340dac-d944-457c-acb2-c5885f4b6d78 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1550 microversion: 2.1 time: 0.155668 Oct 04 11:54:17.140580 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4608/6586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:16 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:17.162908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:17.163404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:17.170201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:17.170723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:17.171230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:17.171932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:17.172397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:17.172834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:17.249727 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5efb090f-aa4a-4fbd-af4b-1dff9c7e4c05 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091186 Oct 04 11:54:17.250529 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1979/6587] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:54:17 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:54:18.177342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b21d4329-70e3-41d2-b026-52e6aea9db40 req-af130771-846a-44ba-b5cc-741ae641468d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2467b055-6749-493c-90f9-6383396068eb", "tag": "ebba3925-06d0-4c44-8e3d-4c2bb2ada66f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:18.182905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:18.189387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b21d4329-70e3-41d2-b026-52e6aea9db40 req-af130771-846a-44ba-b5cc-741ae641468d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:18.189862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b21d4329-70e3-41d2-b026-52e6aea9db40 req-af130771-846a-44ba-b5cc-741ae641468d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:18.190290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b21d4329-70e3-41d2-b026-52e6aea9db40 req-af130771-846a-44ba-b5cc-741ae641468d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:18.201720 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b21d4329-70e3-41d2-b026-52e6aea9db40 req-af130771-846a-44ba-b5cc-741ae641468d service nova] Creating event network-changed:ebba3925-06d0-4c44-8e3d-4c2bb2ada66f for instance 2467b055-6749-493c-90f9-6383396068eb on n-h1-791135-8 Oct 04 11:54:18.206813 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b21d4329-70e3-41d2-b026-52e6aea9db40 req-af130771-846a-44ba-b5cc-741ae641468d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Oct 04 11:54:18.207662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4609/6588] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:54:51.953856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:51.954677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:51.957002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:51.957680 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:51.962010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:51.962632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:51.971199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:51.971712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:51.972148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:51.972855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:51.973326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:51.973817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.108902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:52.117446 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f081e4e-08a0-4783-8149-551843a8bdbc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1669 microversion: 2.1 time: 0.164461 Oct 04 11:54:52.118018 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1980/6589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:51 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:52.139501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:52.140315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=28 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:52.144597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:52.145313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:52.153017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:52.153543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:52.153992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.154696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:52.155157 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:52.155598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.353537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:52.361295 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-acd1bdc7-c03d-4ca1-ab93-b4f3af8a877d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1669 microversion: 2.1 time: 0.224072 Oct 04 11:54:52.361916 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4610/6590] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:52 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:52.383469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:52.384087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:52.390216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:52.390700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:52.391137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.391830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:52.392290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:52.392721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.520873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:52.528513 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3f3c56fb-cc82-41cc-b94e-6dfcc597eed2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1669 microversion: 2.1 time: 0.148880 Oct 04 11:54:52.529082 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1981/6591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:52 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:52.551014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:52.553925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:52.560231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:52.560726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:52.561315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.562144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:52.562500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:52.562957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.591209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:52.596463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Old instance type m1.heat2, new instance type m1.heat {{(pid=122409) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:54:52.603390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:54:52.603813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:54:52.604296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:54:52.604709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:54:52.605144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:54:52.670168 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7282a791-2eb9-4af8-a224-e8ceccc6ef0a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb/action" status: 202 len: 0 microversion: 2.1 time: 0.123279 Oct 04 11:54:52.670789 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4611/6592] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:54:52 2022] POST /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:54:52.678873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:52.679491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:52.685436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:52.685982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:52.686355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.687053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:52.687514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:52.687944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:52.824146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:52.831901 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3bca1665-7775-45d0-9b10-9fe7702050a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1678 microversion: 2.1 time: 0.156925 Oct 04 11:54:52.832475 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1982/6593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:52 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:53.856636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:53.857280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:53.863308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:53.863738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:53.864178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:53.865480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:53.865946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:53.866376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:54.089564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:54.097196 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff468003-1d17-4b7c-81bb-453c651277f9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1678 microversion: 2.1 time: 0.245349 Oct 04 11:54:54.097827 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4612/6594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:53 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:55.121281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:55.121847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:55.128669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:55.129161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:55.129641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:55.130346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:55.130810 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:55.131243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:55.262669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:55.271444 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9fc6a57f-1a81-4ae2-b4cf-2276752fccec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.153554 Oct 04 11:54:55.272026 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1983/6595] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:55 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:56.294730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:56.295355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:56.303110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:56.303597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:56.304063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:56.304766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:56.305230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:56.305699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:56.432759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:56.440496 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3070944b-4b41-460c-8cae-d3b27ce233b9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.149724 Oct 04 11:54:56.441075 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4613/6596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:56 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:57.463782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:57.464411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:57.471248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:57.471740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:57.472182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:57.472877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:57.473342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:57.474309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:57.605727 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:57.613328 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b6578fd5-4752-4551-a740-54dd8515f20e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.153427 Oct 04 11:54:57.613920 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1984/6597] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:57 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:58.637280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:58.637859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:58.644720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:58.645204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:58.645668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:58.646359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:58.646813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:58.647238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:58.775908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:58.783643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5ab935b2-ceda-4b1c-aac1-0f9bbe6a2c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.150577 Oct 04 11:54:58.784225 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4614/6598] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:58 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:59.806155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:59.806773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:54:59.813709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:59.814198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:59.814644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:59.815520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:54:59.815987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:54:59.816508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:54:59.945964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:54:59.953662 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-155a2853-f087-4fc5-9360-0293ccede4d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.151368 Oct 04 11:54:59.954242 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1985/6599] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:54:59 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:00.977212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:00.977893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:00.984697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:00.985175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:00.985643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:00.986330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:00.986782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:00.987207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:01.118099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:01.125765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af7e44f0-f524-461b-92e8-05fc4c161325 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.152394 Oct 04 11:55:01.126335 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4615/6600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:00 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:02.149709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:02.150239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:02.156781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:02.157278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:02.157758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:02.158460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:02.158931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:02.159369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:02.288828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:02.296435 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-084be1bc-1a72-4ab3-8c06-058e62debf92 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.151504 Oct 04 11:55:02.297005 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1986/6601] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:02 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:03.320362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:03.320981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:03.327998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:03.328487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:03.328931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:03.329652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:03.330116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:03.330549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:03.458040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:03.465808 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7ca9eaac-99cb-45c2-adf6-0dfb89db7a98 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.150071 Oct 04 11:55:03.466387 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4616/6602] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:03 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:04.489382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:04.490033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:04.496827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:04.497316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:04.497779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:04.498472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:04.498930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:04.499362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:04.627774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:04.636252 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b9c40eb-0569-4dc1-8f39-88b136f6a57a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.150759 Oct 04 11:55:04.636824 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1987/6603] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:04 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:05.659537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:05.660102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:05.667187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:05.667677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:05.668117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:05.668816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:05.669276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:05.669733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:05.802860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:05.810590 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c73b160d-ea26-4b17-ba2c-2c4cd7ec8617 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1683 microversion: 2.1 time: 0.155182 Oct 04 11:55:05.811174 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4617/6604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:05 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:06.834389 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:06.835000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:06.842022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:06.842513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:06.842947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:06.843649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:06.844103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:06.844528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:06.903570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-99ab7414-57a6-45bb-b155-c1bea22876e2 req-68bd47e6-7201-457a-ae05-8373999cb31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2467b055-6749-493c-90f9-6383396068eb", "name": "network-vif-unplugged", "status": "completed", "tag": "ebba3925-06d0-4c44-8e3d-4c2bb2ada66f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:06.914672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-99ab7414-57a6-45bb-b155-c1bea22876e2 req-68bd47e6-7201-457a-ae05-8373999cb31b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:06.915214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-99ab7414-57a6-45bb-b155-c1bea22876e2 req-68bd47e6-7201-457a-ae05-8373999cb31b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:06.916287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-99ab7414-57a6-45bb-b155-c1bea22876e2 req-68bd47e6-7201-457a-ae05-8373999cb31b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:06.928355 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-99ab7414-57a6-45bb-b155-c1bea22876e2 req-68bd47e6-7201-457a-ae05-8373999cb31b service nova] Creating event network-vif-unplugged:ebba3925-06d0-4c44-8e3d-4c2bb2ada66f for instance 2467b055-6749-493c-90f9-6383396068eb on n-h2-791135-8 Oct 04 11:55:06.933840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-99ab7414-57a6-45bb-b155-c1bea22876e2 req-68bd47e6-7201-457a-ae05-8373999cb31b service nova] Instance 2467b055-6749-493c-90f9-6383396068eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:55:06.944586 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-99ab7414-57a6-45bb-b155-c1bea22876e2 req-68bd47e6-7201-457a-ae05-8373999cb31b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126339 Oct 04 11:55:06.945196 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1988/6605] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:07.097247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:07.105713 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-40425721-1e58-4e15-abea-7c0e3079ec01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1682 microversion: 2.1 time: 0.275656 Oct 04 11:55:07.106376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4618/6606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:06 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1682 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:55:08.130829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:08.131463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:08.137906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:08.138408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:08.138854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:08.139552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:08.140018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:08.140456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:08.270045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:08.277737 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-21d17390-8ab6-40b7-8d76-db02a53a59cf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1680 microversion: 2.1 time: 0.152139 Oct 04 11:55:08.278316 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1989/6607] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:08 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:08.963277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-4a4a2ba0-e1a7-42c7-9fd1-356eb225321e req-59b4599a-1d91-465d-b074-7d9ae360b599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2467b055-6749-493c-90f9-6383396068eb", "tag": "ebba3925-06d0-4c44-8e3d-4c2bb2ada66f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:08.973479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a4a2ba0-e1a7-42c7-9fd1-356eb225321e req-59b4599a-1d91-465d-b074-7d9ae360b599 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:08.974474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a4a2ba0-e1a7-42c7-9fd1-356eb225321e req-59b4599a-1d91-465d-b074-7d9ae360b599 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:08.974911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-4a4a2ba0-e1a7-42c7-9fd1-356eb225321e req-59b4599a-1d91-465d-b074-7d9ae360b599 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:08.986415 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-4a4a2ba0-e1a7-42c7-9fd1-356eb225321e req-59b4599a-1d91-465d-b074-7d9ae360b599 service nova] Creating event network-changed:ebba3925-06d0-4c44-8e3d-4c2bb2ada66f for instance 2467b055-6749-493c-90f9-6383396068eb on n-h2-791135-8 Oct 04 11:55:08.992287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-4a4a2ba0-e1a7-42c7-9fd1-356eb225321e req-59b4599a-1d91-465d-b074-7d9ae360b599 service nova] Instance 2467b055-6749-493c-90f9-6383396068eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:55:09.002950 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-4a4a2ba0-e1a7-42c7-9fd1-356eb225321e req-59b4599a-1d91-465d-b074-7d9ae360b599 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043426 Oct 04 11:55:09.003636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4619/6608] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:09.301039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:09.301679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:09.309155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:09.309684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:09.310126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:09.310865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:09.311370 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:09.311801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:09.447333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:09.455434 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2f61e00-04b2-45dc-81f6-796f8738c00e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1680 microversion: 2.1 time: 0.158154 Oct 04 11:55:09.456030 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1990/6609] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:09 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:10.480638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:10.481388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:10.487569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:10.488053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:10.488489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:10.489186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:10.489744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:10.490174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:10.706564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:10.714962 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0d451887-5432-4ab7-bd81-006de58e7f34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1680 microversion: 2.1 time: 0.239411 Oct 04 11:55:10.715625 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4620/6610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:10 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:11.738349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:11.738884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:11.745775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:11.746261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:11.746700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:11.747385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:11.747849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:11.748294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:11.878782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:11.887358 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fbd2928c-b89a-47e7-9e3c-ea59b292b0a0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1677 microversion: 2.1 time: 0.153007 Oct 04 11:55:11.887932 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1991/6611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:11 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:11.910774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:11.911334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:11.918109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:11.918597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:11.919069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:11.919773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:11.920232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:11.920659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:11.980908 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-84e54e0d-d1d5-4b8a-a351-a412484a5dd9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb/action" status: 204 len: 0 microversion: 2.1 time: 0.073985 Oct 04 11:55:11.981596 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4621/6612] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:55:11 2022] POST /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:55:11.990410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:11.991078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:11.997648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:11.998103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:11.998647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:11.999264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:11.999734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:12.000175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:12.143898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:12.151789 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a0ffe435-0256-4fe2-b4c1-84bdc83ba7f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1677 microversion: 2.1 time: 0.165750 Oct 04 11:55:12.152394 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1992/6613] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:11 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:13.177400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:13.178199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:13.185227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:13.185757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:13.186198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:13.186942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:13.187398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:13.187831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:13.352851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:13.361277 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9f11795-e622-4947-aaf2-27d755eaa7a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1677 microversion: 2.1 time: 0.189892 Oct 04 11:55:13.361916 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4622/6614] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:13 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:13.611346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2cc76903-1e35-450a-a89d-018074b00029 req-5b811151-0697-4509-82d3-04df1c298cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2467b055-6749-493c-90f9-6383396068eb", "name": "network-vif-plugged", "status": "completed", "tag": "ebba3925-06d0-4c44-8e3d-4c2bb2ada66f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:13.620942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2cc76903-1e35-450a-a89d-018074b00029 req-5b811151-0697-4509-82d3-04df1c298cb0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:13.621468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2cc76903-1e35-450a-a89d-018074b00029 req-5b811151-0697-4509-82d3-04df1c298cb0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:13.621915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2cc76903-1e35-450a-a89d-018074b00029 req-5b811151-0697-4509-82d3-04df1c298cb0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:13.633013 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2cc76903-1e35-450a-a89d-018074b00029 req-5b811151-0697-4509-82d3-04df1c298cb0 service nova] Creating event network-vif-plugged:ebba3925-06d0-4c44-8e3d-4c2bb2ada66f for instance 2467b055-6749-493c-90f9-6383396068eb on n-h2-791135-8 Oct 04 11:55:13.638277 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2cc76903-1e35-450a-a89d-018074b00029 req-5b811151-0697-4509-82d3-04df1c298cb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103976 Oct 04 11:55:13.638867 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1993/6615] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:14.386191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:14.386808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:14.393846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:14.394330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:14.394801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:14.395500 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:14.396459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:14.396892 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:14.523167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:14.530924 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6730e1b6-7264-4153-8bae-cfaa4eeddfa7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1669 microversion: 2.1 time: 0.148985 Oct 04 11:55:14.531499 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4623/6616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:14 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:14.555266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:14.555972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:14.562124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:14.562615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:14.563054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:14.563748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:14.564212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:14.564646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:14.691362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:14.699865 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f237d05-0989-4c70-99c9-c1de7794ae00 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1669 microversion: 2.1 time: 0.149629 Oct 04 11:55:14.700700 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1994/6617] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:14 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:14.722869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:14.723488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:14.729568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:14.730061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:14.730504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:14.731207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:14.731670 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:14.732106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:14.749982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:14.867342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:14.875143 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-437ec70f-ee14-4c32-a969-86a6811f6b38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1669 microversion: 2.1 time: 0.156166 Oct 04 11:55:14.875739 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4624/6618] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:14 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:14.898497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:14.898943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:14.904904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:14.905498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:14.905956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:14.906661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:14.907129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:14.907566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:14.931925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:55:14.983656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:15.010790 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cf16cde3-8b08-4bb1-98ec-fddaf30b90a8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 204 len: 0 microversion: 2.1 time: 0.116228 Oct 04 11:55:15.011390 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1995/6619] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:55:14 2022] DELETE /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 11:55:15.020407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:15.021601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:15.027550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:15.028033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:15.028467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:15.029152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:15.029667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:15.030089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:15.156032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:15.163648 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c306350d-d291-487a-8558-22a14d9f748e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1675 microversion: 2.1 time: 0.147292 Oct 04 11:55:15.164225 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4625/6620] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:15 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:55:16.187858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:16.188578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:16.195428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:16.195923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:16.196366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:16.197082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:16.197577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:16.198017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:16.326938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:16.334713 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-670b9832-c98f-4d92-86ec-1d5a9c775104 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1675 microversion: 2.1 time: 0.151169 Oct 04 11:55:16.335283 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1996/6621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:16 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:17.359012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:17.359720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:17.367033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:17.367723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:17.368146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:17.368952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:17.369523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:17.370047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:17.405834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-77531618-5b3c-4572-b07f-b8d6f92cbb12 req-618b2748-93c1-4529-adf9-91b8916e258f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2467b055-6749-493c-90f9-6383396068eb", "name": "network-vif-deleted", "tag": "ebba3925-06d0-4c44-8e3d-4c2bb2ada66f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:17.417945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-77531618-5b3c-4572-b07f-b8d6f92cbb12 req-618b2748-93c1-4529-adf9-91b8916e258f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:17.418458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-77531618-5b3c-4572-b07f-b8d6f92cbb12 req-618b2748-93c1-4529-adf9-91b8916e258f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:17.419083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-77531618-5b3c-4572-b07f-b8d6f92cbb12 req-618b2748-93c1-4529-adf9-91b8916e258f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:17.432648 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-77531618-5b3c-4572-b07f-b8d6f92cbb12 req-618b2748-93c1-4529-adf9-91b8916e258f service nova] Creating event network-vif-deleted:ebba3925-06d0-4c44-8e3d-4c2bb2ada66f for instance 2467b055-6749-493c-90f9-6383396068eb on n-h2-791135-8 Oct 04 11:55:17.438530 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-77531618-5b3c-4572-b07f-b8d6f92cbb12 req-618b2748-93c1-4529-adf9-91b8916e258f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036516 Oct 04 11:55:17.439525 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1997/6622] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:55:17.443816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:17.452209 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3d6b69bf-ee03-4998-9457-63548b75d6d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 200 len: 1609 microversion: 2.1 time: 0.097794 Oct 04 11:55:17.452794 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4626/6623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:17 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 1609 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:18.477568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:18.478311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:18.484499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:18.484994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:18.485471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:18.486171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:18.486643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:18.487082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:18.500124 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb HTTP/1.1 Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '2467b055-6749-493c-90f9-6383396068eb'} Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:18.501752 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f40a689f-719d-477a-bd51-5c62e6af4793 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 404 len: 111 microversion: 2.1 time: 0.030682 Oct 04 11:55:18.506795 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1998/6624] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:18 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:55:18.516463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:18.517095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:18.524678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:18.525173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:18.525665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:18.526390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:18.526857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:18.527292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:18.540650 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb HTTP/1.1 Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2467b055-6749-493c-90f9-6383396068eb'} Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:18.542320 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a6ad8c1-7707-4046-898d-07a92d056c5f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 404 len: 111 microversion: 2.1 time: 0.031183 Oct 04 11:55:18.546673 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4627/6625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:18 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:55:18.592112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-642592050", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "595ce718-19ef-45fd-bf46-f216de20fae5"}], "security_groups": [{"name": "tempest-securitygroup--35547156"}], "key_name": "tempest-keypair-2054538442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:18.697937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] validate_networks() for [('595ce718-19ef-45fd-bf46-f216de20fae5', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:55:19.064846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:55:19.065275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:55:19.065782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:55:19.066198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:55:19.066613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:55:19.075990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:19.076475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:19.076911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:19.077664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:19.078124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:19.078553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:19.094537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for project 733639ce17264784894a065d5406670e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:55:19.099664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for user e21298423c97470ebaca987598a8ce8d and project 733639ce17264784894a065d5406670e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:55:19.111492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:55:19.113773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:55:19.159717 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8bd52c51-af27-4369-94bf-ad01f7c9bc5c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.571379 Oct 04 11:55:19.160361 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 1999/6626] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:55:18 2022] POST /compute/v2.1/servers => generated 404 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:55:19.172183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3e1d8d93-767d-4db4-8f4c-d00e8d0e093b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:19.172925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3e1d8d93-767d-4db4-8f4c-d00e8d0e093b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:19.230332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3e1d8d93-767d-4db4-8f4c-d00e8d0e093b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:19.237291 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3e1d8d93-767d-4db4-8f4c-d00e8d0e093b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1238 microversion: 2.1 time: 0.069123 Oct 04 11:55:19.237889 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4628/6627] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:19 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:20.262879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:20.263497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:20.269574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:20.270075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:20.271197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:20.271909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:20.272378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:20.272819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:20.336033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:20.343955 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-89fe8f52-1a60-44ec-bc87-b5482814c898 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1308 microversion: 2.1 time: 0.086175 Oct 04 11:55:20.344580 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2000/6628] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:20 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1308 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:21.367998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:21.368678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:21.376772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:21.377264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:21.377731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:21.378435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:21.378909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:21.379330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:21.574512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:21.582704 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ab175c81-e57c-44ac-a254-c68bee8eafb9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1362 microversion: 2.1 time: 0.219154 Oct 04 11:55:21.583277 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4629/6629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:21 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:21.667717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4cae6b97-32e7-4297-8a42-0abd6f28126f req-17b8b0fb-0eef-4c37-baad-643582d8c66c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1699f24b-cbe5-4a85-95b3-e55ec577ab0b", "tag": "0f41baa0-d55e-42ff-9206-aba6d02d0421"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:21.680227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4cae6b97-32e7-4297-8a42-0abd6f28126f req-17b8b0fb-0eef-4c37-baad-643582d8c66c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:21.680726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4cae6b97-32e7-4297-8a42-0abd6f28126f req-17b8b0fb-0eef-4c37-baad-643582d8c66c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:21.681171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4cae6b97-32e7-4297-8a42-0abd6f28126f req-17b8b0fb-0eef-4c37-baad-643582d8c66c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:21.692277 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4cae6b97-32e7-4297-8a42-0abd6f28126f req-17b8b0fb-0eef-4c37-baad-643582d8c66c service nova] Creating event network-changed:0f41baa0-d55e-42ff-9206-aba6d02d0421 for instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b on n-h2-791135-8 Oct 04 11:55:21.698115 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4cae6b97-32e7-4297-8a42-0abd6f28126f req-17b8b0fb-0eef-4c37-baad-643582d8c66c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034753 Oct 04 11:55:21.698891 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2001/6630] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:22.606752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:22.607372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:22.610117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=47 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:22.615875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:22.616364 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:22.616808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:22.617601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:22.618064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:22.618495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:22.750666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:22.758940 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6d58824f-e571-4288-94a2-ee5fa8d8720b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1362 microversion: 2.1 time: 0.156096 Oct 04 11:55:22.759519 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4630/6631] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:22 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:23.782705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:23.783418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:23.786223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:23.792339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:23.792828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:23.793271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:23.793988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:23.794450 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:23.794910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:23.922801 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:23.930642 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-94ea2587-2f64-4a81-84f8-7fead6ca6b1c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1362 microversion: 2.1 time: 0.152204 Oct 04 11:55:23.931217 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2002/6632] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:23 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:24.954064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:24.954705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:24.962502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:24.962753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:24.963202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:24.963916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:24.964421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:24.965066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:25.093705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:25.101997 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-962d2b32-5e9d-466d-9754-8fe4780c6f68 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1362 microversion: 2.1 time: 0.151865 Oct 04 11:55:25.102579 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4631/6633] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:24 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:26.127044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:26.127676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:26.134641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:26.135133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:26.135847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:26.136553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:26.137005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:26.137463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:26.548026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:26.555785 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99f24d91-0c0d-4e43-9763-7151a3c1fab1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1362 microversion: 2.1 time: 0.434305 Oct 04 11:55:26.556376 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2003/6634] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:26 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:27.579127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:27.579819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:27.587365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:27.587946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:27.588450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:27.589218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:27.589771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:27.590188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:27.609401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0c02216d-32b7-406c-adde-bbce8368253a req-201c5d06-b90d-4abe-bc54-7fed08f44d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1699f24b-cbe5-4a85-95b3-e55ec577ab0b", "name": "network-vif-plugged", "status": "completed", "tag": "0f41baa0-d55e-42ff-9206-aba6d02d0421"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:27.620302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c02216d-32b7-406c-adde-bbce8368253a req-201c5d06-b90d-4abe-bc54-7fed08f44d79 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:27.621125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c02216d-32b7-406c-adde-bbce8368253a req-201c5d06-b90d-4abe-bc54-7fed08f44d79 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:27.621691 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c02216d-32b7-406c-adde-bbce8368253a req-201c5d06-b90d-4abe-bc54-7fed08f44d79 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:27.644931 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0c02216d-32b7-406c-adde-bbce8368253a req-201c5d06-b90d-4abe-bc54-7fed08f44d79 service nova] Creating event network-vif-plugged:0f41baa0-d55e-42ff-9206-aba6d02d0421 for instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b on n-h2-791135-8 Oct 04 11:55:27.650792 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0c02216d-32b7-406c-adde-bbce8368253a req-201c5d06-b90d-4abe-bc54-7fed08f44d79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045161 Oct 04 11:55:27.651488 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2004/6635] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:55:27.732801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:27.740680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96d078c7-f1b4-4902-b8e5-dbb5152716ad tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1362 microversion: 2.1 time: 0.165682 Oct 04 11:55:27.741267 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4632/6636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:27 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:28.765322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:28.766048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:28.772905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:28.773442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:28.773895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:28.774610 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:28.775104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:28.775540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:28.903037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:28.910652 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aab4b0e5-1454-44df-915f-0e5aca010d77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1362 microversion: 2.1 time: 0.150899 Oct 04 11:55:28.911226 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2005/6637] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:28 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:29.934823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:29.935435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:29.938131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:29.943388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:29.943867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:29.944300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:29.944984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:29.945467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:29.945894 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:30.071691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:55:30.079485 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-55c7c5cc-580b-4c00-88fe-441d4682aed4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1549 microversion: 2.1 time: 0.148521 Oct 04 11:55:30.080058 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4633/6638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:55:29 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:30.103657 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:30.104212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:55:30.106066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:30.106735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:30.115850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:30.116347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:30.116789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:30.117533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:30.117996 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:30.118431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:30.194061 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bb0fc0ac-44d2-46a7-a110-c469ca0731a1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095206 Oct 04 11:55:30.194660 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2006/6639] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:55:30 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:31.118244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-01df01ab-ee3d-4dbf-a673-92fc4b91eefb req-e0058a70-96e7-4d55-9e1e-49f29851101d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1699f24b-cbe5-4a85-95b3-e55ec577ab0b", "tag": "0f41baa0-d55e-42ff-9206-aba6d02d0421"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:31.128604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-01df01ab-ee3d-4dbf-a673-92fc4b91eefb req-e0058a70-96e7-4d55-9e1e-49f29851101d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:55:31.129086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-01df01ab-ee3d-4dbf-a673-92fc4b91eefb req-e0058a70-96e7-4d55-9e1e-49f29851101d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:55:31.129552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-01df01ab-ee3d-4dbf-a673-92fc4b91eefb req-e0058a70-96e7-4d55-9e1e-49f29851101d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:55:31.141393 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-01df01ab-ee3d-4dbf-a673-92fc4b91eefb req-e0058a70-96e7-4d55-9e1e-49f29851101d service nova] Creating event network-changed:0f41baa0-d55e-42ff-9206-aba6d02d0421 for instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b on n-h2-791135-8 Oct 04 11:55:31.146441 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-01df01ab-ee3d-4dbf-a673-92fc4b91eefb req-e0058a70-96e7-4d55-9e1e-49f29851101d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032465 Oct 04 11:55:31.147052 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4634/6640] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:56:34.852936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=9 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:34.853766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=44 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:34.855286 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 11:56:34.860612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7560fc1d-c4dc-4ea9-a3fb-ff8e42a24bbf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:56:34.867963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7560fc1d-c4dc-4ea9-a3fb-ff8e42a24bbf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:34.868457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7560fc1d-c4dc-4ea9-a3fb-ff8e42a24bbf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:34.868897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7560fc1d-c4dc-4ea9-a3fb-ff8e42a24bbf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:34.891394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7560fc1d-c4dc-4ea9-a3fb-ff8e42a24bbf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Going to try to stop instance {{(pid=122408) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 11:56:34.933556 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7560fc1d-c4dc-4ea9-a3fb-ff8e42a24bbf tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/action" status: 202 len: 0 microversion: 2.1 time: 0.082822 Oct 04 11:56:34.934158 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2007/6641] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:56:34 2022] POST /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:56:34.941751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=9 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:34.943556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=49 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:34.944564 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:56:34.944719 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 11:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b (ip 10.222.0.23) !!! Oct 04 11:56:34.951853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:34.952693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:34.959977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:34.960474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:34.960912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:34.961651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:34.962110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:34.962545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:35.099863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:35.107758 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7cfb467c-e64a-4025-a8b2-109f85439808 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.168660 Oct 04 11:56:35.108281 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4635/6642] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:34 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:36.132564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:36.133277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:36.139772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:36.140262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:36.140709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:36.141433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:36.141900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:36.142336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:36.327698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:36.335349 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-25e84b6d-2991-437c-bcee-2d08489118f8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.207909 Oct 04 11:56:36.335935 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2008/6643] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:36 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:37.358669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:37.359343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:37.366713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:37.367198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:37.367638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:37.368331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:37.368794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:37.369222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:37.496332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:37.504087 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c76807a3-9e42-412f-bdc4-4c03b4bffd4a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.149363 Oct 04 11:56:37.504670 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4636/6644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:37 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:38.528989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:38.529640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:38.536445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:38.536938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:38.537406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:38.538107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:38.538570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:38.539004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:38.665019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:38.672774 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f3dee3a-9591-4e81-abce-2d7154db31f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.147707 Oct 04 11:56:38.673371 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2009/6645] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:38 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:39.696092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:39.696748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:39.703661 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:39.704155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:39.704599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:39.705299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:39.705794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:39.706228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:39.837958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:39.845700 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cd930905-5ef7-42d0-83ba-542a8488a704 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.153540 Oct 04 11:56:39.846292 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4637/6646] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:39 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:40.868818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:40.869469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:40.876381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:40.876872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:40.877314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:40.878036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:40.878501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:40.878934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:41.016815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:41.025069 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f0bb617-deef-473e-b147-f2277d3bd818 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.160805 Oct 04 11:56:41.025683 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2010/6647] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:40 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:42.049477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:42.050092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:42.057604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:42.058086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:42.058522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:42.059217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:42.059678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:42.060112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:42.186953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:42.194644 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96430aab-bc1a-4870-a51f-5de1484602d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.149171 Oct 04 11:56:42.195221 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4638/6648] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:42 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:43.217009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:43.217649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:43.224401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:43.224888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:43.225328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:43.226040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:43.226497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:43.226923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:43.352671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:43.360249 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72e33343-bbdc-4ad7-b800-a6452a86ce99 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.147163 Oct 04 11:56:43.360819 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2011/6649] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:43 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:44.383824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:44.384468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:44.391580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:44.392066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:44.392511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:44.393206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:44.393691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:44.394123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:44.528427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:44.536223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d26c369a-a7b4-4909-a5f3-20d4d0fbc383 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.156344 Oct 04 11:56:44.536808 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4639/6650] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:44 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:45.559847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:45.560977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:45.567484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:45.567981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:45.568429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:45.569135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:45.569644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:45.570087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:45.699146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:45.706904 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dcc0f6bc-8849-4578-b553-b666d720f500 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.150942 Oct 04 11:56:45.707484 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2012/6651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:45 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:46.730068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:46.730690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:46.737629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:46.738118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:46.738564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:46.739264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:46.739728 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:46.740159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:46.868826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:46.876541 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2d18fb38-e905-4058-a354-595b873afff2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.150390 Oct 04 11:56:46.877120 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4640/6652] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:46 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:47.902520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:47.903043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:47.909969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:47.910457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:47.910897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:47.911585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:47.912046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:47.912476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:48.042879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:48.050529 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7dd8d444-d423-49bc-a88b-549961635f8a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.152766 Oct 04 11:56:48.051127 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2013/6653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:47 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:49.075017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:49.075634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:49.082480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:49.082962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:49.083396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:49.084725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:49.085177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:49.085634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:49.218450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:49.226731 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69e48f6d-6456-4c83-b50b-fc9acf93d298 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.155618 Oct 04 11:56:49.227298 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4641/6654] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:49 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:50.248632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:50.249255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:50.256590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:50.257086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:50.257568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:50.258276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:50.258743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:50.259183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:50.392643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:50.401252 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-015186c9-b0b7-484f-9781-f100c1ed4a96 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.156471 Oct 04 11:56:50.401858 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2014/6655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:50 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:51.424231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:51.424765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:51.431828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:51.432318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:51.432760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:51.433484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:51.433950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:51.434380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:51.561688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:51.570309 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fd8d7175-be8c-4d45-b324-3491cd90e61a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1655 microversion: 2.1 time: 0.150079 Oct 04 11:56:51.570877 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4642/6656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:51 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:51.592538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:56:51.594792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:51.601516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:51.602001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:51.602440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:51.603125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:51.603578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:51.604002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:51.631971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:51.637500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Old instance type m1.heat2, new instance type m1.heat {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:56:51.644156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:56:51.644578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:56:51.645056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:56:51.645495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:56:51.645915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:56:51.709700 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5c2e8c7-2369-4398-997f-1fd8986ed9b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/action" status: 202 len: 0 microversion: 2.1 time: 0.120328 Oct 04 11:56:51.711058 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2015/6657] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:56:51 2022] POST /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:56:51.718481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:51.719103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:51.726154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:51.726674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:51.727138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:51.727869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:51.728325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:51.728879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:51.893932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:51.902626 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-26f73260-d134-4e92-a083-029a3aea50ec tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.187943 Oct 04 11:56:51.903252 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4643/6658] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:51 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:56:52.927820 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:52.928502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:52.934488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:52.934974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:52.935412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:52.936098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:52.936557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:52.936985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:53.069871 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:53.077960 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-058c6e05-8a26-4112-bab7-9c0f09c464c8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1678 microversion: 2.1 time: 0.155259 Oct 04 11:56:53.078552 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2016/6659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:52 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:56:54.101299 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:54.101943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:54.108734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:54.109213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:54.109688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:54.110377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:54.110829 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:54.111259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:54.239039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:54.246795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b598da33-349b-4397-bffa-00df61f2dbfe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1683 microversion: 2.1 time: 0.149369 Oct 04 11:56:54.247371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4644/6660] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:54 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:55.270931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:55.272043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:55.278756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:55.279243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:55.279682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:55.280372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:55.280828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:55.281261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:55.408717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:55.417132 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f8afe6d-f8eb-4005-9882-ead9d243b3c6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1683 microversion: 2.1 time: 0.150084 Oct 04 11:56:55.417764 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2017/6661] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:55 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:56.081880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-748c463b-62bd-46bb-93d8-65e67af564d2 req-be64d3de-3926-4c85-96c8-f041053e4e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1699f24b-cbe5-4a85-95b3-e55ec577ab0b", "name": "network-vif-unplugged", "status": "completed", "tag": "0f41baa0-d55e-42ff-9206-aba6d02d0421"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:56:56.092592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-748c463b-62bd-46bb-93d8-65e67af564d2 req-be64d3de-3926-4c85-96c8-f041053e4e67 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:56.093074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-748c463b-62bd-46bb-93d8-65e67af564d2 req-be64d3de-3926-4c85-96c8-f041053e4e67 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:56.093542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-748c463b-62bd-46bb-93d8-65e67af564d2 req-be64d3de-3926-4c85-96c8-f041053e4e67 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:56.106365 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-748c463b-62bd-46bb-93d8-65e67af564d2 req-be64d3de-3926-4c85-96c8-f041053e4e67 service nova] Creating event network-vif-unplugged:0f41baa0-d55e-42ff-9206-aba6d02d0421 for instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b on n-h1-791135-8 Oct 04 11:56:56.111848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-748c463b-62bd-46bb-93d8-65e67af564d2 req-be64d3de-3926-4c85-96c8-f041053e4e67 service nova] Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:56:56.122896 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-748c463b-62bd-46bb-93d8-65e67af564d2 req-be64d3de-3926-4c85-96c8-f041053e4e67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044648 Oct 04 11:56:56.123778 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4645/6662] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:56:56.440547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:56.441165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:56.448571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:56.449066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:56.449906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:56.450272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:56.450718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:56.451166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:56.588823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:56.597036 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-38e16e71-52a0-469d-95cb-1493895e7a42 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1682 microversion: 2.1 time: 0.160140 Oct 04 11:56:56.597325 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2018/6663] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:56 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:57.622204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:57.622934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:57.629121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:57.629633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:57.630070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:57.630754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:57.631209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:57.632273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:57.769362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:57.777148 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ff227ff3-7069-4298-8246-228b4f1b0bb2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1680 microversion: 2.1 time: 0.160207 Oct 04 11:56:57.777768 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4646/6664] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:57 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:58.139668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-95bba526-5a36-41ac-bb70-7dad7b53f3fc req-58264ff0-4a53-4ed3-a831-97dc81a6797a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1699f24b-cbe5-4a85-95b3-e55ec577ab0b", "tag": "0f41baa0-d55e-42ff-9206-aba6d02d0421"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:56:58.149828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-95bba526-5a36-41ac-bb70-7dad7b53f3fc req-58264ff0-4a53-4ed3-a831-97dc81a6797a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:58.150322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-95bba526-5a36-41ac-bb70-7dad7b53f3fc req-58264ff0-4a53-4ed3-a831-97dc81a6797a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:58.150764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-95bba526-5a36-41ac-bb70-7dad7b53f3fc req-58264ff0-4a53-4ed3-a831-97dc81a6797a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:58.162151 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-95bba526-5a36-41ac-bb70-7dad7b53f3fc req-58264ff0-4a53-4ed3-a831-97dc81a6797a service nova] Creating event network-changed:0f41baa0-d55e-42ff-9206-aba6d02d0421 for instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b on n-h1-791135-8 Oct 04 11:56:58.167397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-95bba526-5a36-41ac-bb70-7dad7b53f3fc req-58264ff0-4a53-4ed3-a831-97dc81a6797a service nova] Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:56:58.178872 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-95bba526-5a36-41ac-bb70-7dad7b53f3fc req-58264ff0-4a53-4ed3-a831-97dc81a6797a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042366 Oct 04 11:56:58.179524 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2019/6665] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:56:58.800280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:58.801049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:58.808212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:58.808713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:58.809153 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:58.809897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:58.810358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:58.810788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:59.338947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:59.346616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8305d1ef-d1ca-480a-a412-e8deb03850ac tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1676 microversion: 2.1 time: 0.550427 Oct 04 11:56:59.347380 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4647/6666] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:58 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1676 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:59.371894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:56:59.372527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:59.378962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:59.379447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:59.379898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:59.380622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:59.381087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:59.381576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:59.419900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:59.440930 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab0f4724-4e47-42d2-985d-704812ede3de tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/action" status: 204 len: 0 microversion: 2.1 time: 0.074750 Oct 04 11:56:59.441825 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2020/6667] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:56:59 2022] POST /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:56:59.451581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:59.452294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:56:59.458967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:59.459524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:59.459974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:59.460682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:56:59.461758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:56:59.462305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:56:59.666775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:56:59.674682 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-73c3b84f-0202-453d-8055-7515401ef977 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1676 microversion: 2.1 time: 0.227687 Oct 04 11:56:59.675385 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4648/6668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:56:59 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:00.700109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:00.701159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:00.707582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:00.708077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:00.708522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:00.709301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:00.709797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:00.710234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:00.850800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:00.858572 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7595a5d2-f272-49d2-ac1a-324ad9031787 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1655 microversion: 2.1 time: 0.163704 Oct 04 11:57:00.859359 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2021/6669] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:00 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:00.883174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:00.883798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:00.891773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:00.892267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:00.892713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:00.893448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:00.893914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:00.894358 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:01.024191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:01.031979 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b92d3781-c7c2-4ffe-8f52-73db376841b6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1655 microversion: 2.1 time: 0.152750 Oct 04 11:57:01.032554 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4649/6670] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:00 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:01.054677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13ff5739-d0fd-438a-8409-7cf7580f4ab6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:57:01.060531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13ff5739-d0fd-438a-8409-7cf7580f4ab6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:01.061022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13ff5739-d0fd-438a-8409-7cf7580f4ab6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:01.061521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13ff5739-d0fd-438a-8409-7cf7580f4ab6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:01.085895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13ff5739-d0fd-438a-8409-7cf7580f4ab6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Going to try to start instance {{(pid=122408) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 11:57:01.125164 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13ff5739-d0fd-438a-8409-7cf7580f4ab6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/action" status: 202 len: 0 microversion: 2.1 time: 0.074708 Oct 04 11:57:01.125799 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2022/6671] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:57:01 2022] POST /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:57:01.134138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:01.134756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:01.140875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:01.141429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:01.141896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:01.142548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:01.143008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:01.143450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:01.287974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:01.296447 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9e1c6b54-78e0-4624-98a9-3ff1aad2d182 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1664 microversion: 2.1 time: 0.166226 Oct 04 11:57:01.297030 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4650/6672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:01 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:02.014708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e6318bce-e4a3-42e1-ad87-f8a875f854f1 req-8e103cb3-a854-4a6d-9f9e-8a8c5422ae71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1699f24b-cbe5-4a85-95b3-e55ec577ab0b", "name": "network-vif-plugged", "status": "completed", "tag": "0f41baa0-d55e-42ff-9206-aba6d02d0421"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:57:02.025074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6318bce-e4a3-42e1-ad87-f8a875f854f1 req-8e103cb3-a854-4a6d-9f9e-8a8c5422ae71 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:02.025780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6318bce-e4a3-42e1-ad87-f8a875f854f1 req-8e103cb3-a854-4a6d-9f9e-8a8c5422ae71 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:02.026228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e6318bce-e4a3-42e1-ad87-f8a875f854f1 req-8e103cb3-a854-4a6d-9f9e-8a8c5422ae71 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:02.037408 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e6318bce-e4a3-42e1-ad87-f8a875f854f1 req-8e103cb3-a854-4a6d-9f9e-8a8c5422ae71 service nova] Creating event network-vif-plugged:0f41baa0-d55e-42ff-9206-aba6d02d0421 for instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b on n-h1-791135-8 Oct 04 11:57:02.042360 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e6318bce-e4a3-42e1-ad87-f8a875f854f1 req-8e103cb3-a854-4a6d-9f9e-8a8c5422ae71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033361 Oct 04 11:57:02.042950 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2023/6673] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:57:02.319678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:02.320321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:02.327219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:02.327707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:02.328148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:02.328842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:02.329307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:02.329828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:02.463330 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:02.466898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=100 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:02.471901 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78d121b0-17a7-4a93-9cb6-ad5c28c7c9e2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1668 microversion: 2.1 time: 0.156116 Oct 04 11:57:02.472483 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4651/6674] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:02 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:02.494920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:02.495509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:02.501718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:02.502203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:02.502643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:02.503326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:02.503780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:02.504209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:02.529554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:57:02.604625 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49a205fc-dda3-4f07-a2e8-78b9525f4133 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 204 len: 0 microversion: 2.1 time: 0.113627 Oct 04 11:57:02.605306 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2024/6675] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:57:02 2022] DELETE /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:57:02.613806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:02.614426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:02.620823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:02.621312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:02.621788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:02.622499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:02.622946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:02.623377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:02.752217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:02.759943 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2e3205de-5ce5-432a-a080-cbbd9d83213b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1674 microversion: 2.1 time: 0.150165 Oct 04 11:57:02.760547 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4652/6676] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:02 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:57:03.784361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:03.785008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:03.791900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:03.792391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:03.792900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:03.793675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:03.794141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:03.794579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:03.924014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:03.931931 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ff0dac65-92ca-401c-9708-0536c2bda990 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 200 len: 1674 microversion: 2.1 time: 0.151867 Oct 04 11:57:03.932545 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2025/6677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:03 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:04.746198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-122a7791-4ac8-4adc-95da-8c2bdf74048e req-b8b2e0ce-9dad-4a64-ba87-9b00836eb9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1699f24b-cbe5-4a85-95b3-e55ec577ab0b", "name": "network-vif-deleted", "tag": "0f41baa0-d55e-42ff-9206-aba6d02d0421"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:57:04.757870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-122a7791-4ac8-4adc-95da-8c2bdf74048e req-b8b2e0ce-9dad-4a64-ba87-9b00836eb9ee service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:04.758361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-122a7791-4ac8-4adc-95da-8c2bdf74048e req-b8b2e0ce-9dad-4a64-ba87-9b00836eb9ee service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:04.758793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-122a7791-4ac8-4adc-95da-8c2bdf74048e req-b8b2e0ce-9dad-4a64-ba87-9b00836eb9ee service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:04.770992 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-122a7791-4ac8-4adc-95da-8c2bdf74048e req-b8b2e0ce-9dad-4a64-ba87-9b00836eb9ee service nova] Creating event network-vif-deleted:0f41baa0-d55e-42ff-9206-aba6d02d0421 for instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b on n-h1-791135-8 Oct 04 11:57:04.776631 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-122a7791-4ac8-4adc-95da-8c2bdf74048e req-b8b2e0ce-9dad-4a64-ba87-9b00836eb9ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034101 Oct 04 11:57:04.777473 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4653/6678] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:57:04.955858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:04.956675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:04.959642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:04.965319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:04.965976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:04.966547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:04.967519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:04.968091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:04.968622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:04.985375 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b HTTP/1.1 Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '1699f24b-cbe5-4a85-95b3-e55ec577ab0b'} Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:57:04.987278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9786b464-3fb9-4299-b778-560b2134982a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 404 len: 111 microversion: 2.1 time: 0.037451 Oct 04 11:57:04.992618 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2026/6679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:04 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 11:57:05.004445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:05.005159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:05.007719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=39 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:05.013587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:05.014090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:05.014537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:05.015430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:05.015900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:05.016409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:05.030124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b HTTP/1.1 Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1699f24b-cbe5-4a85-95b3-e55ec577ab0b'} Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:57:05.031798 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46faac91-960c-418c-b881-49886f423c57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 404 len: 111 microversion: 2.1 time: 0.033085 Oct 04 11:57:05.043001 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4654/6680] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:04 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:57:05.084514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-444230682", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "595ce718-19ef-45fd-bf46-f216de20fae5"}], "security_groups": [{"name": "tempest-securitygroup--35547156"}], "key_name": "tempest-keypair-2054538442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:57:05.187869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] validate_networks() for [('595ce718-19ef-45fd-bf46-f216de20fae5', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:57:05.631731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:57:05.632168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:57:05.632661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:57:05.633086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:57:05.633589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:57:05.642635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:05.643133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:05.643609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:05.644301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:05.644770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:05.645223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:05.663525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for project 733639ce17264784894a065d5406670e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:57:05.669193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for user e21298423c97470ebaca987598a8ce8d and project 733639ce17264784894a065d5406670e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:57:05.682012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:57:05.684239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:57:05.733762 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7876b9f-922f-40e3-b605-fcfda73ccd34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.652955 Oct 04 11:57:05.740481 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2027/6681] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:57:05 2022] POST /compute/v2.1/servers => generated 404 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 11:57:05.745798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ea3aa2d-2406-462c-8923-2daff9776512 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:05.746998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3ea3aa2d-2406-462c-8923-2daff9776512 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:05.809791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3ea3aa2d-2406-462c-8923-2daff9776512 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:05.819410 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ea3aa2d-2406-462c-8923-2daff9776512 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1238 microversion: 2.1 time: 0.077473 Oct 04 11:57:05.819988 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4655/6682] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:05 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:06.843052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:06.843584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:06.851241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:06.851960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:06.852410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:06.853116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:06.853771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:06.854214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:06.916651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:06.925781 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a619184-4151-47a9-90b7-0e0072cd1254 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1298 microversion: 2.1 time: 0.086535 Oct 04 11:57:06.926370 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2028/6683] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:06 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:07.950797 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:07.951552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:07.958655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:07.959248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:07.959762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:07.960480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:07.960946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:07.961433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:08.217376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:08.225609 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e8a96d48-b32b-4185-9ac6-ed2c2b7b6ad8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1362 microversion: 2.1 time: 0.278166 Oct 04 11:57:08.226185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4656/6684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:07 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:08.390172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-83e03ec4-272c-40df-9ee5-f525c0c60c27 req-fd918d99-78a4-4039-a4e3-cae8776eae31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:57:08.400850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83e03ec4-272c-40df-9ee5-f525c0c60c27 req-fd918d99-78a4-4039-a4e3-cae8776eae31 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:08.401368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83e03ec4-272c-40df-9ee5-f525c0c60c27 req-fd918d99-78a4-4039-a4e3-cae8776eae31 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:08.401985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-83e03ec4-272c-40df-9ee5-f525c0c60c27 req-fd918d99-78a4-4039-a4e3-cae8776eae31 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:08.416289 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-83e03ec4-272c-40df-9ee5-f525c0c60c27 req-fd918d99-78a4-4039-a4e3-cae8776eae31 service nova] Creating event network-changed:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h2-791135-8 Oct 04 11:57:08.421276 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-83e03ec4-272c-40df-9ee5-f525c0c60c27 req-fd918d99-78a4-4039-a4e3-cae8776eae31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035094 Oct 04 11:57:08.422360 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2029/6685] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:57:09.254457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:09.255077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:09.262911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:09.263397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:09.263833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:09.264520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:09.264973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:09.265432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:09.393054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:09.400686 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5850928-b02c-4b0c-a07f-b9f7c40e60f0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1362 microversion: 2.1 time: 0.154838 Oct 04 11:57:09.401274 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4657/6686] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:09 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:10.424862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:10.425617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:10.431836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:10.432329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:10.432771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:10.433500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:10.433968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:10.434405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:10.562003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:10.570227 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a118054-7e0b-478d-8f03-8679a30d400b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1362 microversion: 2.1 time: 0.150442 Oct 04 11:57:10.570789 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2030/6687] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:10 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:11.593945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:11.594562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:11.601956 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:11.602442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:11.602878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:11.603569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:11.604030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:11.604456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:11.733983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:11.741585 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b222cacf-4a1d-4af4-b624-ae70d2111fe8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1362 microversion: 2.1 time: 0.151595 Oct 04 11:57:11.742159 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4658/6688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:11 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:12.764841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:12.765382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:12.772200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:12.772690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:12.773132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:12.773852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:12.774321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:12.774751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:12.940614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:12.948671 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f807260e-83df-4eba-9de7-4487832f9791 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1362 microversion: 2.1 time: 0.188114 Oct 04 11:57:12.949233 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2031/6689] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:12 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:13.972203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:13.972822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:13.979864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:13.980361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:13.981096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:13.981648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:13.982041 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:13.982527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:14.094453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-2795b588-7ccc-4916-8c59-ab8315b4ebb9 req-748c4b8d-9df8-4644-804a-1b3bd2dec22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "name": "network-vif-plugged", "status": "completed", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:57:14.105615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2795b588-7ccc-4916-8c59-ab8315b4ebb9 req-748c4b8d-9df8-4644-804a-1b3bd2dec22e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:14.106238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2795b588-7ccc-4916-8c59-ab8315b4ebb9 req-748c4b8d-9df8-4644-804a-1b3bd2dec22e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:14.106747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-2795b588-7ccc-4916-8c59-ab8315b4ebb9 req-748c4b8d-9df8-4644-804a-1b3bd2dec22e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:14.119867 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-2795b588-7ccc-4916-8c59-ab8315b4ebb9 req-748c4b8d-9df8-4644-804a-1b3bd2dec22e service nova] Creating event network-vif-plugged:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h2-791135-8 Oct 04 11:57:14.125101 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-2795b588-7ccc-4916-8c59-ab8315b4ebb9 req-748c4b8d-9df8-4644-804a-1b3bd2dec22e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034447 Oct 04 11:57:14.126446 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2032/6690] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:57:14.206267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:14.214394 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-38a7c5b1-beab-46df-9c08-0110384dab4b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1362 microversion: 2.1 time: 0.246174 Oct 04 11:57:14.214977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4659/6691] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:13 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:57:15.238488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:15.239191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:15.245806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:15.246290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:15.246779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:15.247471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:15.247930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:15.248362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:15.375439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:15.382985 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9049f23-b140-472a-9c56-a0f7536a7b57 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1362 microversion: 2.1 time: 0.149501 Oct 04 11:57:15.383546 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2033/6692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:15 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:16.406448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:16.406970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:16.409715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:16.415277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:16.415764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:16.416204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:16.416901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:16.417375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:16.417814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:16.547375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:57:16.555694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-752e68e0-12c4-4c88-87e5-7b1d199235b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1549 microversion: 2.1 time: 0.153225 Oct 04 11:57:16.556287 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4660/6693] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:57:16 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:57:16.578543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:57:16.579050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:57:16.581005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:16.581721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:57:16.588287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:16.588782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:16.589225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:16.589954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:16.590419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:16.590857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:16.666674 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-823d8c07-fcda-4565-8449-4d89e70f841f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091907 Oct 04 11:57:16.667280 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2034/6694] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:57:16 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:57:17.650148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c21f00b3-ffd8-4032-863c-bb2aaac06246 req-ea4d4969-25b5-415a-99d7-a4bd0e4af31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:57:17.659852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c21f00b3-ffd8-4032-863c-bb2aaac06246 req-ea4d4969-25b5-415a-99d7-a4bd0e4af31f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:57:17.660344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c21f00b3-ffd8-4032-863c-bb2aaac06246 req-ea4d4969-25b5-415a-99d7-a4bd0e4af31f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:57:17.660776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c21f00b3-ffd8-4032-863c-bb2aaac06246 req-ea4d4969-25b5-415a-99d7-a4bd0e4af31f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:57:17.672845 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c21f00b3-ffd8-4032-863c-bb2aaac06246 req-ea4d4969-25b5-415a-99d7-a4bd0e4af31f service nova] Creating event network-changed:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h2-791135-8 Oct 04 11:57:17.677961 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c21f00b3-ffd8-4032-863c-bb2aaac06246 req-ea4d4969-25b5-415a-99d7-a4bd0e4af31f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092308 Oct 04 11:57:17.678578 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4661/6695] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:58:29.584480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:29.585049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=75,nova_cell1:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:29.597849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:29.600609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:29.613678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:29.614175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:29.614621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:29.615367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:29.616344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:29.616836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:29.648407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:29.654243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Old instance type m1.heat2, new instance type m1.heat {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 11:58:29.661241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:58:29.661714 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:58:29.662736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:58:29.663164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:58:29.663692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:58:29.729922 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-329c082c-546e-4ebb-a7b2-bbdb5e3a26fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191/action" status: 202 len: 0 microversion: 2.1 time: 0.147850 Oct 04 11:58:29.733504 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2035/6696] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:58:29 2022] POST /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:58:29.737804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=17 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:29.738978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=42 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:29.740115 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 11:58:29.741071 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 11:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 (ip 10.222.0.23) !!! Oct 04 11:58:29.746854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:29.747553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:29.755776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:29.756270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:29.756700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:29.757417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:29.757875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:29.758300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:29.937329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:29.945117 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c62a927f-ee43-4e56-adca-494a69ea9e01 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1677 microversion: 2.1 time: 0.209998 Oct 04 11:58:29.945725 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4662/6697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:29 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:30.968219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:30.968836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:30.976249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:30.976743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:30.977191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:30.977938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:30.978402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:30.978840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:31.115526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:31.123427 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3c38f397-cac2-48c9-bfa0-48284772a1a6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1677 microversion: 2.1 time: 0.159100 Oct 04 11:58:31.124026 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2036/6698] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:30 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:32.147982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:32.148511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:32.157488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:32.157980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:32.158421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:32.159117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:32.159578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:32.160009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:32.285904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:32.294612 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2158b953-9510-4879-aba1-9e8ec7b12269 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.151187 Oct 04 11:58:32.295187 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4663/6699] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:32 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:33.319449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:33.320001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:33.326537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:33.327030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:33.327482 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:33.328181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:33.328649 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:33.329086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:33.461008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:33.468672 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dc40a91c-0491-42a5-87d4-26a2b207589e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.153836 Oct 04 11:58:33.469242 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2037/6700] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:33 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:34.492138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:34.492777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:34.499490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:34.499971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:34.500403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:34.501135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:34.501715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:34.502134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:34.635780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:34.643707 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-454df09c-7e58-41d7-977c-fdc8a8ee032a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.156084 Oct 04 11:58:34.644295 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4664/6701] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:34 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:35.666554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:35.667184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:35.674108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:35.674597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:35.675042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:35.675744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:35.676215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:35.676654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:35.807101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:35.815111 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9b07323-7320-464b-b32f-a17f9e6edd63 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.152455 Oct 04 11:58:35.815711 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2038/6702] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:35 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:36.839360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:36.839950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:36.846764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:36.847250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:36.847686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:36.848379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:36.848833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:36.849260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:36.977097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:36.984772 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0ccd38ab-b3a7-43e3-9628-bb42f2f93fa3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.149993 Oct 04 11:58:36.985371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4665/6703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:36 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:38.007715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:38.008399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:38.015581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:38.016076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:38.016529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:38.017225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:38.017716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:38.018155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:38.149604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:38.157271 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a7ddbf5d-5520-4a6a-8c9d-9f5043dd9c31 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.153479 Oct 04 11:58:38.157871 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2039/6704] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:38 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:39.181265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:39.181910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:39.188675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:39.189158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:39.189638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:39.190334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:39.190795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:39.191223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:39.328106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:39.336400 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e0ff7a27-74ac-4045-a060-a54ee2014855 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.159564 Oct 04 11:58:39.336977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4666/6705] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:39 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:40.359535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:40.360155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:40.367661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:40.368146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:40.368590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:40.369280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:40.369773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:40.370211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:40.778854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:40.786813 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7f94e9fc-1bdd-420b-9e13-4e9cdc0f29f3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.431059 Oct 04 11:58:40.787400 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2040/6706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:40 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:41.810288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:41.810895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:41.818011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:41.818435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:41.818873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:41.820084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:41.820543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:41.820972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:41.951401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:41.959073 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e784c8be-68a7-49c6-827c-71f984dd9748 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.152832 Oct 04 11:58:41.959656 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4667/6707] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:41 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:42.982774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:42.983932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:42.990291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:42.990784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:42.991751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:42.992452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:42.992918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:42.993384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:43.129228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:43.137279 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b776da9-be01-4c6c-8a31-a1036a39f4d8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1682 microversion: 2.1 time: 0.158378 Oct 04 11:58:43.137861 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2041/6708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:42 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:44.160104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:44.160855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:44.168415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:44.168915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:44.169391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:44.170098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:44.170562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:44.171002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:44.282113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-549a9410-6fbd-4787-b941-c92afeddf980 req-aea81d6f-3137-4c2f-8a23-7d1dd60f1d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "name": "network-vif-unplugged", "status": "completed", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:44.292053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-549a9410-6fbd-4787-b941-c92afeddf980 req-aea81d6f-3137-4c2f-8a23-7d1dd60f1d2a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:44.292545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-549a9410-6fbd-4787-b941-c92afeddf980 req-aea81d6f-3137-4c2f-8a23-7d1dd60f1d2a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:44.292985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-549a9410-6fbd-4787-b941-c92afeddf980 req-aea81d6f-3137-4c2f-8a23-7d1dd60f1d2a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:44.307417 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-549a9410-6fbd-4787-b941-c92afeddf980 req-aea81d6f-3137-4c2f-8a23-7d1dd60f1d2a service nova] Creating event network-vif-unplugged:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h1-791135-8 Oct 04 11:58:44.312982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-549a9410-6fbd-4787-b941-c92afeddf980 req-aea81d6f-3137-4c2f-8a23-7d1dd60f1d2a service nova] Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:58:44.323836 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-549a9410-6fbd-4787-b941-c92afeddf980 req-aea81d6f-3137-4c2f-8a23-7d1dd60f1d2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094255 Oct 04 11:58:44.324609 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2042/6709] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:58:44.460598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:44.468348 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-20fb3af4-3318-4ce6-8ded-e8973bcb6a94 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1681 microversion: 2.1 time: 0.312185 Oct 04 11:58:44.468931 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4668/6710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:44 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:45.493970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:45.494689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:45.500777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:45.501312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:45.501791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:45.502516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:45.502984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:45.503419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:45.635660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:45.643680 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2882a601-0165-4640-b59a-e955d48995d3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1679 microversion: 2.1 time: 0.155398 Oct 04 11:58:45.644258 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2043/6711] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:45 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:46.341905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7f0053b1-2d29-4d1e-9d8f-1e68b28c2c8e req-f6b5bd60-d10e-4113-b29a-4b1717c1cd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:46.352169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7f0053b1-2d29-4d1e-9d8f-1e68b28c2c8e req-f6b5bd60-d10e-4113-b29a-4b1717c1cd50 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:46.352657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7f0053b1-2d29-4d1e-9d8f-1e68b28c2c8e req-f6b5bd60-d10e-4113-b29a-4b1717c1cd50 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:46.353098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7f0053b1-2d29-4d1e-9d8f-1e68b28c2c8e req-f6b5bd60-d10e-4113-b29a-4b1717c1cd50 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:46.364918 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7f0053b1-2d29-4d1e-9d8f-1e68b28c2c8e req-f6b5bd60-d10e-4113-b29a-4b1717c1cd50 service nova] Creating event network-changed:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h1-791135-8 Oct 04 11:58:46.370856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-7f0053b1-2d29-4d1e-9d8f-1e68b28c2c8e req-f6b5bd60-d10e-4113-b29a-4b1717c1cd50 service nova] Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:58:46.382281 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7f0053b1-2d29-4d1e-9d8f-1e68b28c2c8e req-f6b5bd60-d10e-4113-b29a-4b1717c1cd50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043293 Oct 04 11:58:46.382801 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4669/6712] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:58:46.667718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:46.668336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:46.675286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:46.675766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:46.676312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:46.677028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:46.677519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:46.677951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:46.822487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:46.831767 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90985bca-2fe3-43cc-b9bd-112d69455c40 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1679 microversion: 2.1 time: 0.167828 Oct 04 11:58:46.832362 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2044/6713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:46 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:47.857179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:47.857914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:47.864141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:47.864627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:47.865065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:47.865796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:47.866838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:47.867272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:48.080168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:48.088523 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-85154431-facc-4cf3-ac01-7310d8187a9e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1676 microversion: 2.1 time: 0.236498 Oct 04 11:58:48.089105 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4670/6714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:47 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:48.111303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:48.111934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:48.118933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:48.119464 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:48.119915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:48.120635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:48.121215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:48.121666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:48.160062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:48.160559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:48.161006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:48.161805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:48.162271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:48.162705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:48.186365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for project 733639ce17264784894a065d5406670e. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:58:48.192189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for user e21298423c97470ebaca987598a8ce8d and project 733639ce17264784894a065d5406670e. Resources: {'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:58:48.301847 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdfb889e-e4a7-4371-94ac-c760b62486c3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191/action" status: 202 len: 0 microversion: 2.1 time: 0.194226 Oct 04 11:58:48.302475 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2045/6715] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 11:58:48 2022] POST /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 11:58:48.310989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:48.311890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:48.318221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:48.319529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:48.319979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:48.320712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:48.321174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:48.321637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:48.668518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-1f9f890b-cb9a-44ae-8d64-4b0f4156eaec req-fdbe2725-bed7-4ccd-b54d-1c424377331f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "name": "network-vif-plugged", "status": "completed", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:48.679102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1f9f890b-cb9a-44ae-8d64-4b0f4156eaec req-fdbe2725-bed7-4ccd-b54d-1c424377331f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:48.679731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1f9f890b-cb9a-44ae-8d64-4b0f4156eaec req-fdbe2725-bed7-4ccd-b54d-1c424377331f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:48.680420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-1f9f890b-cb9a-44ae-8d64-4b0f4156eaec req-fdbe2725-bed7-4ccd-b54d-1c424377331f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:48.682582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:48.690872 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c5356985-37f7-4780-98ee-408f7a6ea57e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1675 microversion: 2.1 time: 0.383822 Oct 04 11:58:48.691545 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4671/6716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:48 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1675 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:48.693823 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-1f9f890b-cb9a-44ae-8d64-4b0f4156eaec req-fdbe2725-bed7-4ccd-b54d-1c424377331f service nova] Creating event network-vif-plugged:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h1-791135-8 Oct 04 11:58:48.700093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-1f9f890b-cb9a-44ae-8d64-4b0f4156eaec req-fdbe2725-bed7-4ccd-b54d-1c424377331f service nova] Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:58:48.711262 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-1f9f890b-cb9a-44ae-8d64-4b0f4156eaec req-fdbe2725-bed7-4ccd-b54d-1c424377331f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097366 Oct 04 11:58:48.712059 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2046/6717] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:58:49.716422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:49.717045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:49.724112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:49.724602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:49.725048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:49.726404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:49.726867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:49.727300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:49.854340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:49.862047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3ff1aab2-9262-4a53-8fb0-c44a7b50a1fe tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1675 microversion: 2.1 time: 0.149580 Oct 04 11:58:49.862631 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4672/6718] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:49 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:50.886030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:50.886924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:50.893128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:50.893651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:50.894099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:50.894798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:50.895263 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:50.895702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:51.033767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:51.037257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:51.043413 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f77dd3f4-6015-4f1c-80ee-ef3c286d0007 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1675 microversion: 2.1 time: 0.162635 Oct 04 11:58:51.044073 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2047/6719] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:50 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:51.591970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-22e605ed-4d48-4d8d-bfe6-db089258b64d req-3968206f-27a3-48ec-a7ad-0c1dfc568b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "name": "network-vif-unplugged", "status": "completed", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:51.602373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22e605ed-4d48-4d8d-bfe6-db089258b64d req-3968206f-27a3-48ec-a7ad-0c1dfc568b79 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:51.602910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22e605ed-4d48-4d8d-bfe6-db089258b64d req-3968206f-27a3-48ec-a7ad-0c1dfc568b79 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:51.603408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-22e605ed-4d48-4d8d-bfe6-db089258b64d req-3968206f-27a3-48ec-a7ad-0c1dfc568b79 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:51.618974 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-22e605ed-4d48-4d8d-bfe6-db089258b64d req-3968206f-27a3-48ec-a7ad-0c1dfc568b79 service nova] Creating event network-vif-unplugged:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h2-791135-8 Oct 04 11:58:51.624474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-22e605ed-4d48-4d8d-bfe6-db089258b64d req-3968206f-27a3-48ec-a7ad-0c1dfc568b79 service nova] Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:58:51.636787 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-22e605ed-4d48-4d8d-bfe6-db089258b64d req-3968206f-27a3-48ec-a7ad-0c1dfc568b79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048641 Oct 04 11:58:51.637440 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4673/6720] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:58:52.067376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:52.068106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:52.077715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:52.078211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:52.078651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:52.079365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:52.079819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:52.080248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:52.224183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:52.232653 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-11197310-95ad-4a3a-a0e6-fd978f677acd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1675 microversion: 2.1 time: 0.169374 Oct 04 11:58:52.233454 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2048/6721] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:52 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:53.257512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:53.258218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:53.264615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:53.265100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:53.265580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:53.266265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:53.266721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:53.267152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:53.396239 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:53.404159 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-899ab7c1-3132-4033-a114-09db186e871e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1675 microversion: 2.1 time: 0.151919 Oct 04 11:58:53.404731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4674/6722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:53 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:53.669703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-125b7857-116b-4e82-bd5e-371c95b64106 req-534ef00f-325d-4423-8fd8-61a4376b5db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:53.680503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-125b7857-116b-4e82-bd5e-371c95b64106 req-534ef00f-325d-4423-8fd8-61a4376b5db7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:53.681070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-125b7857-116b-4e82-bd5e-371c95b64106 req-534ef00f-325d-4423-8fd8-61a4376b5db7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:53.681557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-125b7857-116b-4e82-bd5e-371c95b64106 req-534ef00f-325d-4423-8fd8-61a4376b5db7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:53.693013 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-125b7857-116b-4e82-bd5e-371c95b64106 req-534ef00f-325d-4423-8fd8-61a4376b5db7 service nova] Creating event network-changed:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h2-791135-8 Oct 04 11:58:53.698189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-125b7857-116b-4e82-bd5e-371c95b64106 req-534ef00f-325d-4423-8fd8-61a4376b5db7 service nova] Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 11:58:53.708930 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-125b7857-116b-4e82-bd5e-371c95b64106 req-534ef00f-325d-4423-8fd8-61a4376b5db7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042945 Oct 04 11:58:53.709671 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2049/6723] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:58:54.427044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:54.427668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:54.435238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:54.435726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:54.436199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:54.436899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:54.437378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:54.437817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:54.570621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:54.578443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9c12cefa-20b4-4c9b-b01d-1b0364a17210 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1675 microversion: 2.1 time: 0.155358 Oct 04 11:58:54.579030 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4675/6724] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:54 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:55.607970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:55.608722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:55.615352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:55.616165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:55.617666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:55.618975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:55.619863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:55.620569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:55.758039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:55.766110 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04632932-5515-43ad-9878-710f748cebe5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1668 microversion: 2.1 time: 0.168150 Oct 04 11:58:55.766683 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2050/6725] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:55 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:55.788064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:55.789246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:55.796064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:55.796551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:55.796986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:55.797703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:55.798161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:55.798587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:55.929426 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:55.937282 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ba33a2b1-c0e5-4c8c-ae7c-58982afae240 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1668 microversion: 2.1 time: 0.153045 Oct 04 11:58:55.937897 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4676/6726] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:55 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:55.959655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:55.960220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:55.967093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:55.967623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:55.968138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:55.968896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:55.969388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:55.969837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:56.097160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:56.104995 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f2e52b86-c741-4d1f-b80e-c0ad05421915 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1668 microversion: 2.1 time: 0.149237 Oct 04 11:58:56.105606 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2051/6727] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:55 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:56.127214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:56.127716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:56.134339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:56.134821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:56.135264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:56.135953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:56.136660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:56.137086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:56.161844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 11:58:56.206772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:56.237296 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af3756f9-206a-437c-ab30-76e4c8216076 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 204 len: 0 microversion: 2.1 time: 0.113323 Oct 04 11:58:56.237943 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4677/6728] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 11:58:56 2022] DELETE /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 11:58:56.246800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:56.247452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:56.253469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:56.253967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:56.254414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:56.255113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:56.255575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:56.256012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:56.387362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:56.395169 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6e3c4dad-8974-4fbb-bcb9-81003d7ab09b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1674 microversion: 2.1 time: 0.152326 Oct 04 11:58:56.395738 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2052/6729] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:56 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:57.419083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:57.419781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:57.426530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:57.427013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:57.427470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:57.428195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:57.428645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:57.429068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:57.562237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:57.570559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cf30d4a7-a3e7-4573-a21d-28b3be642c0c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1674 microversion: 2.1 time: 0.155197 Oct 04 11:58:57.571137 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4678/6730] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:57 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:58.594644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:58.595466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:58.599636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:58.604439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:58.604944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:58.605491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:58.606212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:58.606678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:58.607143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:58.672823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:58:58.681214 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bce5976-16a5-4454-b8d8-3ea89d078e12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 200 len: 1608 microversion: 2.1 time: 0.090421 Oct 04 11:58:58.682097 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2053/6731] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:58 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 1608 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:58:58.732617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-add10120-f853-48cf-816c-e0c5eedca0c0 req-5481d46f-cdbc-4ce4-bf3f-5d67915c343f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e1535-97d6-48ad-a01c-08ab1d3e9191", "name": "network-vif-deleted", "tag": "e037657a-4587-497e-9dc5-7d99bbec1d08"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:58.744549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-add10120-f853-48cf-816c-e0c5eedca0c0 req-5481d46f-cdbc-4ce4-bf3f-5d67915c343f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:58.745027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-add10120-f853-48cf-816c-e0c5eedca0c0 req-5481d46f-cdbc-4ce4-bf3f-5d67915c343f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:58.745486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-add10120-f853-48cf-816c-e0c5eedca0c0 req-5481d46f-cdbc-4ce4-bf3f-5d67915c343f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:58.763069 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-add10120-f853-48cf-816c-e0c5eedca0c0 req-5481d46f-cdbc-4ce4-bf3f-5d67915c343f service nova] Creating event network-vif-deleted:e037657a-4587-497e-9dc5-7d99bbec1d08 for instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 on n-h2-791135-8 Oct 04 11:58:58.770176 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-add10120-f853-48cf-816c-e0c5eedca0c0 req-5481d46f-cdbc-4ce4-bf3f-5d67915c343f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041578 Oct 04 11:58:58.770787 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4679/6732] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:58:59.704165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:59.704760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:59.707413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:59.712710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:59.713199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:59.713678 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:59.714376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:59.714838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:59.715268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:59.731254 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 HTTP/1.1 Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '942e1535-97d6-48ad-a01c-08ab1d3e9191'} Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:58:59.732852 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-014d79fd-de7f-4381-ba15-dc01302761b1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 404 len: 111 microversion: 2.1 time: 0.034111 Oct 04 11:58:59.737146 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2054/6733] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:59 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:58:59.748697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:58:59.749429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:58:59.752196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:58:59.757777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:59.758263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:59.758701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:59.759401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:58:59.759857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:58:59.760285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:58:59.774611 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 HTTP/1.1 Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '942e1535-97d6-48ad-a01c-08ab1d3e9191'} Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:58:59.776242 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09d92e78-c14b-4dd1-905e-09de4f582d29 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 404 len: 111 microversion: 2.1 time: 0.033177 Oct 04 11:58:59.780705 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4680/6734] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:58:59 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 11:58:59.826776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1426252317", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "595ce718-19ef-45fd-bf46-f216de20fae5"}], "security_groups": [{"name": "tempest-securitygroup--35547156"}], "key_name": "tempest-keypair-2054538442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:58:59.929317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] validate_networks() for [('595ce718-19ef-45fd-bf46-f216de20fae5', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 11:59:00.383492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 11:59:00.383930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 11:59:00.384418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 11:59:00.384862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 11:59:00.385286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 11:59:00.397061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:00.397718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:00.398736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:00.399542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:00.400143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:00.400612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:00.417744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for project 733639ce17264784894a065d5406670e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 11:59:00.422855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for user e21298423c97470ebaca987598a8ce8d and project 733639ce17264784894a065d5406670e. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 11:59:00.435101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 11:59:00.437425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 11:59:00.483971 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cb25ffc2-66dd-4f4a-9a21-2582ba37e40c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.660981 Oct 04 11:59:00.484655 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2055/6735] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 11:58:59 2022] POST /compute/v2.1/servers => generated 404 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 11:59:00.496139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-88b66634-8bba-45b2-9e47-cde6a9c827b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:00.496752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-88b66634-8bba-45b2-9e47-cde6a9c827b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:00.552664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-88b66634-8bba-45b2-9e47-cde6a9c827b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:00.562864 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-88b66634-8bba-45b2-9e47-cde6a9c827b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1239 microversion: 2.1 time: 0.070529 Oct 04 11:59:00.563448 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4681/6736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:00 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:01.585749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:01.587132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:01.595058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:01.595561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:01.596041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:01.596762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:01.597233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:01.597702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:01.661978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:01.670277 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aa6a6554-f662-4db9-bfcd-18c4d8d891ca tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1309 microversion: 2.1 time: 0.088489 Oct 04 11:59:01.670857 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2056/6737] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:01 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:02.694266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:02.694890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:02.703012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:02.703430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:02.703867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:02.704574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:02.705030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:02.705489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:02.909003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:02.917975 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9bd03ad7-c255-4bd3-a0c7-9387904bdc06 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1363 microversion: 2.1 time: 0.227776 Oct 04 11:59:02.918559 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4682/6738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:02 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:03.003803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f36a7827-1934-4420-bfbd-7e36a54d67b0 req-3b42575a-8964-4184-8566-eedcdf40d9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8180a4ca-3c37-4fd0-b0e0-1939a656143c", "tag": "2a0f604d-dd28-4353-ac17-98306ce8f836"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:59:03.014788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f36a7827-1934-4420-bfbd-7e36a54d67b0 req-3b42575a-8964-4184-8566-eedcdf40d9da service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:03.015321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f36a7827-1934-4420-bfbd-7e36a54d67b0 req-3b42575a-8964-4184-8566-eedcdf40d9da service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:03.015839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f36a7827-1934-4420-bfbd-7e36a54d67b0 req-3b42575a-8964-4184-8566-eedcdf40d9da service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:03.031261 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f36a7827-1934-4420-bfbd-7e36a54d67b0 req-3b42575a-8964-4184-8566-eedcdf40d9da service nova] Creating event network-changed:2a0f604d-dd28-4353-ac17-98306ce8f836 for instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c on n-h2-791135-8 Oct 04 11:59:03.035714 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f36a7827-1934-4420-bfbd-7e36a54d67b0 req-3b42575a-8964-4184-8566-eedcdf40d9da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035590 Oct 04 11:59:03.036325 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2057/6739] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:59:03.941280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:03.941937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:03.949273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:03.949796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:03.950261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:03.950955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:03.951419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:03.951851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:04.080460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:04.088094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1ab0760-9775-496e-960d-8613a2b24f66 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1363 microversion: 2.1 time: 0.150729 Oct 04 11:59:04.088661 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4683/6740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:03 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:05.113118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:05.113860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:05.120548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:05.121046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:05.121521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:05.122260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:05.122730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:05.123172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:05.251421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:05.259669 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef5740f8-596f-4269-93e7-95ebb2395fbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1363 microversion: 2.1 time: 0.151683 Oct 04 11:59:05.260241 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2058/6741] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:05 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:06.330889 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:06.331538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:06.338298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:06.338729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:06.339166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:06.339863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:06.340325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:06.340753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:06.471554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:06.479313 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f923a8c2-5227-4b01-8395-b399c1b9d307 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1363 microversion: 2.1 time: 0.200121 Oct 04 11:59:06.479881 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4684/6742] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:06 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:07.502445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:07.503100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:07.509848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:07.510335 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:07.510775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:07.511761 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:07.512219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:07.512648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:07.643294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:07.651341 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0213f1c-da51-45d8-b5f9-2995271961a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1363 microversion: 2.1 time: 0.152835 Oct 04 11:59:07.651913 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2059/6743] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:07 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:08.674922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:08.675590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:08.683045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:08.683525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:08.683962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:08.684656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:08.685108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:08.685566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:08.735965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-5f27b7f4-4fec-482d-b3f0-482000c77f3b req-796dc1b0-cc7c-47e5-8452-7959127b89e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8180a4ca-3c37-4fd0-b0e0-1939a656143c", "name": "network-vif-plugged", "status": "completed", "tag": "2a0f604d-dd28-4353-ac17-98306ce8f836"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:59:08.748178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5f27b7f4-4fec-482d-b3f0-482000c77f3b req-796dc1b0-cc7c-47e5-8452-7959127b89e6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:08.748741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5f27b7f4-4fec-482d-b3f0-482000c77f3b req-796dc1b0-cc7c-47e5-8452-7959127b89e6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:08.749242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-5f27b7f4-4fec-482d-b3f0-482000c77f3b req-796dc1b0-cc7c-47e5-8452-7959127b89e6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:08.764952 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-5f27b7f4-4fec-482d-b3f0-482000c77f3b req-796dc1b0-cc7c-47e5-8452-7959127b89e6 service nova] Creating event network-vif-plugged:2a0f604d-dd28-4353-ac17-98306ce8f836 for instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c on n-h2-791135-8 Oct 04 11:59:08.770348 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-5f27b7f4-4fec-482d-b3f0-482000c77f3b req-796dc1b0-cc7c-47e5-8452-7959127b89e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038265 Oct 04 11:59:08.771131 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2060/6744] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:59:08.818714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:08.827258 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-833aa5a5-5ca3-4bc1-a8b6-c57c2941b551 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1363 microversion: 2.1 time: 0.156051 Oct 04 11:59:08.837185 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4685/6745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:08 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:09.852250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:09.852889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:09.859952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:09.860443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:09.860880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:09.861994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:09.862107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:09.862502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:09.991366 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:09.998920 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e71c28bb-b42d-40c7-aa6b-fa9c9f3bd470 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1363 microversion: 2.1 time: 0.151607 Oct 04 11:59:09.999487 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2061/6746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:09 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:11.023215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:11.023906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:11.026232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:59:11.031550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:11.032032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:11.032464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:11.033151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:11.033630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:11.034061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:11.160593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 11:59:11.168945 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-07816fca-0392-4e20-b48b-1398637da8cd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1551 microversion: 2.1 time: 0.149791 Oct 04 11:59:11.169635 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4686/6747] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 11:59:11 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:59:11.193668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:59:11.194187 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 11:59:11.196359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:59:11.197038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:59:11.203926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:11.204422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:11.204869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:11.205601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:11.206070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:11.206508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:11.282696 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04b05f3a-a1c7-4559-9b22-39f6bdcbfbb0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093093 Oct 04 11:59:11.283301 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2062/6748] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 11:59:11 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:59:12.288929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7c23a08e-1c69-4410-8290-16043330668c req-7a00e6e9-0724-4843-84ce-44ccf68dfce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8180a4ca-3c37-4fd0-b0e0-1939a656143c", "tag": "2a0f604d-dd28-4353-ac17-98306ce8f836"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:59:12.300569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c23a08e-1c69-4410-8290-16043330668c req-7a00e6e9-0724-4843-84ce-44ccf68dfce3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:59:12.301198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c23a08e-1c69-4410-8290-16043330668c req-7a00e6e9-0724-4843-84ce-44ccf68dfce3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:59:12.301718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7c23a08e-1c69-4410-8290-16043330668c req-7a00e6e9-0724-4843-84ce-44ccf68dfce3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:59:12.315741 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7c23a08e-1c69-4410-8290-16043330668c req-7a00e6e9-0724-4843-84ce-44ccf68dfce3 service nova] Creating event network-changed:2a0f604d-dd28-4353-ac17-98306ce8f836 for instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c on n-h2-791135-8 Oct 04 11:59:12.322072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7c23a08e-1c69-4410-8290-16043330668c req-7a00e6e9-0724-4843-84ce-44ccf68dfce3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085810 Oct 04 11:59:12.322689 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4687/6749] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 11:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:00:25.866547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:25.868033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=70 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:25.869390 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:00:25.869528 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c (ip 10.222.0.23) !!! Oct 04 12:00:25.874745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:25.875356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:25.884875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:25.885309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:25.885783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:25.886491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:25.887217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:25.887651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:26.027762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:26.035460 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8b768e71-352c-42d9-b698-ef780ec4f91f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1670 microversion: 2.1 time: 0.171332 Oct 04 12:00:26.036032 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2063/6750] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:25 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:26.056442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=17 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:26.057198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:26.058474 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:00:26.058608 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/os-volume_attachments (ip 10.222.0.23) !!! Oct 04 12:00:26.065044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d37b376-f324-451e-b666-272349bcc391"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:00:26.067559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:26.082732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:26.083220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:26.083687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:26.084377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:26.084830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:26.085252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:26.337371 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e521294c-b5dd-410a-9481-f7519d088ca5 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283384 Oct 04 12:00:26.337919 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4688/6751] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 12:00:26 2022] POST /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:00:37.055958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:00:37.058315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:37.060332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:37.061042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:37.068616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:37.069118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:37.069603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:37.070316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:37.071389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:37.071830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:37.102523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:37.108129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Old instance type m1.heat2, new instance type m1.heat {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 12:00:37.115054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:00:37.115486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:00:37.115971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:00:37.116394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:00:37.116815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:00:37.178596 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9be8acd8-b649-4681-94cb-3a610adab050 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/action" status: 202 len: 0 microversion: 2.1 time: 0.127408 Oct 04 12:00:37.179228 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2064/6752] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:00:37 2022] POST /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:00:37.188839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:37.189742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:37.192937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:37.193838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:37.205666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:37.206293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:37.206805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:37.207942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:37.208492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:37.208924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:37.365247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:37.374357 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2ae51932-fe69-4fe8-b341-0a4dd2bd8591 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1725 microversion: 2.1 time: 0.189976 Oct 04 12:00:37.374952 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4689/6753] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:37 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:38.399324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:38.399982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:38.406028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:38.406520 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:38.406966 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:38.407663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:38.408129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:38.408566 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:38.543418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:38.551606 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd9d193b-11d4-49c2-b8a7-ca07f00f6f45 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1725 microversion: 2.1 time: 0.157515 Oct 04 12:00:38.552185 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2065/6754] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:38 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:39.575767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:39.576418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:39.583401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:39.583887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:39.584324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:39.585017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:39.585514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:39.585946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:39.715164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:39.723507 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e85590a1-56f4-4803-ab31-8ab10d359101 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1725 microversion: 2.1 time: 0.151730 Oct 04 12:00:39.724085 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4690/6755] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:39 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:40.746915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:40.748323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:40.755905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:40.756476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:40.756986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:40.757988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:40.758521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:40.759025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:40.893701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:40.902462 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef85dc18-20e2-48d5-8737-da25d7eb766b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1725 microversion: 2.1 time: 0.159494 Oct 04 12:00:40.903043 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2066/6756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:40 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:41.926072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:41.926714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:41.936440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:41.936926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:41.937390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:41.938080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:41.938533 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:41.938958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:42.070102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:42.078247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe1cee9c-69ee-4f28-8575-3ab4af3fac36 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.156104 Oct 04 12:00:42.078820 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4691/6757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:41 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:43.101101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:43.102368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:43.109066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:43.109592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:43.110043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:43.110772 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:43.111234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:43.111669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:43.241196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:43.249301 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e0659af0-834c-4757-a528-5c1134f3a0e1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.152164 Oct 04 12:00:43.249897 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2067/6758] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:43 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:44.272591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:44.273206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:44.280054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:44.280540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:44.280981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:44.281702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:44.282161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:44.282587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:44.408180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:44.417011 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70ae9783-2bfe-49f1-b1f8-56cd60c1f7ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.148344 Oct 04 12:00:44.417615 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4692/6759] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:44 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:45.441111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:45.441766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:45.448469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:45.448959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:45.449435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:45.450133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:45.450597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:45.451032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:45.579267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:45.588017 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40fca3e6-c35e-4f25-acea-38c39be65045 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.150812 Oct 04 12:00:45.588590 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2068/6760] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:45 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:46.611089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:46.611704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:46.620069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:46.620556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:46.621000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:46.621731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:46.622193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:46.622621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:46.764275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:46.772554 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e627146-563c-4485-9c5b-ae1a143099b8 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.165389 Oct 04 12:00:46.773143 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4693/6761] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:46 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:47.796244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:47.796791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:47.803949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:47.804468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:47.804916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:47.805653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:47.806120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:47.806553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:47.934812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:47.943163 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ad1a6ff-b5ec-48b6-b707-89886ae4b0d7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.150825 Oct 04 12:00:47.943739 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2069/6762] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:47 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:48.966853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:48.967463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:48.974303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:48.974786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:48.975221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:48.975911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:48.976359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:48.976784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:49.104478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:49.112736 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09972dd5-e9be-4fe4-8da4-16c9a26f3c8b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.149911 Oct 04 12:00:49.113301 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4694/6763] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:48 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:50.136500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:50.137462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:50.144233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:50.144721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:50.145160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:50.145885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:50.146348 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:50.146778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:50.280386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:50.288546 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-856bd7c9-4ebd-43d3-879b-2660ff501393 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.156425 Oct 04 12:00:50.289127 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2070/6764] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:50 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:51.311674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:51.312345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:51.319124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:51.319613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:51.320053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:51.321329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:51.321814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:51.322244 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:51.447720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:51.456013 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d98c5eaf-ac98-4692-af14-04395fe3d8f6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.148334 Oct 04 12:00:51.456583 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4695/6765] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:51 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:52.478693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:52.479309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:52.486035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:52.486521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:52.486960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:52.487648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:52.488106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:52.488537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:52.616737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:52.624897 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a40b8b9-a7d2-45e1-ba17-9be4e06afd5a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.150108 Oct 04 12:00:52.625507 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2071/6766] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:52 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:53.648646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:53.649268 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:53.656052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:53.656534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:53.656969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:53.657695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:53.658147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:53.658573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:53.789969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:53.798078 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b5fccef2-446e-44a3-b583-2d8ca0f42087 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.153848 Oct 04 12:00:53.798644 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4696/6767] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:53 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:54.821461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:54.822042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:54.828944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:54.829477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:54.829933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:54.830641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:54.831116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:54.831557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:54.962925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:54.971668 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dd4dc7fd-6761-429f-a265-a120916fc55b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.153964 Oct 04 12:00:54.975870 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2072/6768] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:54 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:55.996348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:55.996955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:56.003878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:56.004369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:56.004814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:56.005548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:56.006019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:56.006455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:56.134666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:56.143105 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1fc1515f-113b-4252-a3a5-eed04699a420 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.151263 Oct 04 12:00:56.143686 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4697/6769] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:55 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:57.165500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:57.166132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:57.172935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:57.173462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:57.173914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:57.174620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:57.175086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:57.175526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:57.302805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:57.311468 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66a25c72-c50b-4fe0-998f-915176d49f72 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.150045 Oct 04 12:00:57.312048 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2073/6770] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:57 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:58.335253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:58.336466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:58.343278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:58.343789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:58.344233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:58.344926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:58.345423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:58.345962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:58.477116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:58.485329 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b853f86c-6c90-4d57-9dbd-c6d6c9e6e348 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.154014 Oct 04 12:00:58.485925 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4698/6771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:58 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:00:59.508108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:59.508895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:00:59.515998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:59.516498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:59.516943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:59.517675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:59.518144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:59.518662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:59.649997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:00:59.658044 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a03e951f-df2e-4638-958d-932d918b88da tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.153870 Oct 04 12:00:59.658619 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2074/6772] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:00:59 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:00.682255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:00.682862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:00.689784 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:00.690260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:00.690689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:00.691377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:00.691831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:00.692254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:00.827466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:00.835764 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6f7d38c9-ff22-4d33-b02b-d51a3dc288b0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.157973 Oct 04 12:01:00.836367 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4699/6773] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:00 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:01.859405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:01.859968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:01.866206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:01.866701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:01.867150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:01.867845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:01.868310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:01.868744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:01.999938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:02.008085 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d689456-009a-44a6-897c-7a58282c6c38 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.152657 Oct 04 12:01:02.008655 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2075/6774] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:01 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:03.032292 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:03.032904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:03.040229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:03.040701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:03.041130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:03.041842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:03.042293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:03.042712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:03.173570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:03.182806 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3854cc48-a87b-40c2-8eaa-86c22df86848 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.154673 Oct 04 12:01:03.183406 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4700/6775] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:03 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:04.206415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:04.207038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:04.214399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:04.214891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:04.215337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:04.216041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:04.216503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:04.216936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:04.352800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:04.361154 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdaa81de-b66d-4b17-b51e-381dbadc9e39 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1730 microversion: 2.1 time: 0.158687 Oct 04 12:01:04.361767 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2076/6776] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:04 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:05.384251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:05.384879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:05.392223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:05.392706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:05.393151 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:05.393887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:05.394353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:05.394786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:05.608251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:05.616483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e1c768cf-d6b7-4962-8656-023a27761428 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1729 microversion: 2.1 time: 0.236180 Oct 04 12:01:05.617062 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4701/6777] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:05 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:05.683956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-db3f5728-4353-4cb5-9ff7-cf6103616919 req-374476ad-e960-46ac-879b-66970a3044be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8180a4ca-3c37-4fd0-b0e0-1939a656143c", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0f604d-dd28-4353-ac17-98306ce8f836"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:01:05.694385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db3f5728-4353-4cb5-9ff7-cf6103616919 req-374476ad-e960-46ac-879b-66970a3044be service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:05.694881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db3f5728-4353-4cb5-9ff7-cf6103616919 req-374476ad-e960-46ac-879b-66970a3044be service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:05.696582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-db3f5728-4353-4cb5-9ff7-cf6103616919 req-374476ad-e960-46ac-879b-66970a3044be service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:05.708319 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-db3f5728-4353-4cb5-9ff7-cf6103616919 req-374476ad-e960-46ac-879b-66970a3044be service nova] Creating event network-vif-unplugged:2a0f604d-dd28-4353-ac17-98306ce8f836 for instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c on n-h1-791135-8 Oct 04 12:01:05.714127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-db3f5728-4353-4cb5-9ff7-cf6103616919 req-374476ad-e960-46ac-879b-66970a3044be service nova] Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 12:01:05.724918 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-db3f5728-4353-4cb5-9ff7-cf6103616919 req-374476ad-e960-46ac-879b-66970a3044be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044686 Oct 04 12:01:05.725571 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2077/6778] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:01:06.641869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:06.642488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:06.651914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:06.652412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:06.652849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:06.653585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:06.654040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:06.654473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:06.787108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:06.796514 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64cce312-36de-4782-9469-c2ca27bc82b3 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1729 microversion: 2.1 time: 0.159067 Oct 04 12:01:06.797258 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4702/6779] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:06 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:07.765917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-490bfa33-fea0-477c-861c-3a511e32f417 req-598f9fa7-42fc-4ea8-a27c-a9d47471faca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8180a4ca-3c37-4fd0-b0e0-1939a656143c", "tag": "2a0f604d-dd28-4353-ac17-98306ce8f836"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:01:07.770825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=33 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:07.776834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-490bfa33-fea0-477c-861c-3a511e32f417 req-598f9fa7-42fc-4ea8-a27c-a9d47471faca service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:07.777332 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-490bfa33-fea0-477c-861c-3a511e32f417 req-598f9fa7-42fc-4ea8-a27c-a9d47471faca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:07.777792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-490bfa33-fea0-477c-861c-3a511e32f417 req-598f9fa7-42fc-4ea8-a27c-a9d47471faca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:07.781622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:07.790044 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-490bfa33-fea0-477c-861c-3a511e32f417 req-598f9fa7-42fc-4ea8-a27c-a9d47471faca service nova] Creating event network-changed:2a0f604d-dd28-4353-ac17-98306ce8f836 for instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c on n-h1-791135-8 Oct 04 12:01:07.796385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-490bfa33-fea0-477c-861c-3a511e32f417 req-598f9fa7-42fc-4ea8-a27c-a9d47471faca service nova] Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-791135-8', 'n-h2-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 12:01:07.808023 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-490bfa33-fea0-477c-861c-3a511e32f417 req-598f9fa7-42fc-4ea8-a27c-a9d47471faca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047256 Oct 04 12:01:07.808621 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2078/6780] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:01:07.819762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:07.820904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:07.824905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=29 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:07.828694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:07.829194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:07.829666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:07.830381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:07.830848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:07.831283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:07.834549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=85 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:08.450813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:08.459491 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18dbe9d6-1e1e-460e-b52b-4f64a334a5c0 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.643529 Oct 04 12:01:08.461437 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4703/6781] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:07 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:09.485790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:09.486492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:09.493104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:09.493612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:09.494056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:09.494771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:09.495231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:09.495661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:09.634324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:09.643654 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-416959a8-0bc7-4074-b5c2-6b490580676e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.163140 Oct 04 12:01:09.644247 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2079/6782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:09 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:10.667623 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:10.668233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:10.674774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:10.675267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:10.675704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:10.676403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:10.676857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:10.677287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:10.811075 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:10.820237 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-42835ba2-581a-4b95-8b3f-67da45c48af6 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.156126 Oct 04 12:01:10.820896 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4704/6783] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:10 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:11.843212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:11.843760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:11.850824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:11.851322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:11.851768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:11.852476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:11.852943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:11.853437 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:11.980433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:11.988634 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2dfdee3b-4e2a-429f-a237-098e081b18d1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.149324 Oct 04 12:01:11.989207 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2080/6784] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:11 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:13.011595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:13.012472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:13.019286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:13.019771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:13.020237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:13.020933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:13.021413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:13.021847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:13.152006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:13.160260 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b8307ec7-983e-4125-a1cb-91a4fdd36c3f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.152598 Oct 04 12:01:13.160839 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4705/6785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:13 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:14.184796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:14.185440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:14.192261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:14.192752 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:14.193194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:14.193921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:14.194562 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:14.195006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:14.324640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:14.332770 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-08fc4769-52cd-4717-a322-82f29affffbd tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.151856 Oct 04 12:01:14.333340 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2081/6786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:14 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:15.355786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:15.356399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:15.363163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:15.363583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:15.364015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:15.364726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:15.365180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:15.365625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:15.498436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:15.506636 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96f60100-436b-483c-91a3-428d13989aaa tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.154814 Oct 04 12:01:15.507821 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4706/6787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:15 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:16.530553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:16.531176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:16.538007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:16.538503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:16.538945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:16.539643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:16.540133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:16.540571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:16.668922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:16.677049 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e6c31670-e16e-4ef5-862c-0764e878bac1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.150361 Oct 04 12:01:16.677650 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2082/6788] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:16 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:17.700027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:17.700649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:17.707428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:17.707910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:17.708344 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:17.709028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:17.709512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:17.709937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:17.837214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:17.845671 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f93312d0-006c-41fc-aaef-6a921de455eb tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1727 microversion: 2.1 time: 0.149540 Oct 04 12:01:17.846240 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4707/6789] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:17 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:18.868768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:18.869330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:18.875981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:18.876469 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:18.876909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:18.877698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:18.878156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:18.878583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:19.010196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:19.018802 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b7828d53-ba68-43b3-98a4-5ef5ec16ba4f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1724 microversion: 2.1 time: 0.153955 Oct 04 12:01:19.019379 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2083/6790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:18 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:19.042774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:01:19.043339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:19.050095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:19.050574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:19.051006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:19.051687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:19.052144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:19.052567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:19.089570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:19.090046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:19.090478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:19.091192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:19.091643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:19.092067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:19.114177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for project 733639ce17264784894a065d5406670e. Resources: {'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:01:19.120007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Getting quotas for user e21298423c97470ebaca987598a8ce8d and project 733639ce17264784894a065d5406670e. Resources: {'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:01:19.219457 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46f07050-b850-4e7b-b855-ed51e355ad37 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "POST /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/action" status: 202 len: 0 microversion: 2.1 time: 0.180241 Oct 04 12:01:19.220422 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4708/6791] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:01:19 2022] POST /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:01:19.229558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:19.230432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:19.236498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:19.236997 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:19.237582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:19.238373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:19.238835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:19.239350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:19.376093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:19.384372 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65aa84f7-361f-4a5c-80ef-5d0518a4c0b4 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.159581 Oct 04 12:01:19.384954 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2084/6792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:19 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:20.409431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:20.410144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:20.417256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:20.417772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:20.418211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:20.418899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:20.419357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:20.419787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:20.552570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:20.561642 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-beca10d4-2271-4b18-8413-52b80b1e8fdc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.157451 Oct 04 12:01:20.562222 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4709/6793] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:20 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:21.584914 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:21.585581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:21.592457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:21.592945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:21.593406 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:21.594124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:21.594584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:21.595017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:21.724617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:21.733739 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-79821081-e76e-407e-89f9-239422b06a3d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.152501 Oct 04 12:01:21.734505 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2085/6794] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:21 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:22.758204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:22.758816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:22.766140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:22.766618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:22.767050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:22.767876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:22.768331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:22.768754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:22.902899 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:22.911269 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f54b3a6-08fc-4e2a-bbb6-6db167b530d9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.157009 Oct 04 12:01:22.912146 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4710/6795] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:22 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:23.935438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:23.936059 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:23.942755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:23.943231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:23.943676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:23.944375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:23.944837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:23.945298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:24.079251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:24.087508 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6d46c981-7bfc-4315-af75-a2638b358dee tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.155972 Oct 04 12:01:24.088091 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2086/6796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:23 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:24.591034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-156dff4b-223d-4a73-b4af-8ba06cd176d8 req-616808e4-139d-4d05-b98b-c4999bb0b3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8180a4ca-3c37-4fd0-b0e0-1939a656143c", "tag": "2a0f604d-dd28-4353-ac17-98306ce8f836"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:01:24.602196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-156dff4b-223d-4a73-b4af-8ba06cd176d8 req-616808e4-139d-4d05-b98b-c4999bb0b3ce service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:24.602683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-156dff4b-223d-4a73-b4af-8ba06cd176d8 req-616808e4-139d-4d05-b98b-c4999bb0b3ce service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:24.603118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-156dff4b-223d-4a73-b4af-8ba06cd176d8 req-616808e4-139d-4d05-b98b-c4999bb0b3ce service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:24.618833 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-156dff4b-223d-4a73-b4af-8ba06cd176d8 req-616808e4-139d-4d05-b98b-c4999bb0b3ce service nova] Creating event network-changed:2a0f604d-dd28-4353-ac17-98306ce8f836 for instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c on n-h2-791135-8 Oct 04 12:01:24.624329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [req-156dff4b-223d-4a73-b4af-8ba06cd176d8 req-616808e4-139d-4d05-b98b-c4999bb0b3ce service nova] Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 12:01:24.636239 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-156dff4b-223d-4a73-b4af-8ba06cd176d8 req-616808e4-139d-4d05-b98b-c4999bb0b3ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048865 Oct 04 12:01:24.637272 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4711/6797] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:01:25.111246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:25.111919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:25.119230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:25.119733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:25.120186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:25.120904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:25.121393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:25.121842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:25.255821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:25.264870 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ecf9729-790e-477d-8592-336fd15f15c9 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.157672 Oct 04 12:01:25.265798 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2087/6798] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:25 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:26.288825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:26.289650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:26.296947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:26.297555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:26.298129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:26.298908 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:26.299434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:26.299936 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:26.454199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:26.462477 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e0cee34-69b6-47c7-a9cd-b64c172c580e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.177963 Oct 04 12:01:26.463050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4712/6799] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:26 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:27.485677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:27.486296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:27.493614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:27.494101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:27.494540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:27.495234 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:27.495694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:27.496120 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:27.628632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:27.637765 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-504d73f4-567e-4110-9cf4-97c6d3786b12 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.155702 Oct 04 12:01:27.638336 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2088/6800] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:27 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:28.660175 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:28.660934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:28.668563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:28.669074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:28.669547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:28.670250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:28.670710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:28.671287 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:28.802535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:28.810914 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-766e6cbb-5856-4ae4-bbc9-c0508f4b8281 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.154701 Oct 04 12:01:28.811496 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4713/6801] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:28 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:29.833974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:29.834539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:29.841465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:29.841983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:29.842417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:29.843124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:29.843596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:29.844034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:29.982466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:29.990998 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8c2f93de-aee5-4bef-876f-5e12aef50197 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.160919 Oct 04 12:01:29.991631 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2089/6802] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:29 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:31.014367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:31.014981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:31.016984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:31.023793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:31.024275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:31.024710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:31.025457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:31.025916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:31.026339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:31.157558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:31.166288 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ee428100-01ae-43c7-bcce-3e7824bed892 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.156081 Oct 04 12:01:31.166863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4714/6803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:31 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:32.190359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:32.190986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:32.198042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:32.198532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:32.198975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:32.199670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:32.200137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:32.200571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:32.327670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:32.336371 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bcec46d-519e-414f-a9de-ed268f55ee34 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.149536 Oct 04 12:01:32.336945 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2090/6804] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:32 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:33.359652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:33.360171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:33.367064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:33.367556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:33.368514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:33.369213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:33.369706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:33.370141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:33.497721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:33.505975 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b57b5c7-f7ca-4d4c-8b22-df3de03ef1b2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.150361 Oct 04 12:01:33.506559 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4715/6805] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:33 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:34.529145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:34.529800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:34.536577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:34.537067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:34.537542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:34.538248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:34.538700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:34.539128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:34.671430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:34.679565 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ead49bb8-0b59-4a0b-9f8e-e40e53a18f9f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.154294 Oct 04 12:01:34.680665 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2091/6806] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:34 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:35.703374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:35.704021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:35.710434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:35.710917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:35.711850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:35.712534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:35.712987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:35.713433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:35.844671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:35.852897 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-362a8db9-03af-486e-b035-f3be8a6dc87d tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.153600 Oct 04 12:01:35.853505 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4716/6807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:35 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:36.876013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:36.876553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:36.883387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:36.883884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:36.884327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:36.885023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:36.885521 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:36.885957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:37.067663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:37.075802 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-56b74917-2e34-4094-aead-cb382bcf9029 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.203854 Oct 04 12:01:37.076379 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2092/6808] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:36 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:38.100320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:38.100951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:38.104349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:38.109907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:38.110406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:38.110851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:38.111559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:38.112019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:38.112450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:38.118130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:38.247671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:38.255842 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-140e97a3-3237-42d9-a1c5-60abdb611c6b tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1723 microversion: 2.1 time: 0.159545 Oct 04 12:01:38.256424 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4717/6809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:38 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:39.278334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:39.278965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:39.282010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=30 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:39.287256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.287749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.288199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.288901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.289389 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.289831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.421152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:39.429512 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58700197-def6-4239-be39-c04f1f89850a tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1716 microversion: 2.1 time: 0.154902 Oct 04 12:01:39.430099 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2093/6810] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:39 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:39.453008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:39.453644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:39.460490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.460972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.461434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.462183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.462643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.463088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.597503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:39.606244 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-47f14304-41f9-43c7-abd3-e3e8f32ef2ea tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1716 microversion: 2.1 time: 0.157257 Oct 04 12:01:39.606816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4718/6811] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:39 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:39.685793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:39.686409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:39.692218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.692705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.693142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.693858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.694315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.694743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.698602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=94 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:39.822182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:39.830331 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-814592af-3f89-4b6b-827a-65341880f06f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1716 microversion: 2.1 time: 0.148382 Oct 04 12:01:39.830903 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2094/6812] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:39 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:39.852193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:39.853234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:39.859294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.859776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.860211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.860900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.861371 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.861812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.887941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:01:39.964530 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1dbd1f36-09ea-4b7b-a4db-6bb07fca7a30 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 204 len: 0 microversion: 2.1 time: 0.115805 Oct 04 12:01:39.965126 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4719/6813] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:01:39 2022] DELETE /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:01:39.974010 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:39.975390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:39.982107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.982679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.983198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:39.983975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:39.984446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:39.984880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:40.117771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:40.126144 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-046c2947-6c9b-4a4e-99cf-e4b7fee3ba77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1722 microversion: 2.1 time: 0.156438 Oct 04 12:01:40.126728 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2095/6814] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:39 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:41.150594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:41.151313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:41.158473 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:41.158962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:41.159398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:41.160104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:41.160558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:41.160982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:41.297091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:41.305467 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7d8d784d-4d04-4e37-8140-400b6de88a64 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1722 microversion: 2.1 time: 0.159214 Oct 04 12:01:41.306646 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4720/6815] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:41 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:41.514074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-27ef3502-e7a4-42cb-8c85-2659dee79a15 req-28ed9e2f-b8c3-4be7-a832-577f2c22d69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8180a4ca-3c37-4fd0-b0e0-1939a656143c", "name": "network-vif-plugged", "status": "completed", "tag": "2a0f604d-dd28-4353-ac17-98306ce8f836"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:01:41.525157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-27ef3502-e7a4-42cb-8c85-2659dee79a15 req-28ed9e2f-b8c3-4be7-a832-577f2c22d69a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:41.526076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-27ef3502-e7a4-42cb-8c85-2659dee79a15 req-28ed9e2f-b8c3-4be7-a832-577f2c22d69a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:41.526760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-27ef3502-e7a4-42cb-8c85-2659dee79a15 req-28ed9e2f-b8c3-4be7-a832-577f2c22d69a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:41.541283 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-27ef3502-e7a4-42cb-8c85-2659dee79a15 req-28ed9e2f-b8c3-4be7-a832-577f2c22d69a service nova] Creating event network-vif-plugged:2a0f604d-dd28-4353-ac17-98306ce8f836 for instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c on n-h2-791135-8 Oct 04 12:01:41.546485 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-27ef3502-e7a4-42cb-8c85-2659dee79a15 req-28ed9e2f-b8c3-4be7-a832-577f2c22d69a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037230 Oct 04 12:01:41.547612 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2096/6816] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:01:42.329511 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:42.330051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:42.336844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:42.337333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:42.337800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:42.338501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:42.338957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:42.339400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:42.434942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:42.443650 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d0d95818-b6f3-42a5-b886-04d59cb5f484 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1656 microversion: 2.1 time: 0.118092 Oct 04 12:01:42.444249 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4721/6817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:42 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1656 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:42.707986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a396c27d-e962-4002-8841-27ba405c72d9 req-6b4e1a22-683d-47ea-9bd1-e45ad0b70a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8180a4ca-3c37-4fd0-b0e0-1939a656143c", "name": "network-vif-deleted", "tag": "2a0f604d-dd28-4353-ac17-98306ce8f836"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:01:42.719523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a396c27d-e962-4002-8841-27ba405c72d9 req-6b4e1a22-683d-47ea-9bd1-e45ad0b70a0a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:42.720063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a396c27d-e962-4002-8841-27ba405c72d9 req-6b4e1a22-683d-47ea-9bd1-e45ad0b70a0a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:42.720741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a396c27d-e962-4002-8841-27ba405c72d9 req-6b4e1a22-683d-47ea-9bd1-e45ad0b70a0a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:42.734748 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a396c27d-e962-4002-8841-27ba405c72d9 req-6b4e1a22-683d-47ea-9bd1-e45ad0b70a0a service nova] Creating event network-vif-deleted:2a0f604d-dd28-4353-ac17-98306ce8f836 for instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c on n-h2-791135-8 Oct 04 12:01:42.740065 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a396c27d-e962-4002-8841-27ba405c72d9 req-6b4e1a22-683d-47ea-9bd1-e45ad0b70a0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035961 Oct 04 12:01:42.741205 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2097/6818] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:01:43.468722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:43.469361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:43.476618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:43.477118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:43.477590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:43.478331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:43.478826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:43.479310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:43.546417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:43.555535 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7620e955-6c6b-49ba-b19a-8bd9e531e8a7 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1370 microversion: 2.1 time: 0.090997 Oct 04 12:01:43.556138 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4722/6819] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:43 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:44.581605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:44.582405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:44.589259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:44.589825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:44.590333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:44.591063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:44.591563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:44.591999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:44.657303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:44.666371 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dec7545c-a05c-4490-9b14-c50aa087ac14 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1370 microversion: 2.1 time: 0.089945 Oct 04 12:01:44.666945 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2098/6820] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:44 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:45.688057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:45.688675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:45.695796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:45.696286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:45.696725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:45.697449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:45.697910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:45.698340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:45.764077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:45.772383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7f5303b-35ba-40a6-8b52-85560620b46f tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1370 microversion: 2.1 time: 0.088212 Oct 04 12:01:45.772965 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4723/6821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:45 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:46.794431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:46.795050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:46.801735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:46.802225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:46.802665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:46.803359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:46.803821 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:46.804356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:46.868748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21298423c97470ebaca987598a8ce8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733639ce17264784894a065d5406670e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:01:46.878582 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bf8d1fe8-0e7b-4dc5-9856-72a17405c6a2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 200 len: 1370 microversion: 2.1 time: 0.087928 Oct 04 12:01:46.879646 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2099/6822] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:46 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:01:47.902556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:47.903091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:47.909826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:47.910306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:47.910736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:47.911418 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:47.911867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:47.912286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:47.925383 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c HTTP/1.1 Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8180a4ca-3c37-4fd0-b0e0-1939a656143c'} Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:47.927020 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:47.933002 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9dcbcca8-5a57-4c20-9cf1-9dfdbf7ea1f2 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 404 len: 111 microversion: 2.1 time: 0.030452 Oct 04 12:01:47.934639 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4724/6823] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:47 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:47.992089 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:47.994326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:48.000995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:48.001539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:48.001981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:48.002690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:48.003222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:48.003748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:48.017389 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/os-volume_attachments HTTP/1.1 Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'server_id': '8180a4ca-3c37-4fd0-b0e0-1939a656143c'} Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:48.019095 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:48.023410 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a7ceeba3-8282-40ff-bc2d-7c2d5c7749c1 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032461 Oct 04 12:01:48.025430 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2100/6824] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:01:47 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:51.341919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.342448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:51.349377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.349881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.350310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.350991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.351441 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.351862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.365967 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c HTTP/1.1 Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '8180a4ca-3c37-4fd0-b0e0-1939a656143c'} Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:51.367475 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7e433354-7f65-43dd-a44e-358f89823998 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 404 len: 111 microversion: 2.1 time: 0.030878 Oct 04 12:01:51.371650 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4725/6825] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:01:51 2022] DELETE /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:51.377338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.377990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 8180a4ca-3c37-4fd0-b0e0-1939a656143c] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:51.385326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.385876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.386325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.387103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.387827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.388269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.403388 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c HTTP/1.1 Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '8180a4ca-3c37-4fd0-b0e0-1939a656143c'} Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.404968 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 8180a4ca-3c37-4fd0-b0e0-1939a656143c could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0d4d7bd3-ae0b-44d2-b3e1-d2f64c3982ce tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c" status: 404 len: 111 microversion: 2.1 time: 0.033154 Oct 04 12:01:51.409867 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2101/6826] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:51 2022] GET /compute/v2.1/servers/8180a4ca-3c37-4fd0-b0e0-1939a656143c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:01:51.416529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.417039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:51.423285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.423782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.424260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.425006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.425509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.426061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.440823 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 HTTP/1.1 Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '942e1535-97d6-48ad-a01c-08ab1d3e9191'} Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:51.442481 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-50c2eaec-515d-4d6c-8d53-d5a69a3ac6bc tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 404 len: 111 microversion: 2.1 time: 0.032053 Oct 04 12:01:51.446654 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4726/6827] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:01:51 2022] DELETE /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:51.452605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.453228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 942e1535-97d6-48ad-a01c-08ab1d3e9191] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:51.459345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.459853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.460307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.461024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.462026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.462498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.476055 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 HTTP/1.1 Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '942e1535-97d6-48ad-a01c-08ab1d3e9191'} Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.478196 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 942e1535-97d6-48ad-a01c-08ab1d3e9191 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:51.482722 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-379afc27-0d8f-4a26-89ed-c476b90f1524 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191" status: 404 len: 111 microversion: 2.1 time: 0.030917 Oct 04 12:01:51.483449 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2102/6828] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:51 2022] GET /compute/v2.1/servers/942e1535-97d6-48ad-a01c-08ab1d3e9191 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:51.488569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.489076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:51.495131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.495620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.496062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.496759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.497217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.497677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.511780 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b HTTP/1.1 Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '1699f24b-cbe5-4a85-95b3-e55ec577ab0b'} Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:51.513615 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:51.518018 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e07fffd6-a965-49c5-a1fe-e5e8e8aa1c77 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 404 len: 111 microversion: 2.1 time: 0.030367 Oct 04 12:01:51.519291 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4727/6829] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:01:51 2022] DELETE /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:51.524792 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.525541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 1699f24b-cbe5-4a85-95b3-e55ec577ab0b] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:51.531553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.532036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.532477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.533169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.533651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.534082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.547581 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b HTTP/1.1 Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '1699f24b-cbe5-4a85-95b3-e55ec577ab0b'} Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.549239 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 1699f24b-cbe5-4a85-95b3-e55ec577ab0b could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cdd3a8a7-3252-44ba-ba00-7a2de606738c tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b" status: 404 len: 111 microversion: 2.1 time: 0.030479 Oct 04 12:01:51.554683 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2103/6830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:51 2022] GET /compute/v2.1/servers/1699f24b-cbe5-4a85-95b3-e55ec577ab0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:51.559839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.562223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:51.568289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.568707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.569173 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.569897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.570345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.570767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.585246 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb HTTP/1.1 Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '2467b055-6749-493c-90f9-6383396068eb'} Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:51.587442 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-76cf8782-e7e8-4703-b482-4533b9858b3e tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 404 len: 111 microversion: 2.1 time: 0.032938 Oct 04 12:01:51.594703 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4728/6831] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:01:51 2022] DELETE /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:51.600993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.601640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] [instance: 2467b055-6749-493c-90f9-6383396068eb] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:01:51.607788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.608285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.608732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.609471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:51.609945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:51.610384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:51.624043 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] HTTP exception thrown: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Request method failure captured: Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb HTTP/1.1 Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPB7d_G_KFafSSgVh03K5xpOGQA87LV2wmyUfud5kQdAw7NHT9W1zhwaikw_nvuK6F8jDO-bUt4SzScwwCzF8-LGVfg7u4J8qJMPoOljhzBiM3hQ-8EI_1-asxqKpGOoiZrB23DT1Mo-KbRbJ3Ei3rVuajnklmcovWGp3e_LfBAwbjqE Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_733639ce17264784894a065d5406670e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/733639ce17264784894a065d5406670e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/733639ce17264784894a065d5406670e"}]}] Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 733639ce17264784894a065d5406670e Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServerActionsTestJSON-1759886975 Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e21298423c97470ebaca987598a8ce8d Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServerActionsTestJSON-1759886975-project Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '2467b055-6749-493c-90f9-6383396068eb'} Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:01:51.625628 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Returning 404 to user: Instance 2467b055-6749-493c-90f9-6383396068eb could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:01:51.630031 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa1cc35b-8cb1-474a-8a91-65fc1cd95981 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb" status: 404 len: 111 microversion: 2.1 time: 0.029885 Oct 04 12:01:51.630832 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2104/6832] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:01:51 2022] GET /compute/v2.1/servers/2467b055-6749-493c-90f9-6383396068eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:01:51.636490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fafc3892-5e71-498c-a80a-78e77c52a195 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] Calling method '.version_select at 0x7f71d86fe550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:01:51.660515 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fafc3892-5e71-498c-a80a-78e77c52a195 tempest-ServerActionsTestJSON-1759886975 tempest-ServerActionsTestJSON-1759886975-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054538442" status: 202 len: 0 microversion: 2.1 time: 0.028245 Oct 04 12:01:51.661314 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4729/6833] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 4 12:01:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054538442 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:02:00.968190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1798970668", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "bb228695-55ed-4336-b7db-9b1df47b3334"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:01.029991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] validate_networks() for [('bb228695-55ed-4336-b7db-9b1df47b3334', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:02:01.415323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:02:01.415766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:02:01.416256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:02:01.416715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:02:01.417145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:02:01.426006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:01.426499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:01.426947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:01.427688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:01.428171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:01.428599 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:01.445944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Getting quotas for project 4b00377c69ca4411bf0325baab7c5d79. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:02:01.451311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Getting quotas for user 01e0413789b7497aa0e2c55f83b58e30 and project 4b00377c69ca4411bf0325baab7c5d79. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:02:01.463341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:02:01.465668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:02:01.510417 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-46720357-f293-42a8-886d-ba9c6635b4aa tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680000 Oct 04 12:02:01.511079 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2105/6834] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:02:01.523443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4c8f3f7-9883-4625-82a0-ea368748ca4e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:01.524103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4c8f3f7-9883-4625-82a0-ea368748ca4e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:01.576468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:01.592957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e4c8f3f7-9883-4625-82a0-ea368748ca4e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:01.600804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4c8f3f7-9883-4625-82a0-ea368748ca4e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1217 microversion: 2.1 time: 0.082114 Oct 04 12:02:01.601412 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4730/6835] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:01 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:02.626233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:02.627016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:02.641200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:02.641748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:02.642176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:02.642901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:02.643362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:02.643798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:02.712768 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:02.720793 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-191c974f-1c36-4dd0-95a0-8d99c44c572a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1287 microversion: 2.1 time: 0.100556 Oct 04 12:02:02.721622 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2106/6836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:02 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:03.744360 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:03.745699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:03.753192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:03.754047 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:03.754726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:03.755657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:03.756434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:03.757084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:04.000448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:04.011325 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-129f4436-da3a-4b95-8064-950b90580e9a tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1317 microversion: 2.1 time: 0.270742 Oct 04 12:02:04.012768 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4731/6837] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:03 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:04.120285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b179801a-a514-4121-940c-d4cf4c8a3dbb req-dfb4ae8e-627a-46f1-8e70-8006b58aaa38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e39de20-f041-4cc2-b85b-ec980db794dc", "tag": "4876e35c-2714-480f-94c2-12992b9b4961"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:04.138140 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b179801a-a514-4121-940c-d4cf4c8a3dbb req-dfb4ae8e-627a-46f1-8e70-8006b58aaa38 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:04.138984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b179801a-a514-4121-940c-d4cf4c8a3dbb req-dfb4ae8e-627a-46f1-8e70-8006b58aaa38 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:04.139577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b179801a-a514-4121-940c-d4cf4c8a3dbb req-dfb4ae8e-627a-46f1-8e70-8006b58aaa38 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:04.152045 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b179801a-a514-4121-940c-d4cf4c8a3dbb req-dfb4ae8e-627a-46f1-8e70-8006b58aaa38 service nova] Creating event network-changed:4876e35c-2714-480f-94c2-12992b9b4961 for instance 0e39de20-f041-4cc2-b85b-ec980db794dc on n-h1-791135-8 Oct 04 12:02:04.162545 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b179801a-a514-4121-940c-d4cf4c8a3dbb req-dfb4ae8e-627a-46f1-8e70-8006b58aaa38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045970 Oct 04 12:02:04.163170 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2107/6838] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:05.035195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:05.035846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:05.042605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:05.043088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:05.043524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:05.044221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:05.044681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:05.045107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:05.175603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:05.183443 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ef067e4f-0d69-4e40-9d03-e95d3ea6b87b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1317 microversion: 2.1 time: 0.152258 Oct 04 12:02:05.184029 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4732/6839] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:05 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:06.207585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:06.208328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:06.216398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:06.216880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:06.217317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:06.218039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:06.218499 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:06.218945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:06.347371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:06.355624 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8f462b5-204c-4789-8dcb-607ae1aa2a45 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1317 microversion: 2.1 time: 0.152427 Oct 04 12:02:06.356188 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2108/6840] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:06 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:07.377264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:07.377933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:07.381098 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:02:07.381255 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc (ip 10.222.0.23) !!! Oct 04 12:02:07.396170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:07.396666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:07.397109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:07.397955 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:07.398423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:07.399524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:07.530967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:07.539460 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-95396efc-a1c5-4428-9fde-1fca13a86304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1317 microversion: 2.1 time: 0.166062 Oct 04 12:02:07.539999 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4733/6841] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:07 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:08.562258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:08.562663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:08.569330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:08.569851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:08.570301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:08.571004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:08.571473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:08.571908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:08.702351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:08.709955 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c059940c-a18f-44f1-a8d0-d15dc43533f6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1317 microversion: 2.1 time: 0.151994 Oct 04 12:02:08.710523 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2109/6842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:08 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:09.506859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-a955ce66-a629-400f-a2c1-7d52c4a0bbe6 req-e7d6bb87-b67f-43fe-a037-3e3a698f6247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e39de20-f041-4cc2-b85b-ec980db794dc", "name": "network-vif-plugged", "status": "completed", "tag": "4876e35c-2714-480f-94c2-12992b9b4961"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:09.513831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:09.519503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a955ce66-a629-400f-a2c1-7d52c4a0bbe6 req-e7d6bb87-b67f-43fe-a037-3e3a698f6247 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:09.519978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a955ce66-a629-400f-a2c1-7d52c4a0bbe6 req-e7d6bb87-b67f-43fe-a037-3e3a698f6247 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:09.520405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-a955ce66-a629-400f-a2c1-7d52c4a0bbe6 req-e7d6bb87-b67f-43fe-a037-3e3a698f6247 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:09.533139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-a955ce66-a629-400f-a2c1-7d52c4a0bbe6 req-e7d6bb87-b67f-43fe-a037-3e3a698f6247 service nova] Creating event network-vif-plugged:4876e35c-2714-480f-94c2-12992b9b4961 for instance 0e39de20-f041-4cc2-b85b-ec980db794dc on n-h1-791135-8 Oct 04 12:02:09.538249 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-a955ce66-a629-400f-a2c1-7d52c4a0bbe6 req-e7d6bb87-b67f-43fe-a037-3e3a698f6247 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035200 Oct 04 12:02:09.538896 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4734/6843] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:09.732108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:09.732741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:09.735548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:09.740737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:09.741229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:09.741706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:09.742440 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:09.742907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:09.743347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:09.748103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=60 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:09.873106 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:09.880817 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3435e4a0-ea8a-468c-83d2-1d5b59d3d6bf tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1317 microversion: 2.1 time: 0.152679 Oct 04 12:02:09.881407 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2110/6844] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:09 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:10.905991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:10.906614 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:10.912719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:10.913206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:10.913675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:10.914375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:10.914830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:10.915260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:11.047782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:11.056149 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5c53e766-1c52-441d-bc39-fadbf74c8915 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1506 microversion: 2.1 time: 0.155861 Oct 04 12:02:11.056738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4735/6845] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:10 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:11.115780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-98778715", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "bb228695-55ed-4336-b7db-9b1df47b3334"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:11.168296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] validate_networks() for [('bb228695-55ed-4336-b7db-9b1df47b3334', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:02:11.438321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:11.458175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:11.530492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:02:11.530925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:02:11.531414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:02:11.531835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:02:11.532257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:02:11.543818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:11.544308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:11.544753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:11.545522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:11.545989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:11.546468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:11.563001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Getting quotas for project 4b00377c69ca4411bf0325baab7c5d79. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:02:11.568372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Getting quotas for user 01e0413789b7497aa0e2c55f83b58e30 and project 4b00377c69ca4411bf0325baab7c5d79. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:02:11.580427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:02:11.583048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:02:11.628211 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cd697ca-9784-4e49-a6cc-77ea42e5ce4c tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516194 Oct 04 12:02:11.634311 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2111/6846] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:02:11.640137 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-67ac93a2-aaea-4a9f-9e13-867ed324bdee tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:11.640749 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-67ac93a2-aaea-4a9f-9e13-867ed324bdee tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:11.643092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:11.697078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-67ac93a2-aaea-4a9f-9e13-867ed324bdee tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:11.704043 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-67ac93a2-aaea-4a9f-9e13-867ed324bdee tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1215 microversion: 2.1 time: 0.068105 Oct 04 12:02:11.717512 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4736/6847] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:11 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:12.728014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:12.728640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:12.734667 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:12.735163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:12.735611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:12.736316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:12.736783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:12.737223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:12.812413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:12.820996 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30860cc4-6c1a-4f23-b032-8e8d09a8f56e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1267 microversion: 2.1 time: 0.098146 Oct 04 12:02:12.821645 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2112/6848] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:12 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:13.844144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:13.844817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:13.852875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:13.853375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:13.853814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:13.854507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:13.854960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:13.855383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:14.074226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:14.082331 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d4e586c0-f7b1-4d60-a414-7c3b7562e304 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1315 microversion: 2.1 time: 0.241870 Oct 04 12:02:14.082862 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4737/6849] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:13 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:14.296984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-999614ec-354a-4d36-9781-1f87385fbf71 req-c9f4e954-d015-4cfc-9e74-bd3c8f5cf6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da59d1d8-aebf-4edf-a717-2b03ee6a9531", "tag": "66e02338-747f-4a1e-ba80-cf1aa981412d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:14.308576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-999614ec-354a-4d36-9781-1f87385fbf71 req-c9f4e954-d015-4cfc-9e74-bd3c8f5cf6a0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:14.309211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-999614ec-354a-4d36-9781-1f87385fbf71 req-c9f4e954-d015-4cfc-9e74-bd3c8f5cf6a0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:14.309778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-999614ec-354a-4d36-9781-1f87385fbf71 req-c9f4e954-d015-4cfc-9e74-bd3c8f5cf6a0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:14.321508 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-999614ec-354a-4d36-9781-1f87385fbf71 req-c9f4e954-d015-4cfc-9e74-bd3c8f5cf6a0 service nova] Creating event network-changed:66e02338-747f-4a1e-ba80-cf1aa981412d for instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 on n-h2-791135-8 Oct 04 12:02:14.326358 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-999614ec-354a-4d36-9781-1f87385fbf71 req-c9f4e954-d015-4cfc-9e74-bd3c8f5cf6a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033217 Oct 04 12:02:14.326964 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2113/6850] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:15.106084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:15.106693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:15.113455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:15.113942 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:15.114376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:15.115068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:15.115518 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:15.115946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:15.289612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:15.297102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cbcbfd7b-9537-4f38-bdd7-3cb81782ca48 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1315 microversion: 2.1 time: 0.195042 Oct 04 12:02:15.297699 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4738/6851] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:15 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:16.321964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:16.322679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:16.328774 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:16.329265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:16.329738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:16.330462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:16.330930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:16.331369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:16.463901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:16.471671 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6399a950-dfc3-4052-8069-29bef50be671 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1315 microversion: 2.1 time: 0.155313 Oct 04 12:02:16.472248 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2114/6852] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:16 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:17.494237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:17.494854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:17.501767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:17.502251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:17.502685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:17.503404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:17.503862 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:17.504290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:17.721300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:17.729800 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d84569fc-9687-447d-b4d4-4954622eaaa5 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1315 microversion: 2.1 time: 0.239442 Oct 04 12:02:17.730535 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4739/6853] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:17 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:18.752151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:18.752773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:18.759618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:18.760113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:18.760559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:18.761259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:18.761753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:18.762190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:18.887944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:18.895628 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-10866dae-d6f5-43fe-9491-48d8c4c2af97 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1315 microversion: 2.1 time: 0.147418 Oct 04 12:02:18.896202 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2115/6854] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:18 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:19.737834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b7ab3405-a7db-4ce1-ba8e-ed6df1aa06d7 req-4cda83f9-8f21-4cd3-b4d0-357a3e661503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da59d1d8-aebf-4edf-a717-2b03ee6a9531", "name": "network-vif-plugged", "status": "completed", "tag": "66e02338-747f-4a1e-ba80-cf1aa981412d"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:19.748202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b7ab3405-a7db-4ce1-ba8e-ed6df1aa06d7 req-4cda83f9-8f21-4cd3-b4d0-357a3e661503 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:19.748712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b7ab3405-a7db-4ce1-ba8e-ed6df1aa06d7 req-4cda83f9-8f21-4cd3-b4d0-357a3e661503 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:19.749133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b7ab3405-a7db-4ce1-ba8e-ed6df1aa06d7 req-4cda83f9-8f21-4cd3-b4d0-357a3e661503 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:19.760181 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b7ab3405-a7db-4ce1-ba8e-ed6df1aa06d7 req-4cda83f9-8f21-4cd3-b4d0-357a3e661503 service nova] Creating event network-vif-plugged:66e02338-747f-4a1e-ba80-cf1aa981412d for instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 on n-h2-791135-8 Oct 04 12:02:19.765412 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b7ab3405-a7db-4ce1-ba8e-ed6df1aa06d7 req-4cda83f9-8f21-4cd3-b4d0-357a3e661503 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031351 Oct 04 12:02:19.766017 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4740/6855] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:19.919113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:19.919739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:19.927027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:19.927523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:19.927967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:19.928674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:19.929138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:19.929627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:20.060361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:20.068165 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8507bc2d-b876-475a-9634-71b44e5b8ecb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1315 microversion: 2.1 time: 0.153448 Oct 04 12:02:20.068748 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2116/6856] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:19 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:21.092768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:21.093491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:21.099794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:21.100273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:21.100739 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:21.101446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:21.101901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:21.102325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:21.233988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:21.241588 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d2d7390b-d7da-4a26-9f25-8b718cefd705 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1315 microversion: 2.1 time: 0.154633 Oct 04 12:02:21.242169 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4741/6857] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:21 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:22.265673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:22.266292 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:22.269114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:22.269814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:22.275945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:22.276432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:22.276869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:22.277586 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:22.278047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:22.278479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:22.404633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:22.412295 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f1a5ea6-db4b-4a41-981c-58734ca73a09 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1505 microversion: 2.1 time: 0.150815 Oct 04 12:02:22.412860 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2117/6858] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:22 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:22.434860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:22.435448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:22.437448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:22.443394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:22.443876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:22.444311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:22.445006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:22.445501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:22.445931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:22.472573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:02:22.547784 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f73fa674-9d3f-43ee-9082-15a621b84e65 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 204 len: 0 microversion: 2.1 time: 0.116948 Oct 04 12:02:22.549031 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4742/6859] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:02:22 2022] DELETE /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:02:22.556903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:22.557698 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:22.563862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:22.564430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:22.564878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:22.565613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:22.566080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:22.566534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:22.693491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:22.701816 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62906664-15f5-4526-a572-d3d081c019eb tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1511 microversion: 2.1 time: 0.148741 Oct 04 12:02:22.702392 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2118/6860] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:22 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:23.725774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:23.726486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:23.733757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:23.734243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:23.734683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:23.735378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:23.735835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:23.736266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:23.870009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:23.877861 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-be64e332-680f-4dd4-b268-e431938679b2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1511 microversion: 2.1 time: 0.156373 Oct 04 12:02:23.878447 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4743/6861] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:23 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:24.582485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ce9e5c99-ca40-4438-b3d6-8e46909221b7 req-a6169f7f-9c52-4c3c-acf2-c5d9342641fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da59d1d8-aebf-4edf-a717-2b03ee6a9531", "name": "network-vif-deleted", "tag": "66e02338-747f-4a1e-ba80-cf1aa981412d"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:24.593819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce9e5c99-ca40-4438-b3d6-8e46909221b7 req-a6169f7f-9c52-4c3c-acf2-c5d9342641fb service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:24.594479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce9e5c99-ca40-4438-b3d6-8e46909221b7 req-a6169f7f-9c52-4c3c-acf2-c5d9342641fb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:24.594937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce9e5c99-ca40-4438-b3d6-8e46909221b7 req-a6169f7f-9c52-4c3c-acf2-c5d9342641fb service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:24.610751 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ce9e5c99-ca40-4438-b3d6-8e46909221b7 req-a6169f7f-9c52-4c3c-acf2-c5d9342641fb service nova] Creating event network-vif-deleted:66e02338-747f-4a1e-ba80-cf1aa981412d for instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 on n-h2-791135-8 Oct 04 12:02:24.616048 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ce9e5c99-ca40-4438-b3d6-8e46909221b7 req-a6169f7f-9c52-4c3c-acf2-c5d9342641fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037257 Oct 04 12:02:24.616677 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2119/6862] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:24.900551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:24.901313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:24.908194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:24.908682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:24.909150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:24.909898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:24.910362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:24.910796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:24.941665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:24.942143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:24.942580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:24.943116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lazy-loading 'fault' on Instance uuid da59d1d8-aebf-4edf-a717-2b03ee6a9531 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:02:24.985553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:24.993477 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3d940a8-68c4-4789-8094-e0bea70ff609 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 200 len: 1305 microversion: 2.1 time: 0.097331 Oct 04 12:02:24.994063 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4744/6863] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:24 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:26.017236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:26.017985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:26.024199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.024759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.025206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.025947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.026419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.026857 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.039979 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] HTTP exception thrown: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Request method failure captured: Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 HTTP/1.1 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCC4ls-w2R8ArFY7iZRK1KXP8E03r896b5N3ODrPO8L-9xV1zU1kO5QrnHx42GcLdaQbakll_ep1_0W_4rQbtcIxRyKl8F61FR33gDQfwIm_3BDoPuRIdqDotJ9rEh4vgIAQFdab-rRANbbC7toysSgh7nYXdPtmcwzXxcrjbQb0BO4 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b00377c69ca4411bf0325baab7c5d79"}]}] Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 01e0413789b7497aa0e2c55f83b58e30 Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'da59d1d8-aebf-4edf-a717-2b03ee6a9531'} Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:26.042131 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Returning 404 to user: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b736571f-2345-4156-82b9-2e271d889ff7 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 404 len: 111 microversion: 2.1 time: 0.031622 Oct 04 12:02:26.047109 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2120/6864] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:26 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:02:26.052546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:26.053154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:26.060620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.061098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.061574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.062260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.062716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.063138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.189849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:26.197546 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bf333a7a-e699-44a0-a6d1-888a72d5c943 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1506 microversion: 2.1 time: 0.148811 Oct 04 12:02:26.198131 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4745/6865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:26 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:26.219545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4abbe5e5-a403-4b41-afc2-5af49695f307 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:26.221873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4abbe5e5-a403-4b41-afc2-5af49695f307 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:26.227291 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-4abbe5e5-a403-4b41-afc2-5af49695f307 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] HTTP exception thrown: Instance 4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3 could not be found. Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4abbe5e5-a403-4b41-afc2-5af49695f307 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Request method failure captured: Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3/action HTTP/1.1 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 32 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCC4ls-w2R8ArFY7iZRK1KXP8E03r896b5N3ODrPO8L-9xV1zU1kO5QrnHx42GcLdaQbakll_ep1_0W_4rQbtcIxRyKl8F61FR33gDQfwIm_3BDoPuRIdqDotJ9rEh4vgIAQFdab-rRANbbC7toysSgh7nYXdPtmcwzXxcrjbQb0BO4 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b00377c69ca4411bf0325baab7c5d79"}]}] Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 01e0413789b7497aa0e2c55f83b58e30 Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: {"resize": {"flavorRef": "452"}} Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3 could not be found. Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3 could not be found. Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:02:26.229468 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3 could not be found. Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3 could not be found. Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4abbe5e5-a403-4b41-afc2-5af49695f307 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Returning 404 to user: Instance 4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4abbe5e5-a403-4b41-afc2-5af49695f307 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "POST /compute/v2.1/servers/4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3/action" status: 404 len: 111 microversion: 2.1 time: 0.015258 Oct 04 12:02:26.234439 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2121/6866] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:02:26 2022] POST /compute/v2.1/servers/4ff3bdcb-6d73-4c1f-96e5-519c8c83a8b3/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:02:26.239196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:26.239812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:26.245771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.246254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.246692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.247379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.247837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.248265 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.380281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:26.388236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a096943-d54d-4e7e-8182-17511cc2e65b tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1506 microversion: 2.1 time: 0.152774 Oct 04 12:02:26.388816 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4746/6867] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:26 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:26.410986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:26.411600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:26.418910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.419397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.419837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.420525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.420983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.421442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.554044 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:26.562483 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62752afe-4195-4522-80da-c0134209e5c1 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1506 microversion: 2.1 time: 0.155314 Oct 04 12:02:26.563057 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2122/6868] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:26 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:26.584809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:26.587615 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:26.593587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.594072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.594507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.595193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.595645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.596070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.707080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:26.712563 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] HTTP exception thrown: Flavor 0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3 could not be found. Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Request method failure captured: Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: request: POST /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc/action HTTP/1.1 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 65 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCC4ls-w2R8ArFY7iZRK1KXP8E03r896b5N3ODrPO8L-9xV1zU1kO5QrnHx42GcLdaQbakll_ep1_0W_4rQbtcIxRyKl8F61FR33gDQfwIm_3BDoPuRIdqDotJ9rEh4vgIAQFdab-rRANbbC7toysSgh7nYXdPtmcwzXxcrjbQb0BO4 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b00377c69ca4411bf0325baab7c5d79"}]}] Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 01e0413789b7497aa0e2c55f83b58e30 Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: {"resize": {"flavorRef": "0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3"}} Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: exception: Flavor 0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3 could not be found. Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '0e39de20-f041-4cc2-b85b-ec980db794dc', 'body': {'resize': {'flavorRef': '0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3'}}} Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:26.725896 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3 could not be found. Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3 could not be found. Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3 could not be found. Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Returning 400 to user: Flavor 0855e173-be0b-4a28-ad9a-4d3c7b8ba6b3 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-37b7bf6a-180d-4cd6-ba8b-10d1b3c1a666 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "POST /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc/action" status: 400 len: 107 microversion: 2.1 time: 0.146677 Oct 04 12:02:26.730967 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4747/6869] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:02:26 2022] POST /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc/action => generated 107 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 12:02:26.738177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:26.738791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:26.745146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.745741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.746185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.746877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.747334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.747762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.877841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:26.885966 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6b54d5c-b495-42ec-b2e8-096df4da028e tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1506 microversion: 2.1 time: 0.151595 Oct 04 12:02:26.886537 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2123/6870] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:26 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:26.909275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:26.909948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:26.916212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.916735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.917172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.917904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:26.918347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:26.918777 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:26.922995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:27.049033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:27.056760 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1f5088fb-3b9e-49ba-bda0-8a6fe9e88908 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1506 microversion: 2.1 time: 0.151435 Oct 04 12:02:27.057322 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4748/6871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:26 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:02:27.079195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f227386b-00ef-41a5-91b8-982322fa4825 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f227386b-00ef-41a5-91b8-982322fa4825 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Request method failure captured: Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: request: POST /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc/action HTTP/1.1 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 29 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCC4ls-w2R8ArFY7iZRK1KXP8E03r896b5N3ODrPO8L-9xV1zU1kO5QrnHx42GcLdaQbakll_ep1_0W_4rQbtcIxRyKl8F61FR33gDQfwIm_3BDoPuRIdqDotJ9rEh4vgIAQFdab-rRANbbC7toysSgh7nYXdPtmcwzXxcrjbQb0BO4 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b00377c69ca4411bf0325baab7c5d79"}]}] Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 01e0413789b7497aa0e2c55f83b58e30 Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: {"resize": {"flavorRef": ""}} Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '0e39de20-f041-4cc2-b85b-ec980db794dc', 'body': {'resize': {'flavorRef': ''}}} Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise error Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi '' Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.089597 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f227386b-00ef-41a5-91b8-982322fa4825 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f227386b-00ef-41a5-91b8-982322fa4825 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "POST /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc/action" status: 400 len: 113 microversion: 2.1 time: 0.015765 Oct 04 12:02:27.094834 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2124/6872] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:02:27 2022] POST /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc/action => generated 113 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 12:02:27.099219 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:27.099834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:27.106566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.107043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.107477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.108161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.108613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.109039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.236144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:27.244281 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7493a473-f57d-4a54-b000-2359c2fc4be2 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1506 microversion: 2.1 time: 0.148822 Oct 04 12:02:27.244850 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4749/6873] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:27 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:27.271221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:27.271728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:27.278663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.279155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.279602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.280299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.280766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.281200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.294005 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] HTTP exception thrown: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Request method failure captured: Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 HTTP/1.1 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCC4ls-w2R8ArFY7iZRK1KXP8E03r896b5N3ODrPO8L-9xV1zU1kO5QrnHx42GcLdaQbakll_ep1_0W_4rQbtcIxRyKl8F61FR33gDQfwIm_3BDoPuRIdqDotJ9rEh4vgIAQFdab-rRANbbC7toysSgh7nYXdPtmcwzXxcrjbQb0BO4 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b00377c69ca4411bf0325baab7c5d79"}]}] Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 01e0413789b7497aa0e2c55f83b58e30 Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'da59d1d8-aebf-4edf-a717-2b03ee6a9531'} Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:02:27.295567 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Returning 404 to user: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e2940bc-c849-4e54-b766-eee62a811e72 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 404 len: 111 microversion: 2.1 time: 0.030485 Oct 04 12:02:27.300359 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2125/6874] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:02:27 2022] DELETE /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:02:27.306133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:27.306747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: da59d1d8-aebf-4edf-a717-2b03ee6a9531] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:27.312567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.313040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.313506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.314189 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.314645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.315067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.328666 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] HTTP exception thrown: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Request method failure captured: Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 HTTP/1.1 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCC4ls-w2R8ArFY7iZRK1KXP8E03r896b5N3ODrPO8L-9xV1zU1kO5QrnHx42GcLdaQbakll_ep1_0W_4rQbtcIxRyKl8F61FR33gDQfwIm_3BDoPuRIdqDotJ9rEh4vgIAQFdab-rRANbbC7toysSgh7nYXdPtmcwzXxcrjbQb0BO4 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b00377c69ca4411bf0325baab7c5d79"}]}] Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 01e0413789b7497aa0e2c55f83b58e30 Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'da59d1d8-aebf-4edf-a717-2b03ee6a9531'} Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:27.330206 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Returning 404 to user: Instance da59d1d8-aebf-4edf-a717-2b03ee6a9531 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e4d76530-b7bd-432e-ba5c-0f1717d59ce6 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531" status: 404 len: 111 microversion: 2.1 time: 0.029839 Oct 04 12:02:27.335044 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4750/6875] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:27 2022] GET /compute/v2.1/servers/da59d1d8-aebf-4edf-a717-2b03ee6a9531 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:02:27.339722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:27.340229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:27.346135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.346575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.347023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.347720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.348182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.348620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.373232 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:02:27.448309 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-23061617-038e-4482-bc9b-5a6ab3a25b25 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 204 len: 0 microversion: 2.1 time: 0.112044 Oct 04 12:02:27.448940 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2126/6876] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:02:27 2022] DELETE /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:02:27.457578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:27.458296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:27.464372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.464896 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.465339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.466067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:27.466529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:27.466995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:27.605996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:27.613878 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-612ccd89-6599-4d21-bc9d-4821d2a99262 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1512 microversion: 2.1 time: 0.160906 Oct 04 12:02:27.614450 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4751/6877] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:27 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:28.638908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:28.639625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:28.646396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:28.646889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:28.647365 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:28.648062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:28.648526 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:28.648958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:28.785513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e0413789b7497aa0e2c55f83b58e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b00377c69ca4411bf0325baab7c5d79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:28.793305 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0ee2ae4e-9863-453c-8fbf-27ebe36cfc74 tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 200 len: 1512 microversion: 2.1 time: 0.159543 Oct 04 12:02:28.793979 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2127/6878] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:28 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:29.222182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e597f57b-b93b-4b64-b926-1b44acaf00d8 req-fca9136f-f709-4107-baf1-4ff7a3254f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e39de20-f041-4cc2-b85b-ec980db794dc", "name": "network-vif-deleted", "tag": "4876e35c-2714-480f-94c2-12992b9b4961"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:29.233721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e597f57b-b93b-4b64-b926-1b44acaf00d8 req-fca9136f-f709-4107-baf1-4ff7a3254f68 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:29.234033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e597f57b-b93b-4b64-b926-1b44acaf00d8 req-fca9136f-f709-4107-baf1-4ff7a3254f68 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:29.234468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e597f57b-b93b-4b64-b926-1b44acaf00d8 req-fca9136f-f709-4107-baf1-4ff7a3254f68 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:29.246571 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e597f57b-b93b-4b64-b926-1b44acaf00d8 req-fca9136f-f709-4107-baf1-4ff7a3254f68 service nova] Creating event network-vif-deleted:4876e35c-2714-480f-94c2-12992b9b4961 for instance 0e39de20-f041-4cc2-b85b-ec980db794dc on n-h1-791135-8 Oct 04 12:02:29.251717 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e597f57b-b93b-4b64-b926-1b44acaf00d8 req-fca9136f-f709-4107-baf1-4ff7a3254f68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Oct 04 12:02:29.252705 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4752/6879] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:29.816737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:29.817258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] [instance: 0e39de20-f041-4cc2-b85b-ec980db794dc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:29.823885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:29.824373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:29.824818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:29.825588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:29.826015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:29.826449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:29.841513 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] HTTP exception thrown: Instance 0e39de20-f041-4cc2-b85b-ec980db794dc could not be found. Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Request method failure captured: Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc HTTP/1.1 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCC4ls-w2R8ArFY7iZRK1KXP8E03r896b5N3ODrPO8L-9xV1zU1kO5QrnHx42GcLdaQbakll_ep1_0W_4rQbtcIxRyKl8F61FR33gDQfwIm_3BDoPuRIdqDotJ9rEh4vgIAQFdab-rRANbbC7toysSgh7nYXdPtmcwzXxcrjbQb0BO4 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b00377c69ca4411bf0325baab7c5d79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b00377c69ca4411bf0325baab7c5d79"}]}] Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 4b00377c69ca4411bf0325baab7c5d79 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1542093482 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 01e0413789b7497aa0e2c55f83b58e30 Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-ServersNegativeTestJSON-1542093482-project Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 0e39de20-f041-4cc2-b85b-ec980db794dc could not be found. Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '0e39de20-f041-4cc2-b85b-ec980db794dc'} Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e39de20-f041-4cc2-b85b-ec980db794dc could not be found. Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e39de20-f041-4cc2-b85b-ec980db794dc could not be found. Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:29.843138 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e39de20-f041-4cc2-b85b-ec980db794dc could not be found. Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] Returning 404 to user: Instance 0e39de20-f041-4cc2-b85b-ec980db794dc could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-30f10f1e-bea7-4368-9a1c-f2bac60ff0ea tempest-ServersNegativeTestJSON-1542093482 tempest-ServersNegativeTestJSON-1542093482-project] 10.222.0.23 "GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc" status: 404 len: 111 microversion: 2.1 time: 0.031840 Oct 04 12:02:29.847943 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2128/6880] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:29 2022] GET /compute/v2.1/servers/0e39de20-f041-4cc2-b85b-ec980db794dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:03:00.527937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:00.530014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=20 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:00.780597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-85f0d1ca-a4a1-4c78-865e-072a8a8e368e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: .version_select at 0x7f71d4493670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-61805184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgmjeQK4MtQbl6rUvnWX9qfdKOARCvGx4WH6Ogo0Sl7/7EXt9RWm0YYnH3XAxznmlPVU2+2wKZlsyASBccZLZsBGbkSS4SA2cQ4uo9+tIeFkvZjU8vz7VFhNvVRi6CZJg=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:00.801096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-85f0d1ca-a4a1-4c78-865e-072a8a8e368e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for project 86179f0e347641d784d87363a98642be. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:03:00.807021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-85f0d1ca-a4a1-4c78-865e-072a8a8e368e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for user 2950e67456474111a1ae2d5298bd84f8 and project 86179f0e347641d784d87363a98642be. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:03:00.834133 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-85f0d1ca-a4a1-4c78-865e-072a8a8e368e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.313433 Oct 04 12:03:00.834969 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4753/6881] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:03:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:00.889192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1237040051", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-61805184", "networks": [{"uuid": "37d89d0d-0ec9-46d5-a4cf-d8c925dd4175"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:00.898451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:00.899114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:00.949656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] validate_networks() for [('37d89d0d-0ec9-46d5-a4cf-d8c925dd4175', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:03:01.342565 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:03:01.343008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:03:01.343498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:03:01.343922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:03:01.344346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:03:01.353832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:01.354326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:01.354776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:01.355513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:01.355978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:01.356416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:01.375207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for project 86179f0e347641d784d87363a98642be. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:03:01.380355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for user 2950e67456474111a1ae2d5298bd84f8 and project 86179f0e347641d784d87363a98642be. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:03:01.392689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:03:01.395015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:03:01.441121 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab77077a-de53-4d2d-8ec2-6959487ebe8d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556465 Oct 04 12:03:01.441841 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2129/6882] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:03:01.453078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecd1fd9d-cfaa-411e-97b3-d7033776f0e2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:01.454052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecd1fd9d-cfaa-411e-97b3-d7033776f0e2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:01.518060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecd1fd9d-cfaa-411e-97b3-d7033776f0e2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:01.525654 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecd1fd9d-cfaa-411e-97b3-d7033776f0e2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1261 microversion: 2.1 time: 0.076742 Oct 04 12:03:01.526235 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4754/6883] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:01 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:02.549507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:02.550133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:02.557747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:02.558549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:02.559105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:02.559936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:02.560510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:02.561060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:02.630498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:02.639163 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-945f8a21-9260-46c6-a8ee-e1b66f3df095 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1313 microversion: 2.1 time: 0.094736 Oct 04 12:03:02.639893 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2130/6884] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:02 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1313 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:03.663968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:03.664877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:03.674083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:03.675102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:03.675851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:03.678200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:03.678841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:03.679987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:03.921195 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:03.930978 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-27f403b6-b215-476c-bbfe-6ef54c444aa3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1361 microversion: 2.1 time: 0.270784 Oct 04 12:03:03.931861 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4755/6885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:03 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:04.208630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-46d8f690-e7eb-4cef-a0bc-737e832425b2 req-679e8fc1-66d7-4832-8b19-c4819a1fd39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87fe29de-f788-4bc2-8b81-b33eb1e4ce97", "tag": "074fb19b-f594-4dfb-b73e-f3ba2aaae3c4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:04.229781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-46d8f690-e7eb-4cef-a0bc-737e832425b2 req-679e8fc1-66d7-4832-8b19-c4819a1fd39e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:04.230493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-46d8f690-e7eb-4cef-a0bc-737e832425b2 req-679e8fc1-66d7-4832-8b19-c4819a1fd39e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:04.230946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-46d8f690-e7eb-4cef-a0bc-737e832425b2 req-679e8fc1-66d7-4832-8b19-c4819a1fd39e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:04.243795 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-46d8f690-e7eb-4cef-a0bc-737e832425b2 req-679e8fc1-66d7-4832-8b19-c4819a1fd39e service nova] Creating event network-changed:074fb19b-f594-4dfb-b73e-f3ba2aaae3c4 for instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 on n-h2-791135-8 Oct 04 12:03:04.249969 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-46d8f690-e7eb-4cef-a0bc-737e832425b2 req-679e8fc1-66d7-4832-8b19-c4819a1fd39e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044859 Oct 04 12:03:04.250587 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2131/6886] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:04.954446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:04.955060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:04.962950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:04.963447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:04.963888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:04.964601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:04.965059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:04.965522 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:05.105381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:05.113573 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3ede6ac-dfd2-486c-9a9c-ff9960dde0f5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1361 microversion: 2.1 time: 0.162988 Oct 04 12:03:05.114302 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4756/6887] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:04 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:06.138122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:06.138755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:06.144894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:06.145419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:06.145869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:06.146569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:06.147035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:06.147467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:06.280873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:06.289745 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5c2b14e-9011-435b-8c1e-1168ffb6577c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1361 microversion: 2.1 time: 0.156396 Oct 04 12:03:06.290352 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2132/6888] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:06 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:07.312460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:07.313084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:07.320599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:07.321172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:07.321646 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:07.322349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:07.322799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:07.323220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:07.450043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:07.457588 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-57c9f3f0-6c9e-4399-9721-3409bc43a2d5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1361 microversion: 2.1 time: 0.149018 Oct 04 12:03:07.458154 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4757/6889] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:07 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:08.480031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:08.480736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:08.487527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:08.488025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:08.488471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:08.489175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:08.489672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:08.490115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:08.619876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:08.627959 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a4dfda66-3074-4ef7-bdb0-4eebe3c5666e tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1361 microversion: 2.1 time: 0.151791 Oct 04 12:03:08.628546 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2133/6890] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:08 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:09.652766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:09.653436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:09.660333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:09.660822 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:09.661261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:09.661985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:09.662442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:09.662871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:09.797315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:09.804959 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0df40d22-0630-4630-88d2-7e198ff30efd tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1361 microversion: 2.1 time: 0.156753 Oct 04 12:03:09.805559 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4758/6891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:09 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:09.936807 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-98c959cc-a437-49da-8bc9-b6a5f77dc7e1 req-2ff7d809-fc8f-4cff-9533-43dce323c85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87fe29de-f788-4bc2-8b81-b33eb1e4ce97", "name": "network-vif-plugged", "status": "completed", "tag": "074fb19b-f594-4dfb-b73e-f3ba2aaae3c4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:09.948831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-98c959cc-a437-49da-8bc9-b6a5f77dc7e1 req-2ff7d809-fc8f-4cff-9533-43dce323c85b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:09.950034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-98c959cc-a437-49da-8bc9-b6a5f77dc7e1 req-2ff7d809-fc8f-4cff-9533-43dce323c85b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:09.950504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-98c959cc-a437-49da-8bc9-b6a5f77dc7e1 req-2ff7d809-fc8f-4cff-9533-43dce323c85b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:09.962467 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-98c959cc-a437-49da-8bc9-b6a5f77dc7e1 req-2ff7d809-fc8f-4cff-9533-43dce323c85b service nova] Creating event network-vif-plugged:074fb19b-f594-4dfb-b73e-f3ba2aaae3c4 for instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 on n-h2-791135-8 Oct 04 12:03:09.967815 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-98c959cc-a437-49da-8bc9-b6a5f77dc7e1 req-2ff7d809-fc8f-4cff-9533-43dce323c85b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035034 Oct 04 12:03:09.968411 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2134/6892] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:10.830668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:10.831194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:10.839470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:10.840135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:10.840577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:10.841542 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:10.842002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:10.842433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:10.974969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:10.982578 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-43d93a21-2060-483f-a316-3b642c917568 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1361 microversion: 2.1 time: 0.155955 Oct 04 12:03:10.983145 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4759/6893] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:10 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:12.005943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:12.006658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:12.009920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:12.010624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:12.017058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:12.017577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:12.018043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:12.018737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:12.019197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:12.019627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:12.152007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:12.159574 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7a71c981-f58b-4c1f-92e1-b4a825aa9ff4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1553 microversion: 2.1 time: 0.158087 Oct 04 12:03:12.160147 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2135/6894] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:12 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:12.181886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:12.182502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:12.184381 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:12.190548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:12.191033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:12.191470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:12.192165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:12.192680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:12.193059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:12.320427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:12.328095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8d2c0d5-1b95-4881-bf34-fa9d9400b7d0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1553 microversion: 2.1 time: 0.150038 Oct 04 12:03:12.328670 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4760/6895] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:12 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:13.991950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9d434e8-b4df-4655-8242-e0230490e020"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:13.994978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:14.001693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:14.002181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:14.002621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:14.003312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:14.003806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:14.004240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:14.259063 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f2831f8-d09f-4108-b73d-ebdb85067203 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270791 Oct 04 12:03:14.260316 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2136/6896] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 12:03:13 2022] POST /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:24.966713 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:24.967249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:24.970091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:24.970858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=36 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:24.978013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:24.979404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:24.979703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:24.980258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:24.980659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:24.981283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.063949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lazy-loading 'services' on Instance uuid 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:03:25.136161 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e20b99d3-1b52-47b3-9369-88462d8ae88f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments/f9d434e8-b4df-4655-8242-e0230490e020" status: 202 len: 0 microversion: 2.1 time: 0.174072 Oct 04 12:03:25.136767 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4761/6897] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:03:24 2022] DELETE /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments/f9d434e8-b4df-4655-8242-e0230490e020 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:03:25.143504 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:25.144301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:25.148595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:25.151717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:25.159449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.159959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.160413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.161143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.161633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.162076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.193398 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a9173800-a8a0-411a-bfc8-e28fcb0cbf6f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051718 Oct 04 12:03:25.193976 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2137/6898] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:03:25 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:26.208404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:26.210878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:26.218024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:26.218575 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:26.219064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:26.220030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:26.220593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:26.221136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:26.254174 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-79111e36-b738-414e-9873-43343966e049 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050007 Oct 04 12:03:26.254174 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4762/6899] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:03:26 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:27.268478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:27.270786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:27.278451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:27.278985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:27.279435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:27.280157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:27.280620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:27.281054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:27.313179 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f6165c44-f45d-44fd-855a-b17a08dd773d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048747 Oct 04 12:03:27.314175 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2138/6900] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:03:27 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:28.324952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:28.327220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:28.334186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:28.334616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:28.335052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:28.335742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:28.336193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:28.336618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:28.366719 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f3741cd1-217c-47dc-8ed5-1d785c3979ca tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045780 Oct 04 12:03:28.367274 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4763/6901] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:03:28 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:29.379760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:29.382038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:29.389800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:29.390299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:29.390746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:29.391455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:29.391916 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:29.392352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:29.421605 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e2092660-fda4-4a6f-a51c-852b75c60ddc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Oct 04 12:03:29.422370 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2139/6902] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:03:29 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:30.433984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:30.436202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:30.443043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:30.443529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:30.443968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:30.444659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:30.445116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:30.445572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:30.475520 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-450392a5-f944-4119-a790-1b70e7bca083 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045555 Oct 04 12:03:30.476090 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4764/6903] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:03:30 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:03:30.487346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:30.487852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:30.494363 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:30.494855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:30.495318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:30.496001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:30.496465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:30.496904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:30.572372 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] HTTP exception thrown: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 is not attached to volume f9d434e8-b4df-4655-8242-e0230490e020 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Request method failure captured: Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments/f9d434e8-b4df-4655-8242-e0230490e020 HTTP/1.1 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCDv8fFUiaW8X5eJ6_9Ixd5Qws6NcuHo8FKQOj26wUYffJNA4OYj0KwOzysgj4EkQZHdTwJkUJ8oHdLQInDvavO7NdvKYhwfhbIptjL1eSLRVAkUrY6Ioa-dcyJFYCUZjsy_baK8BHd8Bm10OLG3bFbdPKMhDr1wykR8bvRhLUB2xbU Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 86179f0e347641d784d87363a98642be Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86179f0e347641d784d87363a98642be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86179f0e347641d784d87363a98642be"}]}] Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 86179f0e347641d784d87363a98642be Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 2950e67456474111a1ae2d5298bd84f8 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 is not attached to volume f9d434e8-b4df-4655-8242-e0230490e020 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'server_id': '87fe29de-f788-4bc2-8b81-b33eb1e4ce97', 'id': 'f9d434e8-b4df-4655-8242-e0230490e020'} Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f9d434e8-b4df-4655-8242-e0230490e020. Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 is not attached to volume f9d434e8-b4df-4655-8242-e0230490e020 Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:03:30.583126 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:03:30.588539 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:03:30.588539 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:03:30.588539 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 is not attached to volume f9d434e8-b4df-4655-8242-e0230490e020 Oct 04 12:03:30.588539 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:30.588539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Returning 404 to user: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 is not attached to volume f9d434e8-b4df-4655-8242-e0230490e020 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:03:30.588539 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1b8a5616-b81d-4847-909a-5222f71d0581 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments/f9d434e8-b4df-4655-8242-e0230490e020" status: 404 len: 154 microversion: 2.1 time: 0.101589 Oct 04 12:03:30.588539 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2140/6904] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:03:30 2022] DELETE /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97/os-volume_attachments/f9d434e8-b4df-4655-8242-e0230490e020 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:03:33.941192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:33.941835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:33.948469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:33.948957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:33.949428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:33.950143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:33.950596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:33.951019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:33.978600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:03:34.059550 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a4d8d84-4879-4cd0-82ba-732b94d90672 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 204 len: 0 microversion: 2.1 time: 0.122289 Oct 04 12:03:34.060246 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4765/6905] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:03:33 2022] DELETE /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:03:34.068929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:34.069683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:34.077104 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:34.077623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:34.078074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:34.078926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:34.079399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:34.079842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:34.210041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:34.218472 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4e0fc6ac-f497-40bb-b6a6-1d51cef1b602 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1559 microversion: 2.1 time: 0.153833 Oct 04 12:03:34.219170 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2141/6906] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:34 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:35.242348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:35.243055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:35.250540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:35.251025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:35.251465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:35.252158 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:35.252617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:35.253048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:35.382849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:35.395110 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-75568ef0-eaf4-4501-909c-6cd9aca9bdd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1559 microversion: 2.1 time: 0.157060 Oct 04 12:03:35.395701 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4766/6907] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:35 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:36.277109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-61f6ff4c-5dbe-481d-9176-3a151909dbfc req-bfc673e5-1b4a-4f94-a932-919c444a46e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87fe29de-f788-4bc2-8b81-b33eb1e4ce97", "name": "network-vif-deleted", "tag": "074fb19b-f594-4dfb-b73e-f3ba2aaae3c4"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:36.290462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61f6ff4c-5dbe-481d-9176-3a151909dbfc req-bfc673e5-1b4a-4f94-a932-919c444a46e4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:36.297334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61f6ff4c-5dbe-481d-9176-3a151909dbfc req-bfc673e5-1b4a-4f94-a932-919c444a46e4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:36.301387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-61f6ff4c-5dbe-481d-9176-3a151909dbfc req-bfc673e5-1b4a-4f94-a932-919c444a46e4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:36.318512 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-61f6ff4c-5dbe-481d-9176-3a151909dbfc req-bfc673e5-1b4a-4f94-a932-919c444a46e4 service nova] Creating event network-vif-deleted:074fb19b-f594-4dfb-b73e-f3ba2aaae3c4 for instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 on n-h2-791135-8 Oct 04 12:03:36.323882 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-61f6ff4c-5dbe-481d-9176-3a151909dbfc req-bfc673e5-1b4a-4f94-a932-919c444a46e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050764 Oct 04 12:03:36.324505 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2142/6908] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:36.419277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:36.419895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:36.427282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:36.427766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:36.428213 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:36.429010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:36.429506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:36.429946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:36.462565 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:36.463054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:36.463496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:36.463949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lazy-loading 'fault' on Instance uuid 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:03:36.505771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:36.513823 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5dd12b73-bc69-4600-9184-8486ee738003 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 200 len: 1351 microversion: 2.1 time: 0.099037 Oct 04 12:03:36.514402 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4767/6909] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:36 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:37.538129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:37.538827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 87fe29de-f788-4bc2-8b81-b33eb1e4ce97] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:37.545538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:37.546031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:37.546476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:37.547170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:37.547633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:37.548065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:37.561395 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] HTTP exception thrown: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 could not be found. Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Request method failure captured: Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 HTTP/1.1 Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCDv8fFUiaW8X5eJ6_9Ixd5Qws6NcuHo8FKQOj26wUYffJNA4OYj0KwOzysgj4EkQZHdTwJkUJ8oHdLQInDvavO7NdvKYhwfhbIptjL1eSLRVAkUrY6Ioa-dcyJFYCUZjsy_baK8BHd8Bm10OLG3bFbdPKMhDr1wykR8bvRhLUB2xbU Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 86179f0e347641d784d87363a98642be Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86179f0e347641d784d87363a98642be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86179f0e347641d784d87363a98642be"}]}] Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 86179f0e347641d784d87363a98642be Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 2950e67456474111a1ae2d5298bd84f8 Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 could not be found. Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '87fe29de-f788-4bc2-8b81-b33eb1e4ce97'} Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 could not be found. Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 could not be found. Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:03:37.563035 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 could not be found. Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Returning 404 to user: Instance 87fe29de-f788-4bc2-8b81-b33eb1e4ce97 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0555bdff-e87b-4052-90d8-7a2c54a906e0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97" status: 404 len: 111 microversion: 2.1 time: 0.031484 Oct 04 12:03:37.567086 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2143/6910] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:37 2022] GET /compute/v2.1/servers/87fe29de-f788-4bc2-8b81-b33eb1e4ce97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:03:37.573261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7cb95549-ab33-4287-b826-a105b00d4839 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '.version_select at 0x7f71cfad0d30>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:37.592979 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7cb95549-ab33-4287-b826-a105b00d4839 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-61805184" status: 202 len: 0 microversion: 2.1 time: 0.023664 Oct 04 12:03:37.593654 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4768/6911] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 12:03:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-61805184 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:03:37.611195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7114e293-78a8-4485-94ff-a11fe59e1577 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: .version_select at 0x7f71d87548b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-220771095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDI08h7zIQ1qI3xoLtNTtkBpEb5UBqOopd/KJOAIG003+ScgpHuabC9WiS5pnGsSwqu38lodwN+Und69grkzdF4WbWMfI6spHO97Xrch70c1wIRegJE5rTskRXQshd9qbA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:37.626703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7114e293-78a8-4485-94ff-a11fe59e1577 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for project 86179f0e347641d784d87363a98642be. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:03:37.632034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-7114e293-78a8-4485-94ff-a11fe59e1577 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for user 2950e67456474111a1ae2d5298bd84f8 and project 86179f0e347641d784d87363a98642be. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:03:37.645339 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7114e293-78a8-4485-94ff-a11fe59e1577 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [e895f24a-1a5c-4f4c-a9b0-814b1b9d4209] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:03:38.653388 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [None req-7114e293-78a8-4485-94ff-a11fe59e1577 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [e895f24a-1a5c-4f4c-a9b0-814b1b9d4209] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35688. Oct 04 12:03:38.667788 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7114e293-78a8-4485-94ff-a11fe59e1577 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.060512 Oct 04 12:03:38.668375 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2144/6912] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:03:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:38.722083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-602929239", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-220771095", "networks": [{"uuid": "37d89d0d-0ec9-46d5-a4cf-d8c925dd4175"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:38.775416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] validate_networks() for [('37d89d0d-0ec9-46d5-a4cf-d8c925dd4175', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:03:39.460202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:03:39.460635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:03:39.461117 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:03:39.461578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:03:39.461998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:03:39.470976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:39.471462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:39.471907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:39.472641 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:39.473126 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:39.473595 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:39.491718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for project 86179f0e347641d784d87363a98642be. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:03:39.497668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for user 2950e67456474111a1ae2d5298bd84f8 and project 86179f0e347641d784d87363a98642be. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:03:39.510042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:03:39.512345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:03:39.563203 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97d3937d-0324-44a9-981f-3bdbbd6de443 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845875 Oct 04 12:03:39.567855 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4769/6913] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:03:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:03:39.576352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f3127fe-705c-474b-93e5-4c2b701b02a8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:39.577007 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f3127fe-705c-474b-93e5-4c2b701b02a8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:39.640067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8f3127fe-705c-474b-93e5-4c2b701b02a8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:39.647137 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f3127fe-705c-474b-93e5-4c2b701b02a8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1261 microversion: 2.1 time: 0.075625 Oct 04 12:03:39.647707 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2145/6914] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:39 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1261 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:40.674343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:40.675406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:40.685611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:40.686256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:40.686701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:40.687407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:40.687918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:40.688823 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:40.796235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:40.804902 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9305c46a-2152-4bb0-8c3c-8554bea5ed56 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1331 microversion: 2.1 time: 0.138045 Oct 04 12:03:40.806343 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4770/6915] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:40 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:41.828915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:41.830403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:41.838844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:41.840122 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:41.840584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:41.841328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:41.842037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:41.842637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:41.978199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:41.986466 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4aee616b-b437-41eb-9ab6-4cbebdd65162 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1361 microversion: 2.1 time: 0.161475 Oct 04 12:03:41.987066 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2146/6916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:41 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:42.007751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d25b18c3-6fe3-43f0-965e-faedf345d669 req-acf7f2e0-4b5d-4ceb-b241-7c2f464c03ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69bfc30-f637-46aa-9b5b-956896918d87", "tag": "3d21e0a3-2238-49df-98b0-0e97376ab12a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:42.020664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d25b18c3-6fe3-43f0-965e-faedf345d669 req-acf7f2e0-4b5d-4ceb-b241-7c2f464c03ea service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:42.021249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d25b18c3-6fe3-43f0-965e-faedf345d669 req-acf7f2e0-4b5d-4ceb-b241-7c2f464c03ea service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:42.021776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d25b18c3-6fe3-43f0-965e-faedf345d669 req-acf7f2e0-4b5d-4ceb-b241-7c2f464c03ea service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:42.033475 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d25b18c3-6fe3-43f0-965e-faedf345d669 req-acf7f2e0-4b5d-4ceb-b241-7c2f464c03ea service nova] Creating event network-changed:3d21e0a3-2238-49df-98b0-0e97376ab12a for instance d69bfc30-f637-46aa-9b5b-956896918d87 on n-h2-791135-8 Oct 04 12:03:42.038863 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d25b18c3-6fe3-43f0-965e-faedf345d669 req-acf7f2e0-4b5d-4ceb-b241-7c2f464c03ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035049 Oct 04 12:03:42.039662 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4771/6917] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:43.009803 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:43.010422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:43.017422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:43.017920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:43.018369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:43.019069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:43.019536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:43.019974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:43.149158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:43.157462 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fedcacc8-4a72-4611-8cca-ac660bb2d717 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1361 microversion: 2.1 time: 0.151563 Oct 04 12:03:43.158044 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2147/6918] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:43 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:44.181919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:44.182622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:44.188735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:44.189222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:44.189684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:44.190379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:44.190837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:44.191270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:44.325949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:44.333501 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72eb480e-d43e-478c-b7d2-881fc955b487 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1361 microversion: 2.1 time: 0.157416 Oct 04 12:03:44.334071 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4772/6919] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:44 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:45.355956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:45.356580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:45.363358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:45.363843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:45.364282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:45.364977 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:45.365459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:45.365896 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:45.501689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:45.509255 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f339e631-4171-4025-acd8-01b352278c66 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1361 microversion: 2.1 time: 0.157210 Oct 04 12:03:45.509854 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2148/6920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:45 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:46.532058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:46.532668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:46.539446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:46.539937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:46.540377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:46.541086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:46.541583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:46.542016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:46.671479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:46.679058 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a620671a-fca2-408d-b365-c838f735d196 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1361 microversion: 2.1 time: 0.150894 Oct 04 12:03:46.679632 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4773/6921] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:46 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:47.702627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:47.703243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:47.715523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:47.716011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:47.716451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:47.717144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:47.717633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:47.718066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:47.851809 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:47.859297 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bc557e9b-4ada-4cfa-bfcb-22a348a31094 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1361 microversion: 2.1 time: 0.161178 Oct 04 12:03:47.859861 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2149/6922] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:47 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:48.391963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-349b1607-0f2c-43c0-8e33-eb6217180995 req-52f830cd-ca10-4ca9-b617-4707a068def7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69bfc30-f637-46aa-9b5b-956896918d87", "name": "network-vif-plugged", "status": "completed", "tag": "3d21e0a3-2238-49df-98b0-0e97376ab12a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:48.405619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-349b1607-0f2c-43c0-8e33-eb6217180995 req-52f830cd-ca10-4ca9-b617-4707a068def7 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:48.406107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-349b1607-0f2c-43c0-8e33-eb6217180995 req-52f830cd-ca10-4ca9-b617-4707a068def7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:48.406539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-349b1607-0f2c-43c0-8e33-eb6217180995 req-52f830cd-ca10-4ca9-b617-4707a068def7 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:48.416931 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-349b1607-0f2c-43c0-8e33-eb6217180995 req-52f830cd-ca10-4ca9-b617-4707a068def7 service nova] Creating event network-vif-plugged:3d21e0a3-2238-49df-98b0-0e97376ab12a for instance d69bfc30-f637-46aa-9b5b-956896918d87 on n-h2-791135-8 Oct 04 12:03:48.422386 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-349b1607-0f2c-43c0-8e33-eb6217180995 req-52f830cd-ca10-4ca9-b617-4707a068def7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090418 Oct 04 12:03:48.422995 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4774/6923] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:48.882535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:48.883097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:48.890770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:48.891270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:48.891718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:48.892418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:48.892889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:48.893336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:49.022776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:49.030399 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a17b041-f921-47b8-aee0-09af4e445ce5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1361 microversion: 2.1 time: 0.151826 Oct 04 12:03:49.030995 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2150/6924] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:48 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:50.051651 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:50.052428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:50.056752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:50.057479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:50.064516 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:50.065005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:50.065497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:50.066191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:50.066652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:50.067080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:50.198172 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:50.206616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3d489905-9357-42b2-9c04-7e224f0adc32 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1554 microversion: 2.1 time: 0.156823 Oct 04 12:03:50.207191 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4775/6925] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:50 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:50.229017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:50.229666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:50.231648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:50.237596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:50.238084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:50.238528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:50.239227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:50.239690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:50.240124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:50.371503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:50.379067 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3e4e051a-54f1-4ece-919d-85adb90d299c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1554 microversion: 2.1 time: 0.153865 Oct 04 12:03:50.379645 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2151/6926] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:50 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:51.868557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b6bcdeb-a98e-452d-84a2-ef7e42278bee"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:51.871507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:51.878245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:51.878737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:51.879198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:51.879885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:51.880334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:51.880759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:52.122699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:52.141247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b32a30ee-aacd-437f-a105-84f39626fa8c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276471 Oct 04 12:03:52.141929 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4776/6927] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 12:03:51 2022] POST /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:02.849297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:02.849846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:02.851959 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:02.852806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=70 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:02.859753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:02.860270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:02.860713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:02.861523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:02.861982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:02.862411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:02.946872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lazy-loading 'services' on Instance uuid d69bfc30-f637-46aa-9b5b-956896918d87 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:04:03.018805 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9af97d41-ede3-47fc-bc1c-e7e0509230a5 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments/4b6bcdeb-a98e-452d-84a2-ef7e42278bee" status: 202 len: 0 microversion: 2.1 time: 0.174039 Oct 04 12:04:03.019403 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2152/6928] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:04:02 2022] DELETE /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments/4b6bcdeb-a98e-452d-84a2-ef7e42278bee => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:04:03.032025 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:03.035118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:03.039286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:03.040002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:03.047301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:03.047785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:03.048221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:03.048926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:03.049387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:03.049815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:03.085655 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b1ec68fd-dae5-4bf8-be32-5426c1c4add6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061080 Oct 04 12:04:03.086220 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4777/6929] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:03 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:04.099961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:04.102380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:04.109296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:04.109827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:04.110293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:04.110990 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:04.111467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:04.111899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:04.142429 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6b9568db-9ce3-4eb2-92c9-b8e689a6469a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047692 Oct 04 12:04:04.142999 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2153/6930] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:04 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:05.155549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:05.157778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:05.164552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:05.165038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:05.165505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:05.166211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:05.166662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:05.167397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:05.198022 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9764b041-cd75-46bf-9f37-ce1efa20d65f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Oct 04 12:04:05.199156 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4778/6931] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:05 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:06.210856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:06.212943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:06.220047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:06.220544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:06.220993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:06.221720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:06.222183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:06.222617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:06.252336 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5bcde2b-250e-4ff3-9466-0869446bf636 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Oct 04 12:04:06.252898 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2154/6932] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:06 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:07.265091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:07.267453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:07.274535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:07.275019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:07.275456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:07.276186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:07.277306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:07.277764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:07.307616 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1d2410a7-2cfa-4a0b-8487-1463feab33e4 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047346 Oct 04 12:04:07.308193 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4779/6933] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:07 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:08.320019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:08.322250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:08.329795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:08.330290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:08.330733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:08.331426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:08.331883 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:08.332314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:08.360175 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a82f6ade-b848-42b6-90d2-08f96d829dac tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044165 Oct 04 12:04:08.360725 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2155/6934] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:08 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 12:04:08.372038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:08.372532 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:08.379479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:08.379968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:08.380412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:08.381105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:08.381591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:08.382054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:08.459770 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] HTTP exception thrown: Instance d69bfc30-f637-46aa-9b5b-956896918d87 is not attached to volume 4b6bcdeb-a98e-452d-84a2-ef7e42278bee Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Request method failure captured: Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments/4b6bcdeb-a98e-452d-84a2-ef7e42278bee HTTP/1.1 Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCDv8fFUiaW8X5eJ6_9Ixd5Qws6NcuHo8FKQOj26wUYffJNA4OYj0KwOzysgj4EkQZHdTwJkUJ8oHdLQInDvavO7NdvKYhwfhbIptjL1eSLRVAkUrY6Ioa-dcyJFYCUZjsy_baK8BHd8Bm10OLG3bFbdPKMhDr1wykR8bvRhLUB2xbU Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 86179f0e347641d784d87363a98642be Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86179f0e347641d784d87363a98642be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86179f0e347641d784d87363a98642be"}]}] Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 86179f0e347641d784d87363a98642be Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2950e67456474111a1ae2d5298bd84f8 Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance d69bfc30-f637-46aa-9b5b-956896918d87 is not attached to volume 4b6bcdeb-a98e-452d-84a2-ef7e42278bee Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': 'd69bfc30-f637-46aa-9b5b-956896918d87', 'id': '4b6bcdeb-a98e-452d-84a2-ef7e42278bee'} Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4b6bcdeb-a98e-452d-84a2-ef7e42278bee. Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69bfc30-f637-46aa-9b5b-956896918d87 is not attached to volume 4b6bcdeb-a98e-452d-84a2-ef7e42278bee Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:08.461772 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:08.465761 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:04:08.465761 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:04:08.465761 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69bfc30-f637-46aa-9b5b-956896918d87 is not attached to volume 4b6bcdeb-a98e-452d-84a2-ef7e42278bee Oct 04 12:04:08.465761 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:08.465761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Returning 404 to user: Instance d69bfc30-f637-46aa-9b5b-956896918d87 is not attached to volume 4b6bcdeb-a98e-452d-84a2-ef7e42278bee {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:04:08.465761 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5c270cf-5a02-48bd-b776-858d2da7230a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments/4b6bcdeb-a98e-452d-84a2-ef7e42278bee" status: 404 len: 154 microversion: 2.1 time: 0.095890 Oct 04 12:04:08.465761 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4780/6935] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:04:08 2022] DELETE /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87/os-volume_attachments/4b6bcdeb-a98e-452d-84a2-ef7e42278bee => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:11.809181 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:11.809750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:11.816747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:11.817168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:11.817645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:11.818362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:11.818828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:11.819260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:11.848500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:04:11.932022 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7cee0d3f-cbd0-4957-9c6f-686813b0c659 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 204 len: 0 microversion: 2.1 time: 0.126729 Oct 04 12:04:11.934120 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2156/6936] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:04:11 2022] DELETE /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:04:11.942799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:11.943452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:11.950261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:11.950855 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:11.951294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:11.951985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:11.952436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:11.952860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:12.085146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:12.094517 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01063871-bbe4-4897-9ca3-8a528ba1803a tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1560 microversion: 2.1 time: 0.155481 Oct 04 12:04:12.095034 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4781/6937] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:11 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:13.118552 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:13.119265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:13.126629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:13.127117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:13.127558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:13.128253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:13.128708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:13.129138 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:13.257251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:13.265070 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-918e9f19-2f9b-4cb9-94bb-9465022c387d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1560 microversion: 2.1 time: 0.150735 Oct 04 12:04:13.265670 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2157/6938] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:13 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:14.176770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f707c512-c5b8-4385-83ec-14f61eb45946 req-bc40ad99-85e3-475e-b745-9aa97dc4c8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69bfc30-f637-46aa-9b5b-956896918d87", "name": "network-vif-deleted", "tag": "3d21e0a3-2238-49df-98b0-0e97376ab12a"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:14.187781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f707c512-c5b8-4385-83ec-14f61eb45946 req-bc40ad99-85e3-475e-b745-9aa97dc4c8c8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:14.188404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f707c512-c5b8-4385-83ec-14f61eb45946 req-bc40ad99-85e3-475e-b745-9aa97dc4c8c8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:14.188933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f707c512-c5b8-4385-83ec-14f61eb45946 req-bc40ad99-85e3-475e-b745-9aa97dc4c8c8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:14.201541 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f707c512-c5b8-4385-83ec-14f61eb45946 req-bc40ad99-85e3-475e-b745-9aa97dc4c8c8 service nova] Creating event network-vif-deleted:3d21e0a3-2238-49df-98b0-0e97376ab12a for instance d69bfc30-f637-46aa-9b5b-956896918d87 on n-h2-791135-8 Oct 04 12:04:14.206561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f707c512-c5b8-4385-83ec-14f61eb45946 req-bc40ad99-85e3-475e-b745-9aa97dc4c8c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107743 Oct 04 12:04:14.207252 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4782/6939] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:14.287827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:14.288457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:14.296692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:14.297194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:14.297681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:14.298399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:14.298866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:14.299309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:14.330695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:14.331177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:14.331626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:14.332137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lazy-loading 'fault' on Instance uuid d69bfc30-f637-46aa-9b5b-956896918d87 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:04:14.373109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:14.380732 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b221382-6c09-4e74-aa48-2edeb60a24fc tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 200 len: 1351 microversion: 2.1 time: 0.096807 Oct 04 12:04:14.381305 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2158/6940] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:14 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:15.405915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:15.406618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: d69bfc30-f637-46aa-9b5b-956896918d87] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:15.412745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:15.413231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:15.413701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:15.414392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:15.414860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:15.415282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:15.428876 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] HTTP exception thrown: Instance d69bfc30-f637-46aa-9b5b-956896918d87 could not be found. Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Request method failure captured: Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 HTTP/1.1 Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCDv8fFUiaW8X5eJ6_9Ixd5Qws6NcuHo8FKQOj26wUYffJNA4OYj0KwOzysgj4EkQZHdTwJkUJ8oHdLQInDvavO7NdvKYhwfhbIptjL1eSLRVAkUrY6Ioa-dcyJFYCUZjsy_baK8BHd8Bm10OLG3bFbdPKMhDr1wykR8bvRhLUB2xbU Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 86179f0e347641d784d87363a98642be Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86179f0e347641d784d87363a98642be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86179f0e347641d784d87363a98642be"}]}] Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 86179f0e347641d784d87363a98642be Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 2950e67456474111a1ae2d5298bd84f8 Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance d69bfc30-f637-46aa-9b5b-956896918d87 could not be found. Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'd69bfc30-f637-46aa-9b5b-956896918d87'} Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69bfc30-f637-46aa-9b5b-956896918d87 could not be found. Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69bfc30-f637-46aa-9b5b-956896918d87 could not be found. Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:15.430560 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69bfc30-f637-46aa-9b5b-956896918d87 could not be found. Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Returning 404 to user: Instance d69bfc30-f637-46aa-9b5b-956896918d87 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5988885b-c101-4fdd-a70a-4da21297c2c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87" status: 404 len: 111 microversion: 2.1 time: 0.031847 Oct 04 12:04:15.435480 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4783/6941] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:15 2022] GET /compute/v2.1/servers/d69bfc30-f637-46aa-9b5b-956896918d87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:15.440696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d10b15ac-9643-49b7-ad18-2db59110f8f6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '.version_select at 0x7f71d8754a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:15.460522 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d10b15ac-9643-49b7-ad18-2db59110f8f6 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-220771095" status: 202 len: 0 microversion: 2.1 time: 0.023634 Oct 04 12:04:15.461090 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2159/6942] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 12:04:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-220771095 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:04:15.479366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0675d5fb-cf39-4921-8c4d-93099bc793a2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: .version_select at 0x7f71cf070ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-948256657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaeMEHLy+7Y4I+Rr668LpAnL1KAwu4o+23voSla88UMQdrnbUsom+Ha+NyRnz6m+WeXriIGBJ3S3snETeX8kDxChOL3O9h01Yopl+k1Agm1sbctE26b9Vt0HqhXEkhIbw=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:15.494756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0675d5fb-cf39-4921-8c4d-93099bc793a2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for project 86179f0e347641d784d87363a98642be. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:04:15.499990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0675d5fb-cf39-4921-8c4d-93099bc793a2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for user 2950e67456474111a1ae2d5298bd84f8 and project 86179f0e347641d784d87363a98642be. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:04:15.523617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0675d5fb-cf39-4921-8c4d-93099bc793a2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048094 Oct 04 12:04:15.524205 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4784/6943] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:04:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:15.574066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1588138336", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-948256657", "networks": [{"uuid": "37d89d0d-0ec9-46d5-a4cf-d8c925dd4175"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:15.625119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] validate_networks() for [('37d89d0d-0ec9-46d5-a4cf-d8c925dd4175', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:04:16.049531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:04:16.049965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:04:16.050449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:04:16.050875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:04:16.051299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:04:16.060950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:16.061487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:16.061942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:16.062686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:16.063153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:16.063624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:16.081313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for project 86179f0e347641d784d87363a98642be. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:04:16.086624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Getting quotas for user 2950e67456474111a1ae2d5298bd84f8 and project 86179f0e347641d784d87363a98642be. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:04:16.099927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:04:16.103048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:04:16.150812 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1f88537c-1da5-421b-b59c-39e11c439c81 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581082 Oct 04 12:04:16.157829 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2160/6944] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:04:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:04:16.162941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f11d1a06-9184-4806-8d3f-7b615888342b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:16.163560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f11d1a06-9184-4806-8d3f-7b615888342b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:16.221764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f11d1a06-9184-4806-8d3f-7b615888342b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:16.232304 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f11d1a06-9184-4806-8d3f-7b615888342b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1262 microversion: 2.1 time: 0.073209 Oct 04 12:04:16.233038 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4785/6945] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:16 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1262 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:17.256965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:17.257705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:17.265634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:17.266212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:17.266726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:17.267658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:17.268331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:17.268868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:17.337935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:17.346269 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4ad000b3-a487-4281-8d18-69eaf34650e3 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1332 microversion: 2.1 time: 0.094163 Oct 04 12:04:17.347324 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2161/6946] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:17 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:18.369964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:18.372603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:18.379772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:18.380261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:18.380702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:18.381427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:18.381883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:18.382342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:18.602302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-99150f89-e4cd-4bec-8e95-06c5b4f2d041 req-ff5d0a03-06ba-4900-9f51-17d90f38a40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6edce5f9-9d06-4d61-b1b3-9442b4934734", "tag": "1bf24b22-9776-4544-8159-ed0cd309fb4b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:18.604867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:18.613265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-99150f89-e4cd-4bec-8e95-06c5b4f2d041 req-ff5d0a03-06ba-4900-9f51-17d90f38a40b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:18.613489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-99150f89-e4cd-4bec-8e95-06c5b4f2d041 req-ff5d0a03-06ba-4900-9f51-17d90f38a40b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:18.614039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-99150f89-e4cd-4bec-8e95-06c5b4f2d041 req-ff5d0a03-06ba-4900-9f51-17d90f38a40b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:18.614690 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7aa26521-b814-43d4-82c4-8023095c41b2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1362 microversion: 2.1 time: 0.247317 Oct 04 12:04:18.615514 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4786/6947] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:18 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:18.627893 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-99150f89-e4cd-4bec-8e95-06c5b4f2d041 req-ff5d0a03-06ba-4900-9f51-17d90f38a40b service nova] Creating event network-changed:1bf24b22-9776-4544-8159-ed0cd309fb4b for instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 on n-h2-791135-8 Oct 04 12:04:18.633812 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-99150f89-e4cd-4bec-8e95-06c5b4f2d041 req-ff5d0a03-06ba-4900-9f51-17d90f38a40b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035420 Oct 04 12:04:18.634644 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2162/6948] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:19.638214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:19.638824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:19.645814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:19.646179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:19.646611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:19.647391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:19.647765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:19.648196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:19.778112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:19.785698 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c9709e7-84d8-46e2-ad22-30b51924d8ae tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1362 microversion: 2.1 time: 0.151618 Oct 04 12:04:19.786268 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4787/6949] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:19 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:20.810663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:20.811428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:20.817636 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:20.818129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:20.818575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:20.819276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:20.819741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:20.820178 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:20.952728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:20.960291 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5ecf6080-ffeb-4610-99f0-4b0a7416ef8f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1362 microversion: 2.1 time: 0.155239 Oct 04 12:04:20.960886 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2163/6950] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:20 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:21.983421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:21.983966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:21.990840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:21.991325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:21.991763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:21.992453 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:21.992912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:21.993345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:22.120225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:22.127911 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f28f1853-df2d-4b42-9d0d-021c9c200206 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1362 microversion: 2.1 time: 0.148493 Oct 04 12:04:22.128484 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4788/6951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:21 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:23.152773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:23.153428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:23.160297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:23.160782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:23.161217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:23.161925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:23.162386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:23.162813 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:23.287876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:23.295833 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1d90f64-3a97-4bbb-9abf-0b49eac391c0 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1362 microversion: 2.1 time: 0.147423 Oct 04 12:04:23.296398 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2164/6952] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:23 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:24.305825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-21a029df-972a-41c4-87f1-8c26eb0aee77 req-1574be80-d548-4225-96d4-bb688e2e2d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6edce5f9-9d06-4d61-b1b3-9442b4934734", "name": "network-vif-plugged", "status": "completed", "tag": "1bf24b22-9776-4544-8159-ed0cd309fb4b"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:24.316541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-21a029df-972a-41c4-87f1-8c26eb0aee77 req-1574be80-d548-4225-96d4-bb688e2e2d8b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:24.316984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-21a029df-972a-41c4-87f1-8c26eb0aee77 req-1574be80-d548-4225-96d4-bb688e2e2d8b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:24.317455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-21a029df-972a-41c4-87f1-8c26eb0aee77 req-1574be80-d548-4225-96d4-bb688e2e2d8b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:24.319291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:24.319835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:24.327364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:24.327907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:24.328550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:24.329270 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:24.329778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:24.330205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:24.332627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-21a029df-972a-41c4-87f1-8c26eb0aee77 req-1574be80-d548-4225-96d4-bb688e2e2d8b service nova] Creating event network-vif-plugged:1bf24b22-9776-4544-8159-ed0cd309fb4b for instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 on n-h2-791135-8 Oct 04 12:04:24.338335 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-21a029df-972a-41c4-87f1-8c26eb0aee77 req-1574be80-d548-4225-96d4-bb688e2e2d8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036156 Oct 04 12:04:24.339735 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4789/6953] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:24.466823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:24.474680 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-73a86460-4179-4f9d-8e0d-6d6a0f63e98f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1362 microversion: 2.1 time: 0.159677 Oct 04 12:04:24.475268 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2165/6954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:24 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:25.499632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:25.500398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:25.506622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:25.507102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:25.507534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:25.508214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:25.508665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:25.509086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:25.955166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:25.962825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-126fbcd3-052d-4564-96a4-1c808a6830f8 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1362 microversion: 2.1 time: 0.468935 Oct 04 12:04:25.963916 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4790/6955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:25 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:26.985985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:26.986626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:26.989492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:26.990157 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:26.996564 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:26.997057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:26.997536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:26.998239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:26.998701 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:26.999133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:27.126135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:27.133672 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43b8d608-9a67-4755-9603-8edc9f421035 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1554 microversion: 2.1 time: 0.151579 Oct 04 12:04:27.134244 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2166/6956] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:26 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:27.155795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:27.156404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:27.158396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:27.164374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:27.164860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:27.165300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:27.166044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:27.167013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:27.167443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:27.294121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:27.301917 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8cddfecb-7da5-4682-bf41-d7b16fac0b52 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1554 microversion: 2.1 time: 0.149935 Oct 04 12:04:27.302520 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4791/6957] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:27 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:28.789651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8751ea74-c3b9-4bc5-a594-22f004220abb"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:28.792607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:28.799289 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:28.799782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:28.800231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:28.800925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:28.801412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:28.801850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:28.943344 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:29.051558 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c03fe51c-2a23-4e9a-9e42-8005eb9d8600 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "POST /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265603 Oct 04 12:04:29.052168 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2167/6958] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 12:04:28 2022] POST /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:39.755392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:39.755972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:39.758079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:39.759036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=66 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:39.765545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:39.766036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:39.766478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:39.767179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:39.767634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:39.768064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:39.848508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lazy-loading 'services' on Instance uuid 6edce5f9-9d06-4d61-b1b3-9442b4934734 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:04:39.918009 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3dbe5082-992b-4584-84c5-236ad5512a2c tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments/8751ea74-c3b9-4bc5-a594-22f004220abb" status: 202 len: 0 microversion: 2.1 time: 0.166708 Oct 04 12:04:39.918606 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4792/6959] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:04:39 2022] DELETE /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments/8751ea74-c3b9-4bc5-a594-22f004220abb => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:04:39.925142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:39.926082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:39.930594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:39.932976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:39.941114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:39.941651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:39.942103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:39.942818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:39.943287 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:39.943725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:39.977334 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-32df9ed1-f83c-41d5-a9f1-fda8469cd7c2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054081 Oct 04 12:04:39.977933 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2168/6960] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:39 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:40.991530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:40.993893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:41.000402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:41.000879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:41.001329 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:41.002049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:41.002499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:41.002920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:41.034090 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9886eea0-f17b-407b-9644-4216b26894fa tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047691 Oct 04 12:04:41.034654 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4793/6961] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:40 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:42.046686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:42.048876 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:42.056030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:42.056532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:42.056982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:42.058231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:42.058715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:42.059151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:42.093820 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-60f746ad-37dc-4f9e-9805-471d91a4a52b tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051160 Oct 04 12:04:42.094414 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2169/6962] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:42 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:43.106909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:43.108995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:43.115922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:43.116416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:43.116858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:43.117599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:43.118063 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:43.118496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:43.149318 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5959662-dbd2-4031-a110-5bcac0a8be9f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047006 Oct 04 12:04:43.149911 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4794/6963] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:43 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:44.161648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:44.163848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:44.171155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:44.171647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:44.172088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:44.172783 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:44.173241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:44.173695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:44.203392 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f20f8186-8a2d-4cb9-bc7d-63d24460a9ce tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Oct 04 12:04:44.203959 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2170/6964] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:44 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:45.215678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:45.217864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:45.224703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:45.225184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:45.225654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:45.226335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:45.226786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:45.227207 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:45.258458 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fa49f8a0-6ec2-4960-9449-759b903491d9 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046703 Oct 04 12:04:45.258939 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4795/6965] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:45 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:04:45.270413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:45.270936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:45.277684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:45.278177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:45.278633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:45.279331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:45.279804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:45.280245 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:45.354300 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] HTTP exception thrown: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 is not attached to volume 8751ea74-c3b9-4bc5-a594-22f004220abb Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Request method failure captured: Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments/8751ea74-c3b9-4bc5-a594-22f004220abb HTTP/1.1 Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCDv8fFUiaW8X5eJ6_9Ixd5Qws6NcuHo8FKQOj26wUYffJNA4OYj0KwOzysgj4EkQZHdTwJkUJ8oHdLQInDvavO7NdvKYhwfhbIptjL1eSLRVAkUrY6Ioa-dcyJFYCUZjsy_baK8BHd8Bm10OLG3bFbdPKMhDr1wykR8bvRhLUB2xbU Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 86179f0e347641d784d87363a98642be Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86179f0e347641d784d87363a98642be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86179f0e347641d784d87363a98642be"}]}] Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 86179f0e347641d784d87363a98642be Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 2950e67456474111a1ae2d5298bd84f8 Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 is not attached to volume 8751ea74-c3b9-4bc5-a594-22f004220abb Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'server_id': '6edce5f9-9d06-4d61-b1b3-9442b4934734', 'id': '8751ea74-c3b9-4bc5-a594-22f004220abb'} Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8751ea74-c3b9-4bc5-a594-22f004220abb. Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 is not attached to volume 8751ea74-c3b9-4bc5-a594-22f004220abb Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:45.356418 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:45.360800 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:04:45.360800 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:04:45.360800 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 is not attached to volume 8751ea74-c3b9-4bc5-a594-22f004220abb Oct 04 12:04:45.360800 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:45.360800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Returning 404 to user: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 is not attached to volume 8751ea74-c3b9-4bc5-a594-22f004220abb {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:04:45.360800 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65d805dc-c084-48f7-9919-b4a6d427103d tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments/8751ea74-c3b9-4bc5-a594-22f004220abb" status: 404 len: 154 microversion: 2.1 time: 0.091564 Oct 04 12:04:45.360800 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2171/6966] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:04:45 2022] DELETE /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734/os-volume_attachments/8751ea74-c3b9-4bc5-a594-22f004220abb => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:48.703419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:48.703906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:48.710727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:48.711212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:48.711650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:48.712340 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:48.712792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:48.713215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:48.738880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:04:48.812730 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c30a9b0f-1ac9-4425-8a4a-b30e76c3f90f tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 204 len: 0 microversion: 2.1 time: 0.112810 Oct 04 12:04:48.813266 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4796/6967] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:04:48 2022] DELETE /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:04:48.821626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:48.822252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:48.829866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:48.830356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:48.830797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:48.831500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:48.831962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:48.832397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:48.971715 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:48.979535 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5c74bbf6-9ca5-4c40-896f-a8c2ea50a137 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1560 microversion: 2.1 time: 0.161863 Oct 04 12:04:48.980115 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2172/6968] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:48 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:50.003184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:50.003928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:50.010859 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:50.011343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:50.011780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:50.012472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:50.012926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:50.013649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:50.145250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:50.152949 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-914231b3-3e33-4cdb-b629-16c4adf4cfd2 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1560 microversion: 2.1 time: 0.154197 Oct 04 12:04:50.153551 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4797/6969] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:49 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:50.988789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-78ef0bed-16d8-4cdd-9f4a-6cf7b0852232 req-8ea8dfb7-f7e3-4d34-b4ee-b0a81477d289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6edce5f9-9d06-4d61-b1b3-9442b4934734", "name": "network-vif-deleted", "tag": "1bf24b22-9776-4544-8159-ed0cd309fb4b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:51.000716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-78ef0bed-16d8-4cdd-9f4a-6cf7b0852232 req-8ea8dfb7-f7e3-4d34-b4ee-b0a81477d289 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:51.001500 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-78ef0bed-16d8-4cdd-9f4a-6cf7b0852232 req-8ea8dfb7-f7e3-4d34-b4ee-b0a81477d289 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:51.001935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-78ef0bed-16d8-4cdd-9f4a-6cf7b0852232 req-8ea8dfb7-f7e3-4d34-b4ee-b0a81477d289 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:51.015503 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-78ef0bed-16d8-4cdd-9f4a-6cf7b0852232 req-8ea8dfb7-f7e3-4d34-b4ee-b0a81477d289 service nova] Creating event network-vif-deleted:1bf24b22-9776-4544-8159-ed0cd309fb4b for instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 on n-h2-791135-8 Oct 04 12:04:51.023351 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-78ef0bed-16d8-4cdd-9f4a-6cf7b0852232 req-8ea8dfb7-f7e3-4d34-b4ee-b0a81477d289 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037902 Oct 04 12:04:51.025632 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2173/6970] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:51.176020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:51.176736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:51.184548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:51.185130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:51.185667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:51.186469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:51.187142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:51.187645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:51.228714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:51.229250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:51.229843 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:51.230294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lazy-loading 'fault' on Instance uuid 6edce5f9-9d06-4d61-b1b3-9442b4934734 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:04:51.281902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2950e67456474111a1ae2d5298bd84f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86179f0e347641d784d87363a98642be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:51.289643 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ce15c0a-78e7-44fa-b648-0a11a7b91a74 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 200 len: 1352 microversion: 2.1 time: 0.117496 Oct 04 12:04:51.290215 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4798/6971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:51 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:52.314669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:52.315385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] [instance: 6edce5f9-9d06-4d61-b1b3-9442b4934734] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:52.321601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:52.322096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:52.322545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:52.323747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:52.324215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:52.324655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:52.337496 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] HTTP exception thrown: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 could not be found. Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Request method failure captured: Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 HTTP/1.1 Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCDv8fFUiaW8X5eJ6_9Ixd5Qws6NcuHo8FKQOj26wUYffJNA4OYj0KwOzysgj4EkQZHdTwJkUJ8oHdLQInDvavO7NdvKYhwfhbIptjL1eSLRVAkUrY6Ioa-dcyJFYCUZjsy_baK8BHd8Bm10OLG3bFbdPKMhDr1wykR8bvRhLUB2xbU Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 86179f0e347641d784d87363a98642be Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_86179f0e347641d784d87363a98642be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/86179f0e347641d784d87363a98642be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/86179f0e347641d784d87363a98642be"}]}] Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 86179f0e347641d784d87363a98642be Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-799001841 Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 2950e67456474111a1ae2d5298bd84f8 Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestEncryptedCinderVolumes-799001841-project Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 could not be found. Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '6edce5f9-9d06-4d61-b1b3-9442b4934734'} Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 could not be found. Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 could not be found. Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:52.339779 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 could not be found. Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Returning 404 to user: Instance 6edce5f9-9d06-4d61-b1b3-9442b4934734 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2ea7654e-f493-4a22-8c08-d5dfdcea91de tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734" status: 404 len: 111 microversion: 2.1 time: 0.031657 Oct 04 12:04:52.344617 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2174/6972] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:52 2022] GET /compute/v2.1/servers/6edce5f9-9d06-4d61-b1b3-9442b4934734 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:52.349840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-df7d7107-9701-4829-8cb1-3ad838525358 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] Calling method '.version_select at 0x7f71d44145e0>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:52.371143 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-df7d7107-9701-4829-8cb1-3ad838525358 tempest-TestEncryptedCinderVolumes-799001841 tempest-TestEncryptedCinderVolumes-799001841-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-948256657" status: 202 len: 0 microversion: 2.1 time: 0.025039 Oct 04 12:04:52.371733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4799/6973] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 4 12:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-948256657 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:05:18.837583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3893e284-9598-4ed0-a759-08e115063807 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'create', calling method: .version_select at 0x7f71d8766280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1130225519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiG+NieD6BtuCmkvn8uoCENagQhK3MuFU+2fiaKVsqDOk1843l5aNgm85UYfqMi36NNqQfRAdBNXDe3RIMbo3JtCsbpm9GUZuhXGN6IYPPLfpsYU5QiJz1TAePRQhlFBw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:18.843749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=14 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:18.844412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=34 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:18.856174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3893e284-9598-4ed0-a759-08e115063807 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Getting quotas for project 88cbdbb95c5a4e6da81573597b657d2d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:05:18.861318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-3893e284-9598-4ed0-a759-08e115063807 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Getting quotas for user 83fefc61f7324655b972d0da38a89046 and project 88cbdbb95c5a4e6da81573597b657d2d. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:05:18.883561 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3893e284-9598-4ed0-a759-08e115063807 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050242 Oct 04 12:05:18.884158 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2175/6974] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:05:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:18.932273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:18.933021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:18.937805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-564710140", "imageRef": "8953316c-3de9-43b3-bf52-f2e49f4678f2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1130225519", "networks": [{"uuid": "41737fba-c3ec-44ba-a8fc-5dd540ce2a0c"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:18.991423 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] validate_networks() for [('41737fba-c3ec-44ba-a8fc-5dd540ce2a0c', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:05:19.366120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:05:19.366545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:05:19.367022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:05:19.367434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:05:19.367881 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:05:19.377198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:19.377723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:19.378163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:19.378888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:19.379350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:19.379780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:19.398179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Getting quotas for project 88cbdbb95c5a4e6da81573597b657d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:05:19.403492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Getting quotas for user 83fefc61f7324655b972d0da38a89046 and project 88cbdbb95c5a4e6da81573597b657d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:05:19.415637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:05:19.417927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8953316c-3de9-43b3-bf52-f2e49f4678f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:05:19.463373 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-89b0a2c9-3874-4649-953d-1632cdd303a4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533281 Oct 04 12:05:19.464034 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4800/6975] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:05:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:05:19.474891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-29fbd808-d045-4f9e-869b-19e06cb88ba2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:19.475516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-29fbd808-d045-4f9e-869b-19e06cb88ba2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:19.529839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-29fbd808-d045-4f9e-869b-19e06cb88ba2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:19.538580 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-29fbd808-d045-4f9e-869b-19e06cb88ba2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1258 microversion: 2.1 time: 0.067561 Oct 04 12:05:19.539149 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2176/6976] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:19 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:20.565818 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:20.566448 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:20.574079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:20.574570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:20.575301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:20.576201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:20.576693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:20.577091 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:20.650779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:20.658682 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db10b9a1-39e3-4d74-99ba-a1489726659f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1328 microversion: 2.1 time: 0.100722 Oct 04 12:05:20.659254 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4801/6977] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:20 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:21.682125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:21.684350 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:21.701830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:21.702349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:21.702804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:21.703537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:21.704056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:21.704620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:21.893613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:21.903212 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2feb24eb-ee25-4473-99b9-d1cec7c4e219 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.225289 Oct 04 12:05:21.903957 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2177/6978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:21 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:22.926446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:22.927098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:22.934201 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.934690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.935131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:22.935838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.936288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.936719 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:23.076496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:23.084660 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0fd060e2-e80f-42b8-b5ac-c87bc483cd1a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.162110 Oct 04 12:05:23.085468 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4802/6979] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:22 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:24.108067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:24.108689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:24.115692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:24.116213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:24.116754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:24.117446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:24.118054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:24.118535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:24.265582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:24.273223 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8624b729-96e5-4027-aca0-30a9c257c455 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.169627 Oct 04 12:05:24.273842 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2178/6980] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:24 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:25.296089 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:25.296707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:25.303534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:25.304015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:25.304682 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:25.305396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:25.305852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:25.306774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:25.459051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:25.467125 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-429a075d-b005-4036-9d5b-436afeaa47ee tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.174832 Oct 04 12:05:25.467707 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4803/6981] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:25 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:26.490345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:26.491006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:26.497859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:26.498354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:26.498799 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:26.499508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:26.499971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:26.500407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:26.650139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:26.658660 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1fa651d5-f588-4c51-bfa5-60aa4b92b741 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.172087 Oct 04 12:05:26.659271 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2179/6982] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:26 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:27.682200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:27.682816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:27.691303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:27.691799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:27.692356 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:27.693068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:27.693556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:27.693984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:27.849043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:27.857061 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b020adea-0ac4-42af-bcd8-5d13afa6ab6d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.178820 Oct 04 12:05:27.857734 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4804/6983] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:27 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:28.881806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:28.882367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:28.889967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:28.890460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:28.890905 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:28.891604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:28.892073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:28.892508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:29.024087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:29.031628 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-889e423f-393f-4c21-b56b-9770efd6bf7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.153911 Oct 04 12:05:29.032201 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2180/6984] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:28 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:30.055116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:30.055735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:30.059564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:30.060346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:30.066564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:30.067055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:30.067505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:30.068212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:30.068675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:30.069108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:30.201725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:30.209503 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-984bc354-75e5-4d61-9e11-440c530e492b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.158329 Oct 04 12:05:30.210072 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4805/6985] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:30 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:31.232620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:31.233367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:31.235486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:31.241488 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:31.241979 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:31.242422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:31.243126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:31.243592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:31.244036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:31.318585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-7887221e-700c-455d-a881-54cf7b5272f2 req-76d3b1f9-0d97-4da7-9e18-fa7d9164c2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9163bb41-eb50-4c84-aaa2-a25c9fe413fc", "tag": "3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:31.335078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7887221e-700c-455d-a881-54cf7b5272f2 req-76d3b1f9-0d97-4da7-9e18-fa7d9164c2c6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:31.335897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7887221e-700c-455d-a881-54cf7b5272f2 req-76d3b1f9-0d97-4da7-9e18-fa7d9164c2c6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:31.336715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-7887221e-700c-455d-a881-54cf7b5272f2 req-76d3b1f9-0d97-4da7-9e18-fa7d9164c2c6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:31.351433 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-7887221e-700c-455d-a881-54cf7b5272f2 req-76d3b1f9-0d97-4da7-9e18-fa7d9164c2c6 service nova] Creating event network-changed:3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f for instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc on n-h2-791135-8 Oct 04 12:05:31.357921 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-7887221e-700c-455d-a881-54cf7b5272f2 req-76d3b1f9-0d97-4da7-9e18-fa7d9164c2c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043776 Oct 04 12:05:31.358900 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4806/6986] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:31.382458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:31.391272 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f69b9b8-61f7-43ce-97c9-a5fa6ad25206 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.162404 Oct 04 12:05:31.397468 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2181/6987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:31 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:32.418886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:32.419587 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:32.425773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:32.426257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:32.426692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:32.427388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:32.427844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:32.428271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:32.556111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:32.564099 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1bd8dbaa-16f5-4845-8e0e-10138a43300e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.150959 Oct 04 12:05:32.564672 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4807/6988] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:32 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:33.586601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:33.587220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:33.594463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:33.594957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:33.595399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:33.596091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:33.596556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:33.596985 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:33.723321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:33.730844 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99cd824d-b4e8-4718-a98b-af77755ab214 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.148126 Oct 04 12:05:33.731422 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2182/6989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:33 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:34.753933 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:34.754549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:34.761166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:34.761674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:34.762108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:34.762801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:34.763520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:34.763946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:34.897512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:34.905743 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-65c9b86c-c59a-4e89-b1fc-4680e3310aa0 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.155833 Oct 04 12:05:34.906319 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4808/6990] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:34 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:35.928971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:35.929630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:35.936410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:35.936932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:35.937381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:35.938086 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:35.938560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:35.939000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:36.074915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:36.082415 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-702fb572-bea7-497e-b73b-4882c54a6bf6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.157397 Oct 04 12:05:36.082994 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2183/6991] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:35 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:36.625620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d64db3ff-6c45-4347-ad7b-8377ea754e24 req-c1727b35-524a-4732-8eef-d897a9210d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9163bb41-eb50-4c84-aaa2-a25c9fe413fc", "name": "network-vif-plugged", "status": "completed", "tag": "3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:36.636458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d64db3ff-6c45-4347-ad7b-8377ea754e24 req-c1727b35-524a-4732-8eef-d897a9210d13 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:36.636946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d64db3ff-6c45-4347-ad7b-8377ea754e24 req-c1727b35-524a-4732-8eef-d897a9210d13 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:36.637419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d64db3ff-6c45-4347-ad7b-8377ea754e24 req-c1727b35-524a-4732-8eef-d897a9210d13 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:36.648777 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d64db3ff-6c45-4347-ad7b-8377ea754e24 req-c1727b35-524a-4732-8eef-d897a9210d13 service nova] Creating event network-vif-plugged:3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f for instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc on n-h2-791135-8 Oct 04 12:05:36.653624 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d64db3ff-6c45-4347-ad7b-8377ea754e24 req-c1727b35-524a-4732-8eef-d897a9210d13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Oct 04 12:05:36.654237 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4809/6992] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:05:37.106206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:37.106776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:37.113835 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:37.114333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:37.114779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:37.115486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:37.115955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:37.116402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:37.245700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:37.261021 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b34b713e-6dbc-4956-9704-04c9c6aca08d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1358 microversion: 2.1 time: 0.159398 Oct 04 12:05:37.261868 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2184/6993] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:37 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:38.285470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:38.286200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:38.292982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.293487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.293924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.294611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.295065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.295490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.423036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:38.430769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae3bd9b7-c7e6-4a40-ac48-41e8904b5df2 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1547 microversion: 2.1 time: 0.150402 Oct 04 12:05:38.431334 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4810/6994] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:38 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:38.452502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:38.453119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:38.459819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.460309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.460751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.461474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.461936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.462904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.595031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:38.602719 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a792326f-76d5-431c-95c3-cce76b92c06e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1547 microversion: 2.1 time: 0.154084 Oct 04 12:05:38.603854 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2185/6995] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:38 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:38.624523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:38.629136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:38.629931 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Searching by: {'deleted': False, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 12:05:38.635673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.636147 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.636577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.637290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.637763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.638430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.662484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 12:05:38.688320 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8f58b93c-e5d5-4d92-b20c-9051680e59c4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067592 Oct 04 12:05:38.688891 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4811/6996] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 12:05:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:38.700733 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:38.701371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:38.707212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.707704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.708150 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.708850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.709313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.709773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.834403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:38.842698 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-da87419b-5249-4853-bdcc-ef5ead14f6bc tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1547 microversion: 2.1 time: 0.146257 Oct 04 12:05:38.843268 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2186/6997] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:38 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:40.378560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b0603d7-5fea-4203-a997-f4b0706e302c"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:40.380913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:40.387346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:40.387831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:40.388538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:40.389221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:40.389706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:40.390134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:40.642057 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-977935b7-97d2-4b31-b1c4-67e37adce50a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267246 Oct 04 12:05:40.642908 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4812/6998] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 12:05:40 2022] POST /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:53.694536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:53.695155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:53.698986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:53.699223 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=60 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:53.704677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.705168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:53.705634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:53.706340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.706802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:53.707231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:53.834709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:53.843473 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b228b42b-97c0-43fd-9382-8b29d09ae28f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1593 microversion: 2.1 time: 0.152735 Oct 04 12:05:53.844044 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2187/6999] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:53 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:55.502012 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:55.503433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:55.504392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:55.652118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-07ba2b64-08f0-450f-a105-edbd9afcadfc req-7c9f7cbb-1f74-42a9-ac12-92db4514b522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9163bb41-eb50-4c84-aaa2-a25c9fe413fc", "tag": "3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:55.662314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-07ba2b64-08f0-450f-a105-edbd9afcadfc req-7c9f7cbb-1f74-42a9-ac12-92db4514b522 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.662801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-07ba2b64-08f0-450f-a105-edbd9afcadfc req-7c9f7cbb-1f74-42a9-ac12-92db4514b522 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.663234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-07ba2b64-08f0-450f-a105-edbd9afcadfc req-7c9f7cbb-1f74-42a9-ac12-92db4514b522 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.679630 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-07ba2b64-08f0-450f-a105-edbd9afcadfc req-7c9f7cbb-1f74-42a9-ac12-92db4514b522 service nova] Creating event network-changed:3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f for instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc on n-h2-791135-8 Oct 04 12:05:55.695128 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-07ba2b64-08f0-450f-a105-edbd9afcadfc req-7c9f7cbb-1f74-42a9-ac12-92db4514b522 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198684 Oct 04 12:05:55.695815 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4813/7000] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:56.515476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-843185252"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:56.516272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:56.523201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.523776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.524297 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.525075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.526235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.526746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.672731 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Adding security group 3a7a5a99-75f1-4a72-af20-947961242428 to port 3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f Oct 04 12:05:56.982679 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a0777f5-f35d-4a12-9f38-28641f7a1368 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/action" status: 202 len: 0 microversion: 2.1 time: 0.471394 Oct 04 12:05:56.983321 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2188/7001] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:05:56 2022] POST /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:05:56.993129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:56.993905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:57.000945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:57.001474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:57.001998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:57.002930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:57.003478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:57.004030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:57.152314 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:57.160694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c60564ef-e8b4-48ac-8e80-815c21a89366 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1757 microversion: 2.1 time: 0.172748 Oct 04 12:05:57.161268 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4814/7002] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:56 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:57.713974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-93926454-8659-479a-8350-36d99b2207a7 req-d7c131af-a3f3-4665-8ad5-852456980c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9163bb41-eb50-4c84-aaa2-a25c9fe413fc", "tag": "3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:57.723180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-93926454-8659-479a-8350-36d99b2207a7 req-d7c131af-a3f3-4665-8ad5-852456980c56 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:57.723658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-93926454-8659-479a-8350-36d99b2207a7 req-d7c131af-a3f3-4665-8ad5-852456980c56 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:57.724091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-93926454-8659-479a-8350-36d99b2207a7 req-d7c131af-a3f3-4665-8ad5-852456980c56 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:57.735354 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-93926454-8659-479a-8350-36d99b2207a7 req-d7c131af-a3f3-4665-8ad5-852456980c56 service nova] Creating event network-changed:3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f for instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc on n-h2-791135-8 Oct 04 12:05:57.740652 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-93926454-8659-479a-8350-36d99b2207a7 req-d7c131af-a3f3-4665-8ad5-852456980c56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031623 Oct 04 12:05:57.741260 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2189/7003] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:08:18.397885 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8829bdcc-210e-40a3-b2af-6ede6e7ff32d] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:08:18.398875 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b0aa98c-d914-4893-9124-de6a30c783e0] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:08:18.399361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:18.400230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:18.401206 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:08:18.401415 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/action (ip 10.222.0.23) !!! Oct 04 12:08:18.402290 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:08:18.402437 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/action (ip 10.222.0.23) !!! Oct 04 12:08:18.408708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:18.411009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:18.420203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:18.420690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:18.421125 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:18.421840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:18.422295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:18.422722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:18.496262 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3c8196b0-53a2-4b99-b10b-4d57e3931057 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/action" status: 202 len: 0 microversion: 2.1 time: 0.100214 Oct 04 12:08:18.496950 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4815/7004] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:08:18 2022] POST /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:08:18.504067 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e9dfef3-0453-479e-ab86-c91297e9b462] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:08:18.504890 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43145c0f-38f9-443d-929f-16a90ce4e841] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:08:18.505484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:18.506226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:18.507146 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:08:18.507267 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc (ip 10.222.0.23) !!! Oct 04 12:08:18.509652 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:08:18.509793 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc (ip 10.222.0.23) !!! Oct 04 12:08:18.524349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:18.525054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:18.536455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:18.536944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:18.537415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:18.538158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:18.538626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:18.539074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:18.766006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:18.774329 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-07c59730-b346-4850-ae2f-b26fca7d4d37 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1759 microversion: 2.1 time: 0.272357 Oct 04 12:08:18.774908 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2190/7005] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:18 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1759 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:19.799135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:19.799841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:19.810626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:19.811114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:19.811549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:19.812286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:19.812696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:19.813122 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:19.818397 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] [8829bdcc-210e-40a3-b2af-6ede6e7ff32d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36396. Oct 04 12:08:19.820632 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b0aa98c-d914-4893-9124-de6a30c783e0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36398. Oct 04 12:08:20.003834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:20.012010 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-83b2a1c4-0283-4408-9558-da02dab8ba17 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1764 microversion: 2.1 time: 0.217191 Oct 04 12:08:20.012575 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4816/7006] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:19 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1764 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:21.035478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:21.036092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:21.050724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:21.051225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:21.051676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:21.052408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:21.052873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:21.053308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:21.059792 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e9dfef3-0453-479e-ab86-c91297e9b462] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36404. Oct 04 12:08:21.060501 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [43145c0f-38f9-443d-929f-16a90ce4e841] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36406. Oct 04 12:08:21.199886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:21.208114 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-737d4ef1-6a20-430f-8f17-f54e90938e8d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1764 microversion: 2.1 time: 0.176521 Oct 04 12:08:21.208683 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2191/7007] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:21 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1764 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:22.230873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:22.231605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:22.238396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:22.238880 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:22.239317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:22.240009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:22.240465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:22.240897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:22.385655 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:22.394803 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6188b4a-8649-416f-85da-1f556f61bd68 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1764 microversion: 2.1 time: 0.167848 Oct 04 12:08:22.395376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4817/7008] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:22 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1764 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:23.417485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:23.418108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:23.425545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:23.426042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:23.426489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:23.427189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:23.427654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:23.428094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:23.571901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:23.580600 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f832f980-cbb6-4ccc-b9a5-5f8338272089 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1764 microversion: 2.1 time: 0.166993 Oct 04 12:08:23.581192 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2192/7009] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:23 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1764 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:24.604179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:24.604832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:24.612294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:24.612780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:24.613221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:24.613954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:24.614416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:24.614847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:24.794758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:24.804212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b4f32645-3fd5-4636-a858-402392e4a7e7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1764 microversion: 2.1 time: 0.203974 Oct 04 12:08:24.804801 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4818/7010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:24 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1764 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:25.828942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:25.829532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:25.836384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:25.836882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:25.837326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:25.838062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:25.838532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:25.838971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:25.982582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:25.990691 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-95afb11b-47ba-4c6c-991c-5d5b0eb22a7f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1757 microversion: 2.1 time: 0.166206 Oct 04 12:08:25.991261 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2193/7011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:25 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:58.431807 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:58.432564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:58.437700 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-843185252"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:58.438231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:58.445654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:58.446133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:58.446566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:58.447243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:58.447692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:58.448114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:58.875218 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.network.security_group_api [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Removing security group 3a7a5a99-75f1-4a72-af20-947961242428 from port 3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f Oct 04 12:09:59.174809 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-774ac453-c880-4bb4-878b-ca7d44d1d03d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/action" status: 202 len: 0 microversion: 2.1 time: 0.744970 Oct 04 12:09:59.175514 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4819/7012] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:09:58 2022] POST /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:09:59.181553 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=8 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:59.182576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=24 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:59.183519 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:09:59.183653 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 04 12:09:59.302963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9ce6f13c-224f-4ea1-8813-ee79dd39f15d req-da5ebfb6-7e32-479f-9573-f8a3b3267aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9163bb41-eb50-4c84-aaa2-a25c9fe413fc", "tag": "3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:59.313590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ce6f13c-224f-4ea1-8813-ee79dd39f15d req-da5ebfb6-7e32-479f-9573-f8a3b3267aab service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:59.313983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ce6f13c-224f-4ea1-8813-ee79dd39f15d req-da5ebfb6-7e32-479f-9573-f8a3b3267aab service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:59.314497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9ce6f13c-224f-4ea1-8813-ee79dd39f15d req-da5ebfb6-7e32-479f-9573-f8a3b3267aab service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:59.328720 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9ce6f13c-224f-4ea1-8813-ee79dd39f15d req-da5ebfb6-7e32-479f-9573-f8a3b3267aab service nova] Creating event network-changed:3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f for instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc on n-h2-791135-8 Oct 04 12:09:59.338590 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9ce6f13c-224f-4ea1-8813-ee79dd39f15d req-da5ebfb6-7e32-479f-9573-f8a3b3267aab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159278 Oct 04 12:09:59.339391 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2194/7013] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:00.610024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:00.610543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:00.616391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:00.616870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:00.617417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:00.618106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:00.618560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:00.618981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:00.699917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lazy-loading 'services' on Instance uuid 9163bb41-eb50-4c84-aaa2-a25c9fe413fc {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:00.770803 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f5bc1175-21d9-4f2b-beae-02ae3691bedb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments/9b0603d7-5fea-4203-a997-f4b0706e302c" status: 202 len: 0 microversion: 2.1 time: 0.166069 Oct 04 12:10:00.771408 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4820/7014] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:10:00 2022] DELETE /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments/9b0603d7-5fea-4203-a997-f4b0706e302c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:10:00.782713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:00.785049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:00.795417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:00.796018 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:00.796998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:00.797824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:00.798523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:00.799032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:00.835924 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bcad6a23-4540-46e4-a991-4a22f3fc34b4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058459 Oct 04 12:10:00.841326 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2195/7015] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:00 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:01.355454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-65c22de6-f628-483e-be7e-afbc32c7565f req-d83d23b6-6d78-4d78-b739-935eee6a056e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9163bb41-eb50-4c84-aaa2-a25c9fe413fc", "tag": "3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:01.366935 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-65c22de6-f628-483e-be7e-afbc32c7565f req-d83d23b6-6d78-4d78-b739-935eee6a056e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:01.367335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-65c22de6-f628-483e-be7e-afbc32c7565f req-d83d23b6-6d78-4d78-b739-935eee6a056e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:01.367772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-65c22de6-f628-483e-be7e-afbc32c7565f req-d83d23b6-6d78-4d78-b739-935eee6a056e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:01.382680 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-65c22de6-f628-483e-be7e-afbc32c7565f req-d83d23b6-6d78-4d78-b739-935eee6a056e service nova] Creating event network-changed:3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f for instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc on n-h2-791135-8 Oct 04 12:10:01.388489 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-65c22de6-f628-483e-be7e-afbc32c7565f req-d83d23b6-6d78-4d78-b739-935eee6a056e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037023 Oct 04 12:10:01.389384 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4821/7016] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:01.848925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:01.852212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:01.859331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:01.859950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:01.860502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:01.861333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:01.861918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:01.862455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:01.895621 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-81605b5c-ac92-4c41-951f-83d8b8534a4f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050595 Oct 04 12:10:01.896843 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2196/7017] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:01 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:02.910630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:02.913004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:02.919994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:02.920488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:02.920927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:02.922748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:02.923234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:02.923649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:02.956626 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9f36f638-e781-4c53-9119-e2c364dbdb9f tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051958 Oct 04 12:10:02.961364 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4822/7018] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:02 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:03.969316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:03.971485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:03.978242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:03.978728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:03.979169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:03.979859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:03.980314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:03.980742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:04.010490 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fdd0d3de-3e76-4b4a-9376-12a7b3a06275 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Oct 04 12:10:04.011382 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2197/7019] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:03 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:05.022761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:05.024944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:05.031766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:05.032250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:05.032691 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:05.033406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:05.033866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:05.034294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:05.064739 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-94c63367-e396-480b-80a8-6c4c429131fb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046010 Oct 04 12:10:05.065319 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4823/7020] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:05 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:06.077159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:06.079790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:06.086484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:06.086974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:06.087412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:06.088100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:06.088556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:06.088983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:06.117751 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b885f8d3-9751-494f-a936-c14fd72b7a25 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044578 Oct 04 12:10:06.118316 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2198/7021] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:06 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:10:06.128837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:06.129327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:06.136098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:06.136578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:06.137017 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:06.137733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:06.138194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:06.138618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:06.213622 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] HTTP exception thrown: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc is not attached to volume 9b0603d7-5fea-4203-a997-f4b0706e302c Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Request method failure captured: Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: request: DELETE /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments/9b0603d7-5fea-4203-a997-f4b0706e302c HTTP/1.1 Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCFwoUFG6nwGtlbd3H1SMndAvXE_P9heFyDG0EVAFdIwbS7VvS_2f8ZNoNmySa2aMo3T9QLQSFZqGvkfmfbEP9awSC8B2MVkqX0V_8NE3ZU3FWJRH5E1DzAHh9MFzSxipHhpHRF-dO9nvPuSq4vYRES4jbQ4x4X-6dG-EWPeY1e48qo Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 88cbdbb95c5a4e6da81573597b657d2d Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88cbdbb95c5a4e6da81573597b657d2d"}]}] Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 88cbdbb95c5a4e6da81573597b657d2d Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestMinimumBasicScenario-1296152478-project Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 83fefc61f7324655b972d0da38a89046 Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestMinimumBasicScenario-1296152478-project Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc is not attached to volume 9b0603d7-5fea-4203-a997-f4b0706e302c Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'server_id': '9163bb41-eb50-4c84-aaa2-a25c9fe413fc', 'id': '9b0603d7-5fea-4203-a997-f4b0706e302c'} Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9b0603d7-5fea-4203-a997-f4b0706e302c. Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc is not attached to volume 9b0603d7-5fea-4203-a997-f4b0706e302c Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:06.215220 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:06.220577 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:06.220577 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:06.220577 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc is not attached to volume 9b0603d7-5fea-4203-a997-f4b0706e302c Oct 04 12:10:06.220577 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:06.220577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Returning 404 to user: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc is not attached to volume 9b0603d7-5fea-4203-a997-f4b0706e302c {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:06.220577 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9a0bd1bd-b529-4772-a188-07987925c4df tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments/9b0603d7-5fea-4203-a997-f4b0706e302c" status: 404 len: 154 microversion: 2.1 time: 0.091802 Oct 04 12:10:06.220577 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4824/7022] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:10:06 2022] DELETE /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc/os-volume_attachments/9b0603d7-5fea-4203-a997-f4b0706e302c => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:10:09.591509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:09.592180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:09.599694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:09.600238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:09.600685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:09.601596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:09.602062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:09.602498 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:09.629967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:10:09.706554 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e8f2981-2c1c-41fb-8166-61f2312c8285 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 204 len: 0 microversion: 2.1 time: 0.118874 Oct 04 12:10:09.707239 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2199/7023] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:10:09 2022] DELETE /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:10:09.715571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:09.716185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:09.724291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:09.724778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:09.725253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:09.725984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:09.726436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:09.726863 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:09.864098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:09.872072 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-189a7845-d1e2-4296-b41c-9a1c3f37b6ff tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1553 microversion: 2.1 time: 0.160363 Oct 04 12:10:09.872643 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4825/7024] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:09 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:10.895935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:10.896563 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:10.903375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:10.903865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:10.904309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:10.905021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:10.906022 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:10.906480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:11.039117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:11.047662 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a1253ff-cfa3-4610-86b6-f5d2b73898e6 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1553 microversion: 2.1 time: 0.156124 Oct 04 12:10:11.048225 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2200/7025] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:10 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:12.006257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-47f6dc04-a3e5-4a33-8a68-4a0fa65a3a40 req-20bc0bbc-ea3e-4d23-9736-6af12d5f8a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9163bb41-eb50-4c84-aaa2-a25c9fe413fc", "name": "network-vif-deleted", "tag": "3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:12.018006 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-47f6dc04-a3e5-4a33-8a68-4a0fa65a3a40 req-20bc0bbc-ea3e-4d23-9736-6af12d5f8a9e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:12.018484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-47f6dc04-a3e5-4a33-8a68-4a0fa65a3a40 req-20bc0bbc-ea3e-4d23-9736-6af12d5f8a9e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:12.018968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-47f6dc04-a3e5-4a33-8a68-4a0fa65a3a40 req-20bc0bbc-ea3e-4d23-9736-6af12d5f8a9e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:12.030845 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-47f6dc04-a3e5-4a33-8a68-4a0fa65a3a40 req-20bc0bbc-ea3e-4d23-9736-6af12d5f8a9e service nova] Creating event network-vif-deleted:3125ab9b-ea3e-4ce1-a650-a7ccb1ca118f for instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc on n-h2-791135-8 Oct 04 12:10:12.036353 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-47f6dc04-a3e5-4a33-8a68-4a0fa65a3a40 req-20bc0bbc-ea3e-4d23-9736-6af12d5f8a9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Oct 04 12:10:12.036943 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4826/7026] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:12.072257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:12.073085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:12.080619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:12.081114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:12.081798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:12.082514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:12.083011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:12.083452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:12.148920 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:12.157011 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c86dfff7-dc6a-41af-b5fd-c398a7c6b5c5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 200 len: 1343 microversion: 2.1 time: 0.089921 Oct 04 12:10:12.157815 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2201/7027] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:12 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 1343 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:13.182957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:13.183649 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 9163bb41-eb50-4c84-aaa2-a25c9fe413fc] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:13.189854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:13.190332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:13.190761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:13.191438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:13.191884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:13.192304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:13.205372 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] HTTP exception thrown: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc could not be found. Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Request method failure captured: Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc HTTP/1.1 Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCFwoUFG6nwGtlbd3H1SMndAvXE_P9heFyDG0EVAFdIwbS7VvS_2f8ZNoNmySa2aMo3T9QLQSFZqGvkfmfbEP9awSC8B2MVkqX0V_8NE3ZU3FWJRH5E1DzAHh9MFzSxipHhpHRF-dO9nvPuSq4vYRES4jbQ4x4X-6dG-EWPeY1e48qo Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 88cbdbb95c5a4e6da81573597b657d2d Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88cbdbb95c5a4e6da81573597b657d2d"}]}] Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 88cbdbb95c5a4e6da81573597b657d2d Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestMinimumBasicScenario-1296152478-project Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 83fefc61f7324655b972d0da38a89046 Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestMinimumBasicScenario-1296152478-project Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc could not be found. Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '9163bb41-eb50-4c84-aaa2-a25c9fe413fc'} Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc could not be found. Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc could not be found. Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:13.206951 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc could not be found. Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Returning 404 to user: Instance 9163bb41-eb50-4c84-aaa2-a25c9fe413fc could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-319e4999-d339-4c54-bdcf-c71d8f883ce7 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc" status: 404 len: 111 microversion: 2.1 time: 0.030596 Oct 04 12:10:13.212256 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4827/7028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:13 2022] GET /compute/v2.1/servers/9163bb41-eb50-4c84-aaa2-a25c9fe413fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:10:13.216887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9ed561fc-6fbe-4556-99f5-a57f66538a84 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '.version_select at 0x7f71cc5c19d0>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:13.240943 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9ed561fc-6fbe-4556-99f5-a57f66538a84 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1130225519" status: 202 len: 0 microversion: 2.1 time: 0.027710 Oct 04 12:10:13.241685 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2202/7029] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 4 12:10:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1130225519 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:10:22.345540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-daf94068-6170-44c2-986f-5921f1d50794 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'create', calling method: .version_select at 0x7f71cefd9ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-400650376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQCv3yfH35OIlLfoxoxdALdgkOB+EQysNnJ2wi0teauPNma/Kpw1R1r9dS9n9Xwyc0LxTg0BdZFY5je64uqiKAYsKXpuV3+I6uR8eprwJMyXpH0p/P3fuaRHGma1Zn6SA=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:22.361124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-daf94068-6170-44c2-986f-5921f1d50794 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Getting quotas for project 88cbdbb95c5a4e6da81573597b657d2d. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:10:22.366145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-daf94068-6170-44c2-986f-5921f1d50794 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Getting quotas for user 83fefc61f7324655b972d0da38a89046 and project 88cbdbb95c5a4e6da81573597b657d2d. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:10:22.393077 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-daf94068-6170-44c2-986f-5921f1d50794 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052016 Oct 04 12:10:22.393645 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4828/7030] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:10:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:22.439972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:22.444040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1412427819", "imageRef": "327a8a55-dc11-48bf-a96b-bbe605f27774", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-400650376", "networks": [{"uuid": "41737fba-c3ec-44ba-a8fc-5dd540ce2a0c"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:22.495618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] validate_networks() for [('41737fba-c3ec-44ba-a8fc-5dd540ce2a0c', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:10:22.916533 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:10:22.917000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:10:22.917531 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:10:22.917955 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:10:22.918377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:10:22.927629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:22.928066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:22.928513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:22.929274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:22.929762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:22.930198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:22.948042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Getting quotas for project 88cbdbb95c5a4e6da81573597b657d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:10:22.953231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Getting quotas for user 83fefc61f7324655b972d0da38a89046 and project 88cbdbb95c5a4e6da81573597b657d2d. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:10:22.965391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:10:22.967769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='327a8a55-dc11-48bf-a96b-bbe605f27774',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:10:23.015852 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa29bb72-113f-4765-b17b-de7850fd031a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577657 Oct 04 12:10:23.016502 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2203/7031] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:10:23.027347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c9bc968c-b345-4440-be77-88ec65fdfa6b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:23.027963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c9bc968c-b345-4440-be77-88ec65fdfa6b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:23.085869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c9bc968c-b345-4440-be77-88ec65fdfa6b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:23.092716 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c9bc968c-b345-4440-be77-88ec65fdfa6b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1258 microversion: 2.1 time: 0.069214 Oct 04 12:10:23.093328 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4829/7032] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:23 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:24.117152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:24.117725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:24.125732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:24.126376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:24.126673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:24.127384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:24.127848 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:24.128315 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:24.193225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:24.201212 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-13dba4bf-4b78-47a1-883c-2cbe39d13442 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1318 microversion: 2.1 time: 0.088857 Oct 04 12:10:24.202879 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2204/7033] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:24 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:25.224716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:25.225262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:25.227322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:25.235226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:25.235789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:25.236229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:25.236939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:25.237410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:25.237837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:25.378317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:25.390307 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e56812a7-51ae-4685-ac59-3b26c2b5210e tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.169128 Oct 04 12:10:25.390910 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4830/7034] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:25 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:26.414392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:26.415121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:26.422433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:26.423063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:26.423654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:26.424376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:26.424845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:26.425280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:26.584694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:26.593333 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ba2b4afa-b170-4feb-a0ab-cc212cb97707 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.182845 Oct 04 12:10:26.594143 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2205/7035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:26 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:27.616433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:27.617050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:27.624840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:27.625634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:27.626081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:27.626802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:27.627573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:27.628128 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:27.775568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:27.793485 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6cae3e11-4600-4f89-b7a6-514427c5524b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.173670 Oct 04 12:10:27.793485 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4831/7036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:27 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:28.809842 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:28.810625 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:28.817952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:28.818737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:28.819293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:28.820144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:28.820723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:28.821267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:28.962465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:28.971694 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2090be48-ebe6-4083-a591-cbfc66c30f46 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.165910 Oct 04 12:10:28.972385 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2206/7037] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:28 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:29.994538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:29.995130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:29.997907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:30.004021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:30.004461 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:30.004897 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:30.005628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:30.006082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:30.006669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:30.180198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:30.188790 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6185b252-4954-4188-b689-3020c1024227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.198023 Oct 04 12:10:30.201928 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4832/7038] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:29 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:31.213439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:31.214069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:31.216756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:31.222127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:31.222627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:31.223078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:31.223790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:31.224260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:31.224703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:31.363472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:31.371414 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-137cb97a-b3eb-418c-820b-b93348265f13 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.161933 Oct 04 12:10:31.371980 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2207/7039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:31 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:32.395805 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:32.396420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:32.403440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:32.403925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:32.404366 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:32.405054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:32.405537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:32.405967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:32.535436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:32.543223 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c0fe4364-b0ee-42f2-897d-c6192c1a20a5 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.151301 Oct 04 12:10:32.543803 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4833/7040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:32 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:33.565656 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:33.566211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:33.569946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:33.570815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:33.575202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:33.575700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:33.576147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:33.576854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:33.577322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:33.577784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:33.711956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:33.720464 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5bb6c7d0-3ef7-4f88-917b-858667c59767 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.158744 Oct 04 12:10:33.721045 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2208/7041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:33 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:34.157688 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-be851070-9515-4c67-a16b-19003cb79618 req-1b3c1bab-6efa-4cc9-811c-a5576a0ccb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a350dc6-150c-4366-bc04-c1f154710703", "tag": "41fd33dc-c741-41ee-84d2-0c6972219377"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:34.162672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:34.169686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-be851070-9515-4c67-a16b-19003cb79618 req-1b3c1bab-6efa-4cc9-811c-a5576a0ccb1a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:34.170171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-be851070-9515-4c67-a16b-19003cb79618 req-1b3c1bab-6efa-4cc9-811c-a5576a0ccb1a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:34.170606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-be851070-9515-4c67-a16b-19003cb79618 req-1b3c1bab-6efa-4cc9-811c-a5576a0ccb1a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:34.182610 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-be851070-9515-4c67-a16b-19003cb79618 req-1b3c1bab-6efa-4cc9-811c-a5576a0ccb1a service nova] Creating event network-changed:41fd33dc-c741-41ee-84d2-0c6972219377 for instance 8a350dc6-150c-4366-bc04-c1f154710703 on n-h2-791135-8 Oct 04 12:10:34.188360 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-be851070-9515-4c67-a16b-19003cb79618 req-1b3c1bab-6efa-4cc9-811c-a5576a0ccb1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034462 Oct 04 12:10:34.188986 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4834/7042] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:34.742943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:34.743525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:34.750218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:34.750705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:34.751147 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:34.751837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:34.752294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:34.752726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:34.878888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:34.886730 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9db8c1db-13c2-4618-a7fe-7ee379f8a333 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.147750 Oct 04 12:10:34.887299 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2209/7043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:34 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:35.911321 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:35.912030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:35.918262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:35.918746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:35.919186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:35.919873 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:35.920341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:35.920755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:36.053906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:36.061566 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9b6c4971-70cf-4381-b273-ecfe95e3b450 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.155450 Oct 04 12:10:36.062149 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4835/7044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:35 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:37.084939 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:37.085535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:37.092663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:37.093166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:37.093643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:37.094364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:37.094872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:37.095907 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:37.235265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:37.243475 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6880e36-e581-4078-b948-11701f0dfaf1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.162540 Oct 04 12:10:37.244070 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2210/7045] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:37 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:38.267256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:38.267870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:38.274690 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:38.275168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:38.275598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:38.276278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:38.276727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:38.277152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:38.404645 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:38.413512 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc13a71c-1030-4fd1-ad45-5766ff29e254 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.151073 Oct 04 12:10:38.414173 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4836/7046] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:38 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:39.436027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:39.436659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:39.443461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:39.443952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:39.444399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:39.445099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:39.445592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:39.446032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:39.575516 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:39.583675 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-18c19263-f0bb-42bd-ab89-8135bcdba60b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.151458 Oct 04 12:10:39.584207 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2211/7047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:39 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:40.607993 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:40.608632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:40.615963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:40.616446 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:40.616878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:40.617631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:40.618081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:40.618502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:40.770774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:40.778450 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1df1ade6-8d7c-4858-a385-49ffe9c7f8ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.175053 Oct 04 12:10:40.779040 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4837/7048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:40 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:41.801084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:41.801737 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:41.808483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:41.809004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:41.809480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:41.810191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:41.810655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:41.811093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:41.948105 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:41.956278 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-31c703b0-3f2d-4d7d-8ca2-da46f7a33c89 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.159178 Oct 04 12:10:41.956850 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2212/7049] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:41 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:42.180541 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-14d1b28f-af5f-4733-aeda-e299e8008f5d req-591d3c05-62f8-4ce2-8117-12dadc80c723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a350dc6-150c-4366-bc04-c1f154710703", "name": "network-vif-plugged", "status": "completed", "tag": "41fd33dc-c741-41ee-84d2-0c6972219377"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:42.190976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-14d1b28f-af5f-4733-aeda-e299e8008f5d req-591d3c05-62f8-4ce2-8117-12dadc80c723 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:42.191489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-14d1b28f-af5f-4733-aeda-e299e8008f5d req-591d3c05-62f8-4ce2-8117-12dadc80c723 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:42.191924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-14d1b28f-af5f-4733-aeda-e299e8008f5d req-591d3c05-62f8-4ce2-8117-12dadc80c723 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:42.203089 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-14d1b28f-af5f-4733-aeda-e299e8008f5d req-591d3c05-62f8-4ce2-8117-12dadc80c723 service nova] Creating event network-vif-plugged:41fd33dc-c741-41ee-84d2-0c6972219377 for instance 8a350dc6-150c-4366-bc04-c1f154710703 on n-h2-791135-8 Oct 04 12:10:42.208139 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-14d1b28f-af5f-4733-aeda-e299e8008f5d req-591d3c05-62f8-4ce2-8117-12dadc80c723 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087604 Oct 04 12:10:42.208751 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4838/7050] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:42.978913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:42.979637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:42.986906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:42.987393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:42.987834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:42.988556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:42.989014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:42.989474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:43.116065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:43.123580 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1923bf8a-032e-4fa5-bcd6-ad9ad4e94227 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1358 microversion: 2.1 time: 0.148554 Oct 04 12:10:43.124150 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2213/7051] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:42 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:44.148838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:44.149459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:44.155919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:44.156402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:44.156842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:44.157569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:44.158023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:44.158452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:44.289154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:44.297095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b96b4640-ddfa-4b71-ab85-f6169120ca21 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1547 microversion: 2.1 time: 0.153549 Oct 04 12:10:44.297694 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4839/7052] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:44 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:44.320328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:44.321055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:44.327962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:44.328453 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:44.328989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:44.329723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:44.330189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:44.330622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:44.457383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:44.465078 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de8916b0-3b32-45f8-8735-797afdbb23bd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1547 microversion: 2.1 time: 0.148596 Oct 04 12:10:44.465720 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2214/7053] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:44 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:44.487021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:44.491765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:44.492530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Searching by: {'deleted': False, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d'} {{(pid=122409) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 12:10:44.497806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:44.498310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:44.498733 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:44.499458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:44.499918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:44.500348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:44.524181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.multi_cell_list [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 12:10:44.551322 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1efa7eb5-c111-49cc-83f2-9b19f7282394 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068537 Oct 04 12:10:44.551910 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4840/7054] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 4 12:10:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:44.564241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:44.564895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:44.570760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:44.571248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:44.571686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:44.572377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:44.572844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:44.573274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:44.981142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:44.989426 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62e568cb-e307-4624-b173-c0595b5c7d01 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1547 microversion: 2.1 time: 0.429648 Oct 04 12:10:44.990021 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2215/7055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:44 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1547 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:46.492748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae54d986-ca43-40a2-b659-544f9e4b6814"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:46.495123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:46.502372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:46.502851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:46.503286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:46.503998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:46.504447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:46.504869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:46.761699 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f60b2ca1-f005-43f0-a1e3-d6f3f0947ddb tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272697 Oct 04 12:10:46.762323 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4841/7056] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 4 12:10:46 2022] POST /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:57.521577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:57.522192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:57.524524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=17 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:57.525294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=74 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:57.530567 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:57.531055 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:57.531497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:57.532190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:57.532654 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:57.533216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:57.660145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:57.668196 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a23cfcdc-3ee1-466e-a357-471b9b5eab16 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1593 microversion: 2.1 time: 0.150380 Oct 04 12:10:57.668770 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2216/7057] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:57 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1593 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:59.285620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-ac60af1c-c9cc-4fd5-9d35-ca0d8a6fec73 req-0f291382-1b7a-4459-ac9e-9230c4b1b3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a350dc6-150c-4366-bc04-c1f154710703", "tag": "41fd33dc-c741-41ee-84d2-0c6972219377"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:59.292129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:59.293035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=19 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:59.293778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:59.302084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ac60af1c-c9cc-4fd5-9d35-ca0d8a6fec73 req-0f291382-1b7a-4459-ac9e-9230c4b1b3d3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:59.302692 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ac60af1c-c9cc-4fd5-9d35-ca0d8a6fec73 req-0f291382-1b7a-4459-ac9e-9230c4b1b3d3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:59.303194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-ac60af1c-c9cc-4fd5-9d35-ca0d8a6fec73 req-0f291382-1b7a-4459-ac9e-9230c4b1b3d3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:59.316430 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-ac60af1c-c9cc-4fd5-9d35-ca0d8a6fec73 req-0f291382-1b7a-4459-ac9e-9230c4b1b3d3 service nova] Creating event network-changed:41fd33dc-c741-41ee-84d2-0c6972219377 for instance 8a350dc6-150c-4366-bc04-c1f154710703 on n-h2-791135-8 Oct 04 12:10:59.322126 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-ac60af1c-c9cc-4fd5-9d35-ca0d8a6fec73 req-0f291382-1b7a-4459-ac9e-9230c4b1b3d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041244 Oct 04 12:10:59.322748 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4842/7058] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:00.519978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-329585636"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:11:00.520528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:00.527684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:00.528239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:00.528687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:00.529430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:00.529903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:00.530371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:00.660002 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Adding security group 8bcbed81-11b2-4dfb-9bea-ff3caabf319a to port 41fd33dc-c741-41ee-84d2-0c6972219377 Oct 04 12:11:00.985412 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-463e550e-4e89-4276-bdb2-f5e47614b86a tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/action" status: 202 len: 0 microversion: 2.1 time: 0.469324 Oct 04 12:11:00.989504 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2217/7059] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:11:00 2022] POST /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:11:00.996825 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:00.997841 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:01.005564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.006067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.006515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.007616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.008256 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.009198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.047431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-50a018a7-635b-4706-9d35-1dd39866e5bd req-a7f208c8-3b0c-44b1-9682-4516d82f90a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a350dc6-150c-4366-bc04-c1f154710703", "tag": "41fd33dc-c741-41ee-84d2-0c6972219377"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:11:01.057183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50a018a7-635b-4706-9d35-1dd39866e5bd req-a7f208c8-3b0c-44b1-9682-4516d82f90a4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.057978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50a018a7-635b-4706-9d35-1dd39866e5bd req-a7f208c8-3b0c-44b1-9682-4516d82f90a4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.058411 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-50a018a7-635b-4706-9d35-1dd39866e5bd req-a7f208c8-3b0c-44b1-9682-4516d82f90a4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.071032 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-50a018a7-635b-4706-9d35-1dd39866e5bd req-a7f208c8-3b0c-44b1-9682-4516d82f90a4 service nova] Creating event network-changed:41fd33dc-c741-41ee-84d2-0c6972219377 for instance 8a350dc6-150c-4366-bc04-c1f154710703 on n-h2-791135-8 Oct 04 12:11:01.077529 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-50a018a7-635b-4706-9d35-1dd39866e5bd req-a7f208c8-3b0c-44b1-9682-4516d82f90a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086598 Oct 04 12:11:01.079304 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2218/7060] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:11:01.191769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:01.201052 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-922af3e4-b6ec-4fcc-b7d4-6d44d8d436b9 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1758 microversion: 2.1 time: 0.210135 Oct 04 12:11:01.201708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4843/7061] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:11:00 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1758 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:11:59.030084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:11:59.032456 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:59.034589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:59.035240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:59.042639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:59.043129 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:59.043575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:59.044264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:59.044720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:59.045149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:59.116050 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a03c8873-b856-4ed4-9049-8910926cfdd1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/action" status: 202 len: 0 microversion: 2.1 time: 0.090395 Oct 04 12:11:59.116695 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2219/7062] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:11:59 2022] POST /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:11:59.124966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:59.125677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:59.128388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:59.129049 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=8 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:59.130510 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:11:59.130872 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:11:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 (ip 10.222.0.23) !!! Oct 04 12:11:59.140980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:59.141496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:59.141947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:59.142660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:59.143120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:59.143555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:59.380886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:59.389334 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-227e7b3a-73ae-49bd-851c-8d473c6435ce tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1750 microversion: 2.1 time: 0.268468 Oct 04 12:11:59.389948 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4844/7063] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:11:59 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1750 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:00.413582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:00.414294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:00.420451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:00.420940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:00.421430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:00.422142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:00.422603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:00.423041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:00.569377 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:00.578136 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-24239984-1dbe-4a0c-a869-f17cb86e5edd tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.169832 Oct 04 12:12:00.578700 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2220/7064] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:00 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:01.602530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:01.603142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:01.610040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:01.610521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:01.610958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:01.611650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:01.612106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:01.612530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:01.752343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:01.761327 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cac66226-607d-4d6a-b7d4-cd448d8967b3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.163170 Oct 04 12:12:01.762159 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4845/7065] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:01 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:02.784093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:02.784743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:02.791775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:02.792264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:02.792711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:02.793441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:02.793909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:02.794349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:02.937317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:02.946138 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bd4b7fdc-88b6-4cd8-b86b-877abea4c877 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.165993 Oct 04 12:12:02.946716 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2221/7066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:02 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:03.968399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:03.969013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:03.976088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:03.976573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:03.977011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:03.977736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:03.978192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:03.978618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:04.122662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:04.131707 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8aa1e573-2eae-41ff-9624-524be67f7774 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.167192 Oct 04 12:12:04.132282 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4846/7067] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:03 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:05.154992 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:05.155602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:05.162532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:05.163021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:05.163462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:05.164155 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:05.164613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:05.165045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:05.304781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:05.313305 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0b9c36de-e844-4ce5-ba79-bc4a60dbb4d1 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.162201 Oct 04 12:12:05.313912 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2222/7068] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:05 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:06.336390 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:06.337045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:06.344336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:06.344832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:06.345275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:06.346011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:06.346469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:06.346905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:06.490594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:06.498869 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0a078581-d219-4f91-82dd-342769d48a51 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.166425 Oct 04 12:12:06.499443 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4847/7069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:06 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:07.522065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:07.522689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:07.529490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:07.529986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:07.530429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:07.531123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:07.531584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:07.532017 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:07.676070 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:07.684800 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d9d38fbd-b418-4775-8db7-b74546208f3c tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.166735 Oct 04 12:12:07.685393 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2223/7070] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:07 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:08.707675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:08.708838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:08.715627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:08.716104 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:08.716537 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:08.717220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:08.717694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:08.718115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:08.862451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:08.872305 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-861711d5-e13d-491e-b83b-e08f14586d97 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.168484 Oct 04 12:12:08.872888 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4848/7071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:08 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:09.896352 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:09.896972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:09.903915 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:09.904401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:09.904841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:09.905573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:09.906038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:09.906465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:10.046904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:10.056197 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3ed15969-8cd0-4788-b886-10201d9c2a96 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1755 microversion: 2.1 time: 0.163752 Oct 04 12:12:10.056766 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2224/7072] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:09 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:11.079800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:11.080442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:11.087385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:11.087868 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:11.088300 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:11.088995 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:11.089475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:11.089905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:11.230347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:11.238564 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3bb8adf1-3e32-40ca-86c0-0d284753f139 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1758 microversion: 2.1 time: 0.162847 Oct 04 12:12:11.239142 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4849/7073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:11 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:14.525294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:14.526083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:14.530954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-329585636"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:14.531641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:14.538676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:14.539170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:14.539609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:14.540307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:14.540762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:14.541190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:14.674550 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.network.security_group_api [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Removing security group 8bcbed81-11b2-4dfb-9bea-ff3caabf319a from port 41fd33dc-c741-41ee-84d2-0c6972219377 Oct 04 12:13:14.989821 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9da78797-d394-4214-91fd-9842d59b67f3 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "POST /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/action" status: 202 len: 0 microversion: 2.1 time: 0.466299 Oct 04 12:13:14.990458 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2225/7074] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:13:14 2022] POST /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:13:14.996255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:14.997102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=36 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:15.002261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-83a58942-2428-47af-88d4-afe35597f1fe req-79fef176-dff1-4519-9444-3bfb9ca30e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a350dc6-150c-4366-bc04-c1f154710703", "tag": "41fd33dc-c741-41ee-84d2-0c6972219377"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:15.013550 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-83a58942-2428-47af-88d4-afe35597f1fe req-79fef176-dff1-4519-9444-3bfb9ca30e91 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:15.016095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-83a58942-2428-47af-88d4-afe35597f1fe req-79fef176-dff1-4519-9444-3bfb9ca30e91 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:15.016095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-83a58942-2428-47af-88d4-afe35597f1fe req-79fef176-dff1-4519-9444-3bfb9ca30e91 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:15.033796 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-83a58942-2428-47af-88d4-afe35597f1fe req-79fef176-dff1-4519-9444-3bfb9ca30e91 service nova] Creating event network-changed:41fd33dc-c741-41ee-84d2-0c6972219377 for instance 8a350dc6-150c-4366-bc04-c1f154710703 on n-h2-791135-8 Oct 04 12:13:15.040549 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-83a58942-2428-47af-88d4-afe35597f1fe req-79fef176-dff1-4519-9444-3bfb9ca30e91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045895 Oct 04 12:13:15.041748 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4850/7075] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:16.127898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:16.128410 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:16.134403 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:16.134900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:16.135347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.136042 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:16.136505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:16.136940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.219395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lazy-loading 'services' on Instance uuid 8a350dc6-150c-4366-bc04-c1f154710703 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:13:16.291544 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-04107fbe-ec01-43ca-a4b3-f9de1bea1d33 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments/ae54d986-ca43-40a2-b659-544f9e4b6814" status: 202 len: 0 microversion: 2.1 time: 0.167966 Oct 04 12:13:16.292150 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2226/7076] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:13:16 2022] DELETE /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments/ae54d986-ca43-40a2-b659-544f9e4b6814 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:13:16.303241 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:16.305577 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:16.315108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:16.315602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:16.316038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.316745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:16.317205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:16.317677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.350252 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-85c6f64f-d42c-41fd-8bce-aa33c4ad5499 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052527 Oct 04 12:13:16.350833 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4851/7077] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:13:16 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:17.058849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-40feb92b-b4ce-4852-acdc-158bcd9ae2f9 req-c1b181f3-fc4e-4f8d-8f65-ab04945e77ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a350dc6-150c-4366-bc04-c1f154710703", "tag": "41fd33dc-c741-41ee-84d2-0c6972219377"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:17.068967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-40feb92b-b4ce-4852-acdc-158bcd9ae2f9 req-c1b181f3-fc4e-4f8d-8f65-ab04945e77ec service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:17.069592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-40feb92b-b4ce-4852-acdc-158bcd9ae2f9 req-c1b181f3-fc4e-4f8d-8f65-ab04945e77ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:17.070114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-40feb92b-b4ce-4852-acdc-158bcd9ae2f9 req-c1b181f3-fc4e-4f8d-8f65-ab04945e77ec service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:17.082395 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-40feb92b-b4ce-4852-acdc-158bcd9ae2f9 req-c1b181f3-fc4e-4f8d-8f65-ab04945e77ec service nova] Creating event network-changed:41fd33dc-c741-41ee-84d2-0c6972219377 for instance 8a350dc6-150c-4366-bc04-c1f154710703 on n-h2-791135-8 Oct 04 12:13:17.087505 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-40feb92b-b4ce-4852-acdc-158bcd9ae2f9 req-c1b181f3-fc4e-4f8d-8f65-ab04945e77ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032810 Oct 04 12:13:17.088220 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2227/7078] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:13:17.363444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:17.365795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:17.373760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:17.374261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:17.374704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:17.375414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:17.376081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:17.376721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:17.408243 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-66269ee2-59ba-4823-8a2a-696039c52dec tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048799 Oct 04 12:13:17.408824 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4852/7079] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:13:17 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:18.423472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:18.426251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:18.432930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:18.433451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:18.433900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:18.434609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:18.435067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:18.435495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:18.467881 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7d58fd96-e70f-4d02-9cfa-7f4197d8d199 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051129 Oct 04 12:13:18.468664 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2228/7080] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:13:18 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:19.480257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:19.482397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:19.489283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:19.489798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:19.490233 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:19.490920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:19.491368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:19.491794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:19.522095 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-db46eecf-3025-4e0d-bcab-5505102abfea tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Oct 04 12:13:19.522679 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4853/7081] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:13:19 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:20.534596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:20.536762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:20.543600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:20.544088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:20.544522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:20.545211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:20.545697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:20.546128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:20.576777 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4548bebf-0b24-4192-a263-097f740a1302 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046100 Oct 04 12:13:20.577375 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2229/7082] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:13:20 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:13:21.589331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:21.592238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:21.598591 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:21.599074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:21.599513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.600203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:21.600656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:21.601085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.629289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-70a192f3-9190-45bd-b108-4effa30acaf4 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044015 Oct 04 12:13:21.629902 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4854/7083] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 4 12:13:21 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:13:21.643048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:21.643556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:21.649536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:21.650030 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:21.650475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.651170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:21.651630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:21.652067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.804559 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] HTTP exception thrown: Instance 8a350dc6-150c-4366-bc04-c1f154710703 is not attached to volume ae54d986-ca43-40a2-b659-544f9e4b6814 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Request method failure captured: Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: request: DELETE /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments/ae54d986-ca43-40a2-b659-544f9e4b6814 HTTP/1.1 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCFwoUFG6nwGtlbd3H1SMndAvXE_P9heFyDG0EVAFdIwbS7VvS_2f8ZNoNmySa2aMo3T9QLQSFZqGvkfmfbEP9awSC8B2MVkqX0V_8NE3ZU3FWJRH5E1DzAHh9MFzSxipHhpHRF-dO9nvPuSq4vYRES4jbQ4x4X-6dG-EWPeY1e48qo Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 88cbdbb95c5a4e6da81573597b657d2d Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88cbdbb95c5a4e6da81573597b657d2d"}]}] Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 88cbdbb95c5a4e6da81573597b657d2d Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestMinimumBasicScenario-1296152478-project Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 83fefc61f7324655b972d0da38a89046 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestMinimumBasicScenario-1296152478-project Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 8a350dc6-150c-4366-bc04-c1f154710703 is not attached to volume ae54d986-ca43-40a2-b659-544f9e4b6814 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'server_id': '8a350dc6-150c-4366-bc04-c1f154710703', 'id': 'ae54d986-ca43-40a2-b659-544f9e4b6814'} Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ae54d986-ca43-40a2-b659-544f9e4b6814. Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a350dc6-150c-4366-bc04-c1f154710703 is not attached to volume ae54d986-ca43-40a2-b659-544f9e4b6814 Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:13:21.806189 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:13:21.811620 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:13:21.811620 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:13:21.811620 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a350dc6-150c-4366-bc04-c1f154710703 is not attached to volume ae54d986-ca43-40a2-b659-544f9e4b6814 Oct 04 12:13:21.811620 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:21.811620 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Returning 404 to user: Instance 8a350dc6-150c-4366-bc04-c1f154710703 is not attached to volume ae54d986-ca43-40a2-b659-544f9e4b6814 {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:13:21.811620 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-298f0c1b-4e6b-4358-899c-f7d84de83177 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments/ae54d986-ca43-40a2-b659-544f9e4b6814" status: 404 len: 154 microversion: 2.1 time: 0.169135 Oct 04 12:13:21.811620 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2230/7084] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 4 12:13:21 2022] DELETE /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703/os-volume_attachments/ae54d986-ca43-40a2-b659-544f9e4b6814 => generated 154 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:13:25.055378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:25.055886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:25.063271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:25.063751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:25.064188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:25.064876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:25.065334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:25.065785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:25.090886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:13:25.172687 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b6f7ba07-c3dc-420d-b4db-7fa4e4bde30d tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 204 len: 0 microversion: 2.1 time: 0.120892 Oct 04 12:13:25.177570 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4855/7085] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:13:25 2022] DELETE /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:13:25.184572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:25.185221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:25.193256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:25.193793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:25.194239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:25.194953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:25.195418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:25.195860 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:25.330538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:25.338423 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-58fd56b4-b9ef-4501-b03c-3eabe2edfa29 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1553 microversion: 2.1 time: 0.159777 Oct 04 12:13:25.338995 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2231/7086] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:25 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:26.362824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:26.363449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:26.371045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:26.371530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:26.372016 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:26.372711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:26.373169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:26.373621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:26.543870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:26.551793 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5b7de06e-b07d-421a-9aa8-a095164e185b tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1553 microversion: 2.1 time: 0.193347 Oct 04 12:13:26.552371 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4856/7087] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:26 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:27.566869 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e9622d17-8bb5-41fb-9706-4656cf16bc79 req-269c4001-bfae-4493-a054-09b9c9ffab2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a350dc6-150c-4366-bc04-c1f154710703", "name": "network-vif-deleted", "tag": "41fd33dc-c741-41ee-84d2-0c6972219377"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:27.574463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:27.575119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:27.578133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e9622d17-8bb5-41fb-9706-4656cf16bc79 req-269c4001-bfae-4493-a054-09b9c9ffab2c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:27.578614 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e9622d17-8bb5-41fb-9706-4656cf16bc79 req-269c4001-bfae-4493-a054-09b9c9ffab2c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:27.579242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e9622d17-8bb5-41fb-9706-4656cf16bc79 req-269c4001-bfae-4493-a054-09b9c9ffab2c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:27.582105 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:27.582594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:27.583038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:27.583742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:27.584202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:27.584629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:27.593927 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e9622d17-8bb5-41fb-9706-4656cf16bc79 req-269c4001-bfae-4493-a054-09b9c9ffab2c service nova] Creating event network-vif-deleted:41fd33dc-c741-41ee-84d2-0c6972219377 for instance 8a350dc6-150c-4366-bc04-c1f154710703 on n-h2-791135-8 Oct 04 12:13:27.600392 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e9622d17-8bb5-41fb-9706-4656cf16bc79 req-269c4001-bfae-4493-a054-09b9c9ffab2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037258 Oct 04 12:13:27.601994 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2232/7088] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:27.650130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fefc61f7324655b972d0da38a89046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cbdbb95c5a4e6da81573597b657d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:27.659219 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-419978ca-a2d7-45bb-8370-94a56e927a74 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 200 len: 1511 microversion: 2.1 time: 0.088656 Oct 04 12:13:27.659802 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4857/7089] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:27 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:28.683486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:28.684731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [instance: 8a350dc6-150c-4366-bc04-c1f154710703] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:28.691635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:28.692113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:28.692550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:28.693239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:28.693724 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:28.694156 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:28.707946 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] HTTP exception thrown: Instance 8a350dc6-150c-4366-bc04-c1f154710703 could not be found. Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Request method failure captured: Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 HTTP/1.1 Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCFwoUFG6nwGtlbd3H1SMndAvXE_P9heFyDG0EVAFdIwbS7VvS_2f8ZNoNmySa2aMo3T9QLQSFZqGvkfmfbEP9awSC8B2MVkqX0V_8NE3ZU3FWJRH5E1DzAHh9MFzSxipHhpHRF-dO9nvPuSq4vYRES4jbQ4x4X-6dG-EWPeY1e48qo Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 88cbdbb95c5a4e6da81573597b657d2d Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/88cbdbb95c5a4e6da81573597b657d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/88cbdbb95c5a4e6da81573597b657d2d"}]}] Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 88cbdbb95c5a4e6da81573597b657d2d Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1296152478 Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestMinimumBasicScenario-1296152478-project Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 83fefc61f7324655b972d0da38a89046 Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestMinimumBasicScenario-1296152478-project Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 8a350dc6-150c-4366-bc04-c1f154710703 could not be found. Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '8a350dc6-150c-4366-bc04-c1f154710703'} Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a350dc6-150c-4366-bc04-c1f154710703 could not be found. Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a350dc6-150c-4366-bc04-c1f154710703 could not be found. Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:13:28.709572 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a350dc6-150c-4366-bc04-c1f154710703 could not be found. Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Returning 404 to user: Instance 8a350dc6-150c-4366-bc04-c1f154710703 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14d8412f-081d-46bd-b965-6f68e4bf5178 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703" status: 404 len: 111 microversion: 2.1 time: 0.031744 Oct 04 12:13:28.714347 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2233/7090] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:28 2022] GET /compute/v2.1/servers/8a350dc6-150c-4366-bc04-c1f154710703 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:13:28.720196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7b70610-21ad-4152-80ff-c376597ac093 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] Calling method '.version_select at 0x7f71d4421a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:28.724678 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d7b70610-21ad-4152-80ff-c376597ac093 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [3ba564bb-cde8-4079-bd63-cad7bb0f661d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:13:29.736338 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [None req-d7b70610-21ad-4152-80ff-c376597ac093 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] [3ba564bb-cde8-4079-bd63-cad7bb0f661d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36930. Oct 04 12:13:29.757135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7b70610-21ad-4152-80ff-c376597ac093 tempest-TestMinimumBasicScenario-1296152478 tempest-TestMinimumBasicScenario-1296152478-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-400650376" status: 202 len: 0 microversion: 2.1 time: 1.040745 Oct 04 12:13:29.757804 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4858/7091] 10.222.0.23 () {58 vars in 1269 bytes} [Tue Oct 4 12:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-400650376 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:13:38.687694 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a803263a-6e57-456c-a84e-04c9e2f373ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: .version_select at 0x7f71d8754ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1031593516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjG9IuWF8m1CoGsJtQJ4vH0UE81s7yq+ut5gnhtXNaP6iIYzGOwBesYBk8EelyzzxxsWrnLCldb6boM3L5ITpgDHAL71tBUaulaUIHklbn/3mE/zV4tdQXQWGavkSmyXw=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:38.693143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=18 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:38.699547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:38.707742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a803263a-6e57-456c-a84e-04c9e2f373ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:13:38.713981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-a803263a-6e57-456c-a84e-04c9e2f373ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:13:38.727543 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a803263a-6e57-456c-a84e-04c9e2f373ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [e895f24a-1a5c-4f4c-a9b0-814b1b9d4209] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:13:39.039862 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:13:39.040084 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Oct 04 12:13:39.735390 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [None req-a803263a-6e57-456c-a84e-04c9e2f373ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [e895f24a-1a5c-4f4c-a9b0-814b1b9d4209] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37060. Oct 04 12:13:39.751554 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a803263a-6e57-456c-a84e-04c9e2f373ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.238818 Oct 04 12:13:39.752199 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2234/7092] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:13:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:45.473077 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:45.474523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:45.478629 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1186787857", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "1f34ca90-d274-46e3-a8be-c2d5b382c6cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1031593516", "security_groups": [{"name": "tempest-secgroup-smoke-384362172"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:45.603928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] validate_networks() for [('1f34ca90-d274-46e3-a8be-c2d5b382c6cd', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:13:46.094005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:13:46.094443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:13:46.094928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:13:46.095401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:13:46.095985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:13:46.106898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:46.107603 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:46.108245 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:46.109007 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:46.109486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:46.109937 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:46.134301 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:13:46.140160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:13:46.156925 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:13:46.159324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:13:46.222398 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b493a7d-4cc1-459c-aaf1-5adb76b7cd54 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751098 Oct 04 12:13:46.223529 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4859/7093] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:13:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:13:46.236762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-47e915ba-6ba8-4c24-800f-e63dcb6b59d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:46.237523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-47e915ba-6ba8-4c24-800f-e63dcb6b59d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:46.328734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-47e915ba-6ba8-4c24-800f-e63dcb6b59d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:46.337075 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-47e915ba-6ba8-4c24-800f-e63dcb6b59d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1267 microversion: 2.1 time: 0.106077 Oct 04 12:13:46.337703 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2235/7094] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:46 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:47.364036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:47.364740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:47.371796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:47.372294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:47.372734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:47.373465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:47.373976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:47.374415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:47.441392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:47.450045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97359c31-5439-48c6-9542-9ed1018a83ed tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1319 microversion: 2.1 time: 0.091791 Oct 04 12:13:47.451024 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4860/7095] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:47 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:48.473712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:48.475077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:48.482522 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:48.484061 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:48.485075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:48.486096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:48.486811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:48.494024 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:48.669945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:48.679290 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-025c4717-e30a-481e-8961-80a46f6dc22f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1392 microversion: 2.1 time: 0.209502 Oct 04 12:13:48.693377 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2236/7096] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:48 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:49.180112 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-3407991b-1122-482c-84e5-f58f5515441b req-43c010fc-93bd-47f6-a4b7-77664ee2b43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1be7b92-7caa-4cde-b307-7813001196e2", "tag": "c1929351-cdd5-4a29-bf28-58be88e34410"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:49.191150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3407991b-1122-482c-84e5-f58f5515441b req-43c010fc-93bd-47f6-a4b7-77664ee2b43e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:49.191630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3407991b-1122-482c-84e5-f58f5515441b req-43c010fc-93bd-47f6-a4b7-77664ee2b43e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:49.192251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-3407991b-1122-482c-84e5-f58f5515441b req-43c010fc-93bd-47f6-a4b7-77664ee2b43e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:49.204733 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-3407991b-1122-482c-84e5-f58f5515441b req-43c010fc-93bd-47f6-a4b7-77664ee2b43e service nova] Creating event network-changed:c1929351-cdd5-4a29-bf28-58be88e34410 for instance c1be7b92-7caa-4cde-b307-7813001196e2 on n-h1-791135-8 Oct 04 12:13:49.209775 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-3407991b-1122-482c-84e5-f58f5515441b req-43c010fc-93bd-47f6-a4b7-77664ee2b43e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034606 Oct 04 12:13:49.210376 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4861/7097] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:49.703186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:49.703834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:49.710673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:49.711158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:49.711595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:49.712283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:49.712741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:49.713174 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:49.844214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:49.852011 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7c256fc9-cdda-4806-9823-4f9cec692b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1392 microversion: 2.1 time: 0.153389 Oct 04 12:13:49.852587 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2237/7098] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:49 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:50.875982 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:50.876694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:50.888699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:50.889770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:50.890218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:50.891184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:50.891647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:50.892085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:51.028046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:51.036708 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72df3b31-6f22-4132-a39f-69c16dda16ca tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1392 microversion: 2.1 time: 0.165873 Oct 04 12:13:51.037319 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4862/7099] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:50 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:52.059493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:52.060121 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:52.066994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:52.067483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:52.067925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:52.068622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:52.069085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:52.069556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:52.201726 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:52.209216 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-df7286ca-ef1f-46bb-ab2e-f691a57ac260 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1392 microversion: 2.1 time: 0.153856 Oct 04 12:13:52.209818 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2238/7100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:52 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:53.231736 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:53.232354 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:53.239802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:53.240290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:53.240726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:53.241457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:53.241912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:53.242341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:53.379958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:53.387686 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c34c5a0b-530a-402d-9537-a801d94119fd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1392 microversion: 2.1 time: 0.159879 Oct 04 12:13:53.388591 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4863/7101] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:53 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:54.411849 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:54.412472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:54.419317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:54.419804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:54.420249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:54.420950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:54.421438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:54.421884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:54.553754 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:54.563286 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-07b675ae-5ba0-45f8-b845-a88ac0ee6884 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1392 microversion: 2.1 time: 0.155283 Oct 04 12:13:54.563868 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2239/7102] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:54 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:54.926174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6c020cef-2b53-42d9-8452-ece336678453 req-89eadcbb-126c-4d29-9904-48b6c2fe6eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1be7b92-7caa-4cde-b307-7813001196e2", "name": "network-vif-plugged", "status": "completed", "tag": "c1929351-cdd5-4a29-bf28-58be88e34410"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:54.937249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6c020cef-2b53-42d9-8452-ece336678453 req-89eadcbb-126c-4d29-9904-48b6c2fe6eb0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:54.939773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6c020cef-2b53-42d9-8452-ece336678453 req-89eadcbb-126c-4d29-9904-48b6c2fe6eb0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:54.940438 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6c020cef-2b53-42d9-8452-ece336678453 req-89eadcbb-126c-4d29-9904-48b6c2fe6eb0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:54.952368 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6c020cef-2b53-42d9-8452-ece336678453 req-89eadcbb-126c-4d29-9904-48b6c2fe6eb0 service nova] Creating event network-vif-plugged:c1929351-cdd5-4a29-bf28-58be88e34410 for instance c1be7b92-7caa-4cde-b307-7813001196e2 on n-h1-791135-8 Oct 04 12:13:54.958193 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6c020cef-2b53-42d9-8452-ece336678453 req-89eadcbb-126c-4d29-9904-48b6c2fe6eb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035206 Oct 04 12:13:54.958798 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4864/7103] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:13:55.586259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:55.586881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:55.593736 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:55.594230 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:55.594675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:55.595375 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:55.595843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:55.596276 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:55.731166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:55.739334 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2070ce3a-5cd4-4f5b-a105-964011bf40f8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1392 microversion: 2.1 time: 0.156928 Oct 04 12:13:55.739922 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2240/7104] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:55 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:56.762920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:56.763561 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:56.767149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:56.767826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:56.774035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:56.774523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:56.774970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:56.775668 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:56.776127 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:56.776558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:57.226087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:57.233830 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-213376c0-3450-4878-96c8-9212450f9478 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1565 microversion: 2.1 time: 0.475317 Oct 04 12:13:57.234410 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4865/7105] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:56 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1565 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:57.256079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:57.256704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:57.258613 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:57.265219 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:57.265999 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:57.266444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:57.267143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:57.267609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:57.268045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:57.399645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:57.407305 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ef68a397-95fb-4238-af1a-91914b5a7903 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1565 microversion: 2.1 time: 0.155074 Oct 04 12:13:57.407872 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2241/7106] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:57 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:59.322437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:59.322976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-992698e8-7e3d-4660-bfb7-bd7349b3a9d4 req-5277d076-3ff0-4021-96fd-594c3485858d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1be7b92-7caa-4cde-b307-7813001196e2", "tag": "c1929351-cdd5-4a29-bf28-58be88e34410"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:59.324878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:59.334143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-992698e8-7e3d-4660-bfb7-bd7349b3a9d4 req-5277d076-3ff0-4021-96fd-594c3485858d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:59.334915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:59.335090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-992698e8-7e3d-4660-bfb7-bd7349b3a9d4 req-5277d076-3ff0-4021-96fd-594c3485858d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:59.335635 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:59.335838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-992698e8-7e3d-4660-bfb7-bd7349b3a9d4 req-5277d076-3ff0-4021-96fd-594c3485858d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:59.338281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:59.339094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:59.339811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:59.340465 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:59.348380 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-992698e8-7e3d-4660-bfb7-bd7349b3a9d4 req-5277d076-3ff0-4021-96fd-594c3485858d service nova] Creating event network-changed:c1929351-cdd5-4a29-bf28-58be88e34410 for instance c1be7b92-7caa-4cde-b307-7813001196e2 on n-h1-791135-8 Oct 04 12:13:59.354184 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-992698e8-7e3d-4660-bfb7-bd7349b3a9d4 req-5277d076-3ff0-4021-96fd-594c3485858d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035240 Oct 04 12:13:59.355044 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2242/7107] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:59.590406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:59.599264 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-42b3d333-6562-4475-8d8b-e9d29f03f942 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1684 microversion: 2.1 time: 0.282948 Oct 04 12:13:59.600164 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4866/7108] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:59 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1684 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:20.858041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:20.859298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=38 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:20.863621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:20.865917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:20.873133 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:20.873643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:20.874090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:20.874791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:20.875254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:20.875688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:20.926031 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5565dd7b-97f6-40fc-b266-fe1c15fe32dc tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action" status: 200 len: 24566 microversion: 2.1 time: 0.069974 Oct 04 12:14:20.926654 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2243/7109] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:14:20 2022] POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action => generated 24566 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:14:31.961160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:31.961740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:31.963768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:31.964427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=36 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:31.970702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:31.971186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:31.971626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:31.972864 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:31.973322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:31.973782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:32.040970 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3f578317-8c95-4203-94c0-e5fa98d1776c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action" status: 202 len: 0 microversion: 2.1 time: 0.083933 Oct 04 12:14:32.044598 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4867/7110] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:14:31 2022] POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:14:32.052158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:32.052884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:32.055673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:32.056685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:32.064747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:32.065235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:32.065732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:32.067535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:32.068020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:32.068454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:32.202379 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:32.210648 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3edcc4e4-f077-4303-810b-670ec2304a73 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1689 microversion: 2.1 time: 0.163754 Oct 04 12:14:32.223001 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2244/7111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:32 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:33.238310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:33.239046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:33.245240 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:33.246563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:33.246563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:33.247928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:33.248394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:33.248831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:33.380377 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:33.388144 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f958ae8c-8c11-4c26-9834-d16626838cc5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1669 microversion: 2.1 time: 0.155749 Oct 04 12:14:33.388720 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4868/7112] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:33 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:34.484722 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:34.487651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:34.495817 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:34.496309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:34.496756 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:34.497495 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:34.497963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:34.498405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:34.547189 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5280521-2852-4336-935b-f0f59ba693f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action" status: 200 len: 32635 microversion: 2.1 time: 0.066149 Oct 04 12:14:34.547830 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2245/7113] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:14:34 2022] POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action => generated 32635 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:14:34.560097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:34.560726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:34.568359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:34.568850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:34.569290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:34.570028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:34.570488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:34.570920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:34.636497 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec3f7ca6-4888-4d3c-8c1d-4fd31661c2bf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action" status: 202 len: 0 microversion: 2.1 time: 0.080107 Oct 04 12:14:34.637138 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4869/7114] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:14:34 2022] POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:14:34.646182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:34.646887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:34.654101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:34.654589 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:34.655032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:34.655766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:34.656246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:34.656677 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:34.792868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:34.801462 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5356cb0e-6029-417d-872b-63a3b0c684f0 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1676 microversion: 2.1 time: 0.158825 Oct 04 12:14:34.802107 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2246/7115] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:34 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:35.826090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:35.826991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:35.834152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:35.834633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:35.835065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:35.835745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:35.836199 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:35.836621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:35.973090 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:35.980768 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1eb89ac7-1cff-4b71-a231-9e40fff42097 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1684 microversion: 2.1 time: 0.159936 Oct 04 12:14:35.981336 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4870/7116] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:35 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:36.075621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:36.077935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:36.085926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:36.086418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:36.086867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:36.087559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:36.088021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:36.088452 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:36.139723 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-12ee9bfb-52a3-4191-bfbc-fbf54215b367 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action" status: 200 len: 38432 microversion: 2.1 time: 0.067890 Oct 04 12:14:36.140377 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2247/7117] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:14:36 2022] POST /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2/action => generated 38432 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:14:37.107958 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:37.109023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:37.114326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-879de673-9219-4f1f-b2d1-bcfa1a971b40 req-72666da1-5a43-4f96-a63d-248b76e4b8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1be7b92-7caa-4cde-b307-7813001196e2", "tag": "c1929351-cdd5-4a29-bf28-58be88e34410"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:37.116816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.117309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.117769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.118466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.118912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.119509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.125384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-879de673-9219-4f1f-b2d1-bcfa1a971b40 req-72666da1-5a43-4f96-a63d-248b76e4b8f9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.126026 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-879de673-9219-4f1f-b2d1-bcfa1a971b40 req-72666da1-5a43-4f96-a63d-248b76e4b8f9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.126478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-879de673-9219-4f1f-b2d1-bcfa1a971b40 req-72666da1-5a43-4f96-a63d-248b76e4b8f9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.137899 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-879de673-9219-4f1f-b2d1-bcfa1a971b40 req-72666da1-5a43-4f96-a63d-248b76e4b8f9 service nova] Creating event network-changed:c1929351-cdd5-4a29-bf28-58be88e34410 for instance c1be7b92-7caa-4cde-b307-7813001196e2 on n-h1-791135-8 Oct 04 12:14:37.143174 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-879de673-9219-4f1f-b2d1-bcfa1a971b40 req-72666da1-5a43-4f96-a63d-248b76e4b8f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033565 Oct 04 12:14:37.144348 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2248/7118] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:37.145579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:14:37.234354 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9d29309-29c4-4885-a42f-d6cc6f1f7972 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 204 len: 0 microversion: 2.1 time: 0.129347 Oct 04 12:14:37.235738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4871/7119] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:14:37 2022] DELETE /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:14:37.245919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:37.246838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:37.255609 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.256598 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.257112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.257924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.258639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.259152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.400166 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:37.408252 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-11ecfa02-d019-491f-bd59-6d1bafc34b4d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1690 microversion: 2.1 time: 0.166780 Oct 04 12:14:37.408832 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2249/7120] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:37 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:38.433633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:38.434369 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:38.441835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:38.442328 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:38.442765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:38.443460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:38.443950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:38.444379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:38.619901 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:38.627816 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c132e426-bea9-4eb0-a403-b8727b2e8015 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1690 microversion: 2.1 time: 0.198447 Oct 04 12:14:38.628406 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4872/7121] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:38 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:39.261279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-4c4b9e63-b400-4cf3-a1cb-e447f289b129 req-5235d98b-4f82-49f7-b970-b5691378568d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1be7b92-7caa-4cde-b307-7813001196e2", "name": "network-vif-deleted", "tag": "c1929351-cdd5-4a29-bf28-58be88e34410"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:39.272600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4c4b9e63-b400-4cf3-a1cb-e447f289b129 req-5235d98b-4f82-49f7-b970-b5691378568d service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:39.273084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4c4b9e63-b400-4cf3-a1cb-e447f289b129 req-5235d98b-4f82-49f7-b970-b5691378568d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:39.273766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-4c4b9e63-b400-4cf3-a1cb-e447f289b129 req-5235d98b-4f82-49f7-b970-b5691378568d service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:39.290355 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-4c4b9e63-b400-4cf3-a1cb-e447f289b129 req-5235d98b-4f82-49f7-b970-b5691378568d service nova] Creating event network-vif-deleted:c1929351-cdd5-4a29-bf28-58be88e34410 for instance c1be7b92-7caa-4cde-b307-7813001196e2 on n-h1-791135-8 Oct 04 12:14:39.295391 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-4c4b9e63-b400-4cf3-a1cb-e447f289b129 req-5235d98b-4f82-49f7-b970-b5691378568d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037956 Oct 04 12:14:39.296017 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2250/7122] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:39.651944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:39.652842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:39.660072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:39.660606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:39.661018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:39.661947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:39.662406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:39.662833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:39.696967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:39.697491 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:39.697971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:39.698429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lazy-loading 'fault' on Instance uuid c1be7b92-7caa-4cde-b307-7813001196e2 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:14:39.741236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:39.748998 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-338cefa7-828a-4922-83ee-634d3b4c0491 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 200 len: 1357 microversion: 2.1 time: 0.101622 Oct 04 12:14:39.749661 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4873/7123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:39 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 1357 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:40.775621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:40.776354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: c1be7b92-7caa-4cde-b307-7813001196e2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:40.782699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:40.783193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:40.783638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:40.784341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:40.784815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:40.785252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:40.799073 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] HTTP exception thrown: Instance c1be7b92-7caa-4cde-b307-7813001196e2 could not be found. Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Request method failure captured: Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 HTTP/1.1 Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCNxL0rAyY6LJuD68NhR5sU35ePaZ4BZ4z8muaqu7Df2RjlPMFPDumyKIM8t3nCO2ArvqT5G6F5K_tmFwBmDBZEH5VeCGCrV0-Wixf1NfktuVfEnNtiTHoO5nqWegE0_B7QVJjS-KHol72zxyy0AhYlRk46Toi8vKzA2ssSsEEwfREM Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f489bde728945dc8c2094c8ebd99afb"}]}] Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 83c9db5be81345af81be484a189292a3 Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance c1be7b92-7caa-4cde-b307-7813001196e2 could not be found. Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'c1be7b92-7caa-4cde-b307-7813001196e2'} Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1be7b92-7caa-4cde-b307-7813001196e2 could not be found. Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1be7b92-7caa-4cde-b307-7813001196e2 could not be found. Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:14:40.800760 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1be7b92-7caa-4cde-b307-7813001196e2 could not be found. Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Returning 404 to user: Instance c1be7b92-7caa-4cde-b307-7813001196e2 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-96c7978f-138b-418b-95cf-bb198ad5a2be tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2" status: 404 len: 111 microversion: 2.1 time: 0.032339 Oct 04 12:14:40.805948 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2251/7124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:40 2022] GET /compute/v2.1/servers/c1be7b92-7caa-4cde-b307-7813001196e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:14:44.078758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56a6aa2d-e879-45cf-91fd-c3393a9411d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '.version_select at 0x7f71cf0e5a60>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:44.104632 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-56a6aa2d-e879-45cf-91fd-c3393a9411d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1031593516" status: 202 len: 0 microversion: 2.1 time: 0.029722 Oct 04 12:14:44.108775 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4874/7125] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 4 12:14:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1031593516 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:14:44.134937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab817437-9adc-45fd-bb21-3ae423e4b63a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: .version_select at 0x7f71cc57bca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1950124906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWusHEJyLfUjVWy0nbMOX+FGDEKaLTK1nyKzVaT+g4gRd+zqhQ5syGfk094R7XsDMdCXN076fm0lZjazU5c3Zv38UJHQRx2YoffDTKmpKiMlwQpTACacdFE95Z05+CIYg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:44.159075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ab817437-9adc-45fd-bb21-3ae423e4b63a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:14:44.165408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-ab817437-9adc-45fd-bb21-3ae423e4b63a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:14:44.191578 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab817437-9adc-45fd-bb21-3ae423e4b63a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060726 Oct 04 12:14:44.192191 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2252/7126] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:14:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:49.645726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-767070943", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "7750d628-dcc4-49df-89d3-b11a01991cef"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1950124906", "security_groups": [{"name": "tempest-secgroup-smoke-574984558"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:49.745439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:49.765752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] validate_networks() for [('7750d628-dcc4-49df-89d3-b11a01991cef', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:14:50.229270 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:14:50.229801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:14:50.230350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:14:50.230826 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:14:50.231447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:14:50.240947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:50.241467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:50.242087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:50.242808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:50.243261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:50.243802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:50.261009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:14:50.267368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:14:50.280470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:14:50.282819 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:14:50.332765 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1e1ba190-48fb-42eb-adf0-539edc009bc1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.692107 Oct 04 12:14:50.339840 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4875/7127] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:14:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:14:50.346237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2356cd77-c672-4d6b-be5c-c877cc280ed2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:50.346865 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2356cd77-c672-4d6b-be5c-c877cc280ed2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:50.408885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2356cd77-c672-4d6b-be5c-c877cc280ed2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:50.416628 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2356cd77-c672-4d6b-be5c-c877cc280ed2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1266 microversion: 2.1 time: 0.075237 Oct 04 12:14:50.421404 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2253/7128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:50 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:51.440192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:51.441470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:51.449638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:51.450142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:51.450860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:51.451781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:51.452404 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:51.453003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:51.532876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:51.542804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0a13a393-7ce6-49cf-abd6-8948e2b11a84 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1336 microversion: 2.1 time: 0.106405 Oct 04 12:14:51.543473 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4876/7129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:51 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:52.566194 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:52.566823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:52.570036 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=32 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:52.576008 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:52.576510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:52.577159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:52.578097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:52.578731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:52.579336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:52.747524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:52.757838 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-71c90de6-5801-4c85-9943-d971e88213d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1391 microversion: 2.1 time: 0.195325 Oct 04 12:14:52.758839 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2254/7130] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:52 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:53.082462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-04620a7e-95a5-4a6c-b306-3bd8a5a5ebba req-31c46132-fc5e-4c48-a4c7-25f0793e36ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca8dcbf7-4c4c-451e-b66f-02c531965926", "tag": "c225380d-fbda-4ed5-bd2f-fd4e95f70ebb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:53.094722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-04620a7e-95a5-4a6c-b306-3bd8a5a5ebba req-31c46132-fc5e-4c48-a4c7-25f0793e36ff service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:53.095209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-04620a7e-95a5-4a6c-b306-3bd8a5a5ebba req-31c46132-fc5e-4c48-a4c7-25f0793e36ff service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:53.095839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-04620a7e-95a5-4a6c-b306-3bd8a5a5ebba req-31c46132-fc5e-4c48-a4c7-25f0793e36ff service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:53.108035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-04620a7e-95a5-4a6c-b306-3bd8a5a5ebba req-31c46132-fc5e-4c48-a4c7-25f0793e36ff service nova] Creating event network-changed:c225380d-fbda-4ed5-bd2f-fd4e95f70ebb for instance ca8dcbf7-4c4c-451e-b66f-02c531965926 on n-h2-791135-8 Oct 04 12:14:53.114826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-04620a7e-95a5-4a6c-b306-3bd8a5a5ebba req-31c46132-fc5e-4c48-a4c7-25f0793e36ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036010 Oct 04 12:14:53.115829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4877/7131] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:53.782093 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:53.782672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:53.790103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:53.790595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:53.791047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:53.791743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:53.792209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:53.792646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:53.920578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:53.928216 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ab945189-671f-4a3b-a4c1-a563a6900cfe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1391 microversion: 2.1 time: 0.150079 Oct 04 12:14:53.928792 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2255/7132] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:53 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:54.952506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:54.953449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:54.959476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:54.959962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:54.960400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:54.961095 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:54.961584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:54.962015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:55.099861 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:55.107524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d1bb6b17-cd2b-4744-8fed-b4aff840d915 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1391 microversion: 2.1 time: 0.160108 Oct 04 12:14:55.108104 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4878/7133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:54 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:56.130697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:56.131266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:56.138717 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:56.139212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:56.139653 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:56.140354 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:56.140819 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:56.141559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:56.285703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:56.294026 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-06dd1d11-ac6a-48ce-805b-ec739ca87404 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1391 microversion: 2.1 time: 0.167385 Oct 04 12:14:56.294630 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2256/7134] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:56 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:57.317586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:57.318282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:57.325606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:57.326093 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:57.326535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:57.327238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:57.327702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:57.328136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:57.471028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:57.478952 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c29f1162-d34b-4ebf-8cb4-162523642373 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1391 microversion: 2.1 time: 0.165428 Oct 04 12:14:57.479542 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4879/7135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:57 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:58.501703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:58.502328 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:58.509057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:58.509594 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:58.510035 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:58.510748 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:58.511204 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:58.511629 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:58.645154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:58.653380 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-40051912-b194-464d-b8ed-e4bc45c9838b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1391 microversion: 2.1 time: 0.155500 Oct 04 12:14:58.653935 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2257/7136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:58 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:59.408830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-44c6acba-4b1e-45c1-b316-bb57a2f40499 req-aef16d1f-ab31-4ad3-b0e7-60acb51a9de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8dcbf7-4c4c-451e-b66f-02c531965926", "name": "network-vif-plugged", "status": "completed", "tag": "c225380d-fbda-4ed5-bd2f-fd4e95f70ebb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:59.419854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-44c6acba-4b1e-45c1-b316-bb57a2f40499 req-aef16d1f-ab31-4ad3-b0e7-60acb51a9de5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:59.420333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-44c6acba-4b1e-45c1-b316-bb57a2f40499 req-aef16d1f-ab31-4ad3-b0e7-60acb51a9de5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:59.420762 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-44c6acba-4b1e-45c1-b316-bb57a2f40499 req-aef16d1f-ab31-4ad3-b0e7-60acb51a9de5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:59.432759 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-44c6acba-4b1e-45c1-b316-bb57a2f40499 req-aef16d1f-ab31-4ad3-b0e7-60acb51a9de5 service nova] Creating event network-vif-plugged:c225380d-fbda-4ed5-bd2f-fd4e95f70ebb for instance ca8dcbf7-4c4c-451e-b66f-02c531965926 on n-h2-791135-8 Oct 04 12:14:59.437705 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-44c6acba-4b1e-45c1-b316-bb57a2f40499 req-aef16d1f-ab31-4ad3-b0e7-60acb51a9de5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Oct 04 12:14:59.438307 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4880/7137] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:59.676027 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:59.676692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:59.684186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:59.684828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:59.685282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:59.686019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:59.686485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:59.686948 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:59.819672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:59.827364 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d528ea9b-7edf-4acd-b4eb-24740b0585d6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1391 microversion: 2.1 time: 0.155284 Oct 04 12:14:59.827941 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2258/7138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:59 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:15:00.847674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:00.848457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:00.854177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:00.854928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:00.861947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:00.862424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:00.862854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:00.863539 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:00.863991 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:00.864413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:01.001082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:01.011467 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ffc4367d-9320-411f-9a39-847ce4f1f70b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1391 microversion: 2.1 time: 0.164721 Oct 04 12:15:01.012050 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4881/7139] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:00 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:15:02.035851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:02.036481 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:02.038479 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:02.044951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:02.045472 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:02.045927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:02.046632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:02.047100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:02.047539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:02.178259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:02.185910 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dec7ab90-d984-478d-beba-eec3e02ec2c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1562 microversion: 2.1 time: 0.153919 Oct 04 12:15:02.186478 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2259/7140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:02 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:15:02.208154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:02.208760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:02.211919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:02.217040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:02.217556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:02.217990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:02.218669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:02.219146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:02.219572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:02.349409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:02.357738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ffd9c745-1d45-4d59-afdc-5892eb83301b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1562 microversion: 2.1 time: 0.153427 Oct 04 12:15:02.358315 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4882/7141] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:02 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:15:03.946699 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:03.947318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:03.951020 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:03.957110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:03.957891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:03.958573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:03.959512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:03.960047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:03.960551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:04.023788 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-8d026d75-63ff-41a2-9b8a-651a3ba4f0ad req-eaffdccd-b251-4c8c-bb7c-965921642663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca8dcbf7-4c4c-451e-b66f-02c531965926", "tag": "c225380d-fbda-4ed5-bd2f-fd4e95f70ebb"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:15:04.035918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d026d75-63ff-41a2-9b8a-651a3ba4f0ad req-eaffdccd-b251-4c8c-bb7c-965921642663 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:04.036415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d026d75-63ff-41a2-9b8a-651a3ba4f0ad req-eaffdccd-b251-4c8c-bb7c-965921642663 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:04.037114 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-8d026d75-63ff-41a2-9b8a-651a3ba4f0ad req-eaffdccd-b251-4c8c-bb7c-965921642663 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:04.049739 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-8d026d75-63ff-41a2-9b8a-651a3ba4f0ad req-eaffdccd-b251-4c8c-bb7c-965921642663 service nova] Creating event network-changed:c225380d-fbda-4ed5-bd2f-fd4e95f70ebb for instance ca8dcbf7-4c4c-451e-b66f-02c531965926 on n-h2-791135-8 Oct 04 12:15:04.056122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-8d026d75-63ff-41a2-9b8a-651a3ba4f0ad req-eaffdccd-b251-4c8c-bb7c-965921642663 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110746 Oct 04 12:15:04.056930 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4883/7142] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:15:04.124298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:04.131986 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7b1a4bec-72f4-42b7-a7d4-be5436fe45b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1562 microversion: 2.1 time: 0.189421 Oct 04 12:15:04.133951 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2260/7143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:03 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1562 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:15:35.415410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:15:35.417716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:35.420152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:35.420794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=38 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:35.427324 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:35.427834 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:35.428267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:35.428953 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:35.429422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:35.429847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:35.497413 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-329852a0-6e1c-40b2-a394-f4a5842e03f3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926/action" status: 200 len: 24565 microversion: 2.1 time: 0.086050 Oct 04 12:15:35.498064 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4884/7144] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:15:35 2022] POST /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926/action => generated 24565 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:16:14.497468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:14.498228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=42 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:14.503460 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:16:14.505670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:14.512532 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:14.513021 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:14.513494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:14.514179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:14.514633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:14.515060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:14.586240 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9dff99e4-dd0a-4482-ad98-5790c550b1cd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926/action" status: 202 len: 0 microversion: 2.1 time: 0.090342 Oct 04 12:16:14.587024 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2261/7145] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:16:14 2022] POST /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:16:14.595743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:14.596436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:14.599024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:14.599770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:14.607040 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:14.607538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:14.607973 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:14.608675 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:14.609133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:14.609593 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:14.790027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:14.797889 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dc4ec745-e04e-458a-884a-6192a916a321 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1673 microversion: 2.1 time: 0.206527 Oct 04 12:16:14.798460 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4885/7146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:14 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:15.822560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:15.823180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:15.829250 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:15.829771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:15.830211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:15.830898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:15.831356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:15.831784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:15.966210 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:15.973803 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c1fcd8b7-eb3e-4fdd-a4b0-45fc6ed3f45f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.156566 Oct 04 12:16:15.974363 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2262/7147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:15 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:16.998456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:16.999218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:17.009560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:17.010051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:17.010494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:17.011188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:17.011647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:17.012078 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:17.141704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:17.150181 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b384194d-3d8f-4a7d-878b-4e920170a031 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.156235 Oct 04 12:16:17.150763 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4886/7148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:16 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:18.173931 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:18.174554 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:18.181334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:18.181859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:18.182303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:18.182998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:18.183483 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:18.183909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:18.317509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:18.325067 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c84d5577-0a2e-48cf-aa58-37fc09d346e6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.155057 Oct 04 12:16:18.325673 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2263/7149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:18 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:19.348255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:19.348782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:19.355574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:19.356058 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:19.356495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:19.357187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:19.357673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:19.358106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:19.497605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:19.505266 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5a2a6b27-2840-4fd7-b816-898b58656229 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.160986 Oct 04 12:16:19.505863 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4887/7150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:19 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:20.529659 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:20.530265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:20.536953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:20.537478 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:20.537925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:20.538616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:20.539073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:20.539503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:20.667784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:20.675340 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9015cc3e-6309-4661-b40d-216077d704b4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.149606 Oct 04 12:16:20.675900 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2264/7151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:20 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:21.699914 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:21.700562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:21.706609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:21.707092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:21.707559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:21.708249 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:21.708737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:21.709165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:21.836096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:21.844416 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9ffe1dea-ed7a-4e86-968c-18efccd71793 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.149204 Oct 04 12:16:21.844985 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4888/7152] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:21 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:22.867241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:22.867798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:22.873888 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:22.874380 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:22.874827 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:22.875523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:22.875989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:22.876425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:23.009745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:23.017392 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de8078ae-b458-4f3e-8f79-1694fb4b53d5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.154248 Oct 04 12:16:23.018220 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2265/7153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:22 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:24.042486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:24.043101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:24.050045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:24.050538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:24.050979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:24.051709 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:24.052162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:24.052590 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:24.191701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:24.199516 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-49780fb0-c1c9-43b9-9051-6c982b6ae47a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.161642 Oct 04 12:16:24.200087 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4889/7154] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:24 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:25.223877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:25.224527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:25.232075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:25.232568 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:25.233011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:25.233734 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:25.234200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:25.234635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:25.363003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:25.371130 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d855aef5-2d83-445b-a52f-64866eb5ff3f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1678 microversion: 2.1 time: 0.151155 Oct 04 12:16:25.371736 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2266/7155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:25 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:26.393939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:26.394510 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:26.401460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:26.401945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:26.402414 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:26.403100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:26.403553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:26.403978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:26.534735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:26.543051 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1255f33b-d880-47c0-8f5a-98b011bdd197 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1681 microversion: 2.1 time: 0.153511 Oct 04 12:16:26.543617 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4890/7156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:16:26 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:16:58.768788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:16:58.771257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:58.773542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:58.774222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:58.779666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:58.780159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:58.780602 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:58.781296 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:58.781788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:58.782222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:58.852085 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdc829b7-943d-4152-9678-de3628e07659 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926/action" status: 200 len: 68874 microversion: 2.1 time: 0.087117 Oct 04 12:16:58.852655 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2267/7157] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:16:58 2022] POST /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926/action => generated 68874 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:17:22.666966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:22.667506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:22.669932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:22.670598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=36 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:22.671556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-9115c128-3859-4df1-8dea-2f2033dfe851 req-6c16fb9b-5da4-4ca8-b786-e03ec8203993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca8dcbf7-4c4c-451e-b66f-02c531965926", "tag": "c225380d-fbda-4ed5-bd2f-fd4e95f70ebb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:22.672327 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:17:22.672486 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:17:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 (ip 10.222.0.23) !!! Oct 04 12:17:22.680241 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:22.681578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.682202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.682557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:22.682672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.683345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.683804 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.684234 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.687877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9115c128-3859-4df1-8dea-2f2033dfe851 req-6c16fb9b-5da4-4ca8-b786-e03ec8203993 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.688806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9115c128-3859-4df1-8dea-2f2033dfe851 req-6c16fb9b-5da4-4ca8-b786-e03ec8203993 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.688806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-9115c128-3859-4df1-8dea-2f2033dfe851 req-6c16fb9b-5da4-4ca8-b786-e03ec8203993 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.702583 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-9115c128-3859-4df1-8dea-2f2033dfe851 req-6c16fb9b-5da4-4ca8-b786-e03ec8203993 service nova] Creating event network-changed:c225380d-fbda-4ed5-bd2f-fd4e95f70ebb for instance ca8dcbf7-4c4c-451e-b66f-02c531965926 on n-h2-791135-8 Oct 04 12:17:22.715766 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:17:22.720756 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-9115c128-3859-4df1-8dea-2f2033dfe851 req-6c16fb9b-5da4-4ca8-b786-e03ec8203993 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054868 Oct 04 12:17:22.721687 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2268/7158] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:17:22.815488 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9ca58abc-40d5-4099-af6f-df42d08c81f2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 204 len: 0 microversion: 2.1 time: 0.152449 Oct 04 12:17:22.816660 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4891/7159] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:17:22 2022] DELETE /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:17:22.826502 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:22.827211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:22.833804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.834291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.834729 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.835419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.835877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.836304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.970719 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:22.978928 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a97c85f-12cd-40d2-b5d2-ca6659abb181 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1687 microversion: 2.1 time: 0.156991 Oct 04 12:17:22.979517 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2269/7160] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:22 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:17:24.004779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:24.005714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:24.015478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:24.015972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:24.016412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:24.017108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:24.017594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:24.018027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:24.205020 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:24.213108 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-920ed5e8-006b-448b-98cc-1cd639a4aea8 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1687 microversion: 2.1 time: 0.213661 Oct 04 12:17:24.213717 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4892/7161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:23 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:25.174798 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a615331f-89b8-4653-905a-c0bd2ffd0f95 req-7f3d2366-6c22-421d-8310-9d4a66ea9f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8dcbf7-4c4c-451e-b66f-02c531965926", "name": "network-vif-deleted", "tag": "c225380d-fbda-4ed5-bd2f-fd4e95f70ebb"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:25.184417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a615331f-89b8-4653-905a-c0bd2ffd0f95 req-7f3d2366-6c22-421d-8310-9d4a66ea9f51 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:25.185029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a615331f-89b8-4653-905a-c0bd2ffd0f95 req-7f3d2366-6c22-421d-8310-9d4a66ea9f51 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:25.185578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a615331f-89b8-4653-905a-c0bd2ffd0f95 req-7f3d2366-6c22-421d-8310-9d4a66ea9f51 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:25.196598 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a615331f-89b8-4653-905a-c0bd2ffd0f95 req-7f3d2366-6c22-421d-8310-9d4a66ea9f51 service nova] Creating event network-vif-deleted:c225380d-fbda-4ed5-bd2f-fd4e95f70ebb for instance ca8dcbf7-4c4c-451e-b66f-02c531965926 on n-h2-791135-8 Oct 04 12:17:25.202161 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a615331f-89b8-4653-905a-c0bd2ffd0f95 req-7f3d2366-6c22-421d-8310-9d4a66ea9f51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088993 Oct 04 12:17:25.202895 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2270/7162] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:17:25.236121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:25.236740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:25.243633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:25.244121 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:25.244582 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:25.245290 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:25.245960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:25.246396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:25.279722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:25.280217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:25.280665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:25.281113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lazy-loading 'fault' on Instance uuid ca8dcbf7-4c4c-451e-b66f-02c531965926 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:17:25.326013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:25.333751 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d54d758d-6ae4-4b8c-9413-6e517db1accd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 200 len: 1356 microversion: 2.1 time: 0.101609 Oct 04 12:17:25.334329 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4893/7163] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:25 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:26.358646 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:26.359283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: ca8dcbf7-4c4c-451e-b66f-02c531965926] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:26.365441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:26.365933 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:26.366383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:26.367082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:26.367547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:26.367983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:26.380825 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] HTTP exception thrown: Instance ca8dcbf7-4c4c-451e-b66f-02c531965926 could not be found. Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Request method failure captured: Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 HTTP/1.1 Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCNxL0rAyY6LJuD68NhR5sU35ePaZ4BZ4z8muaqu7Df2RjlPMFPDumyKIM8t3nCO2ArvqT5G6F5K_tmFwBmDBZEH5VeCGCrV0-Wixf1NfktuVfEnNtiTHoO5nqWegE0_B7QVJjS-KHol72zxyy0AhYlRk46Toi8vKzA2ssSsEEwfREM Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f489bde728945dc8c2094c8ebd99afb"}]}] Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 83c9db5be81345af81be484a189292a3 Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance ca8dcbf7-4c4c-451e-b66f-02c531965926 could not be found. Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'ca8dcbf7-4c4c-451e-b66f-02c531965926'} Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8dcbf7-4c4c-451e-b66f-02c531965926 could not be found. Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8dcbf7-4c4c-451e-b66f-02c531965926 could not be found. Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:17:26.382454 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8dcbf7-4c4c-451e-b66f-02c531965926 could not be found. Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Returning 404 to user: Instance ca8dcbf7-4c4c-451e-b66f-02c531965926 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c4679e77-6b0b-4774-aff9-f085745c3b66 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926" status: 404 len: 111 microversion: 2.1 time: 0.030985 Oct 04 12:17:26.386991 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2271/7164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:26 2022] GET /compute/v2.1/servers/ca8dcbf7-4c4c-451e-b66f-02c531965926 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:17:29.603625 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6447682c-79f5-4f7e-bb31-fe82f3844df1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '.version_select at 0x7f71cf188550>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:29.625155 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6447682c-79f5-4f7e-bb31-fe82f3844df1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1950124906" status: 202 len: 0 microversion: 2.1 time: 0.025807 Oct 04 12:17:29.626084 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4894/7165] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 4 12:17:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1950124906 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:17:29.655596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39a6064b-83c8-45b7-a840-2e20e3f3db6a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: .version_select at 0x7f71d4c08160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1110767106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHR+l/Pvp1Q84goKCYPQAlkuKUTnC25srqzX5vpcZx3oezhs1vhfI45427G2qM8U3Kt7TbuaqUEc37PT2ZfE6ICKxcPBp7ST66fwzirhAPWQrG31ztTjOaGcB/eajW4Bg=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:29.674697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-39a6064b-83c8-45b7-a840-2e20e3f3db6a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:17:29.681073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-39a6064b-83c8-45b7-a840-2e20e3f3db6a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:17:29.706472 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39a6064b-83c8-45b7-a840-2e20e3f3db6a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055341 Oct 04 12:17:29.707233 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2272/7166] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:17:29 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:17:35.035276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1440705545", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "aa8c2218-53c3-419c-b903-3fee11b14eb4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1110767106", "security_groups": [{"name": "tempest-secgroup-smoke-342083952"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:35.150108 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] validate_networks() for [('aa8c2218-53c3-419c-b903-3fee11b14eb4', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:17:35.330226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:35.589755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:17:35.590573 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:17:35.591232 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:17:35.591835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:17:35.592254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:17:35.601965 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:35.602460 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:35.602900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:35.603630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:35.604162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:35.604594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:35.627632 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:17:35.633949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:17:35.649412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:17:35.651831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:17:35.708620 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0a291256-5703-4bcd-b76b-5e621616e962 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.678332 Oct 04 12:17:35.709772 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4895/7167] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:17:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:17:35.721912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fcae2537-c50d-4ab7-8868-f3d151cc5aba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:35.722666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fcae2537-c50d-4ab7-8868-f3d151cc5aba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:35.782894 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fcae2537-c50d-4ab7-8868-f3d151cc5aba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:35.803225 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fcae2537-c50d-4ab7-8868-f3d151cc5aba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1267 microversion: 2.1 time: 0.083790 Oct 04 12:17:35.817706 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2273/7168] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:35 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:36.829746 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:36.831044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:36.840101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:36.840662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:36.841410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:36.842212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:36.843107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:36.843836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:36.923179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:36.931266 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0e1f5ddb-572f-46b4-a293-b647d75c9ef4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1337 microversion: 2.1 time: 0.106945 Oct 04 12:17:36.931837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4896/7169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:36 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1337 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:37.954970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:37.955583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:37.957757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:37.965838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:37.966338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:37.966972 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:37.967858 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:37.968321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:37.969974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:38.157199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:38.167541 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5195bf31-249a-443c-8be2-a64a90b05748 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1392 microversion: 2.1 time: 0.216298 Oct 04 12:17:38.169029 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2274/7170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:37 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1392 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:38.696325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6918d88c-a378-4fbe-afe7-6248d084558b req-a36e0e75-27dc-4f32-9f34-51147473919f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfb4fb4-de63-4eb8-9b1c-15010740acd2", "tag": "0b5ce6ca-a416-463a-bb15-e4bad81005b0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:38.708980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6918d88c-a378-4fbe-afe7-6248d084558b req-a36e0e75-27dc-4f32-9f34-51147473919f service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:38.709572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6918d88c-a378-4fbe-afe7-6248d084558b req-a36e0e75-27dc-4f32-9f34-51147473919f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:38.710074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6918d88c-a378-4fbe-afe7-6248d084558b req-a36e0e75-27dc-4f32-9f34-51147473919f service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:38.722123 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6918d88c-a378-4fbe-afe7-6248d084558b req-a36e0e75-27dc-4f32-9f34-51147473919f service nova] Creating event network-changed:0b5ce6ca-a416-463a-bb15-e4bad81005b0 for instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 on n-h1-791135-8 Oct 04 12:17:38.727995 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6918d88c-a378-4fbe-afe7-6248d084558b req-a36e0e75-27dc-4f32-9f34-51147473919f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036292 Oct 04 12:17:38.729139 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4897/7171] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:17:39.195558 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:39.196192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:39.203746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:39.204239 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:39.204689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:39.205438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:39.205893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:39.206333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:39.338014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:39.345639 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-88ec2fa8-9223-40a5-9f14-7be546e162aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1392 microversion: 2.1 time: 0.154047 Oct 04 12:17:39.346207 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2275/7172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:39 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:40.370174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:40.371574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:40.377876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:40.378374 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:40.378817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:40.379512 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:40.379972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:40.380402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:40.528397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:40.536241 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9557174-838a-457b-96d6-50718613b4d7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1392 microversion: 2.1 time: 0.171762 Oct 04 12:17:40.536829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4898/7173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:40 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:41.559626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:41.561023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:41.568383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:41.568903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:41.569381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:41.570091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:41.570612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:41.571050 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:41.700448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:41.714454 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-38f064ac-3360-4b5a-91b9-ada07e12be0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1392 microversion: 2.1 time: 0.158745 Oct 04 12:17:41.715059 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2276/7174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:41 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:42.738296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:42.738884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:42.746308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:42.746786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:42.747221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:42.747909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:42.748357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:42.748776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:42.886893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:42.894464 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-579ad3b0-1a78-47dd-84c5-4b83ab4f2333 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1392 microversion: 2.1 time: 0.160115 Oct 04 12:17:42.895041 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4899/7175] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:42 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:43.917967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:43.918741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:43.925639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:43.926137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:43.926580 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:43.927280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:43.927743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:43.928177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:44.040477 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e066aa4b-c3c1-4f9c-a0d1-8a2443b0fb19 req-00f08943-3782-4ffb-9b71-f36b52f3a241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfb4fb4-de63-4eb8-9b1c-15010740acd2", "name": "network-vif-plugged", "status": "completed", "tag": "0b5ce6ca-a416-463a-bb15-e4bad81005b0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:44.051083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e066aa4b-c3c1-4f9c-a0d1-8a2443b0fb19 req-00f08943-3782-4ffb-9b71-f36b52f3a241 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:44.051475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e066aa4b-c3c1-4f9c-a0d1-8a2443b0fb19 req-00f08943-3782-4ffb-9b71-f36b52f3a241 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:44.051912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e066aa4b-c3c1-4f9c-a0d1-8a2443b0fb19 req-00f08943-3782-4ffb-9b71-f36b52f3a241 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:44.063600 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e066aa4b-c3c1-4f9c-a0d1-8a2443b0fb19 req-00f08943-3782-4ffb-9b71-f36b52f3a241 service nova] Creating event network-vif-plugged:0b5ce6ca-a416-463a-bb15-e4bad81005b0 for instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 on n-h1-791135-8 Oct 04 12:17:44.068758 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e066aa4b-c3c1-4f9c-a0d1-8a2443b0fb19 req-00f08943-3782-4ffb-9b71-f36b52f3a241 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095387 Oct 04 12:17:44.069416 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4900/7176] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:17:44.097685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:44.106209 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c8d9fba7-62f3-4154-a0d4-d6e94097bec3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1392 microversion: 2.1 time: 0.192729 Oct 04 12:17:44.106799 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2277/7177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:43 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:45.129398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:45.130110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:45.136255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:45.136758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:45.137197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:45.137911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:45.138370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:45.138815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:45.276226 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:45.284950 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-53651479-f2aa-486a-acbb-3b21f5217e57 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1392 microversion: 2.1 time: 0.160563 Oct 04 12:17:45.285564 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4901/7178] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:45 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:46.309364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:46.310001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:46.312746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:46.318142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:46.318643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:46.319092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:46.319800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:46.320268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:46.320708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:46.453083 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:46.460850 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e8a5bc6-165d-46a1-b0e3-52b68628c690 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1563 microversion: 2.1 time: 0.155956 Oct 04 12:17:46.461470 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2278/7179] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:46 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:46.483815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:46.485250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:46.487397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:46.488068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:46.495383 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:46.495874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:46.496318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:46.497019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:46.497506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:46.497945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:46.627742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:46.635455 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-00177049-7391-49c7-9299-c035b97968dd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1563 microversion: 2.1 time: 0.155439 Oct 04 12:17:46.636032 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4902/7180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:46 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:48.496601 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:48.497221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:48.498817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-d36c0ae7-2261-4684-a338-9c290053aa15 req-019f0cf1-df48-460a-acd8-65f6c108a134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfb4fb4-de63-4eb8-9b1c-15010740acd2", "tag": "0b5ce6ca-a416-463a-bb15-e4bad81005b0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:48.504592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:48.505195 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:48.505759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:48.506548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:48.507146 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:48.507651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:48.509307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d36c0ae7-2261-4684-a338-9c290053aa15 req-019f0cf1-df48-460a-acd8-65f6c108a134 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:48.509817 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d36c0ae7-2261-4684-a338-9c290053aa15 req-019f0cf1-df48-460a-acd8-65f6c108a134 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:48.510429 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-d36c0ae7-2261-4684-a338-9c290053aa15 req-019f0cf1-df48-460a-acd8-65f6c108a134 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:48.522084 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-d36c0ae7-2261-4684-a338-9c290053aa15 req-019f0cf1-df48-460a-acd8-65f6c108a134 service nova] Creating event network-changed:0b5ce6ca-a416-463a-bb15-e4bad81005b0 for instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 on n-h1-791135-8 Oct 04 12:17:48.527476 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-d36c0ae7-2261-4684-a338-9c290053aa15 req-019f0cf1-df48-460a-acd8-65f6c108a134 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032836 Oct 04 12:17:48.528091 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4903/7181] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:17:48.664218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:48.672876 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-462313fc-a25d-457c-9c43-4ab658a79a25 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1563 microversion: 2.1 time: 0.180567 Oct 04 12:17:48.673784 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2279/7182] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:17:48 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:09.912346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:18:09.913202 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=38 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:18:09.917373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:18:09.919618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:09.927223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:09.927705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:09.928143 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:09.928833 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:09.929293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:09.929745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:09.985314 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a7e55a19-5c02-4b85-8c9c-745e548c8fb3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action" status: 200 len: 24574 microversion: 2.1 time: 0.074827 Oct 04 12:18:09.985968 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4904/7183] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:18:09 2022] POST /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action => generated 24574 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:18:21.086958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:18:21.089405 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:21.092708 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:18:21.092838 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:18:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action (ip 10.222.0.23) !!! Oct 04 12:18:21.094954 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:18:21.095765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=36 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:18:21.110758 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:21.111258 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:21.111700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:21.112408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:21.112867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:21.113298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:21.224585 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:21.230686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122408) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 12:18:21.238192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:18:21.238619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:18:21.239097 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:18:21.239510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:18:21.239929 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:18:21.303248 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c67b46ce-d59f-453d-a3a7-6be0f4da702a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action" status: 202 len: 0 microversion: 2.1 time: 0.220192 Oct 04 12:18:21.303860 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2280/7184] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:18:21 2022] POST /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:18:21.312701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:21.313457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:21.316169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:18:21.316857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:18:21.323228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:21.323701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:21.324144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:21.324847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:21.325303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:21.325758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:21.464008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:21.472124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0f147f3b-0c72-43cc-9d50-271f66e718cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1691 microversion: 2.1 time: 0.163692 Oct 04 12:18:21.472702 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4905/7185] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:21 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:22.499124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:22.499898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:22.506759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:22.507282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:22.507728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:22.508713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:22.509211 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:22.509685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:22.695378 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:22.703738 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0028454b-c764-45d7-a0ec-98554c23e725 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1691 microversion: 2.1 time: 0.210234 Oct 04 12:18:22.704309 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2281/7186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:22 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:23.726946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:23.727554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:23.735574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:23.736059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:23.736494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:23.737182 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:23.737671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:23.738099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:23.868242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:23.876545 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e9a4efdc-31f6-43be-bc3a-67f888de1d8c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.153579 Oct 04 12:18:23.877131 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4906/7187] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:23 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:24.900429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:24.900969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:24.907976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:24.908473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:24.908937 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:24.909675 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:24.910144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:24.910579 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:25.046326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:25.054535 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d274cdce-24bb-4a2b-b874-fc3a36a045ec tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.158309 Oct 04 12:18:25.055109 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2282/7188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:24 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:26.078359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:26.079010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:26.086177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:26.086706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:26.087176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:26.087876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:26.088331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:26.088760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:26.282470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:26.290185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-765b027c-3b15-48fa-9c88-bdd15786dd7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.215769 Oct 04 12:18:26.290754 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4907/7189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:26 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:27.313388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:27.314016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:27.321255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:27.321785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:27.322233 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:27.322945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:27.323415 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:27.323856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:27.456760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:27.464427 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-146c957e-f15a-434b-beca-5192aa3d5bdf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.155415 Oct 04 12:18:27.465008 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2283/7190] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:27 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:28.487647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:28.488269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:28.495183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:28.495666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:28.496106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:28.496802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:28.497262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:28.497722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:28.628345 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:28.636251 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c0fa7633-f31d-4ea8-b65e-61974f0bfebe tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.152519 Oct 04 12:18:28.636830 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4908/7191] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:28 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:29.660184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:29.660802 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:29.667493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:29.667978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:29.669025 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:29.669744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:29.670201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:29.670628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:30.055546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:30.063906 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2ccca2bf-1090-4105-b443-2f06ba0c91e1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.407509 Oct 04 12:18:30.064488 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2284/7192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:29 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:31.087472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:31.088019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:31.095653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:31.096138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:31.096571 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:31.097261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:31.097743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:31.098170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:31.235397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:31.243094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64b4c8c8-9365-45e9-83fb-4e68afd449c4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.159637 Oct 04 12:18:31.243658 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4909/7193] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:31 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:32.268037 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:32.268666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:32.275965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:32.276471 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:32.276922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:32.277671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:32.278144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:32.278587 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:32.412542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:32.420169 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-70f4cb83-7b66-4d0e-becb-62225e3ad493 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.156038 Oct 04 12:18:32.420735 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2285/7194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:32 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:33.443809 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:33.444421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:33.452087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:33.452570 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:33.453001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:33.453721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:33.454174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:33.454598 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:33.585131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:33.592795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c198b344-bf27-4b1d-9a13-2ea3c4fb97d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.152889 Oct 04 12:18:33.593397 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4910/7195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:33 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:34.616235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:34.616880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:34.624280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:34.624775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:34.625225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:34.625952 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:34.626425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:34.626867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:34.757256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:34.765478 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f5524ab6-8a11-4683-80ef-2f010907fd37 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.153171 Oct 04 12:18:34.766051 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2286/7196] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:34 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:35.788764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:35.789443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:35.796349 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:35.796837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:35.797280 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:35.798005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:35.798475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:35.798909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:35.930647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:35.938393 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3fcec6d0-ccf2-4d72-87f8-926f68e8c121 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.153553 Oct 04 12:18:35.938977 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4911/7197] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:35 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:36.961188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:36.961841 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:36.971189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:36.971689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:36.972142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:36.972847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:36.973314 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:36.973787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:37.107159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:37.114826 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-69d67ec8-0b9b-466a-8791-a04cdec09c90 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.157605 Oct 04 12:18:37.115400 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2287/7198] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:36 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:38.183152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:38.183772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:38.189879 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:38.190367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:38.190806 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:38.191501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:38.191963 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:38.192394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:38.323971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:38.332180 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a8dc7a77-ba73-4691-a539-615b5ecde964 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.198179 Oct 04 12:18:38.332866 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4912/7199] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:38 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:39.356085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:39.356814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:39.363485 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:39.363983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:39.364463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:39.365172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:39.365676 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:39.366116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:39.496023 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:39.504316 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6f8fa1e8-d6d5-4402-9f50-85a64c4c2c7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1696 microversion: 2.1 time: 0.152169 Oct 04 12:18:39.504892 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2288/7200] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:39 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:40.529847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:40.530474 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:40.538313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:40.538814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:40.539257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:40.540101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:40.540568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:40.541051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:40.691597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:40.702236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72b37d13-33da-4292-9b73-1bb2b79c0e89 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1695 microversion: 2.1 time: 0.177840 Oct 04 12:18:40.703027 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4913/7201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:40 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:40.776818 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-a5ae95b8-967c-404a-92af-2f716dd104fe req-553feebb-01cb-4978-bea5-fc0c3eee66af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfb4fb4-de63-4eb8-9b1c-15010740acd2", "name": "network-vif-unplugged", "status": "completed", "tag": "0b5ce6ca-a416-463a-bb15-e4bad81005b0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:18:40.787616 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a5ae95b8-967c-404a-92af-2f716dd104fe req-553feebb-01cb-4978-bea5-fc0c3eee66af service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:40.788125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a5ae95b8-967c-404a-92af-2f716dd104fe req-553feebb-01cb-4978-bea5-fc0c3eee66af service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:40.788570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-a5ae95b8-967c-404a-92af-2f716dd104fe req-553feebb-01cb-4978-bea5-fc0c3eee66af service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:40.803088 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-a5ae95b8-967c-404a-92af-2f716dd104fe req-553feebb-01cb-4978-bea5-fc0c3eee66af service nova] Creating event network-vif-unplugged:0b5ce6ca-a416-463a-bb15-e4bad81005b0 for instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 on n-h2-791135-8 Oct 04 12:18:40.809431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-a5ae95b8-967c-404a-92af-2f716dd104fe req-553feebb-01cb-4978-bea5-fc0c3eee66af service nova] Instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 12:18:40.820647 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-a5ae95b8-967c-404a-92af-2f716dd104fe req-553feebb-01cb-4978-bea5-fc0c3eee66af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047656 Oct 04 12:18:40.821462 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2289/7202] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:18:41.726549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:41.727289 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:41.734748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:41.735255 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:41.735699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:41.736697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:41.737402 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:41.738106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:41.879684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:41.890045 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-72259aa3-ffdc-4598-a104-a59a698e4fde tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1695 microversion: 2.1 time: 0.167037 Oct 04 12:18:41.890693 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4914/7203] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:41 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:42.841016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-20000d24-5020-4ac4-85cb-6216306e4564 req-108fd49e-ef77-4c47-ba93-ed6e15732117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfb4fb4-de63-4eb8-9b1c-15010740acd2", "tag": "0b5ce6ca-a416-463a-bb15-e4bad81005b0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:18:42.850428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-20000d24-5020-4ac4-85cb-6216306e4564 req-108fd49e-ef77-4c47-ba93-ed6e15732117 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:42.850912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-20000d24-5020-4ac4-85cb-6216306e4564 req-108fd49e-ef77-4c47-ba93-ed6e15732117 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:42.851353 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-20000d24-5020-4ac4-85cb-6216306e4564 req-108fd49e-ef77-4c47-ba93-ed6e15732117 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:42.864555 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-20000d24-5020-4ac4-85cb-6216306e4564 req-108fd49e-ef77-4c47-ba93-ed6e15732117 service nova] Creating event network-changed:0b5ce6ca-a416-463a-bb15-e4bad81005b0 for instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 on n-h2-791135-8 Oct 04 12:18:42.869643 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [req-20000d24-5020-4ac4-85cb-6216306e4564 req-108fd49e-ef77-4c47-ba93-ed6e15732117 service nova] Instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-791135-8', 'n-h1-791135-8'} {{(pid=122408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 12:18:42.880631 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-20000d24-5020-4ac4-85cb-6216306e4564 req-108fd49e-ef77-4c47-ba93-ed6e15732117 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044685 Oct 04 12:18:42.881229 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2290/7204] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:18:42.913976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:42.914585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:42.921529 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:42.922019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:42.922452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:42.923269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:42.923678 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:42.924110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:43.158715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:43.166402 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6caea3ee-3b88-47bc-80c4-a1b8e19c93ac tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1693 microversion: 2.1 time: 0.256272 Oct 04 12:18:43.167000 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4915/7205] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:42 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1693 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:44.190800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:44.191508 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:44.197606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:44.198094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:44.198536 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:44.199228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:44.199690 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:44.200711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:44.335237 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:44.342813 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a232d899-d500-4637-9061-ba48216fa109 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1693 microversion: 2.1 time: 0.157155 Oct 04 12:18:44.343368 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2291/7206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:44 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:45.366038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:45.366643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:45.373547 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:45.374030 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:45.374462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:45.375149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:45.375599 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:45.376022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:45.506998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:45.515200 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b53d6156-776e-412f-885c-65d03469df7c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1690 microversion: 2.1 time: 0.153067 Oct 04 12:18:45.515777 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4916/7207] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:45 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:45.538229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:18:45.538786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:45.545480 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:45.545983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:45.546431 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:45.547158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:45.547607 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:45.548047 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:45.604293 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-39a77822-e11f-4897-9a16-935d667b71cb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action" status: 204 len: 0 microversion: 2.1 time: 0.069708 Oct 04 12:18:45.604955 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2292/7208] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:18:45 2022] POST /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:18:45.613399 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:45.614015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:45.620248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:45.620801 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:45.621294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:45.622187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:45.622644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:45.623084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:45.832592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:45.840289 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aed131b8-c25b-4e62-91c7-d4c1409ebb80 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1690 microversion: 2.1 time: 0.230918 Oct 04 12:18:45.840866 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4917/7209] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:45 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:45.863470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:45.864227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:45.871473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:45.872467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:45.872922 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:45.873666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:45.874141 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:45.874584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:46.009399 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:46.019284 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fc600da4-8b13-4358-aed9-2e2b25c3ee03 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1690 microversion: 2.1 time: 0.160551 Oct 04 12:18:46.019912 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2293/7210] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:45 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:18:47.043278 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:18:47.044519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:18:47.051111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:47.051594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:47.052032 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:47.052727 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:47.053186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:47.053636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:47.186977 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:18:47.195024 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-52e1fedc-086e-47e9-b689-be7896225a4b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1682 microversion: 2.1 time: 0.155677 Oct 04 12:18:47.196221 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4918/7211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:18:47 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:18:48.542917 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-efc1c781-ab80-48b5-aa41-96062115daa9 req-757ba330-831c-4a07-a707-26b7f370d042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfb4fb4-de63-4eb8-9b1c-15010740acd2", "name": "network-vif-plugged", "status": "completed", "tag": "0b5ce6ca-a416-463a-bb15-e4bad81005b0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:18:48.554144 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-efc1c781-ab80-48b5-aa41-96062115daa9 req-757ba330-831c-4a07-a707-26b7f370d042 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:18:48.554641 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-efc1c781-ab80-48b5-aa41-96062115daa9 req-757ba330-831c-4a07-a707-26b7f370d042 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:18:48.555081 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-efc1c781-ab80-48b5-aa41-96062115daa9 req-757ba330-831c-4a07-a707-26b7f370d042 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:18:48.568831 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-efc1c781-ab80-48b5-aa41-96062115daa9 req-757ba330-831c-4a07-a707-26b7f370d042 service nova] Creating event network-vif-plugged:0b5ce6ca-a416-463a-bb15-e4bad81005b0 for instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 on n-h2-791135-8 Oct 04 12:18:48.573819 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-efc1c781-ab80-48b5-aa41-96062115daa9 req-757ba330-831c-4a07-a707-26b7f370d042 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034599 Oct 04 12:18:48.574672 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2294/7212] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:19:19.417085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:19:19.419845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:19.422318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=28 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:19:19.422964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=84 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:19:19.430039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:19.430520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:19.430959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:19.431643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:19.432094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:19.432517 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:19.503309 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97262b98-b0b0-402a-924a-3b506b47ac86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action" status: 200 len: 24576 microversion: 2.1 time: 0.089992 Oct 04 12:19:19.503974 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4919/7213] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:19:19 2022] POST /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2/action => generated 24576 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:19:37.007067 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:37.008362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:37.008962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-c6cde184-8142-42cc-8bbc-7016440b7002 req-1cc1c030-b5e1-489a-b994-7520deb10bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cfb4fb4-de63-4eb8-9b1c-15010740acd2", "tag": "0b5ce6ca-a416-463a-bb15-e4bad81005b0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:19:37.010806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=34 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:19:37.011496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:19:37.016488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:19:37.017579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:19:37.018369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:37.018890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:37.019446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:37.020356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:37.020838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:37.021286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:37.025386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c6cde184-8142-42cc-8bbc-7016440b7002 req-1cc1c030-b5e1-489a-b994-7520deb10bca service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:37.025558 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c6cde184-8142-42cc-8bbc-7016440b7002 req-1cc1c030-b5e1-489a-b994-7520deb10bca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:37.025974 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-c6cde184-8142-42cc-8bbc-7016440b7002 req-1cc1c030-b5e1-489a-b994-7520deb10bca service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:37.038297 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-c6cde184-8142-42cc-8bbc-7016440b7002 req-1cc1c030-b5e1-489a-b994-7520deb10bca service nova] Creating event network-changed:0b5ce6ca-a416-463a-bb15-e4bad81005b0 for instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 on n-h2-791135-8 Oct 04 12:19:37.043344 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-c6cde184-8142-42cc-8bbc-7016440b7002 req-1cc1c030-b5e1-489a-b994-7520deb10bca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038958 Oct 04 12:19:37.043958 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4920/7214] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:19:37.049681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:19:37.128638 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3029e5dd-764f-47f0-b632-603e89ebe752 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 204 len: 0 microversion: 2.1 time: 0.125871 Oct 04 12:19:37.133459 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2295/7215] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:19:37 2022] DELETE /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:19:37.139776 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:37.140742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:37.147998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:37.148755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:37.149193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:37.149928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:37.150385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:37.150813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:37.287566 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:37.296217 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-77145eef-05c6-445a-9913-7710cbd92da4 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1688 microversion: 2.1 time: 0.161436 Oct 04 12:19:37.296799 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4921/7216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:37 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:38.320618 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:38.321449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:38.328847 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:38.329357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:38.329815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:38.330523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:38.330991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:38.331427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:38.495305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:38.503658 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8f3bcdd5-f93d-40c7-8d5f-f2b44c87ebf9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1688 microversion: 2.1 time: 0.187304 Oct 04 12:19:38.504233 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2296/7217] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:38 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:39.167962 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-21e9dbe5-e375-4733-ae62-0f4c85d2ff2f req-85ad40c9-4cb0-4d26-9e4b-8694562904de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cfb4fb4-de63-4eb8-9b1c-15010740acd2", "name": "network-vif-deleted", "tag": "0b5ce6ca-a416-463a-bb15-e4bad81005b0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:19:39.179031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-21e9dbe5-e375-4733-ae62-0f4c85d2ff2f req-85ad40c9-4cb0-4d26-9e4b-8694562904de service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:39.179509 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-21e9dbe5-e375-4733-ae62-0f4c85d2ff2f req-85ad40c9-4cb0-4d26-9e4b-8694562904de service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:39.179938 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-21e9dbe5-e375-4733-ae62-0f4c85d2ff2f req-85ad40c9-4cb0-4d26-9e4b-8694562904de service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:39.191147 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-21e9dbe5-e375-4733-ae62-0f4c85d2ff2f req-85ad40c9-4cb0-4d26-9e4b-8694562904de service nova] Creating event network-vif-deleted:0b5ce6ca-a416-463a-bb15-e4bad81005b0 for instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 on n-h2-791135-8 Oct 04 12:19:39.196222 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-21e9dbe5-e375-4733-ae62-0f4c85d2ff2f req-85ad40c9-4cb0-4d26-9e4b-8694562904de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032190 Oct 04 12:19:39.196813 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4922/7218] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:19:39.532893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:39.533637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:39.541259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:39.541259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:39.541259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:39.541259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:39.541259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:39.544172 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:39.579697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:39.580193 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:39.580638 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:39.581099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lazy-loading 'fault' on Instance uuid 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:19:39.624911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:39.632743 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3efecd43-89aa-4ae7-b97f-e7823a4b0921 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 200 len: 1357 microversion: 2.1 time: 0.104457 Oct 04 12:19:39.633497 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2297/7219] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:39 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:40.658660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:40.660285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 0cfb4fb4-de63-4eb8-9b1c-15010740acd2] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:40.668687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:40.669186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:40.670395 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:40.671118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:40.671583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:40.672011 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:40.686252 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] HTTP exception thrown: Instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 could not be found. Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Request method failure captured: Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 HTTP/1.1 Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCNxL0rAyY6LJuD68NhR5sU35ePaZ4BZ4z8muaqu7Df2RjlPMFPDumyKIM8t3nCO2ArvqT5G6F5K_tmFwBmDBZEH5VeCGCrV0-Wixf1NfktuVfEnNtiTHoO5nqWegE0_B7QVJjS-KHol72zxyy0AhYlRk46Toi8vKzA2ssSsEEwfREM Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f489bde728945dc8c2094c8ebd99afb"}]}] Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 83c9db5be81345af81be484a189292a3 Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 could not be found. Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '0cfb4fb4-de63-4eb8-9b1c-15010740acd2'} Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 could not be found. Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 could not be found. Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:19:40.687927 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 could not be found. Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Returning 404 to user: Instance 0cfb4fb4-de63-4eb8-9b1c-15010740acd2 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:19:40.692102 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-cb153685-5b15-4c9c-b044-76b97ae894cf tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2" status: 404 len: 111 microversion: 2.1 time: 0.035491 Oct 04 12:19:40.697722 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4923/7220] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:40 2022] GET /compute/v2.1/servers/0cfb4fb4-de63-4eb8-9b1c-15010740acd2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:19:43.987299 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b87d03ba-64a1-4e00-87bf-7e36c7214414 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '.version_select at 0x7f71cc512940>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:43.991865 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b87d03ba-64a1-4e00-87bf-7e36c7214414 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [e895f24a-1a5c-4f4c-a9b0-814b1b9d4209] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:19:45.000702 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [None req-b87d03ba-64a1-4e00-87bf-7e36c7214414 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [e895f24a-1a5c-4f4c-a9b0-814b1b9d4209] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37698. Oct 04 12:19:45.020476 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b87d03ba-64a1-4e00-87bf-7e36c7214414 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1110767106" status: 202 len: 0 microversion: 2.1 time: 1.036940 Oct 04 12:19:45.021066 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2298/7221] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 4 12:19:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1110767106 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:19:45.049420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a5e7365c-7a36-4afb-8894-d3724abd4fb5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: .version_select at 0x7f71cef0e1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1355959395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfPgYNu7n+jvc6IkXIAeZ1Jl4Zh0fZyiXlOS+nnOrg6lCdPpR/KzEGUbD0gN3wodRLUn9elNw9gv5nhKUE6GRkegBqaMLNJoID/xmvDbJk67CrATD/k5akYEnkOoVZnng=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:19:45.066430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a5e7365c-7a36-4afb-8894-d3724abd4fb5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:19:45.071555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a5e7365c-7a36-4afb-8894-d3724abd4fb5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:19:45.084571 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5e7365c-7a36-4afb-8894-d3724abd4fb5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [3ba564bb-cde8-4079-bd63-cad7bb0f661d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:19:46.092379 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5e7365c-7a36-4afb-8894-d3724abd4fb5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [3ba564bb-cde8-4079-bd63-cad7bb0f661d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37702. Oct 04 12:19:46.106692 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a5e7365c-7a36-4afb-8894-d3724abd4fb5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.061806 Oct 04 12:19:46.107312 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4924/7222] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:19:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:19:51.648541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1436229725", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "9beff52b-808f-477b-80df-84c668594c44"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1355959395", "security_groups": [{"name": "tempest-secgroup-smoke-1452072770"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:19:51.659547 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:19:51.780861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] validate_networks() for [('9beff52b-808f-477b-80df-84c668594c44', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:19:52.175592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:19:52.176092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:19:52.177064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:19:52.177739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:19:52.178334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:19:52.190395 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:52.191321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:52.192031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:52.192898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:52.193600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:52.194127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:52.211688 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:19:52.218084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:19:52.230825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:19:52.233776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:19:52.284406 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b2f0992d-6560-41c1-81b1-6cf81c0eefd9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.640110 Oct 04 12:19:52.292900 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2299/7223] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:19:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:19:52.299003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-018d34ca-fd9e-447a-9e63-c88d0721c347 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:52.299627 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-018d34ca-fd9e-447a-9e63-c88d0721c347 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:52.301730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:19:52.368085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-018d34ca-fd9e-447a-9e63-c88d0721c347 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:52.375884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-018d34ca-fd9e-447a-9e63-c88d0721c347 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1267 microversion: 2.1 time: 0.081628 Oct 04 12:19:52.376614 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4925/7224] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:52 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:53.399560 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:53.401235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:53.411496 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:53.412005 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:53.413073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:53.414355 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:53.414834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:53.415273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:53.520134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:53.528724 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3c35320e-e49e-4af1-bbfd-6dcc33345fd6 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1337 microversion: 2.1 time: 0.133440 Oct 04 12:19:53.530258 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2300/7225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:53 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1337 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:54.554890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:54.556149 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:54.565406 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:54.566008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:54.566452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:54.567159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:54.567619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:54.568060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:54.792580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:54.800879 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2b430a70-801c-4ac6-ade1-210fb5b0346e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1393 microversion: 2.1 time: 0.251199 Oct 04 12:19:54.801493 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4926/7226] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:54 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1393 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:54.976782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-bf9b4857-7b6a-4881-962c-f7434325e99d req-907427d9-2078-4997-a49c-65af046c5273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f1497b-1bae-490f-8b10-474cc57f50a0", "tag": "21f36756-fdc4-45aa-b9e3-83f1fd9c754b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:19:54.987209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bf9b4857-7b6a-4881-962c-f7434325e99d req-907427d9-2078-4997-a49c-65af046c5273 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:54.987695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bf9b4857-7b6a-4881-962c-f7434325e99d req-907427d9-2078-4997-a49c-65af046c5273 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:54.988134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-bf9b4857-7b6a-4881-962c-f7434325e99d req-907427d9-2078-4997-a49c-65af046c5273 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:55.000272 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-bf9b4857-7b6a-4881-962c-f7434325e99d req-907427d9-2078-4997-a49c-65af046c5273 service nova] Creating event network-changed:21f36756-fdc4-45aa-b9e3-83f1fd9c754b for instance 50f1497b-1bae-490f-8b10-474cc57f50a0 on n-h1-791135-8 Oct 04 12:19:55.005273 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-bf9b4857-7b6a-4881-962c-f7434325e99d req-907427d9-2078-4997-a49c-65af046c5273 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033350 Oct 04 12:19:55.006012 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2301/7227] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:19:55.824492 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:55.825034 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:55.831875 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:55.832352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:55.832785 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:55.833494 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:55.833949 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:55.834368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:55.968196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:55.975804 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a76587f4-62b3-4815-943f-3cc3a2baf53d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1393 microversion: 2.1 time: 0.155311 Oct 04 12:19:55.976362 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4927/7228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:55 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:57.000444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:57.001177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:57.007341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:57.007824 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:57.008262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:57.008953 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:57.009433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:57.009864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:57.139523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:57.147147 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-fa403965-d108-42c6-8cc7-d96873e46ca9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1393 microversion: 2.1 time: 0.152448 Oct 04 12:19:57.147728 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2302/7229] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:56 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:58.170849 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:58.171457 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:58.178258 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:58.178680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:58.179115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:58.179800 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:58.180250 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:58.180673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:58.317212 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:58.324875 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3677466-0d2b-4936-a3b8-5aeee7291191 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1393 microversion: 2.1 time: 0.158431 Oct 04 12:19:58.325475 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4928/7230] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:58 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:19:59.347551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:19:59.348183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:19:59.354900 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:59.355396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:59.355845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:59.356548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:19:59.357015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:19:59.357489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:19:59.491683 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:19:59.499999 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af9d0833-7ddc-4054-8a22-83ed441f29f5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1393 microversion: 2.1 time: 0.156354 Oct 04 12:19:59.500572 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2303/7231] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:19:59 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:00.524286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:00.524981 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:00.532613 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:00.533111 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:00.533710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:00.534459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:00.534951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:00.535422 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:00.653867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-426dccd4-5fcd-43b8-88ba-e10a91cf886e req-56321cf7-2d55-4654-a663-8fcd3c3506f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f1497b-1bae-490f-8b10-474cc57f50a0", "name": "network-vif-plugged", "status": "completed", "tag": "21f36756-fdc4-45aa-b9e3-83f1fd9c754b"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:20:00.665227 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-426dccd4-5fcd-43b8-88ba-e10a91cf886e req-56321cf7-2d55-4654-a663-8fcd3c3506f6 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:00.665834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-426dccd4-5fcd-43b8-88ba-e10a91cf886e req-56321cf7-2d55-4654-a663-8fcd3c3506f6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:00.666371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-426dccd4-5fcd-43b8-88ba-e10a91cf886e req-56321cf7-2d55-4654-a663-8fcd3c3506f6 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:00.671851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:00.678184 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-426dccd4-5fcd-43b8-88ba-e10a91cf886e req-56321cf7-2d55-4654-a663-8fcd3c3506f6 service nova] Creating event network-vif-plugged:21f36756-fdc4-45aa-b9e3-83f1fd9c754b for instance 50f1497b-1bae-490f-8b10-474cc57f50a0 on n-h1-791135-8 Oct 04 12:20:00.679787 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0ca99652-c2a0-4fae-811d-dccaf77b474f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1393 microversion: 2.1 time: 0.160022 Oct 04 12:20:00.681549 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4929/7232] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:00 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:20:00.683347 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-426dccd4-5fcd-43b8-88ba-e10a91cf886e req-56321cf7-2d55-4654-a663-8fcd3c3506f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034626 Oct 04 12:20:00.684036 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2304/7233] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:20:01.703664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:01.704310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:01.711197 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:01.711683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:01.712120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:01.712811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:01.713273 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:01.713748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:01.848081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:01.855849 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5158302f-5447-4c00-984c-16965e174187 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1393 microversion: 2.1 time: 0.156183 Oct 04 12:20:01.856445 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4930/7234] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:01 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:02.878631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:02.879414 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:02.883763 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:02.884511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:02.895116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:02.895766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:02.896218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:02.896932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:02.897428 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:02.897864 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:03.030212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:03.038423 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1e0c4e10-fc7a-4b09-ac97-8b3f0cfbd268 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1564 microversion: 2.1 time: 0.162151 Oct 04 12:20:03.039013 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2305/7235] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:02 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:03.061264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:03.061916 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:03.063845 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:03.069869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:03.070367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:03.070808 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:03.071499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:03.071957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:03.072388 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:03.204568 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:03.212454 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c107372a-0cd2-4607-82ad-c9b84c8ba14d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1564 microversion: 2.1 time: 0.155172 Oct 04 12:20:03.213028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4931/7236] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:03 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:05.078201 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:05.078823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:05.087029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:05.087523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:05.088168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:05.089066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:05.089571 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:05.090006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:05.159375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-88b546fb-774e-4e36-b51d-9dddde16e30f req-b2647c61-46ae-42eb-b951-d6177e1f9512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f1497b-1bae-490f-8b10-474cc57f50a0", "tag": "21f36756-fdc4-45aa-b9e3-83f1fd9c754b"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:20:05.170056 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88b546fb-774e-4e36-b51d-9dddde16e30f req-b2647c61-46ae-42eb-b951-d6177e1f9512 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:05.170482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88b546fb-774e-4e36-b51d-9dddde16e30f req-b2647c61-46ae-42eb-b951-d6177e1f9512 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:05.170913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-88b546fb-774e-4e36-b51d-9dddde16e30f req-b2647c61-46ae-42eb-b951-d6177e1f9512 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:05.184022 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-88b546fb-774e-4e36-b51d-9dddde16e30f req-b2647c61-46ae-42eb-b951-d6177e1f9512 service nova] Creating event network-changed:21f36756-fdc4-45aa-b9e3-83f1fd9c754b for instance 50f1497b-1bae-490f-8b10-474cc57f50a0 on n-h1-791135-8 Oct 04 12:20:05.189989 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-88b546fb-774e-4e36-b51d-9dddde16e30f req-b2647c61-46ae-42eb-b951-d6177e1f9512 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111751 Oct 04 12:20:05.190828 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4932/7237] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:20:05.229015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:05.236969 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-44285967-f702-4bf3-b6e2-edc743c5b6ba tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1564 microversion: 2.1 time: 0.163110 Oct 04 12:20:05.237694 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2306/7238] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:05 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:26.482521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:26.483267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=38 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:26.488014 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:20:26.490421 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:26.497751 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:26.498887 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:26.499333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:26.500019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:26.500469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:26.500890 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:26.554067 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f9e4603d-1e75-47ce-96c2-5c11dc7373c1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action" status: 200 len: 24569 microversion: 2.1 time: 0.073717 Oct 04 12:20:26.554708 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4933/7239] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:20:26 2022] POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action => generated 24569 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:20:37.574272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-dba734fd-fef0-463e-93e5-00798f5bf13a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:20:37.576512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:37.577175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=36 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:37.584082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba734fd-fef0-463e-93e5-00798f5bf13a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:37.584574 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba734fd-fef0-463e-93e5-00798f5bf13a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:37.585015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-dba734fd-fef0-463e-93e5-00798f5bf13a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:37.608006 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-dba734fd-fef0-463e-93e5-00798f5bf13a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Going to try to stop instance {{(pid=122408) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 12:20:37.648236 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-dba734fd-fef0-463e-93e5-00798f5bf13a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action" status: 202 len: 0 microversion: 2.1 time: 0.077850 Oct 04 12:20:37.648836 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2307/7240] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:20:37 2022] POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:20:37.657781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:37.658483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:37.661308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:37.662131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:20:37.668579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:37.669064 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:37.669528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:37.670224 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:37.670677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:37.671100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:37.808019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:37.816522 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5fd85d32-1952-4e9a-bf60-6b1648c607d2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.162911 Oct 04 12:20:37.817027 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4934/7241] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:37 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:38.842281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:38.842945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:38.849575 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:38.850074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:38.850519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:38.851218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:38.851692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:38.852130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:38.982386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:38.989916 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7fc5a7c9-c89a-4d3d-8573-6071ad81f44d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.152868 Oct 04 12:20:38.990514 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2308/7242] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:38 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:40.012972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:40.013616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:40.020475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:40.020969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:40.021428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:40.022167 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:40.022581 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:40.023013 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:40.429680 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:40.437247 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-3431ed56-c1d5-4e68-a096-d5e6fb26e984 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.428244 Oct 04 12:20:40.437835 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4935/7243] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:40 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:41.460741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:41.461413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:41.469000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:41.469557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:41.470003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:41.470706 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:41.471170 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:41.471606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:41.606746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:41.615117 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e7d7b480-052d-424d-9533-d881eee7bc44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.158299 Oct 04 12:20:41.615695 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2309/7244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:41 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:42.638009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:42.638612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:42.645443 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:42.645927 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:42.646359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:42.647046 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:42.647498 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:42.647924 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:42.781594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:42.789721 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-09bb7383-cd90-4ab7-9c30-ad9d867629d9 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.155523 Oct 04 12:20:42.790279 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4936/7245] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:42 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:43.813650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:43.814198 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:43.820908 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:43.821427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:43.821866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:43.822556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:43.823013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:43.823443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:43.952087 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:43.960351 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-17972df8-402f-427e-9860-804aa5073c0e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.150648 Oct 04 12:20:43.960936 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2310/7246] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:43 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:44.984154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:44.984774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:44.992286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:44.992781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:44.993227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:44.993968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:44.994435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:44.994871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:45.123911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:45.131712 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c7c64a3f-2a10-4e21-a266-fdac191d606f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.151448 Oct 04 12:20:45.132274 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4937/7247] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:44 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:46.155246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:46.155863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:46.163266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:46.163749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:46.164197 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:46.164873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:46.165334 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:46.165785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:46.300782 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:46.308426 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-72049ecd-9e1a-47e4-a29f-6df16f136267 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.157046 Oct 04 12:20:46.308990 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2311/7248] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:46 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:47.331630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:47.332298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:47.339210 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:47.339705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:47.340152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:47.340888 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:47.341379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:47.341815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:47.475505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:47.483212 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c125bb27-16b0-4121-a3b5-ed1f0a25f931 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.155496 Oct 04 12:20:47.483785 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4938/7249] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:47 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:48.507925 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:48.508542 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:48.515402 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:48.515887 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:48.516329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:48.517019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:48.517515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:48.517949 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:48.647544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:48.655351 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-472e7b80-acfc-49d6-9e2f-3ea7e70fc1f1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.151367 Oct 04 12:20:48.655912 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2312/7250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:48 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:49.678754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:49.679368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:49.686228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:49.686708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:49.687142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:49.687836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:49.688796 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:49.689225 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:49.818786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:49.826452 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-58c7e9cf-30df-46a5-a3da-cb68eca1e5b1 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.151563 Oct 04 12:20:49.827028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4939/7251] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:49 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:50.850266 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:50.850800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:50.857486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:50.857975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:50.858418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:50.859111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:50.859570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:50.860031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:50.989951 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:50.998366 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e71d3b31-5f76-4f10-9463-f04cf730978f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.151932 Oct 04 12:20:50.999259 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2313/7252] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:50 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:52.022503 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:52.023325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:52.030490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:52.030985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:52.031424 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:52.032648 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:52.033107 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:52.033574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:52.164802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:52.172544 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac0db86a-513b-492c-80c1-71f6230e2127 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1692 microversion: 2.1 time: 0.155087 Oct 04 12:20:52.173114 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4940/7253] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:52 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:53.195814 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:53.196429 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:53.202387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:53.202875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:53.203320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:53.204674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:53.205136 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:53.205853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:53.337923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:53.345685 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-afdc074a-f7f7-4e3f-bb76-0804318a6664 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1669 microversion: 2.1 time: 0.154005 Oct 04 12:20:53.346255 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2314/7254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:53 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:54.441400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:20:54.443759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:54.450674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:54.451346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:54.451794 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:54.452490 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:54.452952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:54.453412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:54.505884 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-97710c2a-5d13-486c-9bbe-5915bbc394b5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action" status: 200 len: 38384 microversion: 2.1 time: 0.068285 Oct 04 12:20:54.506522 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4941/7255] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:20:54 2022] POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action => generated 38384 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:20:54.519358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-14257e33-94df-4896-9db5-6907655c067f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:20:54.526549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14257e33-94df-4896-9db5-6907655c067f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:54.527224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14257e33-94df-4896-9db5-6907655c067f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:54.527666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-14257e33-94df-4896-9db5-6907655c067f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:54.550298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-14257e33-94df-4896-9db5-6907655c067f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Going to try to start instance {{(pid=122408) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 12:20:54.591867 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-14257e33-94df-4896-9db5-6907655c067f tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action" status: 202 len: 0 microversion: 2.1 time: 0.077037 Oct 04 12:20:54.592477 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2315/7256] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:20:54 2022] POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:20:54.601926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:54.602767 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:54.610188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:54.610904 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:54.611343 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:54.612050 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:54.612538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:54.612969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:54.833370 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:54.841090 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ee48ab8c-b745-469b-b50b-d686dbb55dd3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1678 microversion: 2.1 time: 0.243434 Oct 04 12:20:54.841770 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4942/7257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:54 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:20:55.865901 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:20:55.866509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:20:55.872588 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:55.873073 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:55.873556 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:55.874247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:20:55.874709 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:20:55.875139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:20:56.003682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:20:56.011293 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-62a624c6-20bc-45bb-a81b-d4adc250f615 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1682 microversion: 2.1 time: 0.150650 Oct 04 12:20:56.011867 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2316/7258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:20:55 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:20.487563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:21:20.489786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:20.492795 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:21:20.492928 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:21:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action (ip 10.222.0.23) !!! Oct 04 12:21:20.494079 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=18 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:20.494870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=52 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:20.503484 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:20.503972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:20.504415 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:20.505118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:20.505602 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:20.506035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:20.559795 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4fb658eb-15bb-4096-ba94-de315776996d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action" status: 200 len: 62950 microversion: 2.1 time: 0.075781 Oct 04 12:21:20.560747 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4943/7259] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:21:20 2022] POST /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0/action => generated 62950 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:21:27.600515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:27.601031 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:27.603572 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=20 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:27.604048 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-870851d7-8f69-4c69-9002-6bd236c64980 req-f1d63ac4-0d96-434a-9409-fd1351a91bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50f1497b-1bae-490f-8b10-474cc57f50a0", "tag": "21f36756-fdc4-45aa-b9e3-83f1fd9c754b"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:21:27.604713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:27.611942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:27.612217 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:27.612660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:27.613384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:27.613853 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:27.614282 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:27.616410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-870851d7-8f69-4c69-9002-6bd236c64980 req-f1d63ac4-0d96-434a-9409-fd1351a91bf4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:27.616986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-870851d7-8f69-4c69-9002-6bd236c64980 req-f1d63ac4-0d96-434a-9409-fd1351a91bf4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:27.617526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-870851d7-8f69-4c69-9002-6bd236c64980 req-f1d63ac4-0d96-434a-9409-fd1351a91bf4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:27.629948 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-870851d7-8f69-4c69-9002-6bd236c64980 req-f1d63ac4-0d96-434a-9409-fd1351a91bf4 service nova] Creating event network-changed:21f36756-fdc4-45aa-b9e3-83f1fd9c754b for instance 50f1497b-1bae-490f-8b10-474cc57f50a0 on n-h1-791135-8 Oct 04 12:21:27.635135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-870851d7-8f69-4c69-9002-6bd236c64980 req-f1d63ac4-0d96-434a-9409-fd1351a91bf4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035738 Oct 04 12:21:27.636058 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4944/7260] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:21:27.643080 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:21:27.728543 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e1d9e89-53fd-48e4-95a8-efe016a604a3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 204 len: 0 microversion: 2.1 time: 0.131903 Oct 04 12:21:27.732453 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2317/7261] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:21:27 2022] DELETE /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:21:27.739350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:27.740083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:27.746815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:27.747398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:27.747860 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:27.748654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:27.749198 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:27.749747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:27.913576 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:27.921504 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d8c72c49-c164-4c37-970b-341c83f4b51c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1688 microversion: 2.1 time: 0.187510 Oct 04 12:21:27.922084 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4945/7262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:27 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:28.945645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:28.946384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:28.953079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:28.953603 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:28.954051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:28.954751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:28.955718 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:28.956153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:29.100514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:29.108380 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a3ae8cd6-272f-4cab-913d-6583e3b8f392 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1688 microversion: 2.1 time: 0.167091 Oct 04 12:21:29.108953 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2318/7263] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:28 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:29.836164 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-080763ad-f305-4ded-a3f8-1d95dfa803c4 req-ddb1e3ee-1ce1-4348-8454-61893b1804be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50f1497b-1bae-490f-8b10-474cc57f50a0", "name": "network-vif-deleted", "tag": "21f36756-fdc4-45aa-b9e3-83f1fd9c754b"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:21:29.847368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-080763ad-f305-4ded-a3f8-1d95dfa803c4 req-ddb1e3ee-1ce1-4348-8454-61893b1804be service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:29.847791 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-080763ad-f305-4ded-a3f8-1d95dfa803c4 req-ddb1e3ee-1ce1-4348-8454-61893b1804be service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:29.848242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-080763ad-f305-4ded-a3f8-1d95dfa803c4 req-ddb1e3ee-1ce1-4348-8454-61893b1804be service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:29.859640 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-080763ad-f305-4ded-a3f8-1d95dfa803c4 req-ddb1e3ee-1ce1-4348-8454-61893b1804be service nova] Creating event network-vif-deleted:21f36756-fdc4-45aa-b9e3-83f1fd9c754b for instance 50f1497b-1bae-490f-8b10-474cc57f50a0 on n-h1-791135-8 Oct 04 12:21:29.864559 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-080763ad-f305-4ded-a3f8-1d95dfa803c4 req-ddb1e3ee-1ce1-4348-8454-61893b1804be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032158 Oct 04 12:21:29.865152 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4946/7264] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:21:30.132261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:30.132884 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:30.139870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:30.140368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:30.140815 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:30.141557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:30.142029 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:30.143046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:30.175874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:30.176382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:30.176834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:30.177302 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lazy-loading 'fault' on Instance uuid 50f1497b-1bae-490f-8b10-474cc57f50a0 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:21:30.223274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:30.231460 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0e27661e-a7b5-43af-9965-ac533bd7726e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 200 len: 1357 microversion: 2.1 time: 0.103081 Oct 04 12:21:30.232169 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2319/7265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:30 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:31.257986 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:31.258722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 50f1497b-1bae-490f-8b10-474cc57f50a0] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:31.264944 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:31.265468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:31.265915 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:31.266609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:31.267074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:31.267506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:31.280822 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] HTTP exception thrown: Instance 50f1497b-1bae-490f-8b10-474cc57f50a0 could not be found. Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Request method failure captured: Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 HTTP/1.1 Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCNxL0rAyY6LJuD68NhR5sU35ePaZ4BZ4z8muaqu7Df2RjlPMFPDumyKIM8t3nCO2ArvqT5G6F5K_tmFwBmDBZEH5VeCGCrV0-Wixf1NfktuVfEnNtiTHoO5nqWegE0_B7QVJjS-KHol72zxyy0AhYlRk46Toi8vKzA2ssSsEEwfREM Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f489bde728945dc8c2094c8ebd99afb"}]}] Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 83c9db5be81345af81be484a189292a3 Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 50f1497b-1bae-490f-8b10-474cc57f50a0 could not be found. Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '50f1497b-1bae-490f-8b10-474cc57f50a0'} Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50f1497b-1bae-490f-8b10-474cc57f50a0 could not be found. Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50f1497b-1bae-490f-8b10-474cc57f50a0 could not be found. Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:21:31.282459 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50f1497b-1bae-490f-8b10-474cc57f50a0 could not be found. Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Returning 404 to user: Instance 50f1497b-1bae-490f-8b10-474cc57f50a0 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6fa66967-a697-4675-af68-2af149448e07 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0" status: 404 len: 111 microversion: 2.1 time: 0.032607 Oct 04 12:21:31.287483 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4947/7266] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:31 2022] GET /compute/v2.1/servers/50f1497b-1bae-490f-8b10-474cc57f50a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:21:34.620151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5bfa592-4227-4236-9a55-59eac1b3a1ab tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '.version_select at 0x7f71cc585040>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:34.640448 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5bfa592-4227-4236-9a55-59eac1b3a1ab tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1355959395" status: 202 len: 0 microversion: 2.1 time: 0.024103 Oct 04 12:21:34.641254 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2320/7267] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 4 12:21:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1355959395 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:21:34.671754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3aad29f-1722-48af-bd84-a2adb8edc566 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: .version_select at 0x7f71cec28d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-602100042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNj8i27IcMggobJejsgQZBsxWPNae3WLOq3nI7/Px7kIG0vPItMv3pwQMl+aChlegwiaooyE/jMjiYOeMc8ME+txxnq4pkmoAAqspqpa4JqU+UpbE2IdPAupJkkW3zsRQ=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:21:34.688774 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a3aad29f-1722-48af-bd84-a2adb8edc566 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:21:34.694731 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-a3aad29f-1722-48af-bd84-a2adb8edc566 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:21:34.718367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3aad29f-1722-48af-bd84-a2adb8edc566 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050479 Oct 04 12:21:34.718950 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4948/7268] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:21:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:21:40.294298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:40.299523 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-818579445", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "networks": [{"uuid": "b688ee3d-38bf-4874-9930-b482a5fff9e7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-602100042", "security_groups": [{"name": "tempest-secgroup-smoke-945825768"}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:21:40.452054 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] validate_networks() for [('b688ee3d-38bf-4874-9930-b482a5fff9e7', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:21:40.961159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:21:40.962116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:21:40.962843 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:21:40.963749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:21:40.964525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:21:40.975330 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:40.976162 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:40.976852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:40.977941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:40.978632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:40.979325 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:40.999687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:21:41.006371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Getting quotas for user 83c9db5be81345af81be484a189292a3 and project 3f489bde728945dc8c2094c8ebd99afb. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:21:41.027790 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:21:41.030725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:21:41.087055 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-eb23b253-ad32-4e14-bf90-5a756df54e7a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.794361 Oct 04 12:21:41.088262 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2321/7269] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:21:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:21:41.100362 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-28ca1174-b62c-4866-93c5-0fe21ee96808 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:41.101015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-28ca1174-b62c-4866-93c5-0fe21ee96808 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:41.209053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-28ca1174-b62c-4866-93c5-0fe21ee96808 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:41.217644 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-28ca1174-b62c-4866-93c5-0fe21ee96808 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1265 microversion: 2.1 time: 0.122569 Oct 04 12:21:41.219403 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4949/7270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:41 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:42.243269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:42.243945 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:42.250872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:42.251383 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:42.252837 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:42.253984 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:42.254475 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:42.254918 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:42.374441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:42.387048 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4cc3979d-5a9d-49b0-b854-b4a161423c21 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1317 microversion: 2.1 time: 0.148460 Oct 04 12:21:42.387759 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2322/7271] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:42 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:43.411397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:43.412010 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:43.415155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=16 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:43.428042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:43.428269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:43.428910 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:43.429832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:43.430298 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:43.430734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:43.638980 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:43.647286 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6225f712-4185-45ab-b586-88ef7f5718d3 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1390 microversion: 2.1 time: 0.240482 Oct 04 12:21:43.647888 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4950/7272] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:43 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1390 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:43.993167 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ac67f2b5-07ba-465b-8a1f-8a7ed7eb500d req-02abb812-ecd1-45a4-90b1-f8b05e9bdf3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e1434f-a68c-4593-bd21-f4150ddda96a", "tag": "d6ee231f-3196-42cc-a812-1462d3947bba"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:21:44.004407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ac67f2b5-07ba-465b-8a1f-8a7ed7eb500d req-02abb812-ecd1-45a4-90b1-f8b05e9bdf3a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:44.004946 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ac67f2b5-07ba-465b-8a1f-8a7ed7eb500d req-02abb812-ecd1-45a4-90b1-f8b05e9bdf3a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:44.005412 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ac67f2b5-07ba-465b-8a1f-8a7ed7eb500d req-02abb812-ecd1-45a4-90b1-f8b05e9bdf3a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:44.015395 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ac67f2b5-07ba-465b-8a1f-8a7ed7eb500d req-02abb812-ecd1-45a4-90b1-f8b05e9bdf3a service nova] Creating event network-changed:d6ee231f-3196-42cc-a812-1462d3947bba for instance 91e1434f-a68c-4593-bd21-f4150ddda96a on n-h2-791135-8 Oct 04 12:21:44.021814 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ac67f2b5-07ba-465b-8a1f-8a7ed7eb500d req-02abb812-ecd1-45a4-90b1-f8b05e9bdf3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033999 Oct 04 12:21:44.022532 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2323/7273] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:21:44.671215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:44.671836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:44.679277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:44.679768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:44.680211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:44.687831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:44.688326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:44.688775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:44.822397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:44.830379 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ef4874f4-cd40-4fdd-ac03-cc6705b59da5 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1390 microversion: 2.1 time: 0.163121 Oct 04 12:21:44.830951 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4951/7274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:44 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:45.853941 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:45.854703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:45.860764 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:45.861828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:45.862272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:45.862993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:45.863454 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:45.863889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:45.999880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:46.007668 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c5368ed5-f426-4280-9fe8-931bde684c86 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1390 microversion: 2.1 time: 0.158881 Oct 04 12:21:46.008246 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2324/7275] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:45 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:47.032174 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:47.032891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:47.038934 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:47.039430 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:47.039905 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:47.040616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:47.041094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:47.041560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:47.258842 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:47.266627 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dd300c96-11ff-47e2-9616-a0668cdcd8fb tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1390 microversion: 2.1 time: 0.239836 Oct 04 12:21:47.267226 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4952/7276] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:47 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1390 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:48.289033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:48.289732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:48.296436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:48.296936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:48.297418 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:48.298123 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:48.299130 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:48.299573 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:48.431789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:48.440251 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-de061807-d2d6-4742-8158-112ac5b1e371 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1390 microversion: 2.1 time: 0.155099 Oct 04 12:21:48.440853 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2325/7277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:48 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:49.463168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:49.463720 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:49.470656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:49.471152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:49.471597 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:49.472293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:49.472754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:49.473185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:49.604385 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:49.612117 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a0c3ec1-bd7f-44c5-afc3-188363714591 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1390 microversion: 2.1 time: 0.152990 Oct 04 12:21:49.612694 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4953/7278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:49 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:50.635708 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:50.636324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:50.643116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:50.643605 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:50.644051 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:50.644740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:50.645199 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:50.645669 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:50.780487 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:50.788038 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed38b533-28e4-42e8-98e9-cab680a16bbd tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1390 microversion: 2.1 time: 0.156361 Oct 04 12:21:50.788638 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2326/7279] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:50 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:51.282211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-bc6e047a-f84f-488c-bf2b-a65be55195d3 req-70ae9fcb-445d-492a-9a00-650b1e750b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e1434f-a68c-4593-bd21-f4150ddda96a", "name": "network-vif-plugged", "status": "completed", "tag": "d6ee231f-3196-42cc-a812-1462d3947bba"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:21:51.288123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:51.289451 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:51.296039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bc6e047a-f84f-488c-bf2b-a65be55195d3 req-70ae9fcb-445d-492a-9a00-650b1e750b77 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:51.296552 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bc6e047a-f84f-488c-bf2b-a65be55195d3 req-70ae9fcb-445d-492a-9a00-650b1e750b77 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:51.296984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-bc6e047a-f84f-488c-bf2b-a65be55195d3 req-70ae9fcb-445d-492a-9a00-650b1e750b77 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:51.308594 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-bc6e047a-f84f-488c-bf2b-a65be55195d3 req-70ae9fcb-445d-492a-9a00-650b1e750b77 service nova] Creating event network-vif-plugged:d6ee231f-3196-42cc-a812-1462d3947bba for instance 91e1434f-a68c-4593-bd21-f4150ddda96a on n-h2-791135-8 Oct 04 12:21:51.313617 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-bc6e047a-f84f-488c-bf2b-a65be55195d3 req-70ae9fcb-445d-492a-9a00-650b1e750b77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035382 Oct 04 12:21:51.314227 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4954/7280] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:21:51.811838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:51.812385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:51.815674 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:51.816342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:21:51.822257 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:51.822749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:51.823188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:51.823881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:51.824338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:51.824770 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:51.955390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:51.962993 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-02ab000e-d39e-4bf8-8ae8-0057f03a0486 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1390 microversion: 2.1 time: 0.155376 Oct 04 12:21:51.963561 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2327/7281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:51 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:52.987200 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:52.987968 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:52.994177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:52.994672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:52.995118 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:52.995821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:52.996285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:52.996723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:53.127317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:53.135283 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-dfca641d-6855-4562-beeb-17ac03d0793b tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1562 microversion: 2.1 time: 0.153241 Oct 04 12:21:53.135859 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4955/7282] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:52 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:53.158207 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:53.158836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:53.165617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:53.166114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:53.166561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:53.167265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:53.167732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:53.168169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:53.301923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:53.309477 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3bc113d0-a918-4ea0-b22c-c7464c97f0f7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1562 microversion: 2.1 time: 0.155196 Oct 04 12:21:53.310048 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2328/7283] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:53 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:21:54.882978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ec346b1c-c2c8-4cc9-a946-63b07e57d82a req-a4baf6d1-8445-4b21-8055-b2bdbb943537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e1434f-a68c-4593-bd21-f4150ddda96a", "tag": "d6ee231f-3196-42cc-a812-1462d3947bba"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:21:54.883712 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:21:54.884361 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:21:54.899643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:54.900138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:54.900295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec346b1c-c2c8-4cc9-a946-63b07e57d82a req-a4baf6d1-8445-4b21-8055-b2bdbb943537 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:54.900578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:54.900735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec346b1c-c2c8-4cc9-a946-63b07e57d82a req-a4baf6d1-8445-4b21-8055-b2bdbb943537 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:54.901049 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ec346b1c-c2c8-4cc9-a946-63b07e57d82a req-a4baf6d1-8445-4b21-8055-b2bdbb943537 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:54.901288 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:21:54.902038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:21:54.902468 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:21:54.913682 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ec346b1c-c2c8-4cc9-a946-63b07e57d82a req-a4baf6d1-8445-4b21-8055-b2bdbb943537 service nova] Creating event network-changed:d6ee231f-3196-42cc-a812-1462d3947bba for instance 91e1434f-a68c-4593-bd21-f4150ddda96a on n-h2-791135-8 Oct 04 12:21:54.918776 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ec346b1c-c2c8-4cc9-a946-63b07e57d82a req-a4baf6d1-8445-4b21-8055-b2bdbb943537 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043553 Oct 04 12:21:54.919748 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2329/7284] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:21:55.144970 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:21:55.153438 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a3dfc80e-3080-4920-88ff-67333cf8d7aa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1562 microversion: 2.1 time: 0.280598 Oct 04 12:21:55.154258 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4956/7285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:21:54 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1562 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:22:28.439627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:22:28.440407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=42 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:22:28.445341 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:22:28.447639 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:22:28.455490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:22:28.455988 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:22:28.456441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:22:28.457153 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:22:28.458311 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:22:28.458784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:22:28.524953 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-828bfa2f-c255-4a3e-b961-ad401aa33488 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action" status: 200 len: 24572 microversion: 2.1 time: 0.087220 Oct 04 12:22:28.525607 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2330/7286] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:22:28 2022] POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action => generated 24572 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:22:58.964307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:22:58.965179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=38 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:22:58.969574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:22:58.970116 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:22:58.976725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:22:58.977217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:22:58.977683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:22:58.978379 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:22:58.978838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:22:58.979269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:22:59.002840 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lazy-loading 'flavor' on Instance uuid 91e1434f-a68c-4593-bd21-f4150ddda96a {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:22:59.068197 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0b0a93fe-e24a-4176-9b53-a95fc68a0b51 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action" status: 202 len: 0 microversion: 2.1 time: 0.105619 Oct 04 12:22:59.068829 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4957/7287] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:22:58 2022] POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:22:59.078206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:22:59.079337 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:22:59.081590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:22:59.082393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=4 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:22:59.088978 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:22:59.089514 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:22:59.089970 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:22:59.090693 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:22:59.091171 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:22:59.091617 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:22:59.308995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:22:59.316703 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ed055bce-5eea-4f3d-9a57-aceb884a98a2 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1689 microversion: 2.1 time: 0.243037 Oct 04 12:22:59.317283 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2331/7288] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:22:59 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1689 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:00.343246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:00.343951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:00.350146 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:00.350634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:00.351072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:00.351760 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:00.352216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:00.352647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:00.481706 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:00.489515 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6702f155-0775-48a5-b95c-e865df5e198a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1689 microversion: 2.1 time: 0.151628 Oct 04 12:23:00.490610 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4958/7289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:00 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:01.513631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:01.514271 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:01.525247 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:01.525773 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:01.526537 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:01.527273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:01.527750 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:01.528446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:01.656557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:01.664293 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f759262d-9b56-479f-a182-53ed5a166aaa tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1672 microversion: 2.1 time: 0.154631 Oct 04 12:23:01.664881 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2332/7290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:01 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:02.760923 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:02.763145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:02.770687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:02.771209 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:02.771656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:02.772351 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:02.772814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:02.773246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:02.835322 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fbfce044-9967-42f0-aa81-048a526a3658 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action" status: 200 len: 34810 microversion: 2.1 time: 0.078053 Oct 04 12:23:02.835917 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4959/7291] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:23:02 2022] POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action => generated 34810 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:23:02.847713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:02.848268 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:02.855058 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:02.855551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:02.856001 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:02.856700 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:02.857164 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:02.857630 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:02.922669 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ad1d8ee7-8cd9-4290-ba24-a8e61fe80482 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action" status: 202 len: 0 microversion: 2.1 time: 0.078720 Oct 04 12:23:02.923296 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2333/7292] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:23:02 2022] POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:23:02.932481 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:02.933170 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:02.941521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:02.942021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:02.943449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:02.944165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:02.945035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:02.945508 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:03.171637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:03.179757 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ae000914-8108-400a-851f-b87f38f19f44 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1678 microversion: 2.1 time: 0.251529 Oct 04 12:23:03.180327 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4960/7293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:02 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1678 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:04.204539 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:04.205248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:04.212747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:04.213238 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:04.213723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:04.214419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:04.214886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:04.215323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:04.345778 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:04.353453 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8d1068a2-67d8-4625-874f-e21f1144e54d tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1678 microversion: 2.1 time: 0.153221 Oct 04 12:23:04.354025 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2334/7294] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:04 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:05.376600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:05.377191 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:05.384054 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:05.384536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:05.384972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:05.385685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:05.386145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:05.386569 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:05.514525 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:05.523100 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c10f25b0-1af7-4bb4-b956-d73ef795cc05 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1681 microversion: 2.1 time: 0.150381 Oct 04 12:23:05.523671 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4961/7295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:05 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:05.616490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:05.618777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:05.625597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:05.626092 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:05.626538 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:05.627286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:05.627703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:05.628135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:05.687957 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-43accb7e-1546-4fb0-b3a2-dbb1689395b7 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action" status: 200 len: 34810 microversion: 2.1 time: 0.075268 Oct 04 12:23:05.688911 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2335/7296] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:23:05 2022] POST /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a/action => generated 34810 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:23:07.024433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:07.025123 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:07.033257 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:07.033718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:07.034308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:07.035179 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:07.035882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:07.036310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:07.068205 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:23:07.084713 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b1b01d30-bd51-4c38-9500-c674b3be5352 req-bfc63051-6294-4633-87aa-044d4c371790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e1434f-a68c-4593-bd21-f4150ddda96a", "tag": "d6ee231f-3196-42cc-a812-1462d3947bba"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:07.095445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1b01d30-bd51-4c38-9500-c674b3be5352 req-bfc63051-6294-4633-87aa-044d4c371790 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:07.095943 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1b01d30-bd51-4c38-9500-c674b3be5352 req-bfc63051-6294-4633-87aa-044d4c371790 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:07.096381 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b1b01d30-bd51-4c38-9500-c674b3be5352 req-bfc63051-6294-4633-87aa-044d4c371790 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:07.108887 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b1b01d30-bd51-4c38-9500-c674b3be5352 req-bfc63051-6294-4633-87aa-044d4c371790 service nova] Creating event network-changed:d6ee231f-3196-42cc-a812-1462d3947bba for instance 91e1434f-a68c-4593-bd21-f4150ddda96a on n-h2-791135-8 Oct 04 12:23:07.113983 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b1b01d30-bd51-4c38-9500-c674b3be5352 req-bfc63051-6294-4633-87aa-044d4c371790 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089512 Oct 04 12:23:07.115171 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2336/7297] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:23:07.145258 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e89827d6-5f0e-4cc1-a4f5-7950c729d72c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 204 len: 0 microversion: 2.1 time: 0.125455 Oct 04 12:23:07.146338 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4962/7298] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:23:07 2022] DELETE /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:23:07.155545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:07.156260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:07.163148 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:07.163647 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:07.164094 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:07.164812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:07.165275 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:07.165744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:07.318392 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:07.327201 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6c834e1-ff1c-4620-8bc2-c0045a72144a tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1687 microversion: 2.1 time: 0.176320 Oct 04 12:23:07.327790 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2337/7299] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:07 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:23:08.353113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:08.353856 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:08.360535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:08.361022 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:08.361487 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:08.362176 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:08.362630 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:08.363053 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:08.492548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:08.500314 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-98ad34db-d7e7-4d78-b38b-dfa908d4a90c tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1687 microversion: 2.1 time: 0.152032 Oct 04 12:23:08.500885 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4963/7300] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:08 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:09.507397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-122f0367-6a79-4358-a512-95d13f3f055e req-9fa867a7-2496-4e14-a42b-a70d3b30c610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e1434f-a68c-4593-bd21-f4150ddda96a", "name": "network-vif-deleted", "tag": "d6ee231f-3196-42cc-a812-1462d3947bba"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:09.520866 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-122f0367-6a79-4358-a512-95d13f3f055e req-9fa867a7-2496-4e14-a42b-a70d3b30c610 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:09.521967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-122f0367-6a79-4358-a512-95d13f3f055e req-9fa867a7-2496-4e14-a42b-a70d3b30c610 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:09.522372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-122f0367-6a79-4358-a512-95d13f3f055e req-9fa867a7-2496-4e14-a42b-a70d3b30c610 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:09.524505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:09.525136 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:09.532472 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:09.532960 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:09.533475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:09.534252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:09.534858 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:09.535286 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:09.537211 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-122f0367-6a79-4358-a512-95d13f3f055e req-9fa867a7-2496-4e14-a42b-a70d3b30c610 service nova] Creating event network-vif-deleted:d6ee231f-3196-42cc-a812-1462d3947bba for instance 91e1434f-a68c-4593-bd21-f4150ddda96a on n-h2-791135-8 Oct 04 12:23:09.542968 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-122f0367-6a79-4358-a512-95d13f3f055e req-9fa867a7-2496-4e14-a42b-a70d3b30c610 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040015 Oct 04 12:23:09.543755 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2338/7301] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:23:09.607076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c9db5be81345af81be484a189292a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f489bde728945dc8c2094c8ebd99afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:09.615047 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-91ef3c2e-bac9-4924-9927-696eb4623a82 tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 200 len: 1350 microversion: 2.1 time: 0.095497 Oct 04 12:23:09.615622 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4964/7302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:09 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:23:10.639420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:10.640126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] [instance: 91e1434f-a68c-4593-bd21-f4150ddda96a] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:10.647640 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:10.648128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:10.648569 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:10.649265 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:10.649769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:10.650206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:10.667146 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] HTTP exception thrown: Instance 91e1434f-a68c-4593-bd21-f4150ddda96a could not be found. Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Request method failure captured: Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a HTTP/1.1 Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCNxL0rAyY6LJuD68NhR5sU35ePaZ4BZ4z8muaqu7Df2RjlPMFPDumyKIM8t3nCO2ArvqT5G6F5K_tmFwBmDBZEH5VeCGCrV0-Wixf1NfktuVfEnNtiTHoO5nqWegE0_B7QVJjS-KHol72zxyy0AhYlRk46Toi8vKzA2ssSsEEwfREM Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f489bde728945dc8c2094c8ebd99afb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f489bde728945dc8c2094c8ebd99afb"}]}] Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 3f489bde728945dc8c2094c8ebd99afb Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-125678107 Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 83c9db5be81345af81be484a189292a3 Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestNetworkAdvancedServerOps-125678107-project Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 91e1434f-a68c-4593-bd21-f4150ddda96a could not be found. Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '91e1434f-a68c-4593-bd21-f4150ddda96a'} Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e1434f-a68c-4593-bd21-f4150ddda96a could not be found. Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e1434f-a68c-4593-bd21-f4150ddda96a could not be found. Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:23:10.668767 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e1434f-a68c-4593-bd21-f4150ddda96a could not be found. Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Returning 404 to user: Instance 91e1434f-a68c-4593-bd21-f4150ddda96a could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-522a8ec4-d227-49a5-a9a6-d44d58c3130e tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a" status: 404 len: 111 microversion: 2.1 time: 0.035014 Oct 04 12:23:10.673278 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2339/7303] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:10 2022] GET /compute/v2.1/servers/91e1434f-a68c-4593-bd21-f4150ddda96a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:23:13.656479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c9f58805-390f-4f70-b034-ad214cc477ae tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] Calling method '.version_select at 0x7f71cf0e2280>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:13.679363 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c9f58805-390f-4f70-b034-ad214cc477ae tempest-TestNetworkAdvancedServerOps-125678107 tempest-TestNetworkAdvancedServerOps-125678107-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-602100042" status: 202 len: 0 microversion: 2.1 time: 0.026886 Oct 04 12:23:13.679989 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4965/7304] 10.222.0.23 () {58 vars in 1281 bytes} [Tue Oct 4 12:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-602100042 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:23:25.104681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=18 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:23:25.106898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:23:25.289577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e8fdaeec-3313-413f-a51b-365d64f92e80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Action: 'create', calling method: .version_select at 0x7f71cc5c19d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-265253720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKp7pVdnqlGIlJ9J7eEscqFi/fJ/I/aM4VHGc/jISXDdZfAJO1RN68rFwqopESanBv34sK2cOWsKdvmpynSEWQshM9Dq5eiNJ0N29yXNTM3lyY8S8jSf9LLMysJKnvgoA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:25.306052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e8fdaeec-3313-413f-a51b-365d64f92e80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Getting quotas for project 6f188aa2bff34d879a2b06c069bdfbbd. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:23:25.311735 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-e8fdaeec-3313-413f-a51b-365d64f92e80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Getting quotas for user e826b34ca17a4832907e5e66a8541e4f and project 6f188aa2bff34d879a2b06c069bdfbbd. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:23:25.338438 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e8fdaeec-3313-413f-a51b-365d64f92e80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.242619 Oct 04 12:23:25.339049 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2340/7305] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:23:25 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:23:26.302837 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:23:26.304029 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:23:26.308502 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-242188175", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-265253720", "security_groups": [{"name": "tempest-secgroup-smoke-513436753"}], "networks": [{"uuid": "ea659f52-ae49-40c1-8eb5-b2eaa5708fd3"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:26.564922 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] validate_networks() for [('ea659f52-ae49-40c1-8eb5-b2eaa5708fd3', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:23:27.041803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:23:27.042243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:23:27.042725 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:23:27.043145 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:23:27.044067 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:23:27.053564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:27.054177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:27.054793 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:27.055857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:27.056513 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:27.057139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:27.078101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Getting quotas for project 6f188aa2bff34d879a2b06c069bdfbbd. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:23:27.083436 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Getting quotas for user e826b34ca17a4832907e5e66a8541e4f and project 6f188aa2bff34d879a2b06c069bdfbbd. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:23:27.096435 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:23:27.099338 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:23:27.149422 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c723605d-1c1d-461f-b7a5-db9fe9f57370 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.848430 Oct 04 12:23:27.150242 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4966/7306] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:23:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:23:27.163398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49ad92d2-7e2a-48b7-95e3-21f8f838a058 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:27.164111 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49ad92d2-7e2a-48b7-95e3-21f8f838a058 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:27.227112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-49ad92d2-7e2a-48b7-95e3-21f8f838a058 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:27.235520 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49ad92d2-7e2a-48b7-95e3-21f8f838a058 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1245 microversion: 2.1 time: 0.077220 Oct 04 12:23:27.236425 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2341/7307] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:27 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:28.262084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:28.262722 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:28.274869 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:28.276274 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:28.277259 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:28.278018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:28.278985 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:28.279586 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:28.393515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:28.402185 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-998fe58a-0ca6-4356-9c41-b34e0e124a1c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1315 microversion: 2.1 time: 0.147766 Oct 04 12:23:28.408962 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4967/7308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:28 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:29.432254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:29.432872 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:29.439446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:29.439936 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:29.440371 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:29.441068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:29.441561 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:29.441993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:29.594209 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:29.602708 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-66f0c105-6db7-4cd1-8115-fbab940076b4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1370 microversion: 2.1 time: 0.174313 Oct 04 12:23:29.603292 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2342/7309] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:29 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:29.717814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-1ddc8453-bb0c-4364-abc8-6fc5c3a8be61 req-2ce0e695-7198-4c26-a074-8a9bd407e03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:29.733540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1ddc8453-bb0c-4364-abc8-6fc5c3a8be61 req-2ce0e695-7198-4c26-a074-8a9bd407e03e service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:29.734036 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1ddc8453-bb0c-4364-abc8-6fc5c3a8be61 req-2ce0e695-7198-4c26-a074-8a9bd407e03e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:29.734707 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-1ddc8453-bb0c-4364-abc8-6fc5c3a8be61 req-2ce0e695-7198-4c26-a074-8a9bd407e03e service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:29.748738 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-1ddc8453-bb0c-4364-abc8-6fc5c3a8be61 req-2ce0e695-7198-4c26-a074-8a9bd407e03e service nova] Creating event network-changed:00869655-44b7-46cf-8670-7382e6158af9 for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed on n-h1-791135-8 Oct 04 12:23:29.753969 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-1ddc8453-bb0c-4364-abc8-6fc5c3a8be61 req-2ce0e695-7198-4c26-a074-8a9bd407e03e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041140 Oct 04 12:23:29.754582 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4968/7310] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:23:30.626442 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:30.627063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:30.634466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:30.634974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:30.635421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:30.636125 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:30.636728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:30.637003 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:30.769295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:30.777984 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6107d587-980e-4a1d-b26a-5a21fa4b99b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1370 microversion: 2.1 time: 0.155332 Oct 04 12:23:30.778835 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2343/7311] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:30 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:31.801770 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:31.802507 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:31.809780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:31.810263 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:31.810698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:31.811387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:31.811838 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:31.812262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:31.953144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:31.961858 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e53b626e-6d36-4bfd-8da2-dcf7b236995d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1370 microversion: 2.1 time: 0.164057 Oct 04 12:23:31.961983 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4969/7312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:31 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:32.984622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:32.985248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:32.992725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:32.993218 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:32.993695 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:32.994401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:32.994870 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:32.995308 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:33.127323 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:33.135033 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-213bb2e6-59cb-4383-a0e8-02be3ebf3a2a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1370 microversion: 2.1 time: 0.154449 Oct 04 12:23:33.135802 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2344/7313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:32 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:34.159476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:34.159998 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:34.166919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:34.167400 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:34.167839 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:34.168528 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:34.168989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:34.169452 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:34.299042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:34.307317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa232797-e12e-49fe-8d18-55ab744ee7cf tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1370 microversion: 2.1 time: 0.151844 Oct 04 12:23:34.307890 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4970/7314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:34 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:35.329789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:35.330422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:35.337932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:35.338432 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:35.338879 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:35.339583 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:35.340048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:35.340492 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:35.480962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:35.490617 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-7304340c-694a-4b54-b73a-cc1b7cb6d973 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1370 microversion: 2.1 time: 0.163509 Oct 04 12:23:35.491431 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2345/7315] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:35 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:35.519672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-18e1cc71-b405-4fec-bb50-9967cee920d0 req-931274cc-a99c-482b-aab3-fb4c1d2fa523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "name": "network-vif-plugged", "status": "completed", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:35.529711 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-18e1cc71-b405-4fec-bb50-9967cee920d0 req-931274cc-a99c-482b-aab3-fb4c1d2fa523 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:35.530196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-18e1cc71-b405-4fec-bb50-9967cee920d0 req-931274cc-a99c-482b-aab3-fb4c1d2fa523 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:35.530638 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-18e1cc71-b405-4fec-bb50-9967cee920d0 req-931274cc-a99c-482b-aab3-fb4c1d2fa523 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:35.541521 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-18e1cc71-b405-4fec-bb50-9967cee920d0 req-931274cc-a99c-482b-aab3-fb4c1d2fa523 service nova] Creating event network-vif-plugged:00869655-44b7-46cf-8670-7382e6158af9 for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed on n-h1-791135-8 Oct 04 12:23:35.547524 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-18e1cc71-b405-4fec-bb50-9967cee920d0 req-931274cc-a99c-482b-aab3-fb4c1d2fa523 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092822 Oct 04 12:23:35.548125 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4971/7316] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:23:36.514019 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:36.514634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:36.521329 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:36.521845 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:36.522285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:36.522987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:36.523443 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:36.523874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:36.659519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:36.667672 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-33166af0-d6c2-4470-9255-25500c53f9ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1370 microversion: 2.1 time: 0.157599 Oct 04 12:23:36.668241 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2346/7317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:36 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:37.689229 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:23:37.690099 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:23:37.694378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:37.695082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:37.702183 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:37.702669 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:37.703115 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:37.703886 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:37.704261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:37.704738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:37.841902 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:37.850354 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-191312c2-993a-487b-97f3-cd5b4606e4ef tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1553 microversion: 2.1 time: 0.162138 Oct 04 12:23:37.850934 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4972/7318] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:37 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:37.871971 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:23:37.872592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:23:37.874466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:23:37.880298 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:37.880789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:37.881228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:37.881987 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:37.882451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:37.882882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:38.013497 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:23:38.021051 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-389fad7c-a4c9-4410-8ec3-3a239951889c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1553 microversion: 2.1 time: 0.152911 Oct 04 12:23:38.022303 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2347/7319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:23:37 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:23:39.924979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-521a989c-13e9-4183-8eef-c944994b472b req-a80a0a2d-9c26-4881-9f55-5b7737c37e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:23:39.935753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-521a989c-13e9-4183-8eef-c944994b472b req-a80a0a2d-9c26-4881-9f55-5b7737c37e18 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:23:39.936247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-521a989c-13e9-4183-8eef-c944994b472b req-a80a0a2d-9c26-4881-9f55-5b7737c37e18 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:23:39.936685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-521a989c-13e9-4183-8eef-c944994b472b req-a80a0a2d-9c26-4881-9f55-5b7737c37e18 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:23:39.948434 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-521a989c-13e9-4183-8eef-c944994b472b req-a80a0a2d-9c26-4881-9f55-5b7737c37e18 service nova] Creating event network-changed:00869655-44b7-46cf-8670-7382e6158af9 for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed on n-h1-791135-8 Oct 04 12:23:39.953726 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-521a989c-13e9-4183-8eef-c944994b472b req-a80a0a2d-9c26-4881-9f55-5b7737c37e18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032366 Oct 04 12:23:39.954473 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4973/7320] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:25:35.220400 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43145c0f-38f9-443d-929f-16a90ce4e841] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:25:35.221329 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e9dfef3-0453-479e-ab86-c91297e9b462] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:25:35.222145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:25:35.223039 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=36 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:25:35.223775 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 12:25:35.229320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:25:35.229881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:35.238704 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:35.239192 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:35.239632 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:35.240331 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:35.240785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:35.241220 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:35.263940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lazy-loading 'flavor' on Instance uuid f44ec85c-244a-41a1-a25e-a2541b9b12ed {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:25:35.443999 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6664a84e-9faf-484a-842e-4d93f0085408 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "POST /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed/action" status: 202 len: 0 microversion: 2.1 time: 0.225121 Oct 04 12:25:35.444656 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2348/7321] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:25:35 2022] POST /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:25:35.451644 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8829bdcc-210e-40a3-b2af-6ede6e7ff32d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:25:35.452545 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b0aa98c-d914-4893-9124-de6a30c783e0] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:25:35.453161 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:25:35.454150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=32 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:25:35.459455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:35.460230 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:35.469214 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:35.469802 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:35.470306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:35.471082 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:35.471775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:35.472218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:35.911827 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:35.919506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-78bf1a7a-9a83-4cf9-86b9-e6c33f7a1e05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.469846 Oct 04 12:25:35.920074 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4974/7322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:35 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:36.945466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:36.946184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:36.955606 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:36.956098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:36.956541 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:36.957251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:36.957746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:36.958180 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:36.963093 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e9dfef3-0453-479e-ab86-c91297e9b462] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38318. Oct 04 12:25:36.963892 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [43145c0f-38f9-443d-929f-16a90ce4e841] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38316. Oct 04 12:25:37.095215 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:37.102956 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-41ccbeb0-00d9-4d98-8ae3-6686908b86b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.163545 Oct 04 12:25:37.103524 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2349/7323] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:36 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:38.126696 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:38.127293 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:38.137181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:38.137698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:38.138141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:38.138846 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:38.139311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:38.139743 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:38.145921 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b0aa98c-d914-4893-9124-de6a30c783e0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38326. Oct 04 12:25:38.146775 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] [8829bdcc-210e-40a3-b2af-6ede6e7ff32d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38324. Oct 04 12:25:38.273272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:38.282163 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-688665ae-4e2e-4e02-9a78-2d3aa8355145 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.159411 Oct 04 12:25:38.282738 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4975/7324] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:38 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:39.305486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:39.306101 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:39.312788 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:39.313277 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:39.313749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:39.314435 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:39.314892 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:39.315321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:39.444760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:39.452920 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-99c64e92-524e-4e13-8357-240f82585ca5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.151471 Oct 04 12:25:39.453513 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2350/7325] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:39 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:40.476070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:40.476689 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:40.484024 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:40.484506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:40.484941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:40.485652 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:40.486109 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:40.486536 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:40.622950 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:40.630726 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fb24ad8c-bff0-4829-b134-7452ff9e537f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.158574 Oct 04 12:25:40.631317 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4976/7326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:40 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:41.654895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:41.655519 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:41.662702 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:41.663214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:41.663645 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:41.664342 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:41.664838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:41.665274 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:41.800151 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:41.808720 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-90e8b851-f5d8-41ec-a8c9-8d58ab12f845 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.157634 Oct 04 12:25:41.809332 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2351/7327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:41 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:42.832094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:42.832710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:42.839601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:42.840092 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:42.840535 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:42.841236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:42.841734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:42.842169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:42.972163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:42.981141 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-390c0b49-f58a-4a84-9ed0-c0d83569cf34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.152921 Oct 04 12:25:42.981772 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4977/7328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:42 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:44.005851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:44.006474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:44.013981 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:44.014473 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:44.014910 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:44.015604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:44.016063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:44.016494 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:44.144398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:44.152229 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53a53431-2184-4145-b5a9-c4551c66895c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.150212 Oct 04 12:25:44.152863 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2352/7329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:44 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:45.175857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:45.176455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:45.183410 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:45.183900 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:45.184342 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:45.185038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:45.185540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:45.185972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:45.316193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:45.324436 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8d0b277d-401c-4fab-a232-ed0081762fa8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.152636 Oct 04 12:25:45.325016 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4978/7330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:45 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:46.348477 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:46.349103 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:46.356791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:46.357281 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:46.357746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:46.358433 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:46.358893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:46.359322 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:46.494909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:46.502515 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2cf38902-d846-4adc-a713-4501583e399a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1699 microversion: 2.1 time: 0.158198 Oct 04 12:25:46.503170 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2353/7331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:46 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:47.526119 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:47.526738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:47.534215 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:47.534698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:47.535133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:47.535988 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:47.536439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:47.536867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:47.667714 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:47.675586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aa0ffb87-fdf2-486a-9484-b63e233ca49a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.154102 Oct 04 12:25:47.676167 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4979/7332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:47 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:48.701660 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:48.703254 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:48.710387 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:48.711169 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:48.711825 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:48.713417 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:48.714112 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:48.714781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:48.859535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:48.868139 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-6579f9c1-33d1-46bc-9a9e-51d430c8edcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.170353 Oct 04 12:25:48.869093 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2354/7333] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:48 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:49.892166 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:49.893413 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:49.900976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:49.901499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:49.901941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:49.902628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:49.903327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:49.904071 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:50.095397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:50.104963 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6c21621-c0fc-4a7b-afaa-3a510f18a1a1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.216647 Oct 04 12:25:50.105577 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4980/7334] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:49 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:50.127286 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fb010933-eef5-4c4b-af26-3922403a72df req-2c4ee672-a4b1-485d-85bf-03bd299042a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "name": "network-vif-plugged", "status": "completed", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:25:50.140142 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb010933-eef5-4c4b-af26-3922403a72df req-2c4ee672-a4b1-485d-85bf-03bd299042a2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:50.140944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb010933-eef5-4c4b-af26-3922403a72df req-2c4ee672-a4b1-485d-85bf-03bd299042a2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:50.141401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb010933-eef5-4c4b-af26-3922403a72df req-2c4ee672-a4b1-485d-85bf-03bd299042a2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:50.154537 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fb010933-eef5-4c4b-af26-3922403a72df req-2c4ee672-a4b1-485d-85bf-03bd299042a2 service nova] Creating event network-vif-plugged:00869655-44b7-46cf-8670-7382e6158af9 for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed on n-h1-791135-8 Oct 04 12:25:50.160321 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fb010933-eef5-4c4b-af26-3922403a72df req-2c4ee672-a4b1-485d-85bf-03bd299042a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045073 Oct 04 12:25:50.162401 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2355/7335] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:25:51.128313 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:51.129768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:51.137223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:51.137747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:51.138187 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:51.138898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:51.139495 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:51.139929 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:51.290169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:51.300264 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a87bb7a-a64f-44d3-be96-135e003cad4b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.174941 Oct 04 12:25:51.300264 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4981/7336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:51 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:52.325244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:52.326110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:52.339131 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:52.339909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:52.340529 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:52.341439 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:52.342069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:52.342747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:52.495319 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:52.503245 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8788821b-1811-4a82-9a03-d0532bbc6c78 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.183223 Oct 04 12:25:52.503827 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2356/7337] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:52 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:53.528037 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:53.528939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:53.538094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:53.539403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:53.540367 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:53.541653 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:53.542319 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:53.542867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:53.708662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:53.718367 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8753f026-e511-4c7b-a71d-08e3d8e47e24 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.194746 Oct 04 12:25:53.718984 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4982/7338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:53 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:54.741725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:54.742458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:54.749670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:54.750173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:54.751046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:54.751767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:54.752259 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:54.752692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:54.900404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:54.908931 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a6a0e92f-f371-4eb3-9357-76a3c990f908 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.170954 Oct 04 12:25:54.909736 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2357/7339] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:54 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:55.932738 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:55.933560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:55.941035 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:55.941594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:55.942039 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:55.942747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:55.943211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:55.943634 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:56.098476 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:56.106826 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-46c5f14e-bedb-4de7-9537-e614041b683d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.178649 Oct 04 12:25:56.107642 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4983/7340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:55 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:57.130673 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:57.131224 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:57.138165 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:57.138662 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:57.139115 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:57.139823 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:57.140413 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:57.140873 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:57.270902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:57.278575 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3108afc4-f842-41f1-a99c-638b1575e2d2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1694 microversion: 2.1 time: 0.151914 Oct 04 12:25:57.279154 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2358/7341] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:57 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:58.302643 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:58.303262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:58.310759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:58.311243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:58.311685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:58.312376 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:58.312835 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:58.313267 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:58.442755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:58.451126 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ecac0b09-7fbd-4177-9c85-accced99b95d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1676 microversion: 2.1 time: 0.152550 Oct 04 12:25:58.451712 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4984/7342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:58 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:25:59.473994 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:25:59.474611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:25:59.481436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:59.481927 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:59.482367 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:59.483066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:25:59.483877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:25:59.484310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:25:59.630135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:25:59.638606 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bef54f58-0cbe-41e3-b0d5-8a9d0c70358e tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1676 microversion: 2.1 time: 0.168561 Oct 04 12:25:59.639246 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2359/7343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:25:59 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:00.065702 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-136fac4e-788d-4bdb-8835-81d58d595fe5 req-54fc3ffd-cc23-4c95-af6f-63b2fb920aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "name": "network-vif-unplugged", "status": "completed", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:26:00.076074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-136fac4e-788d-4bdb-8835-81d58d595fe5 req-54fc3ffd-cc23-4c95-af6f-63b2fb920aa2 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:00.076567 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-136fac4e-788d-4bdb-8835-81d58d595fe5 req-54fc3ffd-cc23-4c95-af6f-63b2fb920aa2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:00.077031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-136fac4e-788d-4bdb-8835-81d58d595fe5 req-54fc3ffd-cc23-4c95-af6f-63b2fb920aa2 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:00.088306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.compute.server_external_events [req-136fac4e-788d-4bdb-8835-81d58d595fe5 req-54fc3ffd-cc23-4c95-af6f-63b2fb920aa2 service nova] Unable to find a host for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed. Dropping event network-vif-unplugged {{(pid=122409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 12:26:00.089201 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-136fac4e-788d-4bdb-8835-81d58d595fe5 req-54fc3ffd-cc23-4c95-af6f-63b2fb920aa2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027524 Oct 04 12:26:00.089837 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4985/7344] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 12:26:00.665963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:00.666791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:00.673592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:00.674085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:00.674527 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:00.675221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:00.675687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:00.676119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:00.807032 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:00.814800 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80cefd23-0cb2-4c5e-ac88-0f4e7f8aba17 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1619 microversion: 2.1 time: 0.152803 Oct 04 12:26:00.815388 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2360/7345] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:00 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1619 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:00.836932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:26:00.837622 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:00.843617 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:00.844110 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:00.844554 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:00.845251 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:00.845741 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:00.846181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:00.888080 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122409) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 12:26:00.953875 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-313c674c-27e2-40ca-beb1-27e955ce9cc5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "POST /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed/action" status: 202 len: 0 microversion: 2.1 time: 0.120732 Oct 04 12:26:00.954499 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4986/7346] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:26:00 2022] POST /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:26:00.962671 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:00.963303 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:00.969124 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:00.969921 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:00.970368 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:00.971074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:00.971540 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:00.972028 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:01.113644 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:01.121856 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-3107ade7-614d-4bfe-84c7-c1eaed555f27 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1627 microversion: 2.1 time: 0.163091 Oct 04 12:26:01.122430 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2361/7347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:00 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1627 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:02.144870 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:02.145434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:02.151506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:02.151994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:02.152433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:02.153131 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:02.153612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:02.154043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:02.288799 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:02.297121 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-b01b1f4a-1735-4216-b859-932c3c9828e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.157094 Oct 04 12:26:02.297720 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4987/7348] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:02 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:03.082963 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-51bedac8-3b95-4e18-a14f-45ef163c6979 req-d79ad06b-bc7f-4764-a44e-68124a4f9ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:26:03.093755 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-51bedac8-3b95-4e18-a14f-45ef163c6979 req-d79ad06b-bc7f-4764-a44e-68124a4f9ef9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:03.094252 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-51bedac8-3b95-4e18-a14f-45ef163c6979 req-d79ad06b-bc7f-4764-a44e-68124a4f9ef9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:03.094697 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-51bedac8-3b95-4e18-a14f-45ef163c6979 req-d79ad06b-bc7f-4764-a44e-68124a4f9ef9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:03.106013 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-51bedac8-3b95-4e18-a14f-45ef163c6979 req-d79ad06b-bc7f-4764-a44e-68124a4f9ef9 service nova] Creating event network-changed:00869655-44b7-46cf-8670-7382e6158af9 for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed on n-h2-791135-8 Oct 04 12:26:03.113018 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-51bedac8-3b95-4e18-a14f-45ef163c6979 req-d79ad06b-bc7f-4764-a44e-68124a4f9ef9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033761 Oct 04 12:26:03.114216 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2362/7349] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:26:03.321186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:03.321844 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:03.329211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:03.329740 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:03.330178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:03.330871 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:03.331326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:03.331755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:03.463672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:03.471586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d5e19a81-1509-41bb-a3b8-c5d3f500fa46 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.154303 Oct 04 12:26:03.472174 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4988/7350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:03 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:04.497145 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:04.497893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:04.504396 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:04.504895 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:04.505340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:04.506085 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:04.506550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:04.506989 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:04.667361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:04.671068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:26:04.676107 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bab09e9c-4637-43ac-a712-2da388f8bfcd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.184844 Oct 04 12:26:04.676720 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2363/7351] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:04 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:05.704444 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:05.705059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:05.707779 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:26:05.713464 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:05.713964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:05.714409 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:05.715204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:05.715616 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:05.716052 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:05.720235 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:26:05.866141 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:05.874815 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0c1d876b-0efc-4237-91e7-9a8273cb5b47 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.174278 Oct 04 12:26:05.875418 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4989/7352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:05 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:06.899830 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:06.900448 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:06.904890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=33 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:26:06.909852 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:06.910340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:06.910781 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:06.911518 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:06.912075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:06.912612 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:07.080932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:07.090555 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2bc51583-7380-4b14-bbd5-0413e6192079 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.195361 Oct 04 12:26:07.091344 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2364/7353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:06 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:08.115142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:08.115759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:08.123992 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:08.124519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:08.124987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:08.125742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:08.126470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:08.127113 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:08.276637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:08.285135 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d7d8075c-67e6-4b75-b884-8dd177283196 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.174103 Oct 04 12:26:08.285964 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4990/7354] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:08 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:09.311015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:09.311015 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:09.317904 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:09.318449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:09.318838 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:09.319544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:09.320004 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:09.320434 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:09.465084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:09.473629 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0f82ed91-3128-4ce2-b3d2-6e21f11cbe42 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.167676 Oct 04 12:26:09.474438 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2365/7355] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:09 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:10.496930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:10.497618 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:10.504729 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:10.505228 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:10.505716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:10.506578 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:10.507045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:10.507478 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:10.654701 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:10.662991 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d26d0a97-8146-4464-a7d7-63af17343ab0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.170708 Oct 04 12:26:10.663588 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4991/7356] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:10 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:11.688033 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:11.688658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:11.696401 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:11.696889 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:11.697326 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:11.698048 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:11.698510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:11.698940 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:11.830982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:11.838655 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2fe60010-2c48-4ada-86b0-82cc540135b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.154510 Oct 04 12:26:11.839738 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2366/7357] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:11 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:12.862097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:12.862756 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:12.869882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:12.870373 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:12.871439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:12.872148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:12.872628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:12.873061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:13.003996 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:13.011710 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ebf27d76-a275-4aa4-9535-c0514c5c5d41 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.153515 Oct 04 12:26:13.012287 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4992/7358] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:12 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:14.035394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:14.036011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:14.042811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:14.043300 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:14.043745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:14.044444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:14.044909 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:14.045457 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:14.175885 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:14.184215 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f12f551a-aceb-4cbf-9af0-d7cc4f947c1a tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.152977 Oct 04 12:26:14.184788 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2367/7359] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:14 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:15.207184 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:15.207803 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:15.215534 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:15.216027 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:15.216467 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:15.217169 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:15.217657 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:15.218094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:15.384282 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:15.392641 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e96d37f1-fc07-4835-aeb7-01076557e53c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.189706 Oct 04 12:26:15.393205 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4993/7360] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:15 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:16.416161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:16.416789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:16.424339 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:16.424831 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:16.425272 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:16.425998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:16.426461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:16.426899 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:16.554462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:16.562265 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-353d8c68-bb14-42e1-bbb1-37088ef66ac6 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.150095 Oct 04 12:26:16.562841 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2368/7361] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:16 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:17.587085 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:17.587708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:17.594523 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:17.595021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:17.595454 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:17.596152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:17.596612 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:17.597044 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:17.731440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:17.739181 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-96dd2adf-12a8-436f-8aa5-a90a2ee5170b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.156096 Oct 04 12:26:17.739787 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4994/7362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:17 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:18.764014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:18.764635 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:18.771751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:18.772249 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:18.772686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:18.773420 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:18.773881 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:18.774313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:18.903515 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e4d931f5-0e18-4b18-871a-5eb3edfecada req-16d71308-f0e7-49f2-bc66-afce06fd8be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "name": "network-vif-plugged", "status": "completed", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:26:18.914543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e4d931f5-0e18-4b18-871a-5eb3edfecada req-16d71308-f0e7-49f2-bc66-afce06fd8be8 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:18.915261 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e4d931f5-0e18-4b18-871a-5eb3edfecada req-16d71308-f0e7-49f2-bc66-afce06fd8be8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:18.915882 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e4d931f5-0e18-4b18-871a-5eb3edfecada req-16d71308-f0e7-49f2-bc66-afce06fd8be8 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:18.918205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:18.926591 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-af569fb8-264a-4e73-ac39-9ea196a538fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.166996 Oct 04 12:26:18.927472 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2369/7363] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:18 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:18.932260 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e4d931f5-0e18-4b18-871a-5eb3edfecada req-16d71308-f0e7-49f2-bc66-afce06fd8be8 service nova] Creating event network-vif-plugged:00869655-44b7-46cf-8670-7382e6158af9 for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed on n-h2-791135-8 Oct 04 12:26:18.938009 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e4d931f5-0e18-4b18-871a-5eb3edfecada req-16d71308-f0e7-49f2-bc66-afce06fd8be8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039100 Oct 04 12:26:18.939165 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4995/7364] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:26:19.949394 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:19.950128 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:19.957079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:19.957611 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:19.958063 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:19.958766 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:19.959236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:19.959672 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:20.097663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:20.105865 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-069b02fd-c9bc-4005-bc73-28a06d600266 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1685 microversion: 2.1 time: 0.159748 Oct 04 12:26:20.106440 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2370/7365] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:19 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:26:21.130083 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:26:21.130789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:26:21.138333 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:21.138815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:21.139248 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:21.139941 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:26:21.140397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:26:21.140945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:26:21.273527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:26:21.282098 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7aaede14-5d87-40af-8a25-94a8c464ac5d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1672 microversion: 2.1 time: 0.156480 Oct 04 12:26:21.282683 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4996/7366] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:26:21 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:06.490898 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=13 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:06.491684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=42 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:06.492930 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:28:06.493068 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed (ip 10.222.0.23) !!! Oct 04 12:28:06.494105 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:28:06.494417 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed (ip 10.222.0.23) !!! Oct 04 12:28:06.497765 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=15 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:06.498600 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=43 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:06.500270 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:28:06.500490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:06.500631 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 04 12:28:06.501159 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:06.517137 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:06.517665 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:06.518110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:06.518822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:06.519278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:06.519707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:06.548351 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Going to try to terminate instance {{(pid=122408) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:28:06.580750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-9c2eb60d-ca11-4d68-953f-f3676ab672d6 req-0e0a88d3-7b2d-4144-8c8f-a7b37cf16d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:28:06.591312 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9c2eb60d-ca11-4d68-953f-f3676ab672d6 req-0e0a88d3-7b2d-4144-8c8f-a7b37cf16d57 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:06.591917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9c2eb60d-ca11-4d68-953f-f3676ab672d6 req-0e0a88d3-7b2d-4144-8c8f-a7b37cf16d57 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:06.592445 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9c2eb60d-ca11-4d68-953f-f3676ab672d6 req-0e0a88d3-7b2d-4144-8c8f-a7b37cf16d57 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:06.604690 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9c2eb60d-ca11-4d68-953f-f3676ab672d6 req-0e0a88d3-7b2d-4144-8c8f-a7b37cf16d57 service nova] Creating event network-changed:00869655-44b7-46cf-8670-7382e6158af9 for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed on n-h2-791135-8 Oct 04 12:28:06.610833 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-9c2eb60d-ca11-4d68-953f-f3676ab672d6 req-0e0a88d3-7b2d-4144-8c8f-a7b37cf16d57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126114 Oct 04 12:28:06.612293 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4997/7367] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:28:06.635629 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-971307c5-687d-4279-92ec-9ea94720da8d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 204 len: 0 microversion: 2.1 time: 0.152680 Oct 04 12:28:06.636316 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2371/7368] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:28:06 2022] DELETE /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:28:06.645148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:06.645812 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:06.652186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:06.652686 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:06.653133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:06.653951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:06.654322 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:06.654755 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:06.801098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:06.809113 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4e969432-82b6-4185-a5fa-bfb7c58fc3b5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.168334 Oct 04 12:28:06.809733 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4998/7369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:06 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:28:07.833658 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:07.834373 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:07.840595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:07.841088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:07.841570 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:07.842273 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:07.842738 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:07.843173 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:08.104090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:08.112373 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c9f0db54-96ee-4a8a-8b0a-605f2aec05ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1678 microversion: 2.1 time: 0.284000 Oct 04 12:28:08.112963 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2372/7370] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:07 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1678 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:08.788459 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-101aa831-ce69-4f17-91a2-5442ed554729 req-56fb12fd-678e-4898-a091-fedc66479ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44ec85c-244a-41a1-a25e-a2541b9b12ed", "name": "network-vif-deleted", "tag": "00869655-44b7-46cf-8670-7382e6158af9"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:28:08.798306 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-101aa831-ce69-4f17-91a2-5442ed554729 req-56fb12fd-678e-4898-a091-fedc66479ff3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:08.798786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-101aa831-ce69-4f17-91a2-5442ed554729 req-56fb12fd-678e-4898-a091-fedc66479ff3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:08.799217 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-101aa831-ce69-4f17-91a2-5442ed554729 req-56fb12fd-678e-4898-a091-fedc66479ff3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:08.810457 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-101aa831-ce69-4f17-91a2-5442ed554729 req-56fb12fd-678e-4898-a091-fedc66479ff3 service nova] Creating event network-vif-deleted:00869655-44b7-46cf-8670-7382e6158af9 for instance f44ec85c-244a-41a1-a25e-a2541b9b12ed on n-h2-791135-8 Oct 04 12:28:08.815504 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-101aa831-ce69-4f17-91a2-5442ed554729 req-56fb12fd-678e-4898-a091-fedc66479ff3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031987 Oct 04 12:28:08.816338 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 4999/7371] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:28:09.136152 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:09.136780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:09.144685 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:09.145186 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:09.145663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:09.146559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:09.147016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:09.147451 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:09.179787 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:09.180279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:09.180721 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:09.181182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lazy-loading 'fault' on Instance uuid f44ec85c-244a-41a1-a25e-a2541b9b12ed {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:28:09.226317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:09.234417 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e93a6f8-e1be-4000-aefe-264ce8bd0c19 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 200 len: 1335 microversion: 2.1 time: 0.102181 Oct 04 12:28:09.234983 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2373/7372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:09 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:10.259275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:10.259979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: f44ec85c-244a-41a1-a25e-a2541b9b12ed] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:10.266148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:10.266624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:10.267057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:10.268242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:10.268699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:10.269120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:10.282236 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] HTTP exception thrown: Instance f44ec85c-244a-41a1-a25e-a2541b9b12ed could not be found. Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Request method failure captured: Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed HTTP/1.1 Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCW3Ue-nLtN3ZHTpztMi6-fKUeqy-Swp6CUkz5t9ghgWEheun3LI70LGMy5dynJxpHzwjm38Axp3Ya6wdUqkNS8Lb_IFE8WXyYF4cKSnSJSqDQRvRiOpJbA6AfI3dxEAmnaLb46UBlmf23csKFbHjfZSdOfEBEaACGsWvyabOvR-g-c Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 6f188aa2bff34d879a2b06c069bdfbbd Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestShelveInstance-1044768825 Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f188aa2bff34d879a2b06c069bdfbbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f188aa2bff34d879a2b06c069bdfbbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f188aa2bff34d879a2b06c069bdfbbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f188aa2bff34d879a2b06c069bdfbbd"}]}] Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestShelveInstance-1044768825 Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 6f188aa2bff34d879a2b06c069bdfbbd Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestShelveInstance-1044768825 Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestShelveInstance-1044768825-project Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: e826b34ca17a4832907e5e66a8541e4f Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestShelveInstance-1044768825-project Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance f44ec85c-244a-41a1-a25e-a2541b9b12ed could not be found. Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': 'f44ec85c-244a-41a1-a25e-a2541b9b12ed'} Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44ec85c-244a-41a1-a25e-a2541b9b12ed could not be found. Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44ec85c-244a-41a1-a25e-a2541b9b12ed could not be found. Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:28:10.284745 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44ec85c-244a-41a1-a25e-a2541b9b12ed could not be found. Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Returning 404 to user: Instance f44ec85c-244a-41a1-a25e-a2541b9b12ed could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2741a338-cd77-4530-b06f-1053c9ffe15d tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed" status: 404 len: 111 microversion: 2.1 time: 0.032408 Oct 04 12:28:10.289893 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5000/7373] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:10 2022] GET /compute/v2.1/servers/f44ec85c-244a-41a1-a25e-a2541b9b12ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:28:10.448769 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-9c3a74fd-0785-4299-881d-6dd009c7fd05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '.version_select at 0x7f71d44f6a60>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:10.472621 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-9c3a74fd-0785-4299-881d-6dd009c7fd05 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-265253720" status: 202 len: 0 microversion: 2.1 time: 0.027780 Oct 04 12:28:10.473217 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2374/7374] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 12:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-265253720 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:28:10.496223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fe2f1bcd-7c2f-4808-b72d-ff9ba33cdd06 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Action: 'create', calling method: .version_select at 0x7f71cf06fb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-186252077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA78w0HTqSnVFDj0FULUDP9e++dx7gqY4TpDJkN8w/zeq3P3aHuL80RCNKKvlCS/LiPvxMc1p04oratKNAyBqsjxOInEWZ+8ogutIHkw9z66zxngIIU0mlgcUT3ZogC5A=="}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:28:10.511656 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-fe2f1bcd-7c2f-4808-b72d-ff9ba33cdd06 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Getting quotas for project 6f188aa2bff34d879a2b06c069bdfbbd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:28:10.516750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-fe2f1bcd-7c2f-4808-b72d-ff9ba33cdd06 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Getting quotas for user e826b34ca17a4832907e5e66a8541e4f and project 6f188aa2bff34d879a2b06c069bdfbbd. Resources: {'key_pairs'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:28:10.544035 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fe2f1bcd-7c2f-4808-b72d-ff9ba33cdd06 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.051711 Oct 04 12:28:10.544865 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5001/7375] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:28:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:28:26.851875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:26.852681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:26.857466 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-956424820", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-186252077", "security_groups": [{"name": "tempest-secgroup-smoke-1595300970"}], "networks": [{"uuid": "ea659f52-ae49-40c1-8eb5-b2eaa5708fd3"}], "block_device_mapping_v2": [{"uuid": "654755fc-8802-47dd-b943-8850c7a4a750", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:28:26.970430 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.network.neutron [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] validate_networks() for [('ea659f52-ae49-40c1-8eb5-b2eaa5708fd3', None, None, None, None, None)] {{(pid=122408) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:28:27.383183 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Flavor limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:28:27.383590 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Image limits 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:28:27.384069 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Flavor pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:28:27.384486 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Image pref 0:0:0 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:28:27.384902 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.virt.hardware [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:28:27.393670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:27.394154 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:27.394595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:27.395320 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:27.395777 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:27.396205 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:27.414108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Getting quotas for project 6f188aa2bff34d879a2b06c069bdfbbd. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:28:27.419338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Getting quotas for user e826b34ca17a4832907e5e66a8541e4f and project 6f188aa2bff34d879a2b06c069bdfbbd. Resources: {'instances', 'ram', 'cores'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:28:27.477143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Going to run 1 instances... {{(pid=122408) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:28:27.479407 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='654755fc-8802-47dd-b943-8850c7a4a750',volume_size=None,volume_type=None)] {{(pid=122408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:28:27.605003 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-49346ccf-9f0c-4147-b31b-f7787549075f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754894 Oct 04 12:28:27.605690 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2375/7376] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:28:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:28:27.614742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=12 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:27.615705 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=4 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:27.616592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:27.621387 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-2c429bc3-54cb-4299-8903-e9ffbe2665cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:27.622015 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-2c429bc3-54cb-4299-8903-e9ffbe2665cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:27.724626 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-2c429bc3-54cb-4299-8903-e9ffbe2665cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:27.732693 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-2c429bc3-54cb-4299-8903-e9ffbe2665cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1087 microversion: 2.1 time: 0.119747 Oct 04 12:28:27.733428 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5002/7377] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:27 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1087 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:28.757208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:28.757935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:28.765779 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:28.766447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:28.767213 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:28.768078 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:28.768744 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:28.769686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:28.853705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:28.862425 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5fa4a95b-1084-44b1-ae15-d99a9380c0db tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1203 microversion: 2.1 time: 0.110206 Oct 04 12:28:28.863438 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2376/7378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:28 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1203 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:29.885449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:29.886066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:29.892789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:29.893276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:29.893737 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:29.894432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:29.895070 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:29.895497 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:30.090135 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:30.099580 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc674baa-ca00-4f5a-9129-453410f4feb0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1271 microversion: 2.1 time: 0.217969 Oct 04 12:28:30.100427 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5003/7379] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:29 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:30.189634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8321d939-e2af-4776-b709-c9ea76d2fe75 req-7b11e321-8273-4ef9-a01d-8cfb0a5cae7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7cebb5-9176-4c15-8183-bed8a8d0e570", "tag": "75a44cf4-9a51-49d2-a718-cdf80773b4d0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:28:30.199874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8321d939-e2af-4776-b709-c9ea76d2fe75 req-7b11e321-8273-4ef9-a01d-8cfb0a5cae7a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:30.200361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8321d939-e2af-4776-b709-c9ea76d2fe75 req-7b11e321-8273-4ef9-a01d-8cfb0a5cae7a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:30.200913 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8321d939-e2af-4776-b709-c9ea76d2fe75 req-7b11e321-8273-4ef9-a01d-8cfb0a5cae7a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:30.212692 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8321d939-e2af-4776-b709-c9ea76d2fe75 req-7b11e321-8273-4ef9-a01d-8cfb0a5cae7a service nova] Creating event network-changed:75a44cf4-9a51-49d2-a718-cdf80773b4d0 for instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 on n-h1-791135-8 Oct 04 12:28:30.225782 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8321d939-e2af-4776-b709-c9ea76d2fe75 req-7b11e321-8273-4ef9-a01d-8cfb0a5cae7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113264 Oct 04 12:28:30.226833 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2377/7380] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:28:31.123562 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:31.124323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:31.132336 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:31.132918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:31.132918 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:31.133574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:31.134043 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:31.134482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:31.274002 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:31.281769 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ec6bb2b6-826e-43c0-aa6d-8b33300d8516 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1271 microversion: 2.1 time: 0.162152 Oct 04 12:28:31.282349 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5004/7381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:31 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:32.306789 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:32.307506 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:32.314463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:32.314956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:32.315409 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:32.316110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:32.316577 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:32.317016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:32.452745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:32.460686 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-107e5a20-0ffb-4503-bfb0-937e8fa805d1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1271 microversion: 2.1 time: 0.159059 Oct 04 12:28:32.461266 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2378/7382] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:32 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:33.484764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:33.485427 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:33.494218 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:33.494718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:33.495291 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:33.496009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:33.496475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:33.496906 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:33.633697 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:33.641825 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d6f70e9c-48ab-4840-bdfc-c0005e9b45cc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1271 microversion: 2.1 time: 0.161945 Oct 04 12:28:33.642423 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5005/7383] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:33 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:34.664426 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:34.664974 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:34.671757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:34.672243 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:34.672684 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:34.673393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:34.673855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:34.674283 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:34.806099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:34.814438 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-1a6a47a3-4fac-4cc0-8026-8c0f8112076c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.153552 Oct 04 12:28:34.815023 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2379/7384] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:34 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:35.838144 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:35.838677 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:35.846171 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:35.846658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:35.847097 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:35.847792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:35.848253 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:35.848685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:35.977076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:35.984904 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-68d196df-9bca-40dd-8b00-7e33a5762271 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.150751 Oct 04 12:28:35.985503 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5006/7385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:35 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:37.007627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:37.008244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:37.014436 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:37.014924 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:37.015369 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:37.016064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:37.016525 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:37.016957 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:37.151596 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:37.160068 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2e5afd28-6b13-4985-8e7b-8537d6499576 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.156535 Oct 04 12:28:37.160638 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2380/7386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:37 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:38.187130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:38.187752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:38.190398 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:38.195772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:38.196269 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:38.196708 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:38.197433 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:38.197895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:38.198325 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:38.332583 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:38.340321 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c9bd1c8c-0a04-4564-be95-d40f02d2b5d4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.161427 Oct 04 12:28:38.340892 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5007/7387] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:38 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:39.363961 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:39.364615 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:39.366670 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:39.367349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:28:39.374261 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:39.374757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:39.375206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:39.375912 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:39.376425 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:39.376868 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:39.505503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:39.513161 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b5170ef5-7858-4d10-a45a-68defbc25505 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.153677 Oct 04 12:28:39.513774 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2381/7388] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:39 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:40.537222 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:40.537790 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:40.544584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:40.545069 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:40.545540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:40.546243 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:40.546698 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:40.547129 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:40.680943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:40.689295 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4a8cb11e-4150-452a-9273-b8712a5bac99 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.156426 Oct 04 12:28:40.689940 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5008/7389] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:40 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:41.711582 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:41.712206 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:41.720493 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:41.721079 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:41.721707 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:41.722445 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:41.722926 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:41.723474 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:41.855038 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:41.863173 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2ca3a4ad-1134-42d9-a7ca-df31e8e3c4b9 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.155480 Oct 04 12:28:41.863752 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2382/7390] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:41 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:42.886372 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:42.887008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:42.894482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:42.894966 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:42.895401 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:42.896087 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:42.896545 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:42.896971 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:43.040610 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:43.048894 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f7ec14c3-4061-4082-9e9b-8f07d0054380 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.166468 Oct 04 12:28:43.065540 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5009/7391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:42 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:44.072386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:44.073009 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:44.080358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:44.080875 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:44.081316 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:44.082040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:44.082501 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:44.082935 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:44.220828 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:44.228618 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-53a1f2f7-b3b4-46c6-a536-539404d32c34 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.160126 Oct 04 12:28:44.229198 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2383/7392] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:44 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:44.767909 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-f9e64cda-b45c-482a-9b4c-97a342025031 req-1fbc3704-301b-4db7-ba73-4a9d1456fa42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7cebb5-9176-4c15-8183-bed8a8d0e570", "name": "network-vif-plugged", "status": "completed", "tag": "75a44cf4-9a51-49d2-a718-cdf80773b4d0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:28:44.778543 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f9e64cda-b45c-482a-9b4c-97a342025031 req-1fbc3704-301b-4db7-ba73-4a9d1456fa42 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:44.779060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f9e64cda-b45c-482a-9b4c-97a342025031 req-1fbc3704-301b-4db7-ba73-4a9d1456fa42 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:44.779488 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-f9e64cda-b45c-482a-9b4c-97a342025031 req-1fbc3704-301b-4db7-ba73-4a9d1456fa42 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:44.791138 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-f9e64cda-b45c-482a-9b4c-97a342025031 req-1fbc3704-301b-4db7-ba73-4a9d1456fa42 service nova] Creating event network-vif-plugged:75a44cf4-9a51-49d2-a718-cdf80773b4d0 for instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 on n-h1-791135-8 Oct 04 12:28:44.796181 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-f9e64cda-b45c-482a-9b4c-97a342025031 req-1fbc3704-301b-4db7-ba73-4a9d1456fa42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081671 Oct 04 12:28:44.796775 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5010/7393] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:28:45.251184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:45.251731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:45.258595 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:45.259082 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:45.259528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:45.260221 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:45.260682 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:45.261117 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:45.390950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:45.398558 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-85248c1f-2de7-41a5-92fe-880d4a63e977 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1259 microversion: 2.1 time: 0.151414 Oct 04 12:28:45.399128 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2384/7394] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:45 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:46.423672 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:46.424386 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:46.430642 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:46.431133 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:46.431574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:46.432272 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:46.432734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:46.433168 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:46.566348 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:46.574124 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5f9874c0-d8b5-4f6e-b45c-b425711b7ed2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1442 microversion: 2.1 time: 0.156096 Oct 04 12:28:46.574716 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5011/7395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:46 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:46.596743 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:28:46.597393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:28:46.604317 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:46.604861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:46.605307 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:46.606040 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:46.606509 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:46.606950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:46.742874 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:28:46.750613 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c51ea2fd-52fe-4147-8581-a48bc0aa1321 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1442 microversion: 2.1 time: 0.158210 Oct 04 12:28:46.751199 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2385/7396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:28:46 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:28:48.646851 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-9cdccf2f-b61e-4cb7-b43a-e532ed34448e req-450e025a-1b2c-4f9e-bbbd-bc7e2693e081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7cebb5-9176-4c15-8183-bed8a8d0e570", "tag": "75a44cf4-9a51-49d2-a718-cdf80773b4d0"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:28:48.658275 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9cdccf2f-b61e-4cb7-b43a-e532ed34448e req-450e025a-1b2c-4f9e-bbbd-bc7e2693e081 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:28:48.659031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9cdccf2f-b61e-4cb7-b43a-e532ed34448e req-450e025a-1b2c-4f9e-bbbd-bc7e2693e081 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:28:48.659521 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-9cdccf2f-b61e-4cb7-b43a-e532ed34448e req-450e025a-1b2c-4f9e-bbbd-bc7e2693e081 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:28:48.670712 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-9cdccf2f-b61e-4cb7-b43a-e532ed34448e req-450e025a-1b2c-4f9e-bbbd-bc7e2693e081 service nova] Creating event network-changed:75a44cf4-9a51-49d2-a718-cdf80773b4d0 for instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 on n-h1-791135-8 Oct 04 12:28:48.675986 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-9cdccf2f-b61e-4cb7-b43a-e532ed34448e req-450e025a-1b2c-4f9e-bbbd-bc7e2693e081 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033094 Oct 04 12:28:48.676587 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5012/7397] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:30:44.079279 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43145c0f-38f9-443d-929f-16a90ce4e841] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:30:44.080204 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e9dfef3-0453-479e-ab86-c91297e9b462] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:30:44.080793 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:30:44.081592 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=58 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:30:44.086844 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:30:44.087393 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:44.094856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:44.095356 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:44.095806 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:44.096512 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:44.096980 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:44.097458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:44.121132 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.objects.instance [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lazy-loading 'flavor' on Instance uuid fc7cebb5-9176-4c15-8183-bed8a8d0e570 {{(pid=122408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:30:44.191271 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d1459467-9e81-4be8-97e4-c1bb7dee65c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "POST /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570/action" status: 202 len: 0 microversion: 2.1 time: 0.113792 Oct 04 12:30:44.191928 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2386/7398] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:30:44 2022] POST /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:30:44.198409 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8829bdcc-210e-40a3-b2af-6ede6e7ff32d] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:30:44.199404 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b0aa98c-d914-4893-9124-de6a30c783e0] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:30:44.200346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=24 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:30:44.201084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=52 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:30:44.202266 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:30:44.202421 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:30:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 (ip 10.222.0.23) !!! Oct 04 12:30:44.207609 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:44.208930 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:44.217814 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:44.218317 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:44.218754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:44.219462 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:44.219920 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:44.220353 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:44.354188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:44.361961 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-64ec443d-2d4a-4759-a457-6c5bbf69e603 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.165524 Oct 04 12:30:44.362539 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5013/7399] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:44 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:45.386284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:45.386991 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:45.400549 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:45.401062 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:45.401545 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:45.402267 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:45.402728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:45.403158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:45.403862 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [43145c0f-38f9-443d-929f-16a90ce4e841] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38882. Oct 04 12:30:45.404567 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e9dfef3-0453-479e-ab86-c91297e9b462] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38884. Oct 04 12:30:45.535973 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:45.544176 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-437eabf0-048a-4673-9b83-1778b1d90182 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.163629 Oct 04 12:30:45.544749 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2387/7400] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:45 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:46.567742 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:46.568368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:46.577455 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:46.577947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:46.578393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:46.579096 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:46.579557 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:46.579990 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:46.588022 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b0aa98c-d914-4893-9124-de6a30c783e0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38892. Oct 04 12:30:46.598426 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] [8829bdcc-210e-40a3-b2af-6ede6e7ff32d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38890. Oct 04 12:30:47.021685 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:47.029555 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-56a5e8a3-abb4-41b3-a59a-3a84805c62b7 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.465789 Oct 04 12:30:47.030136 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5014/7401] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:46 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:48.053762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:48.054388 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:48.061127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:48.061655 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:48.062099 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:48.063068 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:48.063528 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:48.063958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:48.196470 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:48.204504 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c0f0252f-fdc7-4d9e-9aab-c76ce9865014 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.155114 Oct 04 12:30:48.205076 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2388/7402] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:48 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:49.228208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:49.228830 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:49.235704 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:49.236186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:49.236628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:49.237323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:49.237811 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:49.238242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:49.366530 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:49.374320 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7b8c710a-9a64-4b7a-9d25-04e2705216e3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.150171 Oct 04 12:30:49.374892 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5015/7403] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:49 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:50.396791 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:50.397890 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:50.404661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:50.405262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:50.405751 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:50.406446 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:50.406906 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:50.407336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:50.536113 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:50.544409 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cc6e6a88-34f4-4169-aa40-5440afd9472f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.151596 Oct 04 12:30:50.544988 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2389/7404] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:50 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:51.567505 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:51.568154 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:51.575744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:51.576227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:51.576665 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:51.577375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:51.577848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:51.578285 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:51.714821 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:51.722669 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-0afc77e7-1106-4f65-9bd1-2123bfa3d376 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.159167 Oct 04 12:30:51.723257 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5016/7405] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:51 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:52.746091 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:52.746628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:52.753624 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:52.754126 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:52.754578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:52.755288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:52.755786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:52.756225 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:52.884072 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:52.891794 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a2282903-e1ef-4858-aaa6-8dc4b088a365 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.149741 Oct 04 12:30:52.892375 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2390/7406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:52 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:53.915499 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:53.916148 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:53.922976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:53.923466 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:53.923911 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:53.924611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:53.925072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:53.925540 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:54.052295 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:54.060564 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-54db5bfb-f3e3-4302-85f2-ca289029a890 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.148997 Oct 04 12:30:54.061139 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5017/7407] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:53 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:55.084993 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:55.086318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:55.093468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:55.093964 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:55.094408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:55.095109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:55.095600 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:55.096046 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:55.233208 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:55.241048 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c006763f-e4b5-4302-b224-a3f6f7c8a978 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.159905 Oct 04 12:30:55.241664 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2391/7408] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:55 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:56.263650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:56.264271 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:56.270919 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:56.271405 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:56.271847 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:56.272549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:56.273546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:56.273978 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:56.415954 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:56.424012 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f45ed16f-0fc0-4104-9cd5-d06973ba11ec tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.164080 Oct 04 12:30:56.425885 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5018/7409] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:56 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:57.447604 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:57.448551 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:57.455438 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:57.455923 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:57.456361 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:57.457052 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:57.457557 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:57.457986 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:57.590364 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:57.598158 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-8e3551ee-6c13-4cdd-9bc3-b615ef354a80 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.155046 Oct 04 12:30:57.598749 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2392/7410] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:57 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:58.620556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:58.621203 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:58.627983 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:58.628470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:58.628907 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:58.629624 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:58.630084 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:58.630519 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:58.760318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:58.768149 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e183fc1c-1b12-47fc-93cb-a8d70912a17b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1507 microversion: 2.1 time: 0.151526 Oct 04 12:30:58.768730 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5019/7411] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:58 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:58.791114 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:30:58.791846 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:58.798576 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:58.799066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:58.799507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:58.800190 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:58.800648 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:58.801077 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:58.840995 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122408) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 12:30:58.904003 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b9e053c0-ade3-43ae-9ca2-a4dfe4501866 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "POST /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570/action" status: 202 len: 0 microversion: 2.1 time: 0.116799 Oct 04 12:30:58.904618 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2393/7412] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:30:58 2022] POST /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:30:58.913004 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:30:58.913735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:30:58.919658 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:58.920150 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:58.920579 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:58.921276 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:58.921758 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:58.922190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:59.105393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:30:59.113301 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-5403acb2-fc4f-465f-b4e3-96e71548b3b1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1515 microversion: 2.1 time: 0.204446 Oct 04 12:30:59.113909 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5020/7413] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:30:58 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:30:59.380284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ad3a6f3b-c0ec-4559-b6c5-513613e01f57 req-6dd01199-b29d-41ef-b08a-1e7a2935de16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7cebb5-9176-4c15-8183-bed8a8d0e570", "name": "network-vif-unplugged", "status": "completed", "tag": "75a44cf4-9a51-49d2-a718-cdf80773b4d0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:30:59.395278 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ad3a6f3b-c0ec-4559-b6c5-513613e01f57 req-6dd01199-b29d-41ef-b08a-1e7a2935de16 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:30:59.395938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ad3a6f3b-c0ec-4559-b6c5-513613e01f57 req-6dd01199-b29d-41ef-b08a-1e7a2935de16 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:30:59.396633 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ad3a6f3b-c0ec-4559-b6c5-513613e01f57 req-6dd01199-b29d-41ef-b08a-1e7a2935de16 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:30:59.410116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.compute.server_external_events [req-ad3a6f3b-c0ec-4559-b6c5-513613e01f57 req-6dd01199-b29d-41ef-b08a-1e7a2935de16 service nova] Unable to find a host for instance fc7cebb5-9176-4c15-8183-bed8a8d0e570. Dropping event network-vif-unplugged {{(pid=122408) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 12:30:59.411348 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ad3a6f3b-c0ec-4559-b6c5-513613e01f57 req-6dd01199-b29d-41ef-b08a-1e7a2935de16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035032 Oct 04 12:30:59.412150 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2394/7414] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 12:31:00.136283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:00.136952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:00.144005 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:00.144432 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:00.144866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:00.145585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:00.146042 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:00.146469 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:00.290260 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:00.298250 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-529acff5-d4c0-423e-b71d-cfc6953fdf75 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1517 microversion: 2.1 time: 0.165982 Oct 04 12:31:00.299132 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5021/7415] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:00 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:01.321934 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:01.322505 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:01.329376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:01.329877 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:01.330318 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:01.331014 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:01.331476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:01.331911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:01.462982 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:01.471239 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a4e42086-e8f2-4b0c-ba3c-c337ad2839e1 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1517 microversion: 2.1 time: 0.153438 Oct 04 12:31:01.471822 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2395/7416] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:01 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:02.495650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:02.496296 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:02.504984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:02.505506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:02.505947 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:02.506654 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:02.507752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:02.508180 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:02.642204 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:02.650142 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-887d5976-0fa7-431e-b6e1-8dbbce64bd49 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1517 microversion: 2.1 time: 0.159071 Oct 04 12:31:02.650731 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5022/7417] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:02 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:03.674214 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:03.674836 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:03.681767 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:03.682264 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:03.682712 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:03.683416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:03.683882 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:03.684321 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:03.814490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:03.822227 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4a3476d6-c338-4901-94a0-3b6a5bb7072b tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1517 microversion: 2.1 time: 0.151973 Oct 04 12:31:03.822812 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2396/7418] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:03 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:04.845185 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:04.845852 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:04.852644 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:04.853134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:04.853604 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:04.854303 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:04.854757 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:04.855181 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:04.991763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:04.999734 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-327b1ccf-8171-48d9-8455-5f7aa537b6fc tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.158464 Oct 04 12:31:05.000382 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5023/7419] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:04 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:05.557196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-8c038a19-62e8-4410-91af-f91f09bfb7bb req-8de48326-fd9a-4081-9606-4534d663196a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7cebb5-9176-4c15-8183-bed8a8d0e570", "tag": "75a44cf4-9a51-49d2-a718-cdf80773b4d0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:31:05.567816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8c038a19-62e8-4410-91af-f91f09bfb7bb req-8de48326-fd9a-4081-9606-4534d663196a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:05.568313 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8c038a19-62e8-4410-91af-f91f09bfb7bb req-8de48326-fd9a-4081-9606-4534d663196a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:05.568753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-8c038a19-62e8-4410-91af-f91f09bfb7bb req-8de48326-fd9a-4081-9606-4534d663196a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:05.580278 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-8c038a19-62e8-4410-91af-f91f09bfb7bb req-8de48326-fd9a-4081-9606-4534d663196a service nova] Creating event network-changed:75a44cf4-9a51-49d2-a718-cdf80773b4d0 for instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 on n-h2-791135-8 Oct 04 12:31:05.585773 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-8c038a19-62e8-4410-91af-f91f09bfb7bb req-8de48326-fd9a-4081-9606-4534d663196a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032977 Oct 04 12:31:05.586391 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2397/7420] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:31:06.023893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:06.024549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:06.031394 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:06.031913 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:06.032359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:06.033059 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:06.033553 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:06.033987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:06.168753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:06.176586 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8e46083a-1e26-4c16-b9d1-4b9e22bf4296 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.157187 Oct 04 12:31:06.177170 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5024/7421] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:06 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:07.202203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:07.202958 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:07.210391 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:07.210891 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:07.211340 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:07.212057 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:07.212524 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:07.212967 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:07.429484 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:07.437800 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5a743c4b-c4f7-4c8d-88ff-0f37b2f33e7c tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.241621 Oct 04 12:31:07.438386 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2398/7422] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:07 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:08.460952 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:08.461584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:08.468601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:08.469088 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:08.469564 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:08.470365 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:08.470723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:08.471159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:08.605723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:08.613530 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-32ffacc3-5579-44ab-a6c8-c05d59ae247f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.156479 Oct 04 12:31:08.614104 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5025/7423] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:08 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:09.636759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:09.637664 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:09.644797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:09.645294 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:09.645771 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:09.646476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:09.646938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:09.647944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:09.781661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:09.789622 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-ffc740ee-e0eb-4ae2-ae99-5578068741f8 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.156901 Oct 04 12:31:09.790205 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2399/7424] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:09 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:10.813061 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:10.813664 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:10.821094 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:10.821611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:10.822060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:10.822761 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:10.823227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:10.823667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:10.951684 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:10.959491 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-71e78ce7-61ab-44c4-acd4-1573f9993384 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.150485 Oct 04 12:31:10.960687 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5026/7425] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:10 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:11.983189 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:11.983811 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:11.990578 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:11.991100 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:11.991544 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:11.992242 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:11.992711 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:11.993149 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:12.122160 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:12.125663 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:31:12.130843 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-76a8841f-79cc-45ea-ad89-f2ac06fe18aa tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.151580 Oct 04 12:31:12.131424 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2400/7426] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:11 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:13.154439 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:13.155100 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:13.162309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:13.162810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:13.163262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:13.163964 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:13.164428 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:13.164867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:13.297895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:13.305615 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-566e3a60-b7e0-4eeb-a7fc-0f41c753c9cd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.155120 Oct 04 12:31:13.306202 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5027/7427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:13 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:14.328840 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:14.329510 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:14.332661 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:31:14.339710 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:14.340202 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:14.340650 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:14.341376 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:14.341863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:14.342301 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:14.475462 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:14.484187 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-b05e9f13-64ed-43f4-a045-7496a8133de4 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.159168 Oct 04 12:31:14.484681 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2401/7428] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:14 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:15.507601 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:15.508252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:15.510961 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=31 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:31:15.516307 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:15.516798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:15.517247 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:15.517987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:15.518458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:15.518895 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:15.521666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=91 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:31:15.651323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:15.659092 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-1a8c1a89-68ab-4591-8b9e-22c109366ab2 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.155453 Oct 04 12:31:15.659670 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5028/7429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:15 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:16.683107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:16.683728 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:16.689804 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:16.690291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:16.690732 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:16.691422 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:16.691878 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:16.692305 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:16.824739 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:16.832669 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-069ed0f8-1958-4c63-9b4a-773332c353fd tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.153702 Oct 04 12:31:16.833593 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2402/7430] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:16 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:17.856323 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:17.856883 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:17.863076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:17.863574 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:17.864023 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:17.864730 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:17.865194 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:17.865660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:17.998683 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:18.006561 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-99b47acf-75a2-4f54-ad64-aee7b9df20ca tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.154412 Oct 04 12:31:18.007136 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5029/7431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:17 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:18.330016 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-63e458e7-abfc-438c-9f2a-906f1ac2b408 req-5db26ad7-bb10-4ace-95d5-9ebbb0fb2676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7cebb5-9176-4c15-8183-bed8a8d0e570", "name": "network-vif-plugged", "status": "completed", "tag": "75a44cf4-9a51-49d2-a718-cdf80773b4d0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:31:18.341491 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-63e458e7-abfc-438c-9f2a-906f1ac2b408 req-5db26ad7-bb10-4ace-95d5-9ebbb0fb2676 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:18.341975 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-63e458e7-abfc-438c-9f2a-906f1ac2b408 req-5db26ad7-bb10-4ace-95d5-9ebbb0fb2676 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:18.342421 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-63e458e7-abfc-438c-9f2a-906f1ac2b408 req-5db26ad7-bb10-4ace-95d5-9ebbb0fb2676 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:18.354433 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-63e458e7-abfc-438c-9f2a-906f1ac2b408 req-5db26ad7-bb10-4ace-95d5-9ebbb0fb2676 service nova] Creating event network-vif-plugged:75a44cf4-9a51-49d2-a718-cdf80773b4d0 for instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 on n-h2-791135-8 Oct 04 12:31:18.359502 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-63e458e7-abfc-438c-9f2a-906f1ac2b408 req-5db26ad7-bb10-4ace-95d5-9ebbb0fb2676 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033347 Oct 04 12:31:18.360387 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2403/7432] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:31:19.030710 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:19.031339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:19.038997 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:19.039449 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:19.039891 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:19.040596 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:19.041060 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:19.041556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:19.180238 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:19.188059 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-9269f394-0a91-4a46-bb8f-16170479e253 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1573 microversion: 2.1 time: 0.161311 Oct 04 12:31:19.188636 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5030/7433] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:19 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:31:20.213175 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:31:20.213919 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:31:20.220134 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:20.220623 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:20.221065 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:20.221867 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:31:20.222333 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:31:20.222765 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:31:20.356513 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:31:20.364339 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-f989ef2f-d594-40bf-b76a-f0443fd6ab71 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1560 microversion: 2.1 time: 0.156834 Oct 04 12:31:20.364914 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2404/7434] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:31:20 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:32:34.282769 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=5 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:32:34.284456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=17 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:32:34.285668 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:32:34.285813 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 (ip 10.222.0.23) !!! Oct 04 12:32:34.288236 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-89823ac4-3010-427a-878f-0eff6b58a34a req-25ba7997-0122-4769-bfb5-746d3a5388e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7cebb5-9176-4c15-8183-bed8a8d0e570", "tag": "75a44cf4-9a51-49d2-a718-cdf80773b4d0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:32:34.288754 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:32:34.289095 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 (ip 10.222.0.23) !!! Oct 04 12:32:34.294723 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=7 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:32:34.295795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=20 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:32:34.297456 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:32:34.297785 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 04 12:32:34.307002 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-89823ac4-3010-427a-878f-0eff6b58a34a req-25ba7997-0122-4769-bfb5-746d3a5388e3 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:34.307812 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-89823ac4-3010-427a-878f-0eff6b58a34a req-25ba7997-0122-4769-bfb5-746d3a5388e3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:34.308253 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-89823ac4-3010-427a-878f-0eff6b58a34a req-25ba7997-0122-4769-bfb5-746d3a5388e3 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:34.309674 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:34.310192 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:34.318782 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:34.319592 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:34.320038 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:34.320750 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:34.321211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:34.321676 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:34.324754 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-89823ac4-3010-427a-878f-0eff6b58a34a req-25ba7997-0122-4769-bfb5-746d3a5388e3 service nova] Creating event network-changed:75a44cf4-9a51-49d2-a718-cdf80773b4d0 for instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 on n-h2-791135-8 Oct 04 12:32:34.330579 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-89823ac4-3010-427a-878f-0eff6b58a34a req-25ba7997-0122-4769-bfb5-746d3a5388e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047450 Oct 04 12:32:34.331532 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2405/7435] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:32:34.350735 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:32:34.438805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-af67478c-0caa-40ab-8c7e-9675ddf812ad tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 204 len: 0 microversion: 2.1 time: 0.157795 Oct 04 12:32:34.444915 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5031/7436] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:32:34 2022] DELETE /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:32:34.453262 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:34.454362 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:34.462548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:34.463346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:34.464034 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:34.465013 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:34.466503 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:34.467260 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:34.631681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:32:34.640321 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-743000cc-0fae-44f1-97fa-fefc5a25c4a3 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.193400 Oct 04 12:32:34.640912 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2406/7437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:32:34 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:32:35.664948 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:35.665687 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:35.673475 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:35.673967 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:35.674408 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:35.675120 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:35.675580 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:35.676008 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:35.826339 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:32:35.834683 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-630824ac-57bb-4a99-aff4-c383f5a5a8f5 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1566 microversion: 2.1 time: 0.174241 Oct 04 12:32:35.835486 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5032/7438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:32:35 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:32:36.682386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-c7617733-1360-4b14-a3c7-f8488ad8bc1c req-d4f1211e-b4fa-4c14-9aca-0a3d134d1f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7cebb5-9176-4c15-8183-bed8a8d0e570", "name": "network-vif-deleted", "tag": "75a44cf4-9a51-49d2-a718-cdf80773b4d0"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:32:36.693546 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7617733-1360-4b14-a3c7-f8488ad8bc1c req-d4f1211e-b4fa-4c14-9aca-0a3d134d1f1b service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:36.694045 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7617733-1360-4b14-a3c7-f8488ad8bc1c req-d4f1211e-b4fa-4c14-9aca-0a3d134d1f1b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:36.694489 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-c7617733-1360-4b14-a3c7-f8488ad8bc1c req-d4f1211e-b4fa-4c14-9aca-0a3d134d1f1b service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:36.705906 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-c7617733-1360-4b14-a3c7-f8488ad8bc1c req-d4f1211e-b4fa-4c14-9aca-0a3d134d1f1b service nova] Creating event network-vif-deleted:75a44cf4-9a51-49d2-a718-cdf80773b4d0 for instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 on n-h2-791135-8 Oct 04 12:32:36.710997 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-c7617733-1360-4b14-a3c7-f8488ad8bc1c req-d4f1211e-b4fa-4c14-9aca-0a3d134d1f1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032356 Oct 04 12:32:36.711608 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2407/7439] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:32:36.858526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:36.859152 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:36.866124 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:36.866621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:36.867066 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:36.867773 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:36.868246 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:36.868681 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:36.936081 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:32:36.944162 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-aaadfe47-c8ba-4979-87e3-416094400d37 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1218 microversion: 2.1 time: 0.089595 Oct 04 12:32:36.944820 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5033/7440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:32:36 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:32:37.968854 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:37.969775 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:37.975960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:37.976447 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:37.976893 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:37.977626 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:37.978096 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:37.978534 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:38.042386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:32:38.050804 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-a5028839-758f-491f-85c3-b91c309169c0 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1218 microversion: 2.1 time: 0.087066 Oct 04 12:32:38.051385 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2408/7441] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:32:37 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:32:39.073759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:39.074585 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:39.082062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:39.082559 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:39.082999 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:39.083752 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:39.084177 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:39.084606 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:39.154527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:32:39.163398 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-eb78a90d-1db7-4fe7-99b5-3cc3dd5f1a25 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1218 microversion: 2.1 time: 0.093571 Oct 04 12:32:39.163985 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5034/7442] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:32:39 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:32:40.187619 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:40.188168 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:40.195090 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:40.195593 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:40.196066 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:40.196880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:40.197741 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:40.198185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:40.263291 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:32:40.271090 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d2bead3d-8514-421d-bd3f-f161ae9adeeb tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1218 microversion: 2.1 time: 0.088257 Oct 04 12:32:40.271670 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2409/7443] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:32:40 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:32:41.295026 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:41.296832 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:41.307734 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:41.308000 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:41.308447 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:41.309305 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:41.309636 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:41.310068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:41.362031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:41.362524 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:41.362972 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:41.363431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lazy-loading 'fault' on Instance uuid fc7cebb5-9176-4c15-8183-bed8a8d0e570 {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:32:41.407715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e826b34ca17a4832907e5e66a8541e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f188aa2bff34d879a2b06c069bdfbbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:32:41.415805 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-390a36d3-6c54-4fe4-aa53-b02368a0a76f tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 200 len: 1177 microversion: 2.1 time: 0.124642 Oct 04 12:32:41.416520 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5035/7444] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:32:41 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 1177 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:32:42.439119 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:42.439746 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] [instance: fc7cebb5-9176-4c15-8183-bed8a8d0e570] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:32:42.446679 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:42.447179 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:42.447628 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:42.448327 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:32:42.448797 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:32:42.449231 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:32:42.463136 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] HTTP exception thrown: Instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 could not be found. Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Request method failure captured: Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 HTTP/1.1 Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCW3Ue-nLtN3ZHTpztMi6-fKUeqy-Swp6CUkz5t9ghgWEheun3LI70LGMy5dynJxpHzwjm38Axp3Ya6wdUqkNS8Lb_IFE8WXyYF4cKSnSJSqDQRvRiOpJbA6AfI3dxEAmnaLb46UBlmf23csKFbHjfZSdOfEBEaACGsWvyabOvR-g-c Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 6f188aa2bff34d879a2b06c069bdfbbd Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestShelveInstance-1044768825 Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f188aa2bff34d879a2b06c069bdfbbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f188aa2bff34d879a2b06c069bdfbbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f188aa2bff34d879a2b06c069bdfbbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f188aa2bff34d879a2b06c069bdfbbd"}]}] Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestShelveInstance-1044768825 Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 6f188aa2bff34d879a2b06c069bdfbbd Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestShelveInstance-1044768825 Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestShelveInstance-1044768825-project Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: e826b34ca17a4832907e5e66a8541e4f Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestShelveInstance-1044768825-project Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 could not be found. Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': 'fc7cebb5-9176-4c15-8183-bed8a8d0e570'} Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 could not be found. Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 could not be found. Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:32:42.464829 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 could not be found. Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Returning 404 to user: Instance fc7cebb5-9176-4c15-8183-bed8a8d0e570 could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e1dc7cd8-eb48-45e5-9895-dbcc5a14b976 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570" status: 404 len: 111 microversion: 2.1 time: 0.031605 Oct 04 12:32:42.473796 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2410/7445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:32:42 2022] GET /compute/v2.1/servers/fc7cebb5-9176-4c15-8183-bed8a8d0e570 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:32:42.632786 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7a047e9e-0206-4946-8f38-cc6feb308a83 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] Calling method '.version_select at 0x7f71cefcc790>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:32:42.658094 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7a047e9e-0206-4946-8f38-cc6feb308a83 tempest-TestShelveInstance-1044768825 tempest-TestShelveInstance-1044768825-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-186252077" status: 202 len: 0 microversion: 2.1 time: 0.029100 Oct 04 12:32:42.659038 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5036/7446] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 4 12:32:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-186252077 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:32:59.842880 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=12 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:32:59.843637 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=24 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:00.022969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-559df2a2-bb10-4bc7-9ada-6579ee9fd93f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Action: 'create', calling method: .version_select at 0x7f71d8754b80>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1745679912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzi1OK/pZcJVvK+rEoVBVLCmCz1uEI3WYym14eq1i8uhyhtuh2hjJ+mlEZXHbSeo0rZKkKsBy1C/AJ9He2kCQOIdeueKHIPnc+PzvnByv4RKds/MDbrqF5Ss0NjWTX9hA=="}} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:33:00.039747 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-559df2a2-bb10-4bc7-9ada-6579ee9fd93f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Getting quotas for project 928a13e235c54d889a2d3800f58347ae. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:33:00.045228 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.quota [None req-559df2a2-bb10-4bc7-9ada-6579ee9fd93f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Getting quotas for user 54ced40921cc4bc69a75de49c796a184 and project 928a13e235c54d889a2d3800f58347ae. Resources: {'key_pairs'} {{(pid=122408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:33:00.075028 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-559df2a2-bb10-4bc7-9ada-6579ee9fd93f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.237360 Oct 04 12:33:00.075635 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2411/7447] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 4 12:32:59 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:33:01.071555 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:01.072848 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:01.081297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1053727318", "imageRef": "c5abc5b2-fab0-47a3-992d-153996b39244", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1745679912", "security_groups": [{"name": "tempest-secgroup-smoke-1303399166"}], "networks": [{"uuid": "600726c2-485a-4cdb-9d31-990ff79bfc54"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:33:01.207231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] validate_networks() for [('600726c2-485a-4cdb-9d31-990ff79bfc54', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:33:01.706979 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:33:01.707798 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:33:01.708277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:33:01.708716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:33:01.709178 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:33:01.719331 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:01.719824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:01.720264 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:01.720994 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:01.721489 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:01.721917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:01.739816 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Getting quotas for project 928a13e235c54d889a2d3800f58347ae. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:33:01.745237 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Getting quotas for user 54ced40921cc4bc69a75de49c796a184 and project 928a13e235c54d889a2d3800f58347ae. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:33:01.757813 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:33:01.760134 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5abc5b2-fab0-47a3-992d-153996b39244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:33:01.808872 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e3324a0a-2f38-43fb-8ad5-62b91d82f134 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.739300 Oct 04 12:33:01.815774 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5037/7448] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:33:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:33:01.821184 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-91009874-8e30-414a-a775-88fd59cea82a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:01.821947 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-91009874-8e30-414a-a775-88fd59cea82a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:01.896621 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-91009874-8e30-414a-a775-88fd59cea82a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:01.904569 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-91009874-8e30-414a-a775-88fd59cea82a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1249 microversion: 2.1 time: 0.087688 Oct 04 12:33:01.906071 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2412/7449] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:01 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:02.929628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:02.930867 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:02.937220 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:02.937748 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:02.938188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:02.938898 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:02.939357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:02.939789 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:03.027703 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:03.036122 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-681d0abc-ac84-4a72-9b0e-c29314d1f007 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1319 microversion: 2.1 time: 0.111739 Oct 04 12:33:03.036713 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5038/7450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:02 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1319 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:04.061419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:04.062064 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:04.069108 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:04.069651 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:04.070102 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:04.071053 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:04.071511 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:04.071950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:04.212856 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:04.221369 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5500b5dc-9fc2-4ba5-8810-0c38e3ae93ab tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1375 microversion: 2.1 time: 0.165214 Oct 04 12:33:04.221948 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2413/7451] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:04 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:04.331297 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e8a95589-fc38-498b-87c7-f06bb2b6048d req-0b14fb1e-1a95-45ab-aed4-115993f88a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625c85c0-11c5-486d-8306-72bc9e57f579", "tag": "a3c5008d-5ed7-4f41-be36-1f902e37eaf6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:33:04.351560 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8a95589-fc38-498b-87c7-f06bb2b6048d req-0b14fb1e-1a95-45ab-aed4-115993f88a6c service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:04.352055 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8a95589-fc38-498b-87c7-f06bb2b6048d req-0b14fb1e-1a95-45ab-aed4-115993f88a6c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:04.352496 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e8a95589-fc38-498b-87c7-f06bb2b6048d req-0b14fb1e-1a95-45ab-aed4-115993f88a6c service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:04.364486 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e8a95589-fc38-498b-87c7-f06bb2b6048d req-0b14fb1e-1a95-45ab-aed4-115993f88a6c service nova] Creating event network-changed:a3c5008d-5ed7-4f41-be36-1f902e37eaf6 for instance 625c85c0-11c5-486d-8306-72bc9e57f579 on n-h1-791135-8 Oct 04 12:33:04.369412 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e8a95589-fc38-498b-87c7-f06bb2b6048d req-0b14fb1e-1a95-45ab-aed4-115993f88a6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042739 Oct 04 12:33:04.370028 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5039/7452] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:33:05.244336 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:05.244965 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:05.252784 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:05.253309 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:05.253795 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:05.254515 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:05.254976 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:05.255408 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:05.398360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:05.406309 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-65299a94-6047-45b9-9b0d-ce9ad7a93c16 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1375 microversion: 2.1 time: 0.166013 Oct 04 12:33:05.406902 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2414/7453] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:05 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:06.430946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:06.431663 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:06.438527 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:06.439021 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:06.439463 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:06.440163 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:06.440628 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:06.441065 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:06.579211 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:06.587140 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d115daaa-e565-4cee-8627-566a48804cdd tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1375 microversion: 2.1 time: 0.161691 Oct 04 12:33:06.587732 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5040/7454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:06 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:07.610390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:07.610942 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:07.617668 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:07.618158 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:07.618597 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:07.619293 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:07.619757 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:07.620188 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:07.804043 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:07.811725 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-aedff998-cb10-498e-9895-1d6102444497 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1375 microversion: 2.1 time: 0.205367 Oct 04 12:33:07.812301 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2415/7455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:07 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1375 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:08.835375 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:08.835928 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:08.843309 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:08.843795 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:08.844236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:08.844932 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:08.845419 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:08.845853 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:08.973018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:08.980694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-18516cc5-11ed-42ad-bddc-1f2545b53901 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1375 microversion: 2.1 time: 0.149320 Oct 04 12:33:08.981274 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5041/7456] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:08 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1375 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:33:09.917280 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-0c5548ac-1d4a-46ca-89f9-5f6560d4b17b req-5ad34b65-6222-40e6-bf70-eaffe49329aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625c85c0-11c5-486d-8306-72bc9e57f579", "name": "network-vif-plugged", "status": "completed", "tag": "a3c5008d-5ed7-4f41-be36-1f902e37eaf6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:33:09.928730 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c5548ac-1d4a-46ca-89f9-5f6560d4b17b req-5ad34b65-6222-40e6-bf70-eaffe49329aa service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:09.929240 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c5548ac-1d4a-46ca-89f9-5f6560d4b17b req-5ad34b65-6222-40e6-bf70-eaffe49329aa service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:09.929716 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-0c5548ac-1d4a-46ca-89f9-5f6560d4b17b req-5ad34b65-6222-40e6-bf70-eaffe49329aa service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:09.942309 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-0c5548ac-1d4a-46ca-89f9-5f6560d4b17b req-5ad34b65-6222-40e6-bf70-eaffe49329aa service nova] Creating event network-vif-plugged:a3c5008d-5ed7-4f41-be36-1f902e37eaf6 for instance 625c85c0-11c5-486d-8306-72bc9e57f579 on n-h1-791135-8 Oct 04 12:33:09.947741 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-0c5548ac-1d4a-46ca-89f9-5f6560d4b17b req-5ad34b65-6222-40e6-bf70-eaffe49329aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034122 Oct 04 12:33:09.948439 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2416/7457] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:33:10.005732 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:10.006359 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:10.014140 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:10.014640 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:10.015254 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:10.015976 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:10.016437 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:10.016866 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:10.496667 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:10.504340 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-4ce34c09-5486-42de-b9de-ec4422e04df3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1375 microversion: 2.1 time: 0.503691 Oct 04 12:33:10.504913 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5042/7458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:09 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1375 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:11.528631 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:11.529390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:11.537753 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:11.538246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:11.538687 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:11.539385 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:11.539851 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:11.540288 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:11.673295 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:11.681010 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-445c5647-24e7-4eae-9808-0a15ea501f2d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1560 microversion: 2.1 time: 0.157042 Oct 04 12:33:11.681623 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2417/7459] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:11 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:11.704320 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:33:11.704939 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:33:11.711723 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:11.712216 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:11.712662 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:11.713403 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:11.713874 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:11.714310 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:11.728951 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:11.752098 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:11.845546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:33:11.853244 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-ac05f5ac-a530-49e8-95d2-4d59a46893d5 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1560 microversion: 2.1 time: 0.153501 Oct 04 12:33:11.853875 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5043/7460] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:33:11 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:33:13.464384 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-71bdfb6c-f9e0-4151-add4-64b098550dab req-80abdd03-9b09-473c-9a0a-f3e2e267b899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625c85c0-11c5-486d-8306-72bc9e57f579", "tag": "a3c5008d-5ed7-4f41-be36-1f902e37eaf6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:33:13.469555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=6 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:13.475862 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71bdfb6c-f9e0-4151-add4-64b098550dab req-80abdd03-9b09-473c-9a0a-f3e2e267b899 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:33:13.476357 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71bdfb6c-f9e0-4151-add4-64b098550dab req-80abdd03-9b09-473c-9a0a-f3e2e267b899 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:33:13.476800 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-71bdfb6c-f9e0-4151-add4-64b098550dab req-80abdd03-9b09-473c-9a0a-f3e2e267b899 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:33:13.488002 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-71bdfb6c-f9e0-4151-add4-64b098550dab req-80abdd03-9b09-473c-9a0a-f3e2e267b899 service nova] Creating event network-changed:a3c5008d-5ed7-4f41-be36-1f902e37eaf6 for instance 625c85c0-11c5-486d-8306-72bc9e57f579 on n-h1-791135-8 Oct 04 12:33:13.493131 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-71bdfb6c-f9e0-4151-add4-64b098550dab req-80abdd03-9b09-473c-9a0a-f3e2e267b899 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032546 Oct 04 12:33:13.493852 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2418/7461] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:35:05.218009 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b0aa98c-d914-4893-9124-de6a30c783e0] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:35:05.218955 n-d-791135-8 devstack@n-api.service[122409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8829bdcc-210e-40a3-b2af-6ede6e7ff32d] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 12:35:05.219671 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:05.220551 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=34 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:05.226695 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-3004228"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:35:05.229009 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:05.236514 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:05.237003 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:05.237470 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:05.238165 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:05.238621 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:05.239051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:05.563690 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fc754db6-6b77-4f96-997f-f732a92d87e6 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "POST /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579/action" status: 202 len: 0 microversion: 2.1 time: 0.347242 Oct 04 12:35:05.564366 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5044/7462] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:35:05 2022] POST /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 12:35:10.510740 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e9dfef3-0453-479e-ab86-c91297e9b462] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:35:10.512388 n-d-791135-8 devstack@n-api.service[122408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43145c0f-38f9-443d-929f-16a90ce4e841] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 12:35:10.513182 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:10.514041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=28 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:10.515534 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:35:10.515727 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:35:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 04 12:35:10.602107 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ff61dd85-686d-4853-bbce-323db315d25a req-16d1ffa7-fed1-4ebf-be52-496e686196d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625c85c0-11c5-486d-8306-72bc9e57f579", "name": "network-vif-plugged", "status": "completed", "tag": "a3c5008d-5ed7-4f41-be36-1f902e37eaf6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:35:10.615345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ff61dd85-686d-4853-bbce-323db315d25a req-16d1ffa7-fed1-4ebf-be52-496e686196d4 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:10.616143 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ff61dd85-686d-4853-bbce-323db315d25a req-16d1ffa7-fed1-4ebf-be52-496e686196d4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:10.616826 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ff61dd85-686d-4853-bbce-323db315d25a req-16d1ffa7-fed1-4ebf-be52-496e686196d4 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:10.628101 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ff61dd85-686d-4853-bbce-323db315d25a req-16d1ffa7-fed1-4ebf-be52-496e686196d4 service nova] Creating event network-vif-plugged:a3c5008d-5ed7-4f41-be36-1f902e37eaf6 for instance 625c85c0-11c5-486d-8306-72bc9e57f579 on n-h1-791135-8 Oct 04 12:35:10.633601 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ff61dd85-686d-4853-bbce-323db315d25a req-16d1ffa7-fed1-4ebf-be52-496e686196d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124903 Oct 04 12:35:10.634209 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2419/7463] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:35:19.130281 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:19.131130 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:19.137594 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1995712565", "imageRef": "3eb633d4-c8da-48e9-ac10-a8ee04d4b650", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1745679912", "security_groups": [{"name": "tempest-secgroup-smoke-1303399166"}], "networks": [{"uuid": "600726c2-485a-4cdb-9d31-990ff79bfc54"}]}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:35:19.162526 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] [8829bdcc-210e-40a3-b2af-6ede6e7ff32d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39392. Oct 04 12:35:19.163964 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b0aa98c-d914-4893-9124-de6a30c783e0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39390. Oct 04 12:35:19.251884 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.network.neutron [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] validate_networks() for [('600726c2-485a-4cdb-9d31-990ff79bfc54', None, None, None, None, None)] {{(pid=122409) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:35:19.618311 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Flavor limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:35:19.618763 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Image limits 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:35:19.619231 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Flavor pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:35:19.619650 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Image pref 0:0:0 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:35:19.620073 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.virt.hardware [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:35:19.628917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:19.629434 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:19.629885 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:19.630620 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:19.631086 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:19.631526 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:19.649392 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Getting quotas for project 928a13e235c54d889a2d3800f58347ae. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:35:19.654771 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.quota [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Getting quotas for user 54ced40921cc4bc69a75de49c796a184 and project 928a13e235c54d889a2d3800f58347ae. Resources: {'instances', 'ram', 'cores'} {{(pid=122409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:35:19.668721 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Going to run 1 instances... {{(pid=122409) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:35:19.671266 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3eb633d4-c8da-48e9-ac10-a8ee04d4b650',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:35:19.718506 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-8fd2efa1-a7f4-4ba3-8d25-5734f64c3d3b tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.590366 Oct 04 12:35:19.719171 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5045/7464] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 4 12:35:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:35:19.732467 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-cafbd2f8-d613-4748-9342-7e7ce1a2c78d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:19.733191 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-cafbd2f8-d613-4748-9342-7e7ce1a2c78d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:19.745812 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e9dfef3-0453-479e-ab86-c91297e9b462] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39404. Oct 04 12:35:19.746818 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] [43145c0f-38f9-443d-929f-16a90ce4e841] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39406. Oct 04 12:35:19.797786 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-cafbd2f8-d613-4748-9342-7e7ce1a2c78d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:19.805577 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-cafbd2f8-d613-4748-9342-7e7ce1a2c78d tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1249 microversion: 2.1 time: 0.078966 Oct 04 12:35:19.806159 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2420/7465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:19 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:20.829193 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:20.829824 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:20.837619 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:20.838033 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:20.838482 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:20.839190 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:20.840302 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:20.840744 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:20.904072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:20.912659 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-bac56669-d9a9-42cc-ac5e-f841c155cf81 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1309 microversion: 2.1 time: 0.088415 Oct 04 12:35:20.913251 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5046/7466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:20 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:21.936222 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:21.937850 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:21.943550 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:21.951324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:21.952098 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:21.952720 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:21.953696 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:21.954338 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:21.958449 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:22.179689 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:22.187777 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-2be30fb3-4017-40f0-81da-a2969a98989e tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.255777 Oct 04 12:35:22.188374 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2421/7467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:21 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:22.501031 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-e15b04ae-528c-4ebf-86e9-fb0b2f4aff81 req-48b39c41-4dd7-4400-b70d-b43849a05038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625c85c0-11c5-486d-8306-72bc9e57f579", "name": "network-vif-unplugged", "status": "completed", "tag": "a3c5008d-5ed7-4f41-be36-1f902e37eaf6"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:35:22.513959 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e15b04ae-528c-4ebf-86e9-fb0b2f4aff81 req-48b39c41-4dd7-4400-b70d-b43849a05038 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:22.514753 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e15b04ae-528c-4ebf-86e9-fb0b2f4aff81 req-48b39c41-4dd7-4400-b70d-b43849a05038 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:22.515378 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-e15b04ae-528c-4ebf-86e9-fb0b2f4aff81 req-48b39c41-4dd7-4400-b70d-b43849a05038 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:22.528711 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-e15b04ae-528c-4ebf-86e9-fb0b2f4aff81 req-48b39c41-4dd7-4400-b70d-b43849a05038 service nova] Creating event network-vif-unplugged:a3c5008d-5ed7-4f41-be36-1f902e37eaf6 for instance 625c85c0-11c5-486d-8306-72bc9e57f579 on n-h1-791135-8 Oct 04 12:35:22.534393 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-e15b04ae-528c-4ebf-86e9-fb0b2f4aff81 req-48b39c41-4dd7-4400-b70d-b43849a05038 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037296 Oct 04 12:35:22.536347 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5047/7468] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:35:23.212535 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:23.213163 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:23.220725 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:23.221226 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:23.221705 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:23.222490 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:23.223012 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:23.223969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:23.370559 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:23.379412 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4f5433b6-4894-4fb7-90ca-2367e61a8273 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.170591 Oct 04 12:35:23.380019 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2422/7469] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:23 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:24.403393 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:24.404106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:24.411946 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:24.412442 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:24.413051 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:24.414076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:24.414666 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:24.415001 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:24.563318 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:24.571893 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-69edefdc-2fd3-474e-9ca1-e996d9982d45 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.173225 Oct 04 12:35:24.572492 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5048/7470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:24 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:25.595246 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:25.596686 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:25.604780 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:25.605666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:25.606360 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:25.607312 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:25.607776 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:25.608216 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:25.750461 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:25.759143 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-c20dc991-6da8-4025-8041-69e0e3664dae tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.167871 Oct 04 12:35:25.760061 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2423/7471] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:25 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:26.783781 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:26.784440 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:26.792647 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:26.793138 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:26.793611 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:26.794326 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:26.794787 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:26.795391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:26.947346 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:26.955324 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-934f8df4-5658-4500-85a2-072988348e2f tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.175965 Oct 04 12:35:26.955922 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5049/7472] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:26 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:27.978041 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:27.979390 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:27.987343 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:27.987839 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:27.988285 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:27.989056 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:27.989759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:27.990196 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:28.136932 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:28.148873 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-80988ad5-34e8-4ec6-ab83-c4fdd2712f96 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.174964 Oct 04 12:35:28.159751 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2424/7473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:27 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:29.172878 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:29.173538 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:29.180673 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:29.181160 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:29.181631 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:29.182327 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:29.182780 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:29.183206 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:29.316754 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:29.324438 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-fecb981e-6249-41bf-a483-dd0be9d22b94 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.155533 Oct 04 12:35:29.325013 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5050/7474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:29 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:35:30.349642 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:30.350255 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:30.352930 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell0:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:30.358382 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:30.358903 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:30.359345 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:30.360084 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:30.360555 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:30.361000 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:30.492248 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:30.499984 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d66f6b5f-3178-4aad-9679-22278103bdf9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.154830 Oct 04 12:35:30.500562 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2425/7475] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:30 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:31.328506 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:31.329368 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell0:SELECT=6 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:31.399139 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-6342f228-e664-4271-9569-65c18b495890 req-e49daba7-dff5-405e-b868-146ebe6b5ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4836c8-c8f2-4549-950a-262f8f7573db", "tag": "2e7cc084-31cc-48f8-92c3-4adf8015b063"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:35:31.408456 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6342f228-e664-4271-9569-65c18b495890 req-e49daba7-dff5-405e-b868-146ebe6b5ab0 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:31.409018 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6342f228-e664-4271-9569-65c18b495890 req-e49daba7-dff5-405e-b868-146ebe6b5ab0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:31.409486 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-6342f228-e664-4271-9569-65c18b495890 req-e49daba7-dff5-405e-b868-146ebe6b5ab0 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:31.421599 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-6342f228-e664-4271-9569-65c18b495890 req-e49daba7-dff5-405e-b868-146ebe6b5ab0 service nova] Creating event network-changed:2e7cc084-31cc-48f8-92c3-4adf8015b063 for instance 8f4836c8-c8f2-4549-950a-262f8f7573db on n-h2-791135-8 Oct 04 12:35:31.427400 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-6342f228-e664-4271-9569-65c18b495890 req-e49daba7-dff5-405e-b868-146ebe6b5ab0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103569 Oct 04 12:35:31.428006 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5051/7476] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:35:31.523834 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:31.524458 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:31.531251 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:31.531740 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:31.532235 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:31.532886 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:31.533444 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:31.533962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:31.769177 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:31.778415 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e90ee4aa-672b-462d-89fa-262a219a16f9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.259851 Oct 04 12:35:31.779003 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2426/7477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:31 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:32.801637 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:32.802431 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:32.809572 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:32.810062 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:32.810504 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:32.811208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:32.811718 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:32.812103 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:32.947028 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:32.954751 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-01c5b1f7-570d-4238-b5cb-83c89288ed39 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.157924 Oct 04 12:35:32.955328 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5052/7478] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:32 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:33.978468 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:33.979088 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:33.986116 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:33.986960 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:33.987463 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:33.988324 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:33.989306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:33.989762 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:34.226548 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:34.234324 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-d818d81a-0f9f-4f39-ab8c-3d80b0ddce67 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.259788 Oct 04 12:35:34.234908 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2427/7479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:33 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:35.259283 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:35.260068 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:35.268584 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:35.269221 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:35.270186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:35.270877 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:35.271334 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:35.271764 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:35.405715 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:35.414694 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-7712d51f-0566-43f7-bc90-d9aca12aae43 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.160919 Oct 04 12:35:35.415282 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5053/7480] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:35 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:36.437861 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:36.438476 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:36.445859 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:36.446349 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:36.446816 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:36.447507 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:36.447968 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:36.448397 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:36.582681 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:36.590267 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-82adc5f5-dc99-48c4-ad72-c228544c1ae3 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.156354 Oct 04 12:35:36.590845 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2428/7481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:36 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:37.481380 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [req-b17230dd-e215-4caa-9c15-a1ef2108019e req-7ba9ae83-5c3c-4cfd-83e4-f1ee51526049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4836c8-c8f2-4549-950a-262f8f7573db", "name": "network-vif-plugged", "status": "completed", "tag": "2e7cc084-31cc-48f8-92c3-4adf8015b063"}]} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:35:37.493912 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b17230dd-e215-4caa-9c15-a1ef2108019e req-7ba9ae83-5c3c-4cfd-83e4-f1ee51526049 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:37.494397 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b17230dd-e215-4caa-9c15-a1ef2108019e req-7ba9ae83-5c3c-4cfd-83e4-f1ee51526049 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:37.495350 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [req-b17230dd-e215-4caa-9c15-a1ef2108019e req-7ba9ae83-5c3c-4cfd-83e4-f1ee51526049 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:37.507336 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.compute.server_external_events [req-b17230dd-e215-4caa-9c15-a1ef2108019e req-7ba9ae83-5c3c-4cfd-83e4-f1ee51526049 service nova] Creating event network-vif-plugged:2e7cc084-31cc-48f8-92c3-4adf8015b063 for instance 8f4836c8-c8f2-4549-950a-262f8f7573db on n-h2-791135-8 Oct 04 12:35:37.512854 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [req-b17230dd-e215-4caa-9c15-a1ef2108019e req-7ba9ae83-5c3c-4cfd-83e4-f1ee51526049 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035130 Oct 04 12:35:37.513477 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5054/7482] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:35:37.614203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:37.614749 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:37.621785 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:37.622290 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:37.622745 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:37.623465 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:37.623938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:37.624386 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:37.782269 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:37.790677 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-4b892420-07a5-4a9a-b77f-2f20462d5dc8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.181098 Oct 04 12:35:37.791263 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2429/7483] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:37 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:38.814699 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:38.815335 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:38.822926 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:38.823416 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:38.823857 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:38.824556 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:38.825019 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:38.825479 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:38.958352 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:38.965983 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-acc30750-67a3-4a2f-823c-84e8f1f2e022 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1375 microversion: 2.1 time: 0.155655 Oct 04 12:35:38.966562 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5055/7484] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:38 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:39.989950 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:39.990584 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:39.997459 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:39.997962 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:39.998416 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:39.999127 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:39.999627 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:40.000074 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:40.132185 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:40.139808 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-e5834025-aeb6-4e2f-b98a-3df0ea4ee1d9 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1560 microversion: 2.1 time: 0.154454 Oct 04 12:35:40.140389 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2430/7485] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:39 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:40.163412 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:35:40.164294 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:35:40.171142 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:40.171633 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:40.172076 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:40.172775 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:40.173236 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:40.173694 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:40.311831 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:35:40.319731 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-6b4dbbbe-8ecf-47f5-9a4c-c7b93bdd875a tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1560 microversion: 2.1 time: 0.160962 Oct 04 12:35:40.320304 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5056/7486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:35:40 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:42.309441 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-ce85a2f4-5c72-451c-a344-63c775acf8b5 req-d411f1cb-00eb-4287-87b0-be5939b569d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4836c8-c8f2-4549-950a-262f8f7573db", "tag": "2e7cc084-31cc-48f8-92c3-4adf8015b063"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:35:42.314358 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=27 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:42.320256 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce85a2f4-5c72-451c-a344-63c775acf8b5 req-d411f1cb-00eb-4287-87b0-be5939b569d5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:35:42.320742 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce85a2f4-5c72-451c-a344-63c775acf8b5 req-d411f1cb-00eb-4287-87b0-be5939b569d5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:35:42.321176 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-ce85a2f4-5c72-451c-a344-63c775acf8b5 req-d411f1cb-00eb-4287-87b0-be5939b569d5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:35:42.332450 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-ce85a2f4-5c72-451c-a344-63c775acf8b5 req-d411f1cb-00eb-4287-87b0-be5939b569d5 service nova] Creating event network-changed:2e7cc084-31cc-48f8-92c3-4adf8015b063 for instance 8f4836c8-c8f2-4549-950a-262f8f7573db on n-h2-791135-8 Oct 04 12:35:42.338104 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-ce85a2f4-5c72-451c-a344-63c775acf8b5 req-d411f1cb-00eb-4287-87b0-be5939b569d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087904 Oct 04 12:35:42.338697 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2431/7487] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:37:41.116162 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:41.117396 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=56 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:41.118776 n-d-791135-8 devstack@n-api.service[122409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:37:41.118949 n-d-791135-8 devstack@n-api.service[122409]: Tue Oct 4 12:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db/action (ip 10.222.0.23) !!! Oct 04 12:37:41.125693 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-988658323"}} {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:37:41.127969 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:37:41.136778 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:37:41.137262 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:37:41.137726 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:37:41.138420 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:37:41.138876 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:37:41.139308 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:37:41.353920 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-a9a1dd68-896f-4e5f-b031-4610be42dcaa tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "POST /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db/action" status: 202 len: 0 microversion: 2.1 time: 0.239637 Oct 04 12:37:41.354588 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5057/7488] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 4 12:37:41 2022] POST /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 12:37:48.250998 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=1 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:48.251759 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=62 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:48.253408 n-d-791135-8 devstack@n-api.service[122408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:37:48.253735 n-d-791135-8 devstack@n-api.service[122408]: Tue Oct 4 12:37:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 04 12:37:48.261372 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-39a20259-e493-4d8b-93f0-57de4d7c6c9c req-01ac8eca-fc42-4877-852b-e36cf3d46b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4836c8-c8f2-4549-950a-262f8f7573db", "name": "network-vif-plugged", "status": "completed", "tag": "2e7cc084-31cc-48f8-92c3-4adf8015b063"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:37:48.284203 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-39a20259-e493-4d8b-93f0-57de4d7c6c9c req-01ac8eca-fc42-4877-852b-e36cf3d46b24 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:37:48.284692 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-39a20259-e493-4d8b-93f0-57de4d7c6c9c req-01ac8eca-fc42-4877-852b-e36cf3d46b24 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:37:48.285135 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-39a20259-e493-4d8b-93f0-57de4d7c6c9c req-01ac8eca-fc42-4877-852b-e36cf3d46b24 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:37:48.296349 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-39a20259-e493-4d8b-93f0-57de4d7c6c9c req-01ac8eca-fc42-4877-852b-e36cf3d46b24 service nova] Creating event network-vif-plugged:2e7cc084-31cc-48f8-92c3-4adf8015b063 for instance 8f4836c8-c8f2-4549-950a-262f8f7573db on n-h2-791135-8 Oct 04 12:37:48.301735 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-39a20259-e493-4d8b-93f0-57de4d7c6c9c req-01ac8eca-fc42-4877-852b-e36cf3d46b24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053057 Oct 04 12:37:48.302758 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2432/7489] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:38:00.083450 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_api:SELECT=2 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:00.084223 n-d-791135-8 devstack@n-api.service[122409]: DEBUG dbcounter [-] [122409] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:00.088969 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-b6c40689-1966-4973-9573-d262cf9d644c req-4cb6ced9-9f02-4860-ada6-1eabe34516f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f4836c8-c8f2-4549-950a-262f8f7573db", "tag": "2e7cc084-31cc-48f8-92c3-4adf8015b063"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:38:00.094863 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_api:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:00.095760 n-d-791135-8 devstack@n-api.service[122408]: DEBUG dbcounter [-] [122408] Writing DB stats nova_cell1:SELECT=2 {{(pid=122408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:00.102200 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b6c40689-1966-4973-9573-d262cf9d644c req-4cb6ced9-9f02-4860-ada6-1eabe34516f9 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:00.103212 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b6c40689-1966-4973-9573-d262cf9d644c req-4cb6ced9-9f02-4860-ada6-1eabe34516f9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:00.104110 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-b6c40689-1966-4973-9573-d262cf9d644c req-4cb6ced9-9f02-4860-ada6-1eabe34516f9 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:00.117828 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-b6c40689-1966-4973-9573-d262cf9d644c req-4cb6ced9-9f02-4860-ada6-1eabe34516f9 service nova] Creating event network-changed:2e7cc084-31cc-48f8-92c3-4adf8015b063 for instance 8f4836c8-c8f2-4549-950a-262f8f7573db on n-h2-791135-8 Oct 04 12:38:00.127584 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-b6c40689-1966-4973-9573-d262cf9d644c req-4cb6ced9-9f02-4860-ada6-1eabe34516f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044569 Oct 04 12:38:00.128589 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2433/7490] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:38:00.149101 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:00.149759 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:00.158155 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:00.159057 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:00.159544 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:00.160332 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:00.160792 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:00.161227 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:00.191304 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:38:00.282931 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-102bb289-7b0c-46f9-b44f-b22f19a612f1 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 204 len: 0 microversion: 2.1 time: 0.203967 Oct 04 12:38:00.284346 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5058/7491] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:38:00 2022] DELETE /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:38:00.295911 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:00.296622 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:00.304139 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:00.304956 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:00.305427 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:00.306310 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:00.306983 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:00.307666 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:00.448161 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:38:00.456311 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-0a9a342d-1dfa-4736-bcbf-a0e099ddc4c8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1683 microversion: 2.1 time: 0.164947 Oct 04 12:38:00.456876 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2434/7492] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:38:00 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:38:01.481106 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:01.481850 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:01.489188 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:01.489716 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:01.490159 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:01.491355 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:01.491815 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:01.492252 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:01.634520 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:38:01.642512 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-478ba935-82c4-4a46-a2d8-b918b7b34816 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1683 microversion: 2.1 time: 0.165758 Oct 04 12:38:01.643094 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5059/7493] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:38:01 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:38:02.498897 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-f48ddf15-3200-49c6-a227-0b3a41d36b61 req-40667ab4-9155-457b-b4db-8e2049cd1cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f4836c8-c8f2-4549-950a-262f8f7573db", "name": "network-vif-deleted", "tag": "2e7cc084-31cc-48f8-92c3-4adf8015b063"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:38:02.513118 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f48ddf15-3200-49c6-a227-0b3a41d36b61 req-40667ab4-9155-457b-b4db-8e2049cd1cad service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:02.513832 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f48ddf15-3200-49c6-a227-0b3a41d36b61 req-40667ab4-9155-457b-b4db-8e2049cd1cad service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:02.514284 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-f48ddf15-3200-49c6-a227-0b3a41d36b61 req-40667ab4-9155-457b-b4db-8e2049cd1cad service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:02.526810 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-f48ddf15-3200-49c6-a227-0b3a41d36b61 req-40667ab4-9155-457b-b4db-8e2049cd1cad service nova] Creating event network-vif-deleted:2e7cc084-31cc-48f8-92c3-4adf8015b063 for instance 8f4836c8-c8f2-4549-950a-262f8f7573db on n-h2-791135-8 Oct 04 12:38:02.532973 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-f48ddf15-3200-49c6-a227-0b3a41d36b61 req-40667ab4-9155-457b-b4db-8e2049cd1cad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038132 Oct 04 12:38:02.533613 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2435/7494] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:38:02.665660 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:02.666347 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:02.673242 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:02.673768 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:02.674208 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:02.674943 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:02.675608 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:02.676045 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:02.709810 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:02.710357 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:02.710747 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:02.711196 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.objects.instance [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lazy-loading 'fault' on Instance uuid 8f4836c8-c8f2-4549-950a-262f8f7573db {{(pid=122409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:38:02.756828 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:38:02.765181 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-e6b38e3a-84ca-4c6c-82db-9cbddc474025 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 200 len: 1339 microversion: 2.1 time: 0.103747 Oct 04 12:38:02.765818 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5060/7495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:38:02 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:38:03.789306 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:03.790075 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 8f4836c8-c8f2-4549-950a-262f8f7573db] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:03.797279 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:03.797805 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:03.798244 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:03.798938 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:03.799404 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:03.799833 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:03.812776 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.wsgi [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] HTTP exception thrown: Instance 8f4836c8-c8f2-4549-950a-262f8f7573db could not be found. Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Request method failure captured: Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: request: GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db HTTP/1.1 Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: Accept: application/json Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: Accept-Encoding: identity Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: Connection: close Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: Content-Length: 0 Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: Content-Type: application/json Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: Host: 10.222.0.23 Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: Openstack-System-Scope: None Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: User-Agent: python-urllib3/1.26.12 Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Auth-Token: gAAAAABjPCf2HuRP6WrW3F6SGXf8kQHZPszXfgxZFc4W35eCCWhVqX13n_SRgXkxWC_9AzZ_AoUgtmROBxV1V7GdXlqJ7pf-wISZnEB3u_gglQ8FAVoEjueI-oyseZ2_FZ51YZJk0rlvb4BdW9zXZlxQsxno25ZJKizwcSz2GNn6vuEV6rtjqRo Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Id: None Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Domain-Name: None Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Identity-Status: Confirmed Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Is-Admin-Project: True Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Id: default Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Domain-Name: Default Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Id: 928a13e235c54d889a2d3800f58347ae Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Project-Name: tempest-TestSnapshotPattern-1816214213 Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Role: reader,member Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Roles: reader,member Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_928a13e235c54d889a2d3800f58347ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/928a13e235c54d889a2d3800f58347ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/928a13e235c54d889a2d3800f58347ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/928a13e235c54d889a2d3800f58347ae"}]}] Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant: tempest-TestSnapshotPattern-1816214213 Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Id: 928a13e235c54d889a2d3800f58347ae Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-Tenant-Name: tempest-TestSnapshotPattern-1816214213 Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-User: tempest-TestSnapshotPattern-1816214213-project Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Id: default Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-User-Domain-Name: Default Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-User-Id: 54ced40921cc4bc69a75de49c796a184 Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: X-User-Name: tempest-TestSnapshotPattern-1816214213-project Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: method: > Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: exception: Instance 8f4836c8-c8f2-4549-950a-262f8f7573db could not be found. Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: action_args: {'id': '8f4836c8-c8f2-4549-950a-262f8f7573db'} Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f4836c8-c8f2-4549-950a-262f8f7573db could not be found. Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f4836c8-c8f2-4549-950a-262f8f7573db could not be found. Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:38:03.814346 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f4836c8-c8f2-4549-950a-262f8f7573db could not be found. Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: ERROR nova.api.openstack.wsgi Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Returning 404 to user: Instance 8f4836c8-c8f2-4549-950a-262f8f7573db could not be found. {{(pid=122408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-bdc96fd9-d3fa-45ad-9945-937feffb90a8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db" status: 404 len: 111 microversion: 2.1 time: 0.031299 Oct 04 12:38:03.820634 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2436/7496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:38:03 2022] GET /compute/v2.1/servers/8f4836c8-c8f2-4549-950a-262f8f7573db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:38:05.432957 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:05.433605 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:05.438419 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-fb776cfd-b00b-471b-a25c-b8c93f9f21f4 req-6df02c6d-b77c-4440-bd61-3d3a5effee4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625c85c0-11c5-486d-8306-72bc9e57f579", "tag": "a3c5008d-5ed7-4f41-be36-1f902e37eaf6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:38:05.440917 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:05.441549 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:05.442074 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:05.442854 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:05.443391 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:05.444072 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:05.452731 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb776cfd-b00b-471b-a25c-b8c93f9f21f4 req-6df02c6d-b77c-4440-bd61-3d3a5effee4a service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:05.453229 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb776cfd-b00b-471b-a25c-b8c93f9f21f4 req-6df02c6d-b77c-4440-bd61-3d3a5effee4a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:05.453703 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-fb776cfd-b00b-471b-a25c-b8c93f9f21f4 req-6df02c6d-b77c-4440-bd61-3d3a5effee4a service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:05.464191 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-fb776cfd-b00b-471b-a25c-b8c93f9f21f4 req-6df02c6d-b77c-4440-bd61-3d3a5effee4a service nova] Creating event network-changed:a3c5008d-5ed7-4f41-be36-1f902e37eaf6 for instance 625c85c0-11c5-486d-8306-72bc9e57f579 on n-h1-791135-8 Oct 04 12:38:05.469404 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-fb776cfd-b00b-471b-a25c-b8c93f9f21f4 req-6df02c6d-b77c-4440-bd61-3d3a5effee4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034543 Oct 04 12:38:05.470024 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2437/7497] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:38:05.472772 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Going to try to terminate instance {{(pid=122409) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:38:05.567027 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-f0c87586-1e77-4e8f-b8f9-7cb4c83a9148 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "DELETE /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 204 len: 0 microversion: 2.1 time: 0.138254 Oct 04 12:38:05.568317 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5061/7498] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 4 12:38:05 2022] DELETE /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:38:05.577855 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:05.578581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.compute.api [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122408) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:05.584822 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:05.585944 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:05.586398 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:05.587109 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:05.587581 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:05.588011 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:05.725455 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.policy [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122408) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:38:05.733377 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-5bc0848f-6805-4e0a-ac75-3a86e86c52c0 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1684 microversion: 2.1 time: 0.159818 Oct 04 12:38:05.733960 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2438/7499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:38:05 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:38:06.758659 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:06.759407 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:06.766341 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:06.766836 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:06.767277 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:06.767987 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:06.768458 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:06.768893 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:06.906315 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.policy [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54ced40921cc4bc69a75de49c796a184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928a13e235c54d889a2d3800f58347ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122409) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:38:06.914925 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-c567a881-4437-4a9c-b797-a83eb147e936 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 200 len: 1566 microversion: 2.1 time: 0.161296 Oct 04 12:38:06.915777 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5062/7500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:38:06 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:38:07.064304 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [req-e0a5eb4a-0b1d-472d-a99d-c320929c2d9c req-afcee686-508a-433a-af5b-171781136bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625c85c0-11c5-486d-8306-72bc9e57f579", "name": "network-vif-deleted", "tag": "a3c5008d-5ed7-4f41-be36-1f902e37eaf6"}]} {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:38:07.076928 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e0a5eb4a-0b1d-472d-a99d-c320929c2d9c req-afcee686-508a-433a-af5b-171781136bf5 service nova] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:07.077543 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e0a5eb4a-0b1d-472d-a99d-c320929c2d9c req-afcee686-508a-433a-af5b-171781136bf5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:07.078060 n-d-791135-8 devstack@n-api.service[122408]: DEBUG oslo_concurrency.lockutils [req-e0a5eb4a-0b1d-472d-a99d-c320929c2d9c req-afcee686-508a-433a-af5b-171781136bf5 service nova] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:07.090296 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.compute.server_external_events [req-e0a5eb4a-0b1d-472d-a99d-c320929c2d9c req-afcee686-508a-433a-af5b-171781136bf5 service nova] Creating event network-vif-deleted:a3c5008d-5ed7-4f41-be36-1f902e37eaf6 for instance 625c85c0-11c5-486d-8306-72bc9e57f579 on n-h1-791135-8 Oct 04 12:38:07.095230 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [req-e0a5eb4a-0b1d-472d-a99d-c320929c2d9c req-afcee686-508a-433a-af5b-171781136bf5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034863 Oct 04 12:38:07.095826 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2439/7501] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 4 12:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:38:07.938546 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '>' {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:07.939186 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.compute.api [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] [instance: 625c85c0-11c5-486d-8306-72bc9e57f579] Fetching instance by UUID {{(pid=122409) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:38:07.946501 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:07.946984 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:07.947417 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:07.948102 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Acquiring lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:38:07.948563 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:38:07.948989 n-d-791135-8 devstack@n-api.service[122409]: DEBUG oslo_concurrency.lockutils [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Lock "6cc6fbec-876d-44b6-94f9-b28a0a237215" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:38:07.962317 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.wsgi [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] HTTP exception thrown: Instance 625c85c0-11c5-486d-8306-72bc9e57f579 could not be found. Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Request method failure captured: Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: request: GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 HTTP/1.1 Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: Accept: application/json Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: Accept-Encoding: identity Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: Connection: close Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: Content-Length: 0 Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: Content-Type: application/json Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: Host: 10.222.0.23 Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: Openstack-System-Scope: None Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: User-Agent: python-urllib3/1.26.12 Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Auth-Token: gAAAAABjPCf2HuRP6WrW3F6SGXf8kQHZPszXfgxZFc4W35eCCWhVqX13n_SRgXkxWC_9AzZ_AoUgtmROBxV1V7GdXlqJ7pf-wISZnEB3u_gglQ8FAVoEjueI-oyseZ2_FZ51YZJk0rlvb4BdW9zXZlxQsxno25ZJKizwcSz2GNn6vuEV6rtjqRo Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Id: None Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Domain-Name: None Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Identity-Status: Confirmed Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Is-Admin-Project: True Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Id: default Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Domain-Name: Default Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Id: 928a13e235c54d889a2d3800f58347ae Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Project-Name: tempest-TestSnapshotPattern-1816214213 Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Role: reader,member Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Roles: reader,member Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_928a13e235c54d889a2d3800f58347ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/928a13e235c54d889a2d3800f58347ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/928a13e235c54d889a2d3800f58347ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/928a13e235c54d889a2d3800f58347ae"}]}] Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant: tempest-TestSnapshotPattern-1816214213 Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Id: 928a13e235c54d889a2d3800f58347ae Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-Tenant-Name: tempest-TestSnapshotPattern-1816214213 Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-User: tempest-TestSnapshotPattern-1816214213-project Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Id: default Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Domain-Name: Default Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Id: 54ced40921cc4bc69a75de49c796a184 Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: X-User-Name: tempest-TestSnapshotPattern-1816214213-project Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: method: > Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: exception: Instance 625c85c0-11c5-486d-8306-72bc9e57f579 could not be found. Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: action_args: {'id': '625c85c0-11c5-486d-8306-72bc9e57f579'} Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: {{(pid=122409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625c85c0-11c5-486d-8306-72bc9e57f579 could not be found. Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625c85c0-11c5-486d-8306-72bc9e57f579 could not be found. Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:38:07.963945 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625c85c0-11c5-486d-8306-72bc9e57f579 could not be found. Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: ERROR nova.api.openstack.wsgi Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: DEBUG nova.api.openstack.wsgi [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Returning 404 to user: Instance 625c85c0-11c5-486d-8306-72bc9e57f579 could not be found. {{(pid=122409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: INFO nova.api.openstack.requestlog [None req-d9f2e777-f5da-4887-b595-251e4bb973d8 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579" status: 404 len: 111 microversion: 2.1 time: 0.030778 Oct 04 12:38:07.969548 n-d-791135-8 devstack@n-api.service[122409]: [pid: 122409|app: 0|req: 5063/7502] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 4 12:38:07 2022] GET /compute/v2.1/servers/625c85c0-11c5-486d-8306-72bc9e57f579 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:38:08.127076 n-d-791135-8 devstack@n-api.service[122408]: DEBUG nova.api.openstack.wsgi [None req-50c0f6e7-b144-46be-b251-955064a68e24 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] Calling method '.version_select at 0x7f71d44e2310>' {{(pid=122408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:38:08.153368 n-d-791135-8 devstack@n-api.service[122408]: INFO nova.api.openstack.requestlog [None req-50c0f6e7-b144-46be-b251-955064a68e24 tempest-TestSnapshotPattern-1816214213 tempest-TestSnapshotPattern-1816214213-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1745679912" status: 202 len: 0 microversion: 2.1 time: 0.031307 Oct 04 12:38:08.154036 n-d-791135-8 devstack@n-api.service[122408]: [pid: 122408|app: 0|req: 2440/7503] 10.222.0.23 () {58 vars in 1257 bytes} [Tue Oct 4 12:38:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1745679912 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)